VirtualTam's bookmarks

1. PostgreSQL at Scale: Database Schema Changes Without Downtime

   2025-06-12
   database/migration database/postgresql database/schema

   Permalink
   • Safe Operations For High Volume PostgreSQL (Archived 2020-04-14)
2. Archiving URLs | Gwern

   2025-04-09
   network/http personal-knowledge/bookmark personal-knowledge/digital-garden programming/go programming/html programming/java programming/python web web/scraping

   Permalink
   • Archiving Web Sites (LWN)
   • Robots.txt meant for search engines don’t work well for web archives

   Web page archive formats:

   • ARC (1996)
   • WARC (BnF, 2009)
     • WARC Specifications
     • The WARC Ecosystem

   Tools for crawling, scraping and archiving Web pages:

   • internetarchive/heritrix3 - Extensible, web-scale, archival-quality web crawler project (Java)
   • internetarchive/Zeno - State-of-the-art web crawler (Go)
     • internetarchive/gowarc - Read and write WARC files in Go
   • webrecorder/pywb - Web Archiving Toolkit for replay and recording of web archives (Python)

   Self-hosted solutions:

   • ArchiveBox - A self-hosted app that lets you preserve content from websites in a variety of formats
   • Wallabag - Save and classify articles, read them later
3. AFL++ - American Fuzzy Lop Fuzzing Framework

   2025-02-15
   compiler/llvm genetic-algorithm programming/c++ programming/fuzzing programming/rust research security virtualization/qemu

   Permalink
   • AFLplusplus/AFLplusplus
   • AFLplusplus/LibAFL - A collection of reusable pieces of fuzzers
   • rc0r/afl-utils - Utilities for automated crash sample processing/analysis, job management and corpus optimization
   • 0xricksanchez/AFL_Runner - Scaling best-practice AFLPlusPlus fuzzing campaigns made easy
   • AFL++ Papers
   • Sister Projects
   • The LibAFL Book
   • Fuzzing projects with american fuzzy lop (AFL)
   • afl - american fuzzy lop
4. The Ultimate Guide to Django Performance: Best Practices for Scaling and Optimization - LoadForge Guides

   2024-11-18
   database framework/django network/http performance programming/python storage/cache

   Permalink
   • Django - Performance and optimization
   • Django - Database access optimization
   • Better living through optimized Django
5. SSHFP - Secure SHell FingerPrint DNS Records

   2024-10-27
   cryptography/elliptic-curve network/dns network/dnssec network/ssh

   Permalink
   • IANA - DNS SSHFP Resource Record Parameters
   • ssh - How do I generate SSHFP records?
   • Oh SSH-it, What’s My Fingerprint? A Large-Scale Analysis of SSH Host Key Fingerprint Verification Records in the DNS
     • gehaxelt/sshfp-dns-measurement
     • APNIC - Improving SSH’s security with SSHFP DNS records

   RFCs:

   • RFC 4251 - The Secure Shell (SSH) Protocol Architecture
   • RFC 4255 - Using DNS to Securely Publish Secure Shell (SSH) Key Fingerprints
6. Comprehensive Rust 🦀 - a free Rust course developed by the Android team at Google

   2024-03-28
   embedded google mobile/android programming/rust

   Permalink
   • Rust in Android
   • Rust in Chromium
   • Bare Metal Rust
   • Concurrency in Rust
   • google/comprehensive-rust
   • Scaling Rust Adoption Through Training
7. hashicorp/copywrite - Automate copyright headers and license files at scale

   2024-01-14
   license open-source programming/go source-code-management/git

   Permalink
8. Image Stacks and iPhone Racks - Building an Internet Scale Meme Search Engine | FindThatMeme.com Blog

   2023-02-14
   apple image image/optical-character-recognition meme phone

   Permalink
9. Scaling productivity on microservices at Lyft

   2022-03-23
   continuous-integration envoy microservice network/http programming team

   Permalink
   • Part 1 - History of development and test environments
   • Part 2 - Optimizing for fast local development
   • Part 3 - Extending our Envoy mesh with staging overrides
   • Part 4 - Gating Deploys with Automated Acceptance Tests
10. Lessons Learned From 5 Years of Scaling PostgreSQL

    2022-02-16
    database/postgresql performance programming/sql

    Permalink
11. Thanos - Highly available Prometheus setup with long term storage capabilities

    2019-09-11
    database distributed-system/cluster observability observability/time-series observability/time-series/prometheus

    Permalink
    • https://improbable.io/blog/thanos-prometheus-at-scale
    • https://github.com/thanos-io/thanos
    • https://docs.google.com/presentation/d/1uwoxPdTjSjvGaN1LJewZg1NXjeHfRtfvqh6LygLcayQ/edit#slide=id.g5f09eeda59_0_9
    • https://www.youtube.com/watch?v=NuWTNrGyWLQ
    • https://katacoda.com/bwplotka/courses/thanos
12. Amazon Web Services | Auto-scale bind to an elastic IP?

    2019-09-09
    cloud-computing cloud-computing/aws network network/firewall network/ip

    Permalink

    Use case:

    • Set up an AutoScaling Group with exactly 1 min/max/desired instance
    • Attach an Elastic IP to the active instance

    Usually for interoperability reasons and/or IP-based network rules (80's firewall anyone?).

    • https://stackoverflow.com/questions/34849360/how-to-assign-eip-to-autoscaling-group-of-vpc-in-cloudformation-template
    • https://www.reddit.com/r/aws/comments/6k3gb2/auto_assign_eip/
13. When AWS Autoscale Doesn’t · Segment Blog

    2019-02-19
    cloud-computing cloud-computing/aws configuration-management/terraform scaling

    Permalink
14. Dapper, a Large-Scale Distributed Systems Tracing Infrastructure

    2018-12-12
    application distributed distributed-system/cluster google observability/logging observability/tracing performance

    Permalink
15. Vitess | A database clustering system for horizontal scaling of MySQL

    2018-12-12
    database database/mysql distributed-system/cluster google programming/sql shard

    Permalink
    • https://github.com/vitessio/vitess
    • https://www.reddit.com/r/programming/comments/qakq4/google_releases_vitess_used_in_the_core_of/
16. GNU LilyPond Notation Reference: Common notation for fretted strings

    2018-11-18
    instrument/bass instrument/guitar lilypond music notation

    Permalink
    • Melody with chords. Chord diagrams described on top of the score.
    • Fret diagrams explained and developed
    • https://music.stackexchange.com/questions/47957/lilypond-is-there-a-way-to-create-a-song-with-just-lyrics-and-chords-without-t
    • http://danlovesguitars.com/2011/12/fret-diagrams-for-chords-scales-or-licks/#lilypond
    • https://github.com/lilypond/lilypond/blob/master/ly/string-tunings-init.ly
17. Scaling Docker with Kubernetes

    2018-09-13
    continuous-integration/jenkins linux/container linux/container/docker linux/container/kubernetes pipeline

    Permalink
    • https://github.com/jenkinsci/kubernetes-plugin
    • https://github.com/jenkinsci/kubernetes-plugin/tree/master/examples
    • https://issues.jenkins-ci.org/browse/JENKINS-48421
    • https://www.blazemeter.com/blog/how-to-setup-scalable-jenkins-on-top-of-a-kubernetes-cluster
    • https://stackoverflow.com/questions/49988038/declarative-jenkins-pipeline-use-existing-kubernetes-pod-template
18. Stichting Huygens-Fokker | Centre for microtonal music

    2018-09-12
    microtonal music scale software tuning

    Permalink
    • http://huygens-fokker.org/scala/index.html
    • http://huygens-fokker.org/scala/downloads.html#scales
19. GopherCon 2018 - From Prototype to Production: Lessons from Building and Scaling Reddit's Ad Serving Platform with Go

    2018-09-11
    network network/http performance programming/go service

    Permalink
20. Harmonic Expansionism | ROBBY KILGORE

    2018-09-09
    chord harmony instrument/midi instrument/synthesizer multimedia/pure-data music music/jazz scale voicing

    Permalink
    • https://forum.pdpatchrepo.info/topic/10554/noob-trying-to-create-a-midi-chorder-harmonizer
    • https://robbykilgore.com/?p=30
    • https://robbykilgore.com/midi-rotator-v1/
    • https://www.youtube.com/watch?v=4pdU26raLuM
    • https://www.youtube.com/watch?v=4kBpxBJkknY
    • https://www.youtube.com/watch?v=cJ72ys3tkm8
    • https://www.youtube.com/watch?v=mw2bNMpY4w4