VirtualTam's bookmarks

1. PostgreSQL at Scale: Database Schema Changes Without Downtime

   2025-06-12
   database/migration database/postgresql database/schema

   Permalink
   • Safe Operations For High Volume PostgreSQL (Archived 2020-04-14)
2. Flash of unstyled content (Wikipedia)

   2025-06-08
   programming/css programming/html

   Permalink
   • Render Blocking CSS
3. The new reading stack

   2025-05-10
   book indie library network/activitypub personal-knowledge programming/html self-hosting web/syndication

   Permalink
   • Owning my reading log
   • Indie Bookshelves
   • BookWyrm - Social Reading and Reviewing
   • Indieweb - Personal Library
     • 2022/Pop-ups/Personal Libraries
   • Microformats
     • h-cite - format for publishing citations and references to online and other publications
     • h-entry - format for content intended to be syndicated on the web
     • h-review - format for publishing reviews on the web

   Book metadata sources:

   • Bookbrainz
   • Open Library by the Internet Archive
4. Admixfrog - A HMM to infer ancestry frogments (fragments) from low-coverage, contaminated data.

   2025-05-10
   ethnology genetics probability programming/c programming/c++ programming/python programming/r science statistics

   Permalink
   • DReichLab/AdmixTools - Tools test whether admixture occurred and more
   • admixr (CRAN)
   • fgvieira/ngsDist - Estimation of pairwise distances under a probabilistic framework
   • ANGSD/NgsRelate - Infer relatedness and other summary statistics for pairs of individuals from low coverage Next Generation Sequencing (NGS)
   • Science Direct - Population dynamics and genetic connectivity in recent chimpanzee history
5. Re-Implementing the Google Reader API in 2025

   2025-05-09
   feed/rss google/reader network/http programming/elixir

   Permalink
   • greader_api_controller.ex@42ec26f
   • FreshRSS - Google Reader compatible API implementation
   • mihaip/google-reader-api - Unofficial documentation for the unofficial Google Reader API
6. robots.txt - AI / LLM User-Agents: Blocking Guide

   2025-04-29
   network/http robots.txt web/crawling web/scraping

   Permalink
   • A summary of my bot defence systems
     • Butlerian Jihad - Blog posts on the topic of fighting off spam bots, search engine spiders and other non-humans wasting the precious resources we have on Earth
   • EmacsWiki's robots.txt
7. A different approach to blocking bad webbots by IP address

   2025-04-28
   feed network/autonomous-system network/http network/ip web/crawling web/scraping

   Permalink
   • Now a bit about feed readers
   • A deeper dive into mapping web requests via ASN, not by IP address
   • Notes on blocking spam by filtering on ASN
8. Archiving URLs | Gwern

   2025-04-09
   network/http personal-knowledge/bookmark personal-knowledge/digital-garden programming/go programming/html programming/java programming/python web web/scraping

   Permalink
   • Archiving Web Sites (LWN)
   • Robots.txt meant for search engines don’t work well for web archives

   Web page archive formats:

   • ARC (1996)
   • WARC (BnF, 2009)
     • WARC Specifications
     • The WARC Ecosystem

   Tools for crawling, scraping and archiving Web pages:

   • internetarchive/heritrix3 - Extensible, web-scale, archival-quality web crawler project (Java)
   • internetarchive/Zeno - State-of-the-art web crawler (Go)
     • internetarchive/gowarc - Read and write WARC files in Go
   • webrecorder/pywb - Web Archiving Toolkit for replay and recording of web archives (Python)

   Self-hosted solutions:

   • ArchiveBox - A self-hosted app that lets you preserve content from websites in a variety of formats
   • Wallabag - Save and classify articles, read them later
9. Xen Orchestra Installer / Updater

   2025-04-07
   linux/debian programming/node.js virtualization/xen

   Permalink
   • ronivay/xen-orchestra-docker
   • Install Xen Orchestra from Source
   • XOA Installation - From the sources
     • xo-server
     • xo-web
10. Zoekt - Fast trigram based code search

    2025-02-19
    programming/go search-engine source-code-management/git

    Permalink
    • FAQ
    • Zoekt Query Language Guide
    • isker/neogrok - A frontend for Zoekt
    • Query Language Guide by Neogrok
11. bash-stack - modern web framework in bash

    2025-01-20
    parody programming/awk programming/html programming/node.js programming/shell/bash sed

    Permalink

    Need bash scripts? Already have too many? I'm available to help.

    • cgsdev0/bash-stack
    • bash.consulting
12. Rust needs a web framework for lazy developers

    2024-12-30
    database framework network/http programming/html programming/rust web

    Permalink

    The benefits are there: you get wonderful type system, wonderful performance, and build times that give you back those coffee breaks you used to get while your code compiled.

    • ~ntietz/newt - Nicole's Web Toolkit
    • Are we web yet?
13. Lychee - Finds broken hyperlinks and mail addresses inside Markdown, HTML, reStructuredText, or any other text file or website!

    2024-12-21
    command-line network/url programming/markdown programming/rust web

    Permalink
    • lycheeverse/lychee-action - Github action to check for broken links in Markdown, HTML, and text files
14. FreshRSS - #4220 - Implement Web scraping "HTML + XPath"

    2024-12-14
    feed/rss programming/html programming/php programming/xml/xpath web/scraping

    Permalink

    Consume any Web site / HTML source, also when an RSS / Atom feed is not available.

    • XPath Scraping with FreshRSS
    • RSS-Bridge/rss-bridge
15. A look at search engines with their own indexes

    2024-11-28
    alternative network/http search-engine search-engine/search-engine-optimization web

    Permalink
    • Very Alternative Search Engines
    • Neat search engines you may not have heard of
    • Lots of great new search engines popping up that search the rest of the web that Google tends to ignore.
    • How bad are search results? Let's compare Google, Bing, Marginalia, Kagi, Mwmbl, and ChatGPT
16. Automatic Summarization

    2024-11-27
    natural-language-processing programming/python programming/r text

    Permalink
    • TextRank: Bringing Order into Texts (PDF)
    • TextRank example for summarizing text with R
    • TextRank example for text summarization with Python, Numpy, Pandas, NLTK and Networkx
17. ElectroPortis - The famous SGI/IRIX ElectroPaint(tm) screensaver by David Tristram, ported to Windows

    2024-11-26
    art graphics/2d programming/c programming/c++ programming/javascript screensaver

    Permalink
    • Electropaint History (archived 2011-07-26)
    • Silicon Graphics - Irix - ElectroPaint screen saver
    • iamralpht/elektropaintjs - Electropaint screensaver from IRIX in JavaScript

          __    __
         /..\ /| |'-.
        .\_O/ || |   |   OH WOW
     _ /  `._ \|_|_.-'  FREE SOFTWARE
    | /  \__.`=._) (_
    |/ ._/  |"""""""""|  LET ME IN
    |'.  `\ |         |   ON THIS
    ;"""/ / |         |
     ) /_/| |.-------.|
    '  `-`' "         "
    

18. Web Synth - A browser-based audio synthesis, music production, and sound experimentation platform

    2024-11-22
    audio instrument/midi instrument/synthesizer programming/rust programming/typescript programming/webassembly

    Permalink
    • ameobea/web-synth
    • Rust+WASM Powered FM Synthesizer
    • FM Synthesis in the Browser with Rust, Web Audio, and WebAssembly with SIMD
19. SimCities and SimCrises - Transcript of the keynote for the 2017 International City Gaming Conference

    2024-11-22
    architecture/urban-planning city game/sandbox game/sim-city game/simulation politics research science-fiction society/demographics weather

    Permalink
    • Matteo Brittanti - How to get rid of homeless? - A 600-page epic split in two volumes documenting the so-called “homeless scandal” that affected the newly released game SimCity (Maxis/Electronic Arts, 2013)
    • Stanisław Lem - The Cyberiad
    • MIT - Urban Intervention Simulation (archive)
    • MIT - City Science Research Group
    • The Landlord's Game, a realty and taxation game intended to educate users about Georgism
    • Invisible Cities, prose poems describing 55 fictitious cities, many of which can be read as commentary on culture, language, time, memory, death, or human experience
20. go-i18n - Translate your Go program into multiple languages

    2024-11-21
    internationalization programming/go

    Permalink
    • Golang internationalization & localization examples with go-i18n
    • Internationalization of a Go web application