VirtualTam's bookmarks

1. Archiving URLs | Gwern

   2025-04-09
   network/http personal-knowledge/bookmark personal-knowledge/digital-garden programming/go programming/html programming/java programming/python web web/scraping

   Permalink
   • Archiving Web Sites (LWN)
   • Robots.txt meant for search engines don’t work well for web archives

   Web page archive formats:

   • ARC (1996)
   • WARC (BnF, 2009)
     • WARC Specifications
     • The WARC Ecosystem

   Tools for crawling, scraping and archiving Web pages:

   • internetarchive/heritrix3 - Extensible, web-scale, archival-quality web crawler project (Java)
   • internetarchive/Zeno - State-of-the-art web crawler (Go)
     • internetarchive/gowarc - Read and write WARC files in Go
   • webrecorder/pywb - Web Archiving Toolkit for replay and recording of web archives (Python)

   Self-hosted solutions:

   • ArchiveBox - A self-hosted app that lets you preserve content from websites in a variety of formats
   • Wallabag - Save and classify articles, read them later
2. baskervaldx – Extension and modification of BaskervaldADF with LaTeX support

   2025-01-27
   programming/latex text/font

   Permalink
   • BaskervilleF and Baskervaldx
   • Font Catalogue - Baskervald X
   • baskervaldadf – Baskervald ADF fonts collection with TeX/LaTeX support
3. pgrx - Build Postgres Extensions with Rust!

   2024-12-25
   database/postgresql programming/rust

   Permalink
   • dalibo/postgresql_anonymizer
   • daamien/pgrx-tuto
4. UsenetArchives - One of the most extensive archives of Usenet newsgroups on the Internet

   2024-12-08
   bulletin-board-system forum/usenet history storage/tape text

   Permalink
   • Converting UTZOO-Wiseman Usenet Tapes to Website with PostgreSQL backend using Python 3.8
   • 2.1 Million of the Oldest Internet Posts Are Now Online for Anyone to Read
   • DataHoarders, UsenetArchives.com now includes UTZOO-Wiseman tapes of the earliest internet posts made between Feb 1981 and June 1991
   • The UTZOO Wiseman Usenet Archive (data removed following legal action)
5. pg_duckdb - A Postgres extension that embeds DuckDB's columnar-vectorized analytics engine and features

   2024-11-20
   database/duckdb database/postgresql programming/apache-parquet programming/c++ programming/json programming/python programming/sql

   Permalink
   • DuckDB - PostgreSQL Extension
   • Querying Postgres Tables Directly from DuckDB
6. What is an idiomatic way of representing enums in Go?

   2024-02-28
   programming/go

   Permalink
   • golang/go #19814 - proposal: spec: add typed enum support
   • golang/go #28987 - proposal: Go 2: enums as an extension to types
   • Go Enums Suck: let's make them suck less
7. Sidebery - Firefox extension for managing tabs and bookmarks in sidebar

   2023-06-03
   internet/browser internet/browser/firefox programming/css user-interface

   Permalink
   • Sidebery – Get this Extension for 🦊 Firefox
   • https://www.reddit.com/r/FirefoxCSS/comments/m4cqse/a_few_sidebery_and_firefox_tweaks/
   • https://www.reddit.com/r/FirefoxCSS/comments/rmi8dg/yet_another_sidebery_setup/
8. Obsidian - a powerful and extensible knowledge base that works on top of your local folder of plain text files

   2023-01-31
   knowledge programming/markdown programming/yaml text

   Permalink
   • https://minimal.guide/Home
   • https://github.com/kepano/obsidian-minimal
   • https://github.com/kepano/obsidian-minimal-settings
   • https://forum.obsidian.md/t/share-your-minimal-theme-screenshots-configuration/8983
   • https://github.com/dvcrn/obsidian-filename-heading-sync
   • https://github.com/zsviczian/obsidian-excalidraw-plugin
   • https://github.com/lynchjames/obsidian-mind-map
   • https://www.eleanorkonik.com/its-not-just-a-pretty-gimmick-in-defense-of-obsidians-graph-view/
   • https://medium.com/@ensleytan/using-obsidians-graph-view-for-real-99fd94153514
   • Obsidian TTRPG
   • Zsolt's Visual Personal Knowledge Management
9. Mutagen Extension for Docker Desktop

   2023-01-07
   apple/macos linux/container/docker virtualization

   Permalink

   Create synchronized caches of macOS and Windows filesystem contents in ext4 volumes inside the Docker Desktop VM

   • https://ddev.com/ddev-local/ddev-docker-desktop-and-colima-benchmarking-updated-dec-2022/
10. Visual Studio Code User and Workspace Settings

    2022-12-17
    editor/vscode programming/json

    Permalink
    • https://stackoverflow.com/questions/35773299/how-can-you-export-the-visual-studio-code-extension-list
    • https://stackoverflow.com/questions/55310734/how-to-add-more-indentation-in-the-visual-studio-code-explorer-file-tree-structu/55315106#55315106
    • https://github.com/microsoft/vscode/issues/1027 - Suppress display of end-of-file newline as blank line
    • https://stackoverflow.com/questions/30140112/how-do-i-hide-certain-files-from-the-sidebar-in-visual-studio-code
    • https://stackoverflow.com/questions/29973619/how-to-make-vs-code-treat-a-file-extensions-as-a-certain-language
    • https://stackoverflow.com/questions/44774709/removing-the-file-preview-on-the-right-side-of-the-editor-in-vs-code
11. diffware: An extensively configurable tool providing a summary of the changes between two files or directories, ignoring all the fluff you don't care about.

    2022-08-23
    archive binary firmware programming/python text/diff

    Permalink
12. PyO3 — C interface for Rust // Lib.rs

    2022-07-05
    programming/c programming/python programming/rust

    Permalink
    • https://github.com/PyO3/setuptools-rust
    • https://github.com/PyO3/maturin
    • https://depth-first.com/articles/2022/03/09/python-extensions-in-pure-rust-with-rust-cpython/
    • https://www.benfrederickson.com/writing-python-extensions-in-rust-using-pyo3/
13. PostgresSQL ltree module - a data type for representing labels of data stored in a hierarchical tree-like structure

    2022-04-07
    data-structure/tree database/postgresql graphviz programming/go

    Permalink
    • https://coderwall.com/p/whf3-a/hierarchical-data-in-postgres
    • https://stackoverflow.com/questions/tagged/ltree
    • https://github.com/jinagamvasubabu/ltreevisualizer
    • https://patshaughnessy.net/2017/12/11/trying-to-represent-a-tree-structure-using-postgres
    • https://patshaughnessy.net/2017/12/12/installing-the-postgres-ltree-extension
    • https://patshaughnessy.net/2017/12/13/saving-a-tree-in-postgres-using-ltree
    • https://patshaughnessy.net/2017/12/14/manipulating-trees-using-sql-and-the-postgres-ltree-extension
14. Enhanced SSL Load Balancing with Server Name Indication (SNI) TLS Extension - HAProxy Technologies

    2020-12-11
    network/dns network/reverse-proxy network/reverse-proxy/haproxy network/server-name-indication network/tcp network/transport-layer-security

    Permalink
    • https://discourse.haproxy.org/t/req-ssl-sni-and-ssl-termination/2139/3
    • com/@olivier.ragain/haproxy-https-load-balancing-on-sni-207c17398d19
15. X11 / XKB custom keyboard layout definition

    2020-08-15
    keyboard layout linux linux/x11 user-interface

    Permalink
    • https://web.archive.org/web/20170825051821/http://madduck.net:80/docs/extending-xkb/
    • https://web.archive.org/web/20170720005456/http://pascal.tsu.ru/en/xkb/
    • https://web.archive.org/web/20170709093947/https://wiki.debian.org/XStrikeForce/InputHotplugGuide
    • https://help.ubuntu.com/community/Custom%20keyboard%20layout%20definitions
    • http://linux.lsdev.sil.org/wiki/index.php/Building_an_XKB_Keyboard
    • https://rlog.rgtti.com/2014/05/01/how-to-modify-a-keyboard-layout-in-linux/
    • https://www.freedesktop.org/wiki/Software/XKeyboardConfig/
    • https://askubuntu.com/questions/482678/how-to-add-a-new-keyboard-layout-custom-keyboard-layout-definition
    • https://wiki.archlinux.org/index.php/X_keyboard_extension
16. avx-turbo: Test the non-AVX, AVX2 and AVX-512 speeds across various active core counts

    2019-12-31
    hardware/cpu instruction intel performance performance/benchmark processor

    Permalink
    • https://en.wikipedia.org/wiki/Advanced_Vector_Extensions
    • https://www.intel.com/content/www/us/en/architecture-and-technology/avx-512-overview.html
17. hypothesis-auto - an extension for the Hypothesis project that enables fully automatic tests for type annotated functions

    2019-09-24
    hypothesis programming/python programming/testing programming/testing/property-based-testing

    Permalink
    • https://github.com/timothycrosley/hypothesis-auto/
18. refined-github: Browser extension that simplifies the GitHub interface and adds useful features

    2019-03-05
    extension internet/browser source-code-management/git source-code-management/github

    Permalink
19. Share Compose configurations between files and projects | Docker Documentation

    2018-07-25
    configuration linux/container/docker linux/container/docker-compose programming/yaml

    Permalink

    Extension with Compose format 3.4+:

    • https://github.com/moby/moby/issues/31101
    • https://github.com/docker/compose/issues/4315
    • https://github.com/docker/cli/pull/452
    • https://github.com/docker/compose/pull/5140
    • https://stackoverflow.com/questions/45279662/extend-service-in-docker-compose-3

    Inheritance through YAML anchors:

    • https://stackoverflow.com/questions/14184971/more-complex-inheritance-in-yaml
    • https://web.archive.org/web/20130213112648/http://blog.101ideas.cz/posts/dry-your-yaml-files.html
    • https://gist.github.com/bowsersenior/979804
20. MediaWiki Docker deployment

    2018-06-28
    documentation linux/container/docker linux/container/docker-compose wiki

    Permalink

    Docker images:

    • https://hub.docker.com/_/mediawiki/
    • https://hub.docker.com/r/wikimedia/mediawiki-node-services/
    • https://github.com/wikimedia/mediawiki-node-services
    • https://hub.docker.com/r/thenets/parsoid/
    • https://github.com/thenets/docker-parsoid
    • https://hub.docker.com/r/pastakhov/restbase/
    • https://github.com/pastakhov/docker-restbase

    Visual Editor:

    • https://www.mediawiki.org/wiki/VisualEditor
    • https://www.mediawiki.org/wiki/Extension:VisualEditor
    • https://www.mediawiki.org/wiki/Parsoid
    • https://www.mediawiki.org/wiki/Parsoid/Setup
    • https://www.mediawiki.org/wiki/RESTBase
    • https://www.mediawiki.org/wiki/RESTBase/Installation

    Compose examples:

    • https://github.com/pastakhov/compose-mediawiki-ubuntu
    • https://github.com/wikimedia/mediawiki-containers