VirtualTam's bookmarks

21. HyperLogLog - Approximate the number of distinct elements in a set 2022-12-14

    tags: algorithm, database/postgresql, database/redis

    [ permalink ]

    • HyperLogLog: the analysis of a near-optimal cardinality estimation algorithm (PDF)
    • HyperLogLog in Practice: Algorithmic Engineering of a State of The Art Cardinality Estimation Algorithm
    • https://agkn.wordpress.com/2012/10/25/sketch-of-the-day-hyperloglog-cornerstone-of-a-big-data-infrastructure/
    • Redis new data structure: the HyperLogLog
    • https://www.reddit.com/r/programming/comments/21wshj/redis_new_data_structure_the_hyperloglog/
    • https://redis.uptrace.dev/guide/go-redis-hll.html
    • https://towardsdatascience.com/hyperloglog-a-simple-but-powerful-algorithm-for-data-scientists-aed50fe47869
    • https://odino.org/my-favorite-data-structure-hyperloglog/
    • http://blog.notdot.net/2012/09/Dam-Cool-Algorithms-Cardinality-Estimation
    • https://supabase.com/blog/seen-by-in-postgresql
    • https://www.citusdata.com/blog/2017/12/22/distributed-count-vs-hyperloglog/
22. Seastar, a high performance C++ application framework for high concurrency server applications. 2022-09-04

    tags: distributed-system, programming/c++

    [ permalink ]

    • https://github.com/scylladb/seastar
    • https://docs.seastar.io/master/index.html
23. Herding elephants: Lessons learned from sharding Postgres at Notion 2022-08-28

    tags: database/postgresql, distributed-system, performance, programming/sql, shard

    [ permalink ]
24. The hunt for the cluster-killer Erlang bug 2022-06-16

    tags: distributed-system, distributed-system/cluster, message-broker/kafka, programming/erlang

    [ permalink ]
25. Fixing a MongoDB Replication Protocol Bug with TLA+ - William Schultz 2022-05-31

    tags: database/mongodb, distributed, distributed-system/cluster, formal-specification/tla+, protocol

    [ permalink ]

    • https://www.youtube.com/watch?v=x9zSynTfLDE
26. How I centralize and distribute my [browser] bookmarks 2022-01-11

    tags: internet/browser, personal-knowledge/bookmark, programming/html, programming/node.js, web

    [ permalink ]

    • https://github.com/thearegee/bookworms
27. sccache - ccache with cloud storage 2021-10-11

    tags: compiler, compiler/cache, mozilla, programming/c, programming/c++, programming/rust, storage/cache

    [ permalink ]

    • https://blog.mozilla.org/ted/2016/11/21/sccache-mozillas-distributed-compiler-cache-now-written-in-rust/
28. Kafka, Pulsar & RabbitMQ 2021-08-21

    tags: cloud-computing, distributed-system/cluster, message-broker/kafka, message-broker/rabbitmq, microservice, network

    [ permalink ]

    Articles by Eran Stiller:

    • RabbitMQ vs. Kafka – An Architect’s Dilemma (Part 1)
    • RabbitMQ vs. Kafka – An Architect’s Dilemma (Part 2)

    Article and StackOverflow response by Lovisa Johansson from CloudAMQP, seem slightly biased towards RabbitMQ:

    • SO: When to use RabbitMQ over Kafka?
    • When to use RabbitMQ or Apache Kafka

    Benchmarks by Confluent.io (Kafka creator and Cloud Provider), seem heavily biased towards Kafka:

    • Kafka vs. Pulsar vs. RabbitMQ: Performance, Architecture, and Features Compared
    • Benchmarking Apache Kafka, Apache Pulsar, and RabbitMQ: Which is the Fastest?
29. Thundering Herds & Promises 2021-08-19

    tags: distributed, memory/cache, performance, programming/c++

    [ permalink ]

    • https://engineering.fb.com/2015/06/19/developer-tools/futures-for-c-11-at-facebook/
    • https://github.com/facebook/folly/blob/master/folly/futures/SharedPromise.h
30. Presto | Distributed SQL Query Engine for Big Data 2021-01-07

    tags: business-intelligence, database, programming/api, programming/sql, statistics

    [ permalink ]

    • https://github.com/prestodb/presto
31. Grafana Tempo | a high volume, minimal dependency trace storage 2020-12-21

    tags: observability, observability/grafana, observability/logging, observability/logging/grafana-loki, observability/tracing, observability/tracing/grafana-tempo, performance, programming/go

    [ permalink ]

    • https://grafana.com/docs/tempo/latest/getting-started/
    • https://grafana.com/docs/tempo/latest/configuration/
    • https://github.com/grafana/tempo
    • https://grafana.com/blog/2020/10/27/announcing-grafana-tempo-a-massively-scalable-distributed-tracing-system/
    • https://grafana.com/blog/2020/11/09/trace-discovery-in-grafana-tempo-using-prometheus-exemplars-loki-2.0-queries-and-more/
    • https://grafana.com/go/observabilitycon/observability-with-logs-grafana/
    • https://grafana.com/go/observabilitycon/tracing-made-simple-with-grafana/
    • https://gouthamve.dev/tempo-a-game-of-trade-offs/
32. What's the Point of Multiple Redis Databases? 2020-11-23

    tags: database, database/redis, distributed-system/cluster

    [ permalink ]

    • https://stackoverflow.com/questions/12802726/how-to-list-all-redis-databases
    • https://groups.google.com/g/redis-db/c/vS5wX8X4Cjg/discussion
    • https://stackoverflow.com/questions/13386053/how-do-i-change-between-redis-database
33. distri — a Linux distribution to research fast package management | distri 2020-01-30

    tags: distribution, linux, packaging

    [ permalink ]

    • https://michael.stapelberg.ch/posts/2019-08-17-introducing-distri/
34. Building a BitTorrent client from the ground up in Go | Jesse Li 2020-01-08

    tags: distributed, programming/go, torrent

    [ permalink ]

    • https://github.com/veggiedefender/torrent-client/
35. MySQL High Availability at GitHub 2019-12-31

    tags: consul, database, database/mysql, distributed-system/cluster, distributed-system/high-availability, source-code-management/github

    [ permalink ]

    • https://github.blog/2017-10-13-mitigating-replication-lag-and-reducing-read-load-with-freno/
    • https://github.com/github/freno
    • https://github.blog/2016-12-08-orchestrator-github/
    • https://github.com/github/orchestrator
    • https://raft.github.io/
36. GitHub Load Balancer Director and supporting tooling 2019-12-31

    tags: distributed-system/high-availability, load-balancing, network, network/http, network/reverse-proxy/haproxy, network/tcp, source-code-management/github

    [ permalink ]

    • https://github.com/github/glb-director
    • https://github.blog/2018-06-20-mysql-high-availability-at-github/
37. blast: a full text search and indexing server, written in Go, built on top of Bleve. 2019-10-19

    tags: distributed, programming/go, search-engine, text

    [ permalink ]

    • https://golangexample.com/a-full-text-search-and-indexing-server-written-in-go/
38. /r/golang | Learning Distributed systems 2019-09-16

    tags: data, distributed, distributed-system/cluster, network, programming, programming/go

    [ permalink ]

    • https://github.com/golang/go/wiki/Courses
    • https://dataintensive.net/
    • https://columbia.github.io/ds2-class/
    • https://github.com/brendandburns/designing-distributed-systems-labs
    • https://azure.microsoft.com/en-us/resources/designing-distributed-systems/en-us/
    • https://www.distributed-systems.net/index.php/books/distributed-systems-3rd-edition-2017/
39. Thanos - Highly available Prometheus setup with long term storage capabilities 2019-09-11

    tags: database, distributed-system/cluster, observability, observability/time-series, observability/time-series/prometheus

    [ permalink ]

    • https://improbable.io/blog/thanos-prometheus-at-scale
    • https://github.com/thanos-io/thanos
    • https://docs.google.com/presentation/d/1uwoxPdTjSjvGaN1LJewZg1NXjeHfRtfvqh6LygLcayQ/edit#slide=id.g5f09eeda59_0_9
    • https://www.youtube.com/watch?v=NuWTNrGyWLQ
    • https://katacoda.com/bwplotka/courses/thanos
40. How To Create a Kubernetes Cluster Using Kubeadm on Ubuntu 18.04 | DigitalOcean 2019-09-03

    tags: distributed-system/cluster, linux, linux/container/docker, linux/container/kubernetes, linux/ubuntu

    [ permalink ]