VirtualTam's bookmarks

1. Faktory - a language-agnostic background job framework (by the authors of Sidekiq) 2023-02-19

   tags: distributed-system, message-queue, programming/go, task

   [ permalink ]

   • https://github.com/contribsys/faktory
   • https://github.com/contribsys/faktory/wiki
   • https://www.mikeperham.com/2017/10/24/introducing-faktory/
2. RedPanda | Data Streaming Platform 2022-09-04

   tags: message-broker/kafka, message-queue, programming/c++, programming/go

   [ permalink ]

   • https://redpanda.com/blog/validating-consistency
   • https://redpanda.com/blog/kafka-redpanda-availability
   • https://redpanda.com/blog/redpanda-official-jepsen-report-and-analysis
   • https://github.com/redpanda-data/redpanda/
   • https://news.ycombinator.com/item?id=25075739
3. IoT logging with MQTT, Fluentd / Fluent Bit and Loki 2020-08-15

   tags: embedded, fluentd, internet-of-things, network/mqtt, observability/grafana, observability/logging, observability/logging/grafana-loki

   [ permalink ]

   Open questions, potential solutions or workarounds:

   • Loki does not support out-of-order message ingestion
     • https://github.com/grafana/loki/issues/1544
     • https://github.com/project-hatohol/fluent-plugin-sort
   • There is not Java client for Loki
     • https://github.com/grafana/loki/issues/1158
     • https://grafana.com/docs/loki/latest/api/
     • https://github.com/grafana/loki/tree/master/cmd/fluent-bit
   • The Wiced MQTT queue might be limited depending on the volume of logs
     • https://iotexpert.com/2017/03/08/embedded-world-2017-wiced-wifi-mqtt-and-the-amazon-iot-cloud/
4. Asynchronous Tasks with Django and Celery | TestDriven.io 2020-03-31

   tags: database/redis, framework/django, message-queue, programming/python

   [ permalink ]

   • https://flower.readthedocs.io/en/latest/index.html
5. amqproxy: An intelligent AMQP proxy, with connection and channel pooling/reusing 2019-06-12

   tags: message-broker/rabbitmq, message-queue, network/amqp, network/proxy, performance, programming/php

   [ permalink ]

   • https://www.cloudamqp.com/blog/2019-05-29-maintaining-long-lived-connections-with-AMQProxy.html
6. Why We Chose Kafka For The Trello Socket Architecture 2018-08-28

   tags: distributed, distributed-system/cluster, message-broker/kafka, message-broker/rabbitmq, performance, queue

   [ permalink ]
7. Every Silver Lining Has a Cloud - ACM Queue 2018-06-17

   tags: cloud, fun, linux/container, metal, performance, web

   [ permalink ]

   "Cache is king. And if your cache is cut, you're going to feel it."

   "Some providers now have something called Metal-as-a-Service, which I really think ought to mean that an '80s metal band shows up at your office, plays a gig, smashes the furniture, and urinates on the carpet."

8. Python - Logging and Multiprocessing 2017-11-09

   tags: concurrency/threading, observability/logging, process, programming/python

   [ permalink ]

   • https://docs.python.org/3/library/logging.html
   • https://docs.python.org/3/library/multiprocessing.html#multiprocessing.Queue
   • https://stackoverflow.com/questions/641420/how-should-i-log-while-using-multiprocessing-in-python
   • https://stackoverflow.com/questions/21419323/multiprocessing-logging-lock-vs-queue
   • https://github.com/jruere/multiprocessing-logging
9. Homepage | Celery: Distributed Task Queue 2015-02-11

   tags: distributed, network, programming/python, queue, task

   [ permalink ]