VirtualTam's bookmarks
-
2018-02-10 -
2018-01-31 - https://thoughts.t37.net/how-we-reindexed-36-billions-documents-in-5-days-within-the-same-elasticsearch-cluster-cd9c054d1db8
- https://thoughts.t37.net/how-we-upgraded-a-22tb-mysql-cluster-from-5-6-to-5-7-in-9-months-cc41b391895d
- https://www.elastic.co/blog/hot-warm-architecture-in-elasticsearch-5-x
- https://www.graylog.org/post/back-to-basics-using-a-hot-warm-elasticsearch-cluster
- https://github.com/mraad/es-hot-warm
-
2017-12-04 -
Actors:
- database server / cluster
- load-balanced application servers relying on a database schema with migrations
- reverse proxy
Issue:
- managing database schema migrations
Possible sequence:
- create the database
- run a service that executes database schema migrations
- start application servers
- start the load-balancer / reverse-proxy
Resources:
- https://www.reddit.com/r/docker/comments/2t2pnf/what_are_best_strategies_to_migrate_relational/
- https://softwareengineering.stackexchange.com/questions/357929/db-migration-strategy-for-docker-containers-in-aws-ecs
- https://stackoverflow.com/questions/41592091/run-a-database-migration-command-when-deploying-a-docker-container-to-aws
- https://ltd-keeper.lsst.io/gke-migrations.html
- https://stackoverflow.com/questions/31715239/docker-compose-database-migrations-and-other-pre-post-scripts
- https://stackoverflow.com/questions/38089999/docker-compose-rails-best-practice-to-migrate
- https://stackoverflow.com/questions/37058812/how-best-to-run-one-off-migration-tasks-in-a-kubernetes-cluster
-
2017-11-29 Django ORM:
- https://docs.djangoproject.com/en/1.11/ref/databases/#mysql-notes
- https://stackoverflow.com/questions/34777755/how-to-config-django-using-pymysql-as-driver
- https://stackoverflow.com/questions/19189813/setting-django-up-to-use-mysql
MySQL / MariaDB / Percona connectors:
- https://stackoverflow.com/questions/4960048/python-3-and-mysql
- https://github.com/PyMySQL/PyMySQL
- https://pypi.python.org/pypi/mysql-connector-python
Docker images:
- https://store.docker.com/images/mariadb
- https://store.docker.com/images/mysql
- https://store.docker.com/images/percona
Compose and Django ORM database migrations:
-
- https://bitquabit.com/post/having-fun-python-and-elasticsearch-part-1/
- https://bitquabit.com/post/having-fun-python-and-elasticsearch-part-2/
- https://bitquabit.com/post/having-fun-python-and-elasticsearch-part-3/
- https://elasticsearch-py.readthedocs.io
- https://elasticsearch-dsl.readthedocs.io/
- https://docs.python.org/3.6/library/email.html
-
2017-10-06 -
- https://github.com/qmk/qmk_firmware
- https://colemak.com/
- https://www.scorpia.co.uk/2016/03/17/using-usb-type-c-on-hobyist-projects/
- http://www.embedded.com/electronics-blogs/benson-s-blocks/4442214/USB-Type-C-in-a-Micro-B-world
- https://sgotti.me/post/atreus-keyboard-build-log/
- https://atreus.technomancy.us/
-
2017-05-19 -
2017-05-15 -
2017-04-01 -
2017-02-24 - https://security.googleblog.com/2017/02/announcing-first-sha1-collision.html
- https://arstechnica.com/security/2017/02/at-deaths-door-for-years-widely-used-sha1-function-is-now-dead/
- https://news.ycombinator.com/item?id=13719368
- https://github.com/peff/git/commits/jk/sha1dc
- https://plus.google.com/+LinusTorvalds/posts/7tp2gYWQugL
-
- https://superuser.com/questions/344962/web-scraper-for-outlook-web-app-2010
- https://hub.docker.com/r/jberrenberg/davmail/
- https://www.ctl.io/developers/blog/post/killing-your-outlook-with-docker-and-davmail/
- https://aur.archlinux.org/packages/davmail/
- https://bbs.archlinux.org/viewtopic.php?id=141256
- https://unix.stackexchange.com/questions/70935/davmail-systemd-launcher-on-headless-server
-
2016-12-27 -
2016-12-12 A whole buncha' links with contradictory information on how to properly set up a mail server ;-)
Disclaimer - My primary goal is to add proper Spamassassin (SA) filtering to an existing Postfix / Dovecot / roundcube installation, i.e.:
- use SA as a milter (mail filter) to attribute a spam score to incoming mail
- keep SA up-to-date
- train SA with spam/ham from the users' virtual mailboxes
- train SA according to user decisions (actual user or trained mail client with automatic/trained spam detection)
Here we go!
Most useful links; I stumbled upon them as soon as I knew what to look for:
- https://workaround.org/ispmail/jessie/spamassassin
- https://lelutin.ca/posts/installing_postfix_-_clamav_-_spamassassin_-_dovecot_-_postfixadmin_on_debian_squeeze/
Official:
- https://spamassassin.apache.org
- https://spamassassin.apache.org/gtube/
- https://wiki.apache.org/spamassassin/FrequentlyAskedQuestions
Debian:
- https://wiki.debian.org/DebianSpamAssassin
- http://www.stefan-seelmann.de/wiki/mailserver-postfix-dovecot (wheezy)
- https://www.christianroessler.net/tech/2015/spamassassin-dovecot-postfix.html
- https://www.digitalocean.com/community/tutorials/how-to-configure-a-mail-server-using-postfix-dovecot-mysql-and-spamassassin
CentOS:
- https://www.rosehosting.com/blog/how-to-install-and-integrate-spamassassin-with-postfix-on-a-centos-6-vps/
- https://www.rosehosting.com/blog/how-to-set-up-server-side-email-filtering-with-dovecot-sieve-and-roundcube-on-a-centos-6-vps/
- http://shisaa.jp/postset/mailserver-1.html - a bit outdated but plenty of useful information regarding how components interact with each other
- http://wiki2.dovecot.org/HowTo
RHEL:
- https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/7/html/System_Administrators_Guide/ch-Mail_Servers.html
- https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/7/html/System_Administrators_Guide/s1-email-mta.html
- https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/7/html/System_Administrators_Guide/s1-email-mda.html
