VirtualTam's bookmarks

161. Distributed environments and database migrations 2017-11-29

     tags: data, database, database/migration, distributed, framework/django, linux/container/docker

     [ permalink ]

     Actors:

     • database server / cluster
     • load-balanced application servers relying on a database schema with migrations
     • reverse proxy

     Issue:

     • managing database schema migrations

     Possible sequence:

     • create the database
     • run a service that executes database schema migrations
     • start application servers
     • start the load-balancer / reverse-proxy

     Resources:

     • https://www.reddit.com/r/docker/comments/2t2pnf/what_are_best_strategies_to_migrate_relational/
     • https://softwareengineering.stackexchange.com/questions/357929/db-migration-strategy-for-docker-containers-in-aws-ecs
     • https://stackoverflow.com/questions/41592091/run-a-database-migration-command-when-deploying-a-docker-container-to-aws
     • https://ltd-keeper.lsst.io/gke-migrations.html
     • https://stackoverflow.com/questions/31715239/docker-compose-database-migrations-and-other-pre-post-scripts
     • https://stackoverflow.com/questions/38089999/docker-compose-rails-best-practice-to-migrate
     • https://stackoverflow.com/questions/37058812/how-best-to-run-one-off-migration-tasks-in-a-kubernetes-cluster
162. CardIO framework for deep research of electrocardiograms 2017-11-24

     tags: data, deep-learning, ecg, health, heart, machine-learning, programming/python

     [ permalink ]

     • https://github.com/analysiscenter/cardio
     • https://analysiscenter.github.io/cardio/
     • https://physionet.org/challenge/2017/

     via https://www.reddit.com/r/Python/comments/7exmkn/cardio_a_rich_python_library_for_heart_signals/

163. Monitoring the Dark Army with Kibana on Mr. Robot | Elastic 2017-11-22

     tags: dashboard, data, engine, observability/elastic/elasticsearch, observability/elastic/kibana, search, series, visualization

     [ permalink ]

     • https://medium.com/@ryankazanciyan/mr-robot-disassembled-3-4-runtime-error-r00-9319c70c30f2
164. How Sentry Receives 20 Billion Events Per Month While Preparing to Handle Twice That 2017-11-09

     tags: crash, data, error, observability, programming/python, report

     [ permalink ]

     • https://news.ycombinator.com/item?id=15655135
       • https://news.ycombinator.com/item?id=15660707
       • https://news.ycombinator.com/item?id=15656474
     • https://sentry.io/welcome/
165. Watching a directory for file changes 2017-11-03

     tags: file, programming/c, programming/c++, programming/python, tail

     [ permalink ]

     Python:

     • http://brunorocha.org/python/watching-a-directory-for-file-changes-with-python.html
     • https://github.com/gorakhargosh/watchdog
     • https://stackoverflow.com/questions/182197/how-do-i-watch-a-file-for-changes
     • https://stackoverflow.com/questions/136168/get-last-n-lines-of-a-file-with-python-similar-to-tail

     C/C++:

     • https://stackoverflow.com/questions/62832/reading-data-from-a-log-file-as-a-separate-application-is-writing-to-it
     • https://doc.qt.io/qt-5/qfilesystemwatcher.html
166. alecthomas/voluptuous: Voluptuous, despite the name, is a Python data validation library. 2017-11-03

     tags: data, programming/api/rest, programming/python, programming/testing, validator

     [ permalink ]
167. The Python Graph Gallery – Visualizing data – with Python 2017-10-15

     tags: chart, graph, plot, programming/python, visualization

     [ permalink ]
168. Data Art – The R graph Gallery 2017-10-15

     tags: art, chart, graph, plot, programming/r

     [ permalink ]
169. Algorithmic Composer 2017-10-11

     tags: algorithm, audio, multimedia/pure-data, synthesis

     [ permalink ]
170. Pure Data for PDA's | PDa - Puredata anywhere 2017-10-11

     tags: mobile, multimedia/pure-data

     [ permalink ]
171. 17 Line Markov Chain 2017-10-10

     tags: markov, programming/python, text

     [ permalink ]

     • http://theorangeduck.com/media/uploads/other_stuff/irc
     • http://theorangeduck.com/media/uploads/other_stuff/poetry.zip
     • http://theorangeduck.com/page/data-science-how-hard
172. Exoplanet sonification 2017-10-07

     tags: planet, sound, visualization, visualization/d3.js

     [ permalink ]

     • http://phl.upr.edu/projects/habitable-exoplanets-catalog/data/database
     • http://kyma.symbolicsound.com/
     • https://xkcd.com/1071/
173. High-pass Filter: Karplus-Strong guitar string synthesis with Pure Data 2017-10-03

     tags: karplus, multimedia/pure-data, string, synthesis, wavetable

     [ permalink ]

     • https://en.wikipedia.org/wiki/Karplus%E2%80%93Strong_string_synthesis

     • https://uk.mathworks.com/help/signal/examples/generating-guitar-chords-using-the-karplus-strong-algorithm.html?s_tid=gn_loc_drop

     • http://amid.fish/karplus-strong

     • https://github.com/mrahtz/javascript-karplus-strong

     • https://www.youtube.com/watch?v=WxqsTd1xZm8

     • https://www.youtube.com/watch?v=fZ1rviedGvc

     • https://www.youtube.com/watch?v=5RYy8Cvgkqk

174. Engineering Uber Predictions in Real Time with ELK - Uber Engineering Blog 2017-10-02

     tags: data, observability/elastic/elasticsearch, predictive

     [ permalink ]
175. ELK Hello World Example 2017-10-02

     tags: dashboard, data-mining, observability/elastic/elasticsearch, search-engine

     [ permalink ]

     • https://oliverveits.wordpress.com/2016/11/17/logstash-hello-world/
     • https://oliverveits.wordpress.com/2016/11/18/elasticsearch-hello-world-example/
     • https://oliverveits.wordpress.com/2016/11/20/kibana-hello-world-example/
176. Fluentd | Open Source Data Collector | Unified Logging Layer 2017-10-02

     tags: network, observability/logging, programming/c, programming/ruby

     [ permalink ]

     • https://github.com/fluent/fluentd
177. Pure Data Patches - LWM Rack 1.01b - The Free Open Source Virtual Eurorack System for PD 2017-10-01

     tags: audio, multimedia/pure-data, rack

     [ permalink ]
178. Home Page for 20 Newsgroups Data Set 2017-09-30

     tags: dataset, forum, natural-language-processing, text

     [ permalink ]
179. How to use Elasticsearch for NLP and Text Mining 2017-09-30

     tags: data-mining, natural-language-processing, observability/elastic/elasticsearch, search-engine

     [ permalink ]

     • http://dataconomy.com/2016/12/use-elasticsearch-nlp-text-mining%e2%80%8a-%e2%80%8apart-1/

     • http://dataconomy.com/2017/05/use-elasticsearch-nlp-text-mining-part-2/

     • https://www.elastic.co/blog/text-classification-made-easy-with-elasticsearch

     • https://www.elastic.co/guide/en/elasticsearch/guide/current/languages.html

     • https://github.com/spinscale/elasticsearch-opennlp-plugin

     • https://github.com/spinscale/elasticsearch-ingest-opennlp

     • https://github.com/jprante/elasticsearch-langdetect

     • https://www.elastic.co/guide/en/elasticsearch/plugins/current/ingest-attachment.html

     • https://tika.apache.org/

     • https://www.elastic.co/guide/en/elasticsearch/reference/current/analysis-lang-analyzer.html

     • https://lingpipe-blog.com/2014/04/10/lucene4-document-classification/

     • https://medium.com/@textminers/how-to-use-elasticsearch-for-textmining-part-1-5589e76301d5

180. Removing Data From ElasticSearch - Stack Overflow 2017-09-30

     tags: delete, index, observability/elastic/elasticsearch

     [ permalink ]