VirtualTam's bookmarks

41. Aggregating Container Logs | Installation and Configuration | OpenShift Origin Latest 2018-01-15

    tags: linux/container, observability/elastic, observability/logging, openshift

    [ permalink ]

    • https://blog.openshift.com/fluentd-enterprise/
    • https://www.fluentd.org/
    • https://www.elastic.co/guide/en/elasticsearch/client/curator/current/about.html
42. How to Monitor HAProxy with the ELK Stack - Logz.io 2018-01-08

    tags: network/http, network/http-server/haproxy, observability/elastic, observability/elastic/logstash, observability/logging, server

    [ permalink ]

    • https://logz.io/learn/complete-guide-elk-stack/
    • https://app.logz.io/#/dashboard/apps?q=haproxy
    • https://cbonte.github.io/haproxy-dconv/1.8/configuration.html#8
43. Polycon.io BCN: Managing your Black Friday Logs // Speaker Deck 2017-11-21

    tags: engine, index, observability/elastic/elasticsearch, observability/logging, scale, search

    [ permalink ]
44. Python - Logging and Multiprocessing 2017-11-09

    tags: concurrency/threading, observability/logging, process, programming/python

    [ permalink ]

    • https://docs.python.org/3/library/logging.html
    • https://docs.python.org/3/library/multiprocessing.html#multiprocessing.Queue
    • https://stackoverflow.com/questions/641420/how-should-i-log-while-using-multiprocessing-in-python
    • https://stackoverflow.com/questions/21419323/multiprocessing-logging-lock-vs-queue
    • https://github.com/jruere/multiprocessing-logging
45. Filebeat vs. Logstash -- The Evolution of a Log Shipper - Logz.io 2017-10-02

    tags: client, network, observability/logging

    [ permalink ]
46. What Are Use Cases of Elasticsearch? - Quora 2017-10-02

    tags: document, engine, observability/elastic/elasticsearch, observability/logging, search

    [ permalink ]

    • https://www.elastic.co/use-cases
    • https://www.elastic.co/blog/found-uses-of-elasticsearch
    • https://www.elastic.co/blog/using-elastic-graph-and-kibana-to-analyze-panama-papers
    • https://www.elastic.co/blog/introducing-machine-learning-for-the-elastic-stack
    • http://blog.florian-hopf.de/2014/07/use-cases-for-elasticsearch-document.html
    • http://blog.florian-hopf.de/2014/12/use-cases-for-elasticsearch-analytics.html
47. What are the pros and cons of LogStash versus Fluentd? 2017-10-02

    tags: collection, fluentd, observability/elastic, observability/elastic/logstash, observability/logging, programming/c, programming/java, programming/ruby

    [ permalink ]

    • https://sematext.com/blog/2016/09/13/logstash-alternatives/
    • https://logz.io/blog/fluentd-logstash/
    • https://github.com/repeatedly/fluent-plugin-beats
    • https://www.fluentd.org/guides/recipes/elasticsearch-and-s3
    • https://docs.fluentd.org/v1.0/articles/out_elasticsearch
    • https://dzone.com/articles/kubernetes-log-analysis-with-fluentd-elasticsearch
48. Fluentd | Open Source Data Collector | Unified Logging Layer 2017-10-02

    tags: network, observability/logging, programming/c, programming/ruby

    [ permalink ]

    • https://github.com/fluent/fluentd
49. How to Use Elasticsearch, Logstash, and Kibana to Manage Apache Logs 2017-09-30

    tags: network/http-server/apache-httpd, observability/elastic/elasticsearch, observability/elastic/logstash, observability/logging

    [ permalink ]

    • https://www.elastic.co/guide/en/logstash/master/config-examples.html
    • https://github.com/logstash-plugins/logstash-patterns-core/blob/master/patterns/httpd
    • https://discuss.elastic.co/t/apache-error-logs-timestamp/82010/9
    • https://discuss.elastic.co/t/parsing-apache-logs-combinedapachelog-commonapachelog-not-working/82007
    • http://www.thegeekstuff.com/2014/12/logstash-setup/
50. Where can I find web server log dataset? - Quora 2017-09-30

    tags: apache, dataset, observability/logging, server

    [ permalink ]

    • https://www.quora.com/Are-there-any-free-large-datasets-in-the-format-of-an-Apache-access-log

    Apache:

    • https://github.com/silicon-valley-data-science/datasets
    • http://ita.ee.lbl.gov/html/contrib/NASA-HTTP.html
    • https://archive.org/details/webserverlogs
    • http://opensource.indeedeng.io/imhotep/docs/sample-data/
51. Ansible | Logging playbook runs 2017-08-29

    tags: configuration, configuration-management/ansible, observability/logging

    [ permalink ]

    • https://stackoverflow.com/questions/18794808/how-do-i-get-logs-details-of-ansible-playbook-module-executions
    • https://stackoverflow.com/questions/35135954/how-to-log-in-a-separate-file-per-playbook-in-ansible
    • https://dzone.com/articles/running-ansible-playbooks-from-jenkins
52. ansible - iteration using with_items and register - Stack Overflow 2017-08-25

    tags: configuration-management/ansible, item, list, loop, observability/logging, variable

    [ permalink ]
53. action - Ansible - Print message - debug: msg="line1 \n {{ var2 }} \n line3 with var3 = {{ var3 }}" - Stack Overflow 2017-08-24

    tags: configuration-management/ansible, debugging, line, multiple, observability/logging

    [ permalink ]
54. Sshguard 2017-08-08

    tags: ban, linux, network/ssh, observability/logging, security, system

    [ permalink ]
55. Understanding Python's logging module | Electricmonk.nl weblog 2017-08-07

    tags: observability/logging, programming/python

    [ permalink ]
56. Python Logging Cookbook — Rotation 2017-07-19

    tags: file, message, observability/logging, programming/python

    [ permalink ]

    • http://www.blog.pythonlibrary.org/2014/02/11/python-how-to-create-rotating-logs/
    • https://docs.python.org/3/library/logging.handlers.html#watchedfilehandler
    • https://docs.python.org/3/library/logging.handlers.html#rotatingfilehandler
57. security - How can I reduce the verbosity of certain Ansible tasks to not leak passwords into syslog? - Server Fault 2017-04-22

    tags: configuration-management/ansible, linux, observability/logging, security/password

    [ permalink ]
58. git-log-compact – log --oneline with who & when 2017-04-02

    tags: command-line, observability/logging, source-code-management/git

    [ permalink ]
59. Graylog documentation 2017-02-18

    tags: linux, linux/container, linux/container/docker, observability/logging

    [ permalink ]

    • http://docs.graylog.org/en/latest/pages/gelf.html
    • https://www.graylog.org/

    via https://jpetazzo.github.io/2017/01/20/docker-logging-gelf/

60. Jenkins - Display Information About Nodes 2016-04-12

    tags: agent, build, continuous-integration, continuous-integration/jenkins, node, observability/logging, programming/groovy

    [ permalink ]

     1for (agent in hudson.model.Hudson.instance.slaves) {
     2  println('====================');
     3  println('Name: ' + agent.name);
     4  println('getLabelString: ' + agent.getLabelString());
     5  println('getNumExectutors: ' + agent.getNumExecutors());
     6  println('getRemoteFS: ' + agent.getRemoteFS());
     7  println('getMode: ' + agent.getMode());
     8  println('getRootPath: ' + agent.getRootPath());
     9  println('getDescriptor: ' + agent.getDescriptor());
    10  println('getComputer: ' + agent.getComputer());
    11  println('\tcomputer.isAcceptingTasks: ' + agent.getComputer().isAcceptingTasks());
    12  println('\tcomputer.isLaunchSupported: ' + agent.getComputer().isLaunchSupported());
    13  println('\tcomputer.getConnectTime: ' + agent.getComputer().getConnectTime());
    14  println('\tcomputer.getDemandStartMilliseconds: ' + agent.getComputer().getDemandStartMilliseconds());
    15  println('\tcomputer.isOffline: ' + agent.getComputer().isOffline());
    16  println('\tcomputer.countBusy: ' + agent.getComputer().countBusy());
    17  //if (agent.name == 'NAME OF NODE TO DELETE') {
    18  //  println('Shutting down node!!!!');
    19  //  agent.getComputer().setTemporarilyOffline(true,null);
    20  //  agent.getComputer().doDoDelete();
    21  //}
    22  println('\tcomputer.getLog: ' + agent.getComputer().getLog());
    23  println('\tcomputer.getBuilds: ' + agent.getComputer().getBuilds());
    24}