VirtualTam's bookmarks

1. Elasticsearch - Grok processor 2023-11-19

   tags: observability/elastic/elasticsearch, observability/elastic/logstash, observability/logging, programming/go, programming/java, programming/regular-expressions, programming/rust

   [ permalink ]

   • Elastic - Grokking Grok
   • Kibana - Debug grok expressions
   • Grok Constructor
   • Elasticsearch Grok Patterns
   • Logstash Grok Patterns

   Alternative implementations:

   • vjeantet/grok - Simple library to use/parse grok patterns with Go
     • GuanceCloud/grok - Fork of the above
     • logrusorgru/grokky - Pure golang grok-like library
     • Telegraf's Grok Parser Plugin
   • Vector Remap Language - Datadog Grok Parser
2. elasticsearch - Logstash CSV filter not parsing JSON - Stack Overflow 2018-03-29

   tags: observability/elastic, observability/elastic/logstash, programming/csv, programming/json

   [ permalink ]

   • https://www.elastic.co/guide/en/logstash/6.2/plugins-filters-csv.html#plugins-filters-csv-quote_char
3. Elapsed filter plugin | Logstash Reference 2018-03-26

   tags: date, observability/elastic, observability/elastic/logstash, observability/logging, time

   [ permalink ]

   • https://github.com/logstash-plugins/logstash-filter-elapsed
   • https://stackoverflow.com/questions/29020545/logstash-elapsed-filter
   • https://stackoverflow.com/questions/21902423/how-to-create-query-which-can-calculate-time-difference
4. Collecting and analysing network flow data with Elastic Stack by Robert Cowart 2018-02-28

   tags: network/http, observability/elastic, observability/elastic/elasticsearch, observability/elastic/kibana, observability/elastic/logstash, observability/logging, server

   [ permalink ]
5. magnusbaeck/logstash-filter-verifier 2018-02-12

   tags: linux, observability/elastic/logstash, parser, programming/go, programming/testing

   [ permalink ]

   • https://github.com/magnusbaeck/logstash-filter-verifier/releases
   • https://discuss.elastic.co/t/testing-your-logstash-configuration/53061
   • https://discuss.elastic.co/t/logstash-configuration-file-unit-testing/88450
   • https://discuss.elastic.co/t/testing-and-benchmarking-log-collection-pipeline/42942
   • https://bugs.archlinux.org/task/56039
   • https://wiki.archlinux.org/index.php/Java
6. Configuration and patterns rspec tests on LogStash v1.4 | It's all bullshit 2018-02-12

   tags: observability/elastic/logstash, observability/logging, parser, programming/ruby, programming/testing

   [ permalink ]

   • https://jsosic.wordpress.com/2015/12/13/rspec-tests-on-logstash-v1-5-and-v1-5/
7. RSpec is no longer bundled · Issue #6479 · elastic/logstash · GitHub 2018-02-12

   tags: observability/elastic, observability/elastic/logstash, parser, programming/ruby, programming/testing

   [ permalink ]

   • https://github.com/elastic/logstash/issues/5666
   • https://github.com/elastic/logstash/pull/5667
   • https://github.com/magnusbaeck/logstash-filter-verifier
   • https://github.com/elastic/logstash#testing
   • https://discuss.elastic.co/t/how-to-run-rspec-tests-in-logstash-5-0-0/64895
   • http://rspec.info/
8. how to implement the unit or integration tests for logstash configuration? - Stack Overflow 2018-02-10

   tags: data, observability/elastic/logstash, parser, programming/java, programming/ruby, programming/testing, unit

   [ permalink ]

   • https://github.com/elastic/logstash/tree/master/spec
   • https://github.com/logstash-plugins
   • https://gquintana.github.io/2016/09/07/Testing-Logstash-configuration.html
   • https://github.com/gquintana/gquintana.github.io/tree/master/sources/2016-09-07-Testing-Logstash-configuration
9. Grok filter plugin | Logstash Reference | Elastic 2018-02-09

   tags: data, observability/elastic, observability/elastic/logstash, observability/logging, parser, programming/regular-expressions

   [ permalink ]

   • https://www.elastic.co/guide/en/logstash/current/field-extraction.html
   • https://www.elastic.co/guide/en/logstash/current/config-examples.html
   • https://github.com/logstash-plugins/logstash-patterns-core/blob/master/patterns/grok-patterns
   • https://logz.io/blog/logstash-grok/
   • https://github.com/elastic/logstash/issues/2965
10. ELK Stack: Elasticsearch, Logstash, Kibana | Elastic 2018-01-29

    tags: fun, observability/elastic

    [ permalink ]

    It's more than a stack of elks... or is it?

11. How to Setup FileBeat with Basic Auth for LogStash Output? - Filebeat - Discuss the Elastic Stack 2018-01-12

    tags: cryptography/certificate, cryptography/certificate-authority, network/transport-layer-security, observability/elastic, observability/elastic/beats, observability/elastic/logstash, security, security/authentication

    [ permalink ]

    • https://github.com/logstash-plugins/logstash-input-beats/issues/8
    • https://www.elastic.co/guide/en/logstash/current/plugins-inputs-beats.html
    • https://www.elastic.co/guide/en/beats/filebeat/master/config-filebeat-logstash.html
    • https://www.elastic.co/guide/en/beats/filebeat/current/configuring-ssl-logstash.html
    • https://www.gilesorr.com/blog/elkbeats-beats-secure.html
    • https://discuss.elastic.co/t/beats-logstash-security-use-of-security-token-to-authenticate-clients/104981/4
    • https://stackoverflow.com/questions/40341664/how-to-configure-logstash-and-filebeat-ssl-communication
12. How to Monitor HAProxy with the ELK Stack - Logz.io 2018-01-08

    tags: network/http, network/http-server/haproxy, observability/elastic, observability/elastic/logstash, observability/logging, server

    [ permalink ]

    • https://logz.io/learn/complete-guide-elk-stack/
    • https://app.logz.io/#/dashboard/apps?q=haproxy
    • https://cbonte.github.io/haproxy-dconv/1.8/configuration.html#8
13. ELK Hello World Example 2017-10-02

    tags: dashboard, data-mining, observability/elastic/elasticsearch, search-engine

    [ permalink ]

    • https://oliverveits.wordpress.com/2016/11/17/logstash-hello-world/
    • https://oliverveits.wordpress.com/2016/11/18/elasticsearch-hello-world-example/
    • https://oliverveits.wordpress.com/2016/11/20/kibana-hello-world-example/
14. What are the pros and cons of LogStash versus Fluentd? 2017-10-02

    tags: collection, fluentd, observability/elastic, observability/elastic/logstash, observability/logging, programming/c, programming/java, programming/ruby

    [ permalink ]

    • https://sematext.com/blog/2016/09/13/logstash-alternatives/
    • https://logz.io/blog/fluentd-logstash/
    • https://github.com/repeatedly/fluent-plugin-beats
    • https://www.fluentd.org/guides/recipes/elasticsearch-and-s3
    • https://docs.fluentd.org/v1.0/articles/out_elasticsearch
    • https://dzone.com/articles/kubernetes-log-analysis-with-fluentd-elasticsearch
15. How to Use Elasticsearch, Logstash, and Kibana to Manage Apache Logs 2017-09-30

    tags: network/http-server/apache-httpd, observability/elastic/elasticsearch, observability/elastic/logstash, observability/logging

    [ permalink ]

    • https://www.elastic.co/guide/en/logstash/master/config-examples.html
    • https://github.com/logstash-plugins/logstash-patterns-core/blob/master/patterns/httpd
    • https://discuss.elastic.co/t/apache-error-logs-timestamp/82010/9
    • https://discuss.elastic.co/t/parsing-apache-logs-combinedapachelog-commonapachelog-not-working/82007
    • http://www.thegeekstuff.com/2014/12/logstash-setup/
16. GitHub - elastic/stack-docker: Meta-project for the Elastic Docker images. 2017-09-30

    tags: data, engine, linux/container/docker, observability/elastic/elasticsearch, observability/elastic/kibana, observability/elastic/logstash, search

    [ permalink ]

    • https://github.com/deviantony/docker-elk