VirtualTam's bookmarks

1. elastic-integration-corpus-generator-tool - Generate an event corpus given a specific integration 2024-05-15

   tags: observability/elastic/elasticsearch, observability/logging, programming/go, programming/json

   [ permalink ]

   • quickwit-oss/benchmarks/tree/main/scripts/create-generated-log-dataset
2. Elasticsearch - Grok processor 2023-11-19

   tags: observability/elastic/elasticsearch, observability/elastic/logstash, observability/logging, programming/go, programming/java, programming/regular-expressions, programming/rust

   [ permalink ]

   • Elastic - Grokking Grok
   • Kibana - Debug grok expressions
   • Grok Constructor
   • Elasticsearch Grok Patterns
   • Logstash Grok Patterns

   Alternative implementations:

   • vjeantet/grok - Simple library to use/parse grok patterns with Go
     • GuanceCloud/grok - Fork of the above
     • logrusorgru/grokky - Pure golang grok-like library
     • Telegraf's Grok Parser Plugin
   • Vector Remap Language - Datadog Grok Parser
3. Vector - A lightweight, ultra-fast tool for building observability pipelines 2022-02-01

   tags: linux, observability/elastic/elasticsearch, observability/logging/grafana-loki, observability/metrics, observability/time-series/prometheus, syslog

   [ permalink ]
4. testssl.sh-masscan: Make TLS/SSL security mass scans with testssl.sh and import results into ElasticSearch 2021-11-14

   tags: cryptography/certificate, cryptography/certificate-authority, network/http, network/tcp, network/transport-layer-security, observability/elastic/elasticsearch

   [ permalink ]
5. Open Distro for Elasticsearch | Open Distro 2020-12-20

   tags: cloud, cloud/aws, machine-learning, observability/elastic/elasticsearch, observability/logging, observability/tracing, programming/java, security/authentication, security/authorization

   [ permalink ]

   • https://github.com/opendistro-for-elasticsearch
   • https://aws.amazon.com/blogs/aws/new-open-distro-for-elasticsearch/
   • https://opendistro.github.io/for-elasticsearch/blog/releases/2020/12/announcing-trace-analytics/
   • https://logz.io/blog/open-distro-for-elasticsearch/
6. container.training: Slides and code samples for training, tutorials, and workshops about containers. 2018-05-07

   tags: cloud, linux, linux/container, linux/container/docker, linux/container/kubernetes, observability/elastic/elasticsearch, training

   [ permalink ]
7. elasticsearch - Logstash CSV filter not parsing JSON - Stack Overflow 2018-03-29

   tags: observability/elastic, observability/elastic/logstash, programming/csv, programming/json

   [ permalink ]

   • https://www.elastic.co/guide/en/logstash/6.2/plugins-filters-csv.html#plugins-filters-csv-quote_char
8. Elapsed filter plugin | Logstash Reference 2018-03-26

   tags: date, observability/elastic, observability/elastic/logstash, observability/logging, time

   [ permalink ]

   • https://github.com/logstash-plugins/logstash-filter-elapsed
   • https://stackoverflow.com/questions/29020545/logstash-elapsed-filter
   • https://stackoverflow.com/questions/21902423/how-to-create-query-which-can-calculate-time-difference
9. Searching for Emoji Characters / Unicode - Elasticsearch - Discuss the Elastic Stack 2018-03-15

   tags: observability/elastic, observability/elastic/elasticsearch, text/unicode

   [ permalink ]

   • Unicode text segmentation - https://unicode.org/reports/tr29/
   • Unicode emoji - https://unicode.org/reports/tr51/#Searching
   • https://jolicode.com/blog/search-for-emoji-with-elasticsearch
10. Collecting and analysing network flow data with Elastic Stack by Robert Cowart 2018-02-28

    tags: network/http, observability/elastic, observability/elastic/elasticsearch, observability/elastic/kibana, observability/elastic/logstash, observability/logging, server

    [ permalink ]
11. We’re Opening X-Pack | Elastic 2018-02-28

    tags: observability/elastic, security, security/authentication

    [ permalink ]

    • https://www.elastic.co/blog/heya-elastic-stack-and-x-pack
    • https://www.elastic.co/blog/doubling-down-on-open
    • https://twitter.com/bluxte/status/968675301499654144
    • https://www.elastic.co/blog/opening-x-pack-phase-1-complete
12. magnusbaeck/logstash-filter-verifier 2018-02-12

    tags: linux, observability/elastic/logstash, parser, programming/go, programming/testing

    [ permalink ]

    • https://github.com/magnusbaeck/logstash-filter-verifier/releases
    • https://discuss.elastic.co/t/testing-your-logstash-configuration/53061
    • https://discuss.elastic.co/t/logstash-configuration-file-unit-testing/88450
    • https://discuss.elastic.co/t/testing-and-benchmarking-log-collection-pipeline/42942
    • https://bugs.archlinux.org/task/56039
    • https://wiki.archlinux.org/index.php/Java
13. Configuration and patterns rspec tests on LogStash v1.4 | It's all bullshit 2018-02-12

    tags: observability/elastic/logstash, observability/logging, parser, programming/ruby, programming/testing

    [ permalink ]

    • https://jsosic.wordpress.com/2015/12/13/rspec-tests-on-logstash-v1-5-and-v1-5/
14. RSpec is no longer bundled · Issue #6479 · elastic/logstash · GitHub 2018-02-12

    tags: observability/elastic, observability/elastic/logstash, parser, programming/ruby, programming/testing

    [ permalink ]

    • https://github.com/elastic/logstash/issues/5666
    • https://github.com/elastic/logstash/pull/5667
    • https://github.com/magnusbaeck/logstash-filter-verifier
    • https://github.com/elastic/logstash#testing
    • https://discuss.elastic.co/t/how-to-run-rspec-tests-in-logstash-5-0-0/64895
    • http://rspec.info/
15. how to implement the unit or integration tests for logstash configuration? - Stack Overflow 2018-02-10

    tags: data, observability/elastic/logstash, parser, programming/java, programming/ruby, programming/testing, unit

    [ permalink ]

    • https://github.com/elastic/logstash/tree/master/spec
    • https://github.com/logstash-plugins
    • https://gquintana.github.io/2016/09/07/Testing-Logstash-configuration.html
    • https://github.com/gquintana/gquintana.github.io/tree/master/sources/2016-09-07-Testing-Logstash-configuration
16. Grok filter plugin | Logstash Reference | Elastic 2018-02-09

    tags: data, observability/elastic, observability/elastic/logstash, observability/logging, parser, programming/regular-expressions

    [ permalink ]

    • https://www.elastic.co/guide/en/logstash/current/field-extraction.html
    • https://www.elastic.co/guide/en/logstash/current/config-examples.html
    • https://github.com/logstash-plugins/logstash-patterns-core/blob/master/patterns/grok-patterns
    • https://logz.io/blog/logstash-grok/
    • https://github.com/elastic/logstash/issues/2965
17. Running a 400+ Node Elasticsearch Cluster - Meltwater Engineering Blog 2018-02-08

    tags: distributed-system/cluster, observability/elastic, observability/elastic/elasticsearch, performance

    [ permalink ]

    • https://www.reddit.com/r/elasticsearch/comments/7vo9lk/running_a_400_node_elasticsearch_cluster/
    • https://news.ycombinator.com/item?id=16316915
    • https://github.com/meltwater
18. Migrating a 130TB Cluster from Elasticsearch 2 to 5 in 20 Hours with 0 Downtime and a Rollback… 2018-01-31

    tags: data, database, distributed-system/cluster, index, observability/elastic, observability/elastic/elasticsearch, search

    [ permalink ]

    • https://thoughts.t37.net/how-we-reindexed-36-billions-documents-in-5-days-within-the-same-elasticsearch-cluster-cd9c054d1db8
    • https://thoughts.t37.net/how-we-upgraded-a-22tb-mysql-cluster-from-5-6-to-5-7-in-9-months-cc41b391895d
    • https://www.elastic.co/blog/hot-warm-architecture-in-elasticsearch-5-x
    • https://www.graylog.org/post/back-to-basics-using-a-hot-warm-elasticsearch-cluster
    • https://github.com/mraad/es-hot-warm
19. ELK Stack: Elasticsearch, Logstash, Kibana | Elastic 2018-01-29

    tags: fun, observability/elastic

    [ permalink ]

    It's more than a stack of elks... or is it?

20. Aggregating Container Logs | Installation and Configuration | OpenShift Origin Latest 2018-01-15

    tags: linux/container, observability/elastic, observability/logging, openshift

    [ permalink ]

    • https://blog.openshift.com/fluentd-enterprise/
    • https://www.fluentd.org/
    • https://www.elastic.co/guide/en/elasticsearch/client/curator/current/about.html