VirtualTam's bookmarks

1. ast-grep - Command-line tool for structural code search & rewrite 2024-10-30

   tags: abstract-syntax-tree, command-line, parser, programming/rust

   [ permalink ]

   • ast-grep/ast-grep
2. Crowdsec - Curated Threat Intelligence Powered by the Crowd 2024-05-29

   tags: bsd, linux/iptables, network/firewall, observability/logging, programming/go

   [ permalink ]

   • crowdsecurity/crowdsec
   • Documentation
     • Docker / Podman Deployment
     • Data Sources
     • Parsers
     • Configuration
     • Observability / Prometheus
     • OpenAPI Specification
   • Blog
     • Building a Network for Small Businesses Part 1: Hardware
     • Building a Network for Small Businesses Part 2: Running Configurations
     • Building a Network for Small Businesses Part 3: Attack Scenarios
   • Discussion on HN (2020)
3. postgres_lsp - Language Server for PostgreSQL 2023-12-08

   tags: database/postgresql, programming-language, programming/sql

   [ permalink ]

   • Postgres Language Server: implementing the Parser
   • Hacker News announcement thread
4. Elasticsearch - Grok processor 2023-11-19

   tags: observability/elastic/elasticsearch, observability/elastic/logstash, observability/logging, programming/go, programming/java, programming/regular-expressions, programming/rust

   [ permalink ]

   • Elastic - Grokking Grok
   • Kibana - Debug grok expressions
   • Grok Constructor
   • Elasticsearch Grok Patterns
   • Logstash Grok Patterns

   Alternative implementations:

   • vjeantet/grok - Simple library to use/parse grok patterns with Go
     • GuanceCloud/grok - Fork of the above
     • logrusorgru/grokky - Pure golang grok-like library
     • Telegraf's Grok Parser Plugin
   • Vector Remap Language - Datadog Grok Parser
5. astpath: A command-line search utility for Python ASTs using XPath syntax. 2022-08-02

   tags: command-line, parser, programming/python

   [ permalink ]
6. Analyzing One Million robots.txt Files 2022-06-19

   tags: parser, programming/c++, programming/python, robots.txt

   [ permalink ]

   • https://docs.python.org/3/library/urllib.robotparser.html
   • https://github.com/scrapy/scrapy/issues/3656
   • https://github.com/scrapy/scrapy/issues/5226
   • https://github.com/seomoz/reppy
   • https://github.com/seomoz/reppy/issues/132
7. Using Rust with Elixir for code reuse and performance 2021-08-19

   tags: parser, performance, programming/elixir, programming/markdown, programming/rust

   [ permalink ]
8. simdjson: Parsing gigabytes of JSON per second 2019-12-31

   tags: data, file, parser, performance, programming/c++, programming/json

   [ permalink ]

   • https://arxiv.org/abs/1902.08318
   • https://branchfree.org/2019/02/25/paper-parsing-gigabytes-of-json-per-second/
9. hyperscan: High-performance regular expression matching library 2019-12-31

   tags: intel, parser, performance, programming/json, programming/regular-expressions, security

   [ permalink ]

   • https://www.hyperscan.io
   • https://github.blog/2018-10-17-behind-the-scenes-of-github-token-scanning/
   • https://www.hyperscan.io/2017/06/20/regex-set-scanning-hyperscan-re2set/
10. Let's build a compiler 2019-11-08

    tags: grammar, parser, pascal, security/token, text

    [ permalink ]

    • https://compilers.iecc.com/crenshaw/
11. A look at Go lexer/scanner packages - Fatih Arslan 2019-11-07

    tags: data, grammar, parser, programming/go, security/token, text

    [ permalink ]

    • https://medium.com/@farslan/hcl-parser-family-in-pure-go-86589a5648fb
    • https://github.com/hashicorp/hcl/pull/45
12. “What is this s#*t?!” → assertchris.io 2019-01-21

    tags: network/http, programming/html, programming/php, programming/xml, websocket

    [ permalink ]

    • https://github.com/preprocess/pre-phpx
    • https://github.com/preprocess/example-phpx-live
    • https://github.com/nikic/PHP-Parser
    • https://github.com/marcioAlmada/yay
    • http://calebporzio.com/proof-of-concept-phoenix-liveview-for-laravel/
13. python-sqlparse - a non-validating SQL parser module for Python 2018-10-21

    tags: database, database/mariadb, database/mysql, database/postgresql, database/sqlite, parser, programming/python, programming/sql

    [ permalink ]

    • https://github.com/andialbrecht/sqlparse
14. Parsing command line arguments using a finite state machine and backtracking 2018-09-24

    tags: finite-state-machine, parser, programming/go

    [ permalink ]

    • https://jawher.me/2013/08/19/creation-langage-programmation-litil-3-2-recursive-descent-parsing/
15. ldetool - line data extraction tool 2018-09-24

    tags: finite-state-machine, grammar, parser, programming/go

    [ permalink ]

    • https://www.reddit.com/r/golang/comments/6xsghz/fast_log_parsing_with_go/
    • https://github.com/sirkon/ldetool
    • https://github.com/sirkon/ldetool/blob/master/TOOL_RULES.md
16. Ragel State Machine Compiler 2018-09-24

    tags: compiler, finite-state-machine, parser

    [ permalink ]

    • https://www.reddit.com/r/golang/comments/6xsghz/fast_log_parsing_with_go/
    • https://www.reddit.com/r/golang/comments/302o4r/fsm_a_lightweight_state_machine/
17. Parsing with ANTLR 4 and Go 2018-09-23

    tags: antlr, grammar, parser, programming/go

    [ permalink ]

    • https://github.com/antlr/antlr4/tree/master/runtime/Go/antlr
    • https://github.com/antlr/antlr4/blob/master/doc/go-target.md
18. Regular-Expressions.info - Regex Tutorial, Examples and Reference - Regexp Patterns 2018-09-23

    tags: parser, programming/regular-expressions, text

    [ permalink ]
19. Text generation with context-free grammars in Python 2018-04-28

    tags: generation, grammar, natural-language-processing, programming/python, text

    [ permalink ]

    • https://en.wikipedia.org/wiki/Context-free_grammar
    • https://en.wikipedia.org/wiki/Recursive_transition_network
    • https://eli.thegreenplace.net/2010/01/28/generating-random-sentences-from-a-context-free-grammar/
    • http://davidsd.org/2009/01/the-real-theorem-generator-a-context-free-grammar/
    • https://www.reddit.com/r/Python/comments/1h5ucz/defining_a_contextfree_grammar_easily/
    • https://stackoverflow.com/questions/4543008/efficient-context-free-grammar-parser-preferably-python-friendly
    • http://nltk.sourceforge.net/doc/en/ch07.html#formalizing-context-free-grammars
    • https://stackoverflow.com/questions/17695611/nltk-context-free-grammar-genaration
20. magnusbaeck/logstash-filter-verifier 2018-02-12

    tags: linux, observability/elastic/logstash, parser, programming/go, programming/testing

    [ permalink ]

    • https://github.com/magnusbaeck/logstash-filter-verifier/releases
    • https://discuss.elastic.co/t/testing-your-logstash-configuration/53061
    • https://discuss.elastic.co/t/logstash-configuration-file-unit-testing/88450
    • https://discuss.elastic.co/t/testing-and-benchmarking-log-collection-pipeline/42942
    • https://bugs.archlinux.org/task/56039
    • https://wiki.archlinux.org/index.php/Java