VirtualTam's bookmarks

1. Text normalization in Go 2024-11-28

   tags: ietf/rfc, programming/go, text/ascii, text/unicode

   [ permalink ]

   Standard library:

   • unicode - Data and functions to test some properties of Unicode code points

   Extra libraries:

   • golang.org/x/text - Supplementary Go packages for text processing, many involving Unicode
   • golang.org/x/text/runes - Tansforms for UTF-8 encoded text
   • golang.org/x/text/transform - Reader and writer wrappers that transform the bytes passing through
   • golang.org/x/text/unicode/norm - Types and functions for normalizing Unicode strings
   • golang.org/x/text/unicode - Building blocks for other packages in golang.org/x/text

   Third-party libraries:

   • anyascii/go - Converts Unicode characters to their best ASCII representation

   RFCs:

   • RFC 8264 - PRECIS Framework: Preparation, Enforcement, and Comparison of Internationalized Strings in Application Protocols
   • RFC 8265 - PRECIS for Usernames and Passwords
   • RFC 8266 - PRECIS for Nicknames

   Resources:

   • Unicode - General Category Property
   • Diacritic
   • Unicode Equivalence
   • Unicode Equivalence - Normal Forms
   • When to use Unicode Normalization Forms NFC and NFD?
   • Remove diacritics using Go
2. Dealing with Human Language | Elasticsearch: The Definitive Guide [2.x] 2017-10-01

   tags: engine, language, natural, observability/elastic/elasticsearch, processing, search

   [ permalink ]

   • https://www.elastic.co/guide/en/elasticsearch/guide/current/language-intro.html
   • https://www.elastic.co/guide/en/elasticsearch/guide/current/identifying-words.html
   • https://www.elastic.co/guide/en/elasticsearch/guide/current/token-normalization.html
   • https://www.elastic.co/guide/en/elasticsearch/guide/current/stemming.html
   • https://www.elastic.co/guide/en/elasticsearch/guide/current/stopwords.html
   • https://www.elastic.co/guide/en/elasticsearch/guide/current/synonyms.html
   • https://www.elastic.co/guide/en/elasticsearch/guide/current/fuzzy-matching.html
3. Music Theory for Musicians and Normal People 2016-09-20

   tags: comics, music, theroy

   [ permalink ]
4. How can I normalize audio using ffmpeg? 2016-02-09

   tags: audio, ffmpeg, normalize, peak, track, volume

   [ permalink ]

   Python wrapper:

   • https://github.com/slhck/audio-normalize
   • https://pypi.python.org/pypi/ffmpeg-normalize
5. xkcd: Keyboard Mash 2015-05-28

   tags: keyboard, solitaire, spider, typo

   [ permalink ]

   I'm a normal human, typing with my human hands

6. DRY Principle: Don't Repeat Yourself 2014-12-17

   tags: code, development, duplication, factorize, maintenance, normalize, programming

   [ permalink ]

   "Every piece of knowledge must have a single, unambiguous, authoritative representation within a system."

   The opposite is WET:

   We
   Edit
   Terribly, Tumultuously, Tempestuously, Tenaciously, Too much, Timidly, Tortuously, Terrifiedly... 
   

   > I think WET also stands for "We Enjoy Typing" // DuncanBayne