VirtualTam's bookmarks

21. How to setup a Docker Monitoring Prometheus stack 2018-09-20

    tags: linux/container/docker, observability, observability/grafana, observability/time-series/prometheus

    [ permalink ]

    • https://github.com/vegasbrianc/prometheus
    • https://www.brianchristner.io/updated-docker-monitoring-prometheus-grafana/
    • https://grafana.com/dashboards/179
22. kubespray: Setup a kubernetes cluster 2018-09-19

    tags: cloud, configuration-management/ansible, distributed-system/cluster, linux, linux/container/docker, linux/container/kubernetes

    [ permalink ]

    • https://github.com/kubespray
    • http://kubespray.io/
23. Scaling Docker with Kubernetes 2018-09-13

    tags: continuous-integration/jenkins, linux/container, linux/container/docker, linux/container/kubernetes, pipeline

    [ permalink ]

    • https://github.com/jenkinsci/kubernetes-plugin
    • https://github.com/jenkinsci/kubernetes-plugin/tree/master/examples
    • https://issues.jenkins-ci.org/browse/JENKINS-48421
    • https://www.blazemeter.com/blog/how-to-setup-scalable-jenkins-on-top-of-a-kubernetes-cluster
    • https://stackoverflow.com/questions/49988038/declarative-jenkins-pipeline-use-existing-kubernetes-pod-template
24. coturn TURN server project 2018-08-03

    tags: linux, media, network/address-translation, network/stun, network/turn, nextcloud, programming/c, video

    [ permalink ]

    • https://github.com/coturn/coturn/wiki/turnserver
    • https://www.linuxbabe.com/linux-server/install-coturn-turn-server-spreed-webrtc
    • https://webrtc.ventures/2017/08/quick-guide-stunturn-webrtc/
    • https://stackoverflow.com/questions/40583954/coturn-stun-works-but-turn-does-not-work
    • https://hub.docker.com/r/instrumentisto/coturn
    • https://help.nextcloud.com/t/howto-setup-nextcloud-talk-with-turn-server/30794
    • https://en.wikipedia.org/wiki/STUN
    • https://en.wikipedia.org/wiki/Traversal_Using_Relays_around_NAT
25. Load balancing and scaling Docker containers with Træfik 2018-07-18

    tags: linux/container/docker, network, network/http, network/proxy

    [ permalink ]

    Træfik options:

    • https://docs.traefik.io/configuration/backends/docker/
    • https://docs.traefik.io/configuration/commons/

    Relevant backend labels:

    • traefik.port
    • traefik.docker.network
    • traefik.backend.loadbalancer.method
    • traefik.backend.loadbalancer.stickiness

    Examples:

    • https://www.katacoda.com/courses/traefik/deploy-load-balancer

    Gateway timeout and overlay network setup:

    • https://github.com/containous/traefik/issues/979
    • https://github.com/containous/traefik/issues/1254
    • https://github.com/containous/traefik/issues/3599
26. MediaWiki Docker deployment 2018-06-28

    tags: documentation, linux/container/docker, linux/container/docker-compose, wiki

    [ permalink ]

    Docker images:

    • https://hub.docker.com/_/mediawiki/
    • https://hub.docker.com/r/wikimedia/mediawiki-node-services/
    • https://github.com/wikimedia/mediawiki-node-services
    • https://hub.docker.com/r/thenets/parsoid/
    • https://github.com/thenets/docker-parsoid
    • https://hub.docker.com/r/pastakhov/restbase/
    • https://github.com/pastakhov/docker-restbase

    Visual Editor:

    • https://www.mediawiki.org/wiki/VisualEditor
    • https://www.mediawiki.org/wiki/Extension:VisualEditor
    • https://www.mediawiki.org/wiki/Parsoid
    • https://www.mediawiki.org/wiki/Parsoid/Setup
    • https://www.mediawiki.org/wiki/RESTBase
    • https://www.mediawiki.org/wiki/RESTBase/Installation

    Compose examples:

    • https://github.com/pastakhov/compose-mediawiki-ubuntu
    • https://github.com/wikimedia/mediawiki-containers
27. docker_auth: Authentication server for Docker Registry 2 2018-06-26

    tags: linux/container/docker, network/ldap, network/transport-layer-security, security/authentication

    [ permalink ]

    • https://hub.docker.com/r/cesanta/docker_auth/
    • https://github.com/kwk/docker-registry-setup
    • https://docs.docker.com/registry/spec/auth/token/
28. https - How to run Gitlab in docker container with nginx-proxy over ssl with letsencrypt securely - Stack Overflow 2018-06-11

    tags: linux/container/docker, network/http, network/http-server/nginx, network/proxy, network/transport-layer-security, source-code-management/git, source-code-management/gitlab

    [ permalink ]

    Container setup:

    • https://gist.github.com/netdesk/c1db2985b542f9916995139318e5a7ce
    • https://hub.docker.com/r/jwilder/nginx-proxy/
    • https://hub.docker.com/r/jrcs/letsencrypt-nginx-proxy-companion/

    Gitlab settings:

    • https://docs.gitlab.com/omnibus/docker/
    • https://docs.gitlab.com/ce/administration/environment_variables.html
    • https://docs.gitlab.com/omnibus/settings/ssl.html
    • https://gitlab.com/gitlab-org/omnibus-gitlab/blob/master/files/gitlab-config-template/gitlab.rb.template

    Performance considerations:

    • https://docs.gitlab.com/omnibus/settings/memory_constrained_envs.html (skip the cgroups section for Gitaly as we are already running in a container)
    • https://docs.gitlab.com/ee/update/#gitaly-omnibus-gitlab-configuration-structure-change for Gitlab 16 changes to Gitaly configuration
29. Qt for Python - Qt Wiki 2018-05-07

    tags: programming/c++, programming/library, programming/python, user-interface, user-interface/qt

    [ permalink ]

    • https://blog.qt.io/blog/2018/04/13/qt-for-python-is-coming-to-a-computer-near-you/
    • https://blog.qt.io/blog/2018/05/04/hello-qt-for-python/
    • https://blog.qt.io/blog/2018/06/13/qt-python-5-11-released/
    • https://groups.google.com/forum/#!topic/pyside-dev/pqwzngAGLWE
    • https://codereview.qt-project.org/gitweb?p=pyside/pyside-setup.git;a=summary
30. Centos/RHEL 7 - Fix LVM boot issues after migration from ESXi to VirtualBox 2018-04-20

    tags: boot, bootloader/grub, filesystem, filesystem/lvm, fstab, linux, linux/centos, linux/kernel, linux/red-hat

    [ permalink ]

    Here are the steps I used to migrate a CentOS 7 VM from (presumably?) an ESXi server, to a local VirtualBox environment.

    The LVM volumes were not detected at boot, and after the boot timeout, the OS fell back to the Dracut emergency shell.

    • get a CentOS minimal installation CD
    • check the VM's resources and peripherals:
      • ensure there are no floppy drives (!)
      • setup CPU and RAM resources
      • check virtual drives
      • add an SCSI optical drive if needed
    • optional: convert the virtual drive images from VMDK to VDI
    • mount the CentOS installation disc
    • boot on the installation disc:
      • select "Troubleshooting", then "Rescue"
      • let the rescue utility detect filesystems and mountpoints
    • $ chroot to the detected environment
    • backup files:
      • /etc/fstab
      • /boot/grub/grub.cfg
    • under /boot, backup the initrd and initramfs for the current configuration (these will be overwritten)
    • compare the current /etc/fstab with the output of $ lsblk and $ blkid
    • if needed, manually edit /etc/fstab to use the appropriate block device UUIDs, identifiers and mountpoints
    • regenerate GRUB configuration:
      • $ grub2-mkconfig -o /boot/grub2/grub.cfg
    • if needed, reinstall GRUB:
      • $ grub-install /dev/sda
    • rebuild initrd:
      • $ mkinitrd --force /boot/<initrd_image> <kernel_version>
    • rebuild initramfs:
      • $ dracut --force <kernel_version>
    • exit the chroot
    • unmount the installation disc
    • reboot
    • optional but highly recommended: cross your fingers
    • ...
    • profit!
31. List of projects for development environment setup with Ansible, Vagrant and VirtualBox 2018-04-12

    tags: configuration-management/ansible, development, linux, tool, virtualization/vagrant, virtualization/virtualbox

    [ permalink ]

    • https://github.com/AlbanAndrieu/ansible-nabla
    • https://github.com/AlbanAndrieu/ansible-workstation
    • https://github.com/Benoth/ansible-ubuntu
    • https://github.com/carltonstedman/anarres
    • https://github.com/gantsign/development-environment
    • https://github.com/virtualtam/anarres
32. Linux - Network over USB (usbnet) 2018-04-03

    tags: ethernet, linux, microsoft/windows, network, raspberry-pi, usb

    [ permalink ]

    • http://www.linux-usb.org/usbnet/

    • http://www.davehylands.com/linux/gumstix/usbnet/

    • https://en.wikipedia.org/wiki/Ethernet_over_USB

    • https://superuser.com/questions/145933/how-to-add-usbnet-driver-to-the-linux-kernel#145944

    • https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/tree/drivers/net/usb/usbnet.c

    • https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/tree/drivers/net/usb/cdc_ether.c

    • https://www.systutorials.com/linux-kernels/tag/cdc_ether/

    • https://raspberrypi.stackexchange.com/questions/9636/usb-to-usb-mimicking-ethernet

    • https://www.raspberrypi.org/forums/viewtopic.php?f=36&t=131042

    • https://www.raspberrypi.org/forums/viewtopic.php?f=63&t=130810

    • https://www.raspberrypi.org/forums/viewtopic.php?p=865905#p865905

    • https://raspberrypi.stackexchange.com/questions/13917/raspberry-pi-communication-over-usb

    • http://wiki.openmoko.org/wiki/USB_Networking

    • http://www.webos-internals.org/wiki/USBnet_Setup

    • https://developer.ridgerun.com/wiki/index.php/How_to_use_USB_device_networking

    • http://www.ev3dev.org/docs/tutorials/connecting-to-the-internet-via-usb/

33. How to Setup FileBeat with Basic Auth for LogStash Output? - Filebeat - Discuss the Elastic Stack 2018-01-12

    tags: cryptography/certificate, cryptography/certificate-authority, network/transport-layer-security, observability/elastic, observability/elastic/beats, observability/elastic/logstash, security, security/authentication

    [ permalink ]

    • https://github.com/logstash-plugins/logstash-input-beats/issues/8
    • https://www.elastic.co/guide/en/logstash/current/plugins-inputs-beats.html
    • https://www.elastic.co/guide/en/beats/filebeat/master/config-filebeat-logstash.html
    • https://www.elastic.co/guide/en/beats/filebeat/current/configuring-ssl-logstash.html
    • https://www.gilesorr.com/blog/elkbeats-beats-secure.html
    • https://discuss.elastic.co/t/beats-logstash-security-use-of-security-token-to-authenticate-clients/104981/4
    • https://stackoverflow.com/questions/40341664/how-to-configure-logstash-and-filebeat-ssl-communication
34. How to Use Elasticsearch, Logstash, and Kibana to Manage Apache Logs 2017-09-30

    tags: network/http-server/apache-httpd, observability/elastic/elasticsearch, observability/elastic/logstash, observability/logging

    [ permalink ]

    • https://www.elastic.co/guide/en/logstash/master/config-examples.html
    • https://github.com/logstash-plugins/logstash-patterns-core/blob/master/patterns/httpd
    • https://discuss.elastic.co/t/apache-error-logs-timestamp/82010/9
    • https://discuss.elastic.co/t/parsing-apache-logs-combinedapachelog-commonapachelog-not-working/82007
    • http://www.thegeekstuff.com/2014/12/logstash-setup/
35. Which GPU(s) to Get for Deep Learning 2017-09-26

    tags: cuda, deep-learning, diy, gpu, linux, machine-learning

    [ permalink ]

    • https://medium.com/towards-data-science/building-your-own-deep-learning-box-47b918aea1eb
    • https://blog.slavv.com/the-1700-great-deep-learning-box-assembly-setup-and-benchmarks-148c5ebe6415
36. First time using multiple displays. What are some people's setup? : awesomewm 2017-09-06

    tags: screen, window-manager/awesome-wm

    [ permalink ]
37. Setup DKIM (DomainKeys) for Ubuntu, Postfix and Mailman - Ask Ubuntu 2017-08-30

    tags: cryptography/public-key-infrastructure, email, email/dkim, email/postfix, linux, signature

    [ permalink ]
38. Ansible | Setup SSH PKI authentication between two hosts 2017-08-22

    tags: configuration-management/ansible, cryptography/public-key-infrastructure, host, network/ssh, variable

    [ permalink ]

    • https://docs.ansible.com/ansible/latest/playbooks_conditionals.html#register-variables
    • https://docs.ansible.com/ansible/latest/authorized_key_module.html
    • https://stackoverflow.com/questions/25629933/ansible-copy-ssh-key-from-one-host-to-another#25644384
    • https://stackoverflow.com/questions/35808649/ansible-accessing-register-variables-from-other-plays-within-same-playbook
    • https://stackoverflow.com/questions/33896847/how-do-i-set-register-a-variable-to-persist-between-plays-in-ansible
    • https://serverfault.com/questions/638507/how-to-access-host-variable-of-a-different-host-with-ansible
    • https://github.com/ansible/ansible/issues/1934
39. Planning out my self-host setup for my 2.5TB of data - would love critique! : selfhosted 2017-07-13

    tags: cloud, data, linux, linux/container, linux/container/docker, network/http, network/transport-layer-security, self-hosting, virtualization/proxmox

    [ permalink ]
40. Ansible setup mysql root password - Stack Overflow 2017-06-26

    tags: configuration-management/ansible, database/mysql, security/password

    [ permalink ]

    • https://docs.ansible.com/ansible/mysql_user_module.html
    • https://docs.ansible.com/ansible/ini_file_module.html