Setting up a Python Training Environment

I have recently started a crash course in Learning Python to brush up on my technical knowledge of the Language. I have made the following notes to help anybody starting out: The first thing that I did before starting the course was to set up a docker container to learn the language in to be Read more about Setting up a Python Training Environment[…]

Fixing Index limit exceeded in ELK

This is caused by the default Elasticsearch limit for an Index of 1000 total fields. Run the below command from the ELK server directly to increase this limit to 100000 Error in Logstash logs: [2018-04-04T16:38:46,241][WARN ][logstash.outputs.elasticsearch] Could not index event to Elasticsearch. {:status=>400, :action=>[“index”, {:_id=>nil, :_index=>”index-name”, :_type=>”doc”, :_routing=>nil}, #<LogStash::Event:0x25e996cf>], :response=>{“index”=>{“_index”=>”index-name”, “_type”=>”doc”, “_id”=>”h3OGkWIBjOPkI6XxYjvC”, “status”=>400, “error”=>{“type”=>”illegal_argument_exception”, “reason”=>”Limit Read more about Fixing Index limit exceeded in ELK[…]

Using Dropbox Docker Container

This page contains guides on using Dropbox within a Docker container on Ubuntu 14/16.04 (Not tested on other versions). It will use Docker and docker-compose so ensure these are installed first Script to Install Docker Ubuntu 14.04. Installing a Dropbox Docker Container This can be downloaded from: https://github.com/radio-astro/docker-dropbox/blob/master/docker-compose.yml but I have included one below using custom Read more about Using Dropbox Docker Container[…]

Clearing Docker Container Logs

Finding the large log file To identify the largest log file, run the below command (Based on a standard docker installation): for i in $(docker ps –format ‘{{.Names}}’); do j=$(docker inspect $i -f ‘{{.LogPath}}’); s=$(du -sh $j); echo “$i $s ($j)”; done This will show you the container name, log file size and location for Read more about Clearing Docker Container Logs[…]

Adding a new disk to a linux server without rebooting

This is most useful when using virtualisation platforms such as VMware, Hyper-V etc. When you have added your new disk to your Linux server from your Host, simply run the below command to pick up the new disk without restarting. for HOST in /sys/class/scsi_host/host*/scan; do echo “- – -” >  ${HOST}; done You can now Read more about Adding a new disk to a linux server without rebooting[…]

Downloading Subtitles for all media files on a Server

This guide is based on using CentOS 6 and running Python 2.7. Firstly, install Python 2.7 onto your server: yum install -y centos-release-SCL yum install -y python27 Now enable python27 via scl enable (This will launch a new bash session using the more recent Python version) – You will need to do this again if Read more about Downloading Subtitles for all media files on a Server[…]

Installing a Kubernetes Cluster from Scratch

This guide is based on having a 4 server setup (All running Ubuntu 16.04) with one Master and 3 additional Kubernetes nodes. These servers should all be on the same network, with all updates installed. In the following guide I have set up the following servers: ksm = Kubernetes Server Manager ks01 = Kubernetes Node Read more about Installing a Kubernetes Cluster from Scratch[…]