Docker Media Server 2018

This guide will step you through installing Ubuntu server 16.04 and several home media applications. We will use docker-compose which to give us the power and flexibility to keep our new server up to date and rock solid.

We will be installing the following applications.

Media Servers and Services

• Sabnzb - https://sabnzbd.org/
• Hyrdra - https://github.com/theotherp/nzbhydra
• Sonarr - https://sonarr.tv/
• Plex - https://www.plex.tv/
• Plexpy - https://github.com/JonnyWong16/plexpy
• OMBI - https://github.com/tidusjar/Ombi
• MuxiMux - https://github.com/mescon/Muximux
• Mylar - https://github.com/evilhero/mylar

System Tools

• Influxdb - https://www.influxdata.com/
• Grafana - https://grafana.com/
• Portainer - https://portainer.io/

Tutorial Walkthrough

Ubuntu

Install Ubuntu server

• Download the 16.04 Server ISO from https://www.ubuntu.com/download
• Disconnect your media drives
• Boot into installer
• Chose: Install Ubuntu Server
• Step through the language settings pages
• Enter server name. (This is what your server will be called on the network)
• Enter user information (Remember it!!)
  • Do not encrypt the home directory
• Set your timezone
• Partition disks
  • Chose Guided - use entire disk (Data disks should be disconnected)
  • Check the output and choose yes to write changes to the disk.
• Configure the package manager.
  • Just hit enter
• Configuring taskel
  • Select the default to auto update
• Software selection - Select the following packages
  • Samba file server
  • Standard system utilities
  • OpenSSH server

Log into server

• Log into the server to get the IP address. Type ip a for your servers ip address. Or check your router to see what ip it was given.

• You can now log into your server via SSH using Bash in windows 10 ssh username@ip

ssh username@youripaddress

• Update and install upgrades

sudo apt update
sudo apt upgrade

Setting up BTRFS

• Shutdown the server and power off using the command sudo poweroff
• Install the data drives into the server and power up.
• Check if the disks are now visible t0 the system by issuing lsblk. You should see the disks. ex.
  • sdb
  • sdc
  • sdc
  • and so forth
• Create the mount point for the file system to live. In this tutorial I will use BigPurple as the name of the directory. Use what you wish to call it.

sudo mkdir /mnt/BigPurple

• Create the first BTRFS file structure

  sudo mkfs.btrfs -L “BigPurple” -f /dev/sdb

• Mount the drive. We will use the first available drive for the mount point. In my example it is sdb.

  sudo mount /dev/sdb /mnt/BigPurple

• Create the subvolume.

  • Change into the directory of the mount point.

  cd /mnt/BigPurple

  • Create the subvolume.

  sudo btrfs subvolume create BigPurple

  • Get out of the BigPurple directory by typing cd and hitting enter.

  • Unmount the drive.

  sudo umount /mnt/BigPurple

  • Remount the subvolum with these options.

  sudo mount -o compress=zlib,subvol=BigPurple,autodefrag /dev/sdb /mnt/BigPurple

• Adding other drives to the BTRFS file system.

  • Add all the remaing drives one by one. Do this for each drive untill they are all a part of the BigPurple filesystem

  sudo btrfs device add -f /dev/sdc /mnt/BigPurple

  • Check to see if all devices are listed.

  sudo btrfs filesystem show /mnt/BigPurple

• Convert the BTRFS to a Raid1 - Raid 1 will split your total storage by half but give you better redundancy.

  sudo btrfs filesystem balance start -dconvert=raid1 -mconvert=raid1 /mnt/BigPurple

• Setting up the FSTAB

  • We need to make sure the server mounts the drives on reboot.
  • Get the subvolume ID

  sudo btrfs subvolume list /mnt/BigPurple

  • Edit the /etc/fstab file

  sudo nano /etc/fstab

  • Add this line to the bottom of the fstab. Use the same mnt point we used before and make sure to use the correct subvol name. (That is all one line)

  /dev/sdb /mnt/BigPurple    btrfs  defaults,compress=zlib,subvolid=257,autodefrag 0 0
  

  • Save by hitting ctrl-x, say Y and enter
  • Reboot

  sudo reboot

  • Log back in and check that the volumes mounted correctly

  df -h
  sudo btrfs filesystem show /mnt/BigPurple

Installing Docker

• Follow the instructions here:

  • https://www.digitalocean.com/community/tutorials/how-to-install-and-use-docker-on-ubuntu-16-04

• Install docker-compose

  sudo apt install docker-compose

Installing the Server using Docker Compose

• Check out this repository to your /opt directory. Be sure to have the period/full stop, at the end of the git clone line.

  cd /opt
  sudo git clone https://github.com/NoobTaco/MediaServer2018.git .

• Set permissions

  sudo chown -R yourusername:yourusername /opt/*

• Edit the environments file to reflect your servers file locations, time zone and user ID.

  sudo nano /opt/.env

  • CONFIG_DIR - You should keep this pointing to /opt/appdata unless you edit the docker-compose.yml file to reflect changes
  • MEDIA - Set this to where you want your media files stored.
  • TZ - Set to your time zone.
  • PUID and PGID should be 1000 for your main user.

• Make edits to the docker-compose.yml file.

  • Make changes to the docker-compose file to reflect your server. You can comment out service blocks if you do not wish to use that service.

  nano /opt/docker-compose.yml

  • Save by hitting ctrl-x, say Y and enter

Starting the Server

Navigate to your /opt directory and issue the following command to start downloading and starting all the servers.

cd /opt
docker-compose up -d

You can check the status of your servers by issuing docker ps to list the running containers.

IMPORTANT!

Once docker-compose brings everything up you will need to set permissions and ownership of the data file structure for everything to work. I have not found a way to do this during the first run of the containers yet.

Issue the following command to allow all containers to use the data drive. Remember to use your directory names. Use your username instead of noobtaco.

sudo chown -R noobtaco:noobtaco /mnt/BigPurple
sudo chmod -R 777 /mnt/BigPurple

Configure your Servers and Services

Navigate to your services and configure them. I suggest this order.

Media Servers and Services

• Sabnzb - http://yourserverip:8080
• Hyrdra - http://yourserverip:5075
• Sonarr - http://yourserverip:8989
• Plex - http://yourserverip:32400/web
• Plexpy - http://yourserverip:8181
• OMBI - http://yourserverip:3579
• MuxiMux - http://yourserverip:7777
• Mylar - http://yourserverip:8090

System Tools

• Influxdb - Follow directions on how to create a database. Web interface is active. DO NOT EXPOSE!!
• Grafana - http://yourserverip:3000
• Portainer - http://yourserverip:9000

Update Your Server

There are 3 main areas that you will want to focus on updating on your new system.

• Ubuntu's operating system and applications.

  • Durring installation we chose to have the system update itself. However it never hurts to do a manual check every now and again.

  sudo apt update
  sudo apt upgrade

• Docker Containers

  • We can check for updates to container images by taking the server down then checking for updates.

  cd /opt
  docker-compose down
  docker-compose pull
  docker-compose up -d

• BTRFS File System

  • (Placeholder)