User:Pytony/Home Server Journey

Home Server Journey

Day 0

I am thinking about setting up a local server that would mainly serve as a NAS but also provide some other services I could reach at home or from my office or anywhere else. I also would like to use it as a media center to bind any audio source (jack, bluetooth, inner storage, USB peripherals, network, ...) to the amplifier. Most services (especially those I'm not gonna be the only user) would be controllable via a mobile-friendly web interface.

This is the base idea for this beginning journey. :)

Day 1

Time to find the hardware... My main criteria were the price, the size of the case and power consumption. In order to satisfy these criteria I decided to look for a mini-ITX motherboard with integrated CPU and supplied through ATX. My other criteria for the motherboard were:

• At least 1 HDMI output (ideally 2)
• At least 1 optical S/PDIF output
• At least 4 SATA III ports (ideally 6)
• At least 1 Ethernet 1Gbps controller
• Ideally some PCI slots
• Ideally hardware RAID support

Originally, I chose the ASRock N3700-ITX but it was not in stock and procurement was unknown. I decided to wait but finally I found the ASRock N3150-ITX which was $30 cheaper and very close to my original choice. One thing I especially appreciated with these motherboards is that the processor is fanless, which I think is good for power consumption and silence.

For this kind of server I don't think RAM is essential so I just took 2×2GB Crucial CT25664BF160B.

For the storage, I first thought about 3 or 4 HDD in RAID 5 or 6. But I remembered my price criteria and decided to start with 1×2To HDD and add some more in the future. I chose WD Green WD20EZRX (mainly because there was $20 off as it was a reconditioned product).

I wanted a silent modular 350-450W power supply at least 80Plus Gold certified. The choice was quite limited and I found myself with a Corsair CS450M.

Finally, I looked for a small case, ideally white in order to break with all that black furniture and stuff in my living room, and not ugly. My choice fell on a Cooler Master Elite 120 Advanced white.

Day 2

My excitation when I received all that stuff quickly dissipated when I realized the stand-off screws were missing in the case. Without them I was unable to set up the motherboard.

Day 3

A week later I received the missing screws I had requested. Still I could assemble my server. I originally planned a fanless system, but I noticed there were two fans in the case, so I plugged them, just in case.

The first time I turned on the computer, nothing happened. :( When checking again the cable connections, I noticed I plugged the system panel header on the COM port header by mistake while I rearranged the cables in the case. Fortunately this didn't damage any component, and everything worked fine the second time I turned on the computer.

Day 4

Now it's time to install the best GNU/Linux distribution in the world: Funtoo. =)

I wanted to try ZFS and build my own initramfs for the first time. But I also wanted to get it working as soon as possible. So I decided to stick with the ZFS Install Guide and use genkernel to configure the kernel and initramfs. Knowing that this doesn't prevent me from building alternate kernel/initramfs later.

Bleh, got a kernel panic after reboot. =( I think there is a couple of things I've done wrong:

• I didn't boot sysresccd via UEFI, though I partitioned my disk using `gdisk`
• I didn't care about this warning "Today is 2015-05-12. ZFS has undertaken an upgrade - from 0.6.3 to 0.6.4. Please ensure that you use a RescueCD with ZFS 0.6.3."
• I didn't care about this warning "When booting into the ISO, Make sure that you select the "Alternate 64 bit kernel (altker64)".".

So let's try again with funtoo-stable-hardened/pure64/generic_64-pure64 stage3 (nothing related to the kernel panic here, but I think this will be better than what I originally chose (funtoo-current/pure64/intel64-silvermont-pure64)).

And... it failed again. :) grub-install: error: cannot find EFI directory. I didn't to extensive researches about this error, I'm pretty sure this is due to something I've done wrong in the beginning. So I'm gonna start again. However I'll first try to do a "standard" installation. I thought about using LVM instead of ZFS (I also learned ZFS is a bit greedy in terms of RAM, so this is probably better anyway), but there is a couple of things that I am not used to: UEFI installation, initramfs, use of genkernel to build a kernel, ... I think the first thing to do is successfully building a system booting with UEFI.

Day 5

OK, standard install worked with UEFI. I accidentally made /boot partition ext2 instead of vfat, fortunately it was quite easy to fix afterwards. I think it's one of the mistakes I made in the previous installs. So let's try again taking especially care about UEFI things.

I made a 500MB EFI partition and all space left for ZFS:

Disk /dev/sda: 3907029168 sectors, 1.8 TiB
Logical sector size: 512 bytes
Disk identifier (GUID): E2066145-69F3-46DD-8329-6DC3D3094EB2
Partition table holds up to 128 entries
First usable sector is 34, last usable sector is 3907029134
Partitions will be aligned on 2048-sector boundaries
Total free space is 2014 sectors (1007.0 KiB)

Number  Start (sector)    End (sector)  Size       Code  Name
   1            2048         1026047   500.0 MiB   EF00  EFI System
   2         1026048      3907029134   1.8 TiB     BF00  Solaris root

And here is how I partitioned the system:

root@sysresccd /root % mkfs.vfat -F 32 /dev/sda1
mkfs.fat 3.0.22 (2013-07-19)
root@sysresccd /root % zpool create -f -o ashift=12 -o cachefile=/tmp/zpool.cache -O normalization=formD -m none -R /mnt/funtoo toast /dev/sda2
root@sysresccd /root % zfs create -p toast/funtoo
root@sysresccd /root % cd /mnt
root@sysresccd /mnt % zfs create -o mountpoint=/ toast/funtoo/root
root@sysresccd /mnt % zfs create -o mountpoint=/home toast/funtoo/home
root@sysresccd /mnt % zfs create toast/swap -V 8G -b 4K
root@sysresccd /mnt % mkswap /dev/toast/swap
Setting up swapspace version 1, size = 8388604 KiB
no label, UUID=dffed32f-f0f0-4e9c-b405-9a82b1e30805
root@sysresccd /mnt % swapon /dev/toast/swap
root@sysresccd /mnt % zfs create -o mountpoint=/opt toast/funtoo/opt
root@sysresccd /mnt % zfs create -o mountpoint=/usr toast/funtoo/usr
root@sysresccd /mnt % zfs create -o mountpoint=/var toast/funtoo/var
root@sysresccd /mnt % zfs create -o mountpoint=/tmp toast/funtoo/tmp
root@sysresccd /mnt % zfs create -o mountpoint=/var/tmp toast/funtoo/var/tmp
root@sysresccd /mnt % zfs create -o mountpoint=/var/portage/distfiles toast/funtoo/var/portage-distfiles
root@sysresccd /mnt % zfs create -o mountpoint=/var/portage/packages toast/funtoo/var/portage-packages
root@sysresccd /mnt % cd funtoo
root@sysresccd /mnt/funtoo % chmod 1777 var/tmp
root@sysresccd /mnt/funtoo % chmod 1777 tmp

Obivously, not to forget the fstab:

   /etc/fstab

# <fs>                  <mountpoint>    <type>          <opts>          <dump/pass>

/dev/sda1               /boot           vfat            defaults        0 2
/dev/zvol/toast/swap    none            swap            defaults        0 0

And still kept funtoo-stable-hardened/pure64/generic_64-pure64 build.

Let's run emerge -uDN --with-bdeps=y @world && genkernel kernel --no-clean --no-mountboot && emerge zfs and go to sleep. :)

Day 6

Reboot... And... it worked :D Except that I forgot to setup my keymap and I had to type my password in qwerty while my keyboard is azerty. :P

I ran into troubles installing samba server. I didn't know if I should user security = user or security = share. Default was user (as well as most docs) but all docs mentioned smbpasswd utility to create new users, which was not provided by portage. Using share I could use smbclient to login but was unable to mount CIFS partitions. Finally, I figured out security=share was deprecated, so I duckducked "gentoo smbpassword" and found I had to use pdbedit rather than smbpasswd. Now it works fine.

Day 7

Today I tried to figure out how to control the fans. Unfortunately I could not find how to set fan speed from sysfs. On my other computer, I can do it within /sys/class/hwmon/hwmon3/pwm[1-3]. Unfortunately I have no such file available on the sysfs of my server. Maybe a missing configuration in the kernel, but this is the default debian-sources configuration. I would rather say my motherboard do not provide such interface to the OS. In the BIOS, I can configure the fans speed (from level 1 to level 9) but not turn them off. :/

I monitored the temperature in normal usage and full CPU usage. With both fans at lowest speed level, the CPUs temperature stays between 30 and 40°C. When running a compilation that requires all processors working at 100%, the temperature rarely raises above 50°C. So I think I can remove both fans. I will try to do so, and keep monitoring the temperature.

Day 8

Time to get interested in ZFS properties... Oops, I just noticed I created datasets for /var/portage/{distfiles,packages} rather than /usr/portage/{distfiles,packages}.

Let's change this :

root # zfs rename toast/funtoo/var/portage-distfiles toast/funtoo/usr/portage-distfiles
root # zfs rename toast/funtoo/var/portage-packages toast/funtoo/usr/portage-packages
root # zfs set mountpoint=/usr/portage/packages toast/funtoo/usr/portage-packages
root # zfs set mountpoint=/usr/portage/distfiles toast/funtoo/usr/portage-distfiles
cannot mount '/usr/portage/distfiles': directory is not empty
property may be set but unable to remount filesystem
root # mkdir /tmp/usr-portage-distfiles
root # mv /usr/portage/distfiles/* /tmp/usr-portage-distfiles
root # zfs mount toast/funtoo/usr/portage-distfiles
root # mv /tmp/usr-portage-distfiles/* /usr/portage/distfiles
root # zfs list
NAME                                 USED  AVAIL  REFER  MOUNTPOINT
toast                               21.0G  1.76T   136K  none
toast/funtoo                        12.5G  1.76T   136K  none
toast/funtoo/home                    248K  1.76T   248K  /home
toast/funtoo/opt                     136K  1.76T   136K  /opt
toast/funtoo/root                    250M  1.76T   250M  /
toast/funtoo/tmp                     160K  1.76T   160K  /tmp
toast/funtoo/usr                    12.2G  1.76T  12.2G  /usr
toast/funtoo/usr/portage-distfiles   136K  1.76T   136K  /usr/portage/distfiles
toast/funtoo/usr/portage-packages    136K  1.76T   136K  /usr/portage/packages
toast/funtoo/var                    76.2M  1.76T  69.3M  /var
toast/funtoo/var/tmp                6.84M  1.76T  6.84M  /var/tmp
toast/swap                          8.50G  1.77T  1.32G  -

I also noticed there is a way to share datasets through samba. I tried to set up this feature but I couldn't get it work. I also ran into troubles trying to set default file mode to 0660 and directory mode to 0770 on samba shared folders. My personal station keeps creating files with mode 0640 and directories with mode 0750. This is really annoying that group does not have write access on a shared folder and setting umask in my zshrc is not satisfying either. I tried to setup ACL on the shared folder, but I can't get ACL working on the client side. I think I'll have to learn more about ACL and try again later.