The Funtoo Linux project has transitioned to "Hobby Mode" and this wiki is now read-only.
Difference between revisions of "Building a Kernel from Source"
| Line 150: | Line 150: | ||
Please see discussion page for listings of [[Talk:Building_a_Kernel_from_Source|sys-kernel]] <br /> | Please see discussion page for listings of [[Talk:Building_a_Kernel_from_Source|sys-kernel]] <br /> | ||
=== Preparing the kernel === | === Preparing the kernel === | ||
Revision as of 05:40, September 15, 2016
Setting up a proper kernel yourself - lean, mean and tailored to your hardware, is the challenge by which a linux user can graduate to becoming a Funtoo knight ;-)
Even though many of us are using enterprise-ready kernels in datacenters, there is almost nobody who hasn't at least considered building a kernel for his laptop / PC. We are showing here how an intermediate Linux user can use an alternative to the standard beginners "genkernel" approach, to compile a custom kernel, in a relatively speedy and easy set up.
Minimum Requirements
- Understand the command line
- Know where the kernel files are located
Assumptions
You start from an installed Funtoo system on the disk, or at least, you are on stage3 in a chrooted environment from a live cd, following somehow the Funto Installation Tutorial.
Less advanced version
Emerging the kernel sources
To begin, we have to figure out which kernel sources we will use. If you are unsure about which sources are available and what their benefits and drawbacks are, check out the Kernels page.
After you have made a decision as to which kernel you want to install, emerge it:
root # emerge sys-kernel/[kernel-name]
Portage will now go about installing the sources to /usr/src/. This is default directory, where kernel sources installed.
You may use
root # eselect kernel list
to display a list of kernels currently installed.
In case, you have more than one kernel installed, switching between them is easy with eselect. Below, we will choose the first kernel in the list. This step also creates /usr/src/linux symlink, which points to the actual directory with kernel sources inside /usr/src directory.
root # eselect kernel set 1
For example
oleg2 tmp # eselect kernel list Available kernel symlink targets: [1] linux-stable * oleg2 tmp # ls -l /usr/src total 4.0K drwxr-xr-x 26 root root 4.0K Aug 16 09:13 linux-stable/ lrwxrwxrwx 1 root root 13 Sep 9 03:22 linux -> linux-stable// oleg2 tmp #
Note that portage can also set this up for you automatically, if the "symlink" USE flag enabled for preferred kernel ebuild.
Configuring the kernel
Now that the kernel sources are on your system, you should configure them. To do this, change your directory to /usr/src/linux
root # cd /usr/src/linux
We are now in the kernel sources directory, next sanitize the sources:
this will delete your .config
root # make clean && make distclean && make mrproper
Copy configurations if you have previous configurations to copy:
root # cp /boot/config-3.13.7 .config
Notice, when updating to newer kernel, a copied config file is for older version of kernel! Run:
root # make oldconfig
This will provide an interactive menu, and a user asked to review newly added features, driver support and config changes. Do not dismiss this part. If no changes found between older and newer kernel configurations "oldconfig" script will write new .config in /usr/src/linux automatically. We can now run a script that allows us to modify the configuration. Run:
root # make menuconfig
or
root # make nconfig
here is where you insert kernel configs, or press / to search for kernel modules by name
While you edit the sources, keep the following in mind:
- To build something into your kernel, press y when you have it selected.
- To exclude something from your kernel, press n when you have it selected.
- To build something as a module, press m.
Things that you may need to include in your kernel:
as modules:
- Wireless/LAN drivers
- Support for your graphics card
- Support for your audio card
- Support for USB devices
as built in:
- scsi sata & or ata controllers
- file system
Many pages on the wiki will tell you the kernel requirements for the application that they are about. Keep your eyes open for the blue background, white text sections of pages. Like on this one: uvesafb
Building and installing the kernel sources
If you decided to use LZO compression in kernel settings, install lzop package first. It is needed for decompressing lzo kernel image and not included in default stage3 images.
root # emerge lzop
After you finish configuring your kernel sources, you will need to build them. To build your sources, run the following:
root # make
You can add -j<number of processing cores + 1> after make to build the kernel more quickly.
When the kernel and its modules finish building, install them:
root # make modules_install && make install
Now that you have installed your kernel and modules, it is a good idea to install an Initramfs.
- If your system has a separate /usr partition, is encrypted, or uses some other non-standard configuration, it will probably not boot without an initramfs.
- If your system is unencrypted, with file system, and hard drive controllers compiled in rather than as modules, it will not need an initramfs.
Advanced version
Getting ready to start
In this case we are building a kernel that is booting root in LVM over encrypted LUKS container. If you don't have this setup, don't worry, you just don't need all the modules, but everything else is similar.
First, there is the decision which linux kernel sources we need. There are plenty of them in the repositories around, often it is not easy to distinguish between them.
We recommend (especially if it is your first time) to build a debian-sourced genkernel like described in chapter 5 "Using Debian-Sources with Genkernel" in the Funtoo Kernels Tutorial.
From there you should have a running system booting nicely from your own build (just little bit bloated) kernel. This is more than you can expect from any other ready to go distribution.
Let's go!
Kernel Sources
The source you use on your system is up to you. For a laptop or desktop system, the following are recommended:
- sys-kernel/pf-sources
- sys-kernel/ck-sources
- sys-kernel/gentoo-sources
- sys-kernel/git-sources
- sys-kernel/debian-sources
- sys-kernel/vanilla-sources
If you are unsure of which sources you would like to use, emerge gentoo-sources. That's always a safe bet for a general system. For more information on available kernels, check out: Funtoo Linux Kernels
Please see discussion page for listings of sys-kernel
Preparing the kernel
We go now to the sources directory and enter the following commands to update the kernel's .config file:
root # cd /usr/src/linux/ root # make clean CLEAN . CLEAN arch/x86/kernel/acpi/realmode CLEAN arch/x86/kernel/cpu CLEAN arch/x86/kernel CLEAN arch/x86/vdso CLEAN arch/x86/lib CLEAN drivers/gpu/drm/radeon CLEAN drivers/net/wan CLEAN drivers/scsi/aic7xxx CLEAN drivers/tty/vt CLEAN drivers/video/logo CLEAN firmware CLEAN kernel CLEAN lib/raid6 CLEAN lib CLEAN security/apparmor CLEAN security/selinux CLEAN usr CLEAN arch/x86/boot/compressed CLEAN arch/x86/boot CLEAN .tmp_versions CLEAN vmlinux System.map .tmp_kallsyms2.S .tmp_kallsyms1.o .tmp_kallsyms2.o .tmp_kallsyms1.S .tmp_vmlinux1 .tmp_vmlinux2 .tmp_System.map root # zcat /proc/config.gz > /usr/src/linux/.config
Next, we run make localmodconfig. You will get some questions which you can answer mostly with either M (compiled as a module) or Y (compiled directly into the kernel). If you are not sure what to choose, press enter, and the default option will be selected.
root # make localmodconfig Enable different security models (SECURITY) [Y/n/?] y Enable the securityfs filesystem (SECURITYFS) [Y/?] y Socket and Networking Security Hooks (SECURITY_NETWORK) [Y/?] y Security hooks for pathname based access control (SECURITY_PATH) [Y/?] y Low address space for LSM to protect from user allocation (LSM_MMAP_MIN_ADDR) [65536] 65536 NSA SELinux Support (SECURITY_SELINUX) [Y/n/?] y NSA SELinux boot parameter (SECURITY_SELINUX_BOOTPARAM) [N/y/?] n NSA SELinux runtime disable (SECURITY_SELINUX_DISABLE) [N/y/?] n NSA SELinux Development Support (SECURITY_SELINUX_DEVELOP) [Y/n/?] y NSA SELinux AVC Statistics (SECURITY_SELINUX_AVC_STATS) [Y/n/?] y NSA SELinux checkreqprot default value (SECURITY_SELINUX_CHECKREQPROT_VALUE) [1] 1 NSA SELinux maximum supported policy format version (SECURITY_SELINUX_POLICYDB_VERSION_MAX) [Y/n/?] y NSA SELinux maximum supported policy format version value (SECURITY_SELINUX_POLICYDB_VERSION_MAX_VALUE) [19] 19 TOMOYO Linux Support (SECURITY_TOMOYO) [Y/n/?] y Default maximal count for learning mode (SECURITY_TOMOYO_MAX_ACCEPT_ENTRY) [2048] 2048 Default maximal count for audit log (SECURITY_TOMOYO_MAX_AUDIT_LOG) [1024] 1024 Activate without calling userspace policy loader. (SECURITY_TOMOYO_OMIT_USERSPACE_LOADER) [Y/n/?] y AppArmor support (SECURITY_APPARMOR) [Y/n/?] y AppArmor boot parameter default value (SECURITY_APPARMOR_BOOTPARAM_VALUE) [1] 1 Integrity Measurement Architecture(IMA) (IMA) [Y/n/?] y EVM support (EVM) [N/y/?] (NEW) Default security module 1. SELinux (DEFAULT_SECURITY_SELINUX) 2. TOMOYO (DEFAULT_SECURITY_TOMOYO) 3. AppArmor (DEFAULT_SECURITY_APPARMOR) > 4. Unix Discretionary Access Controls (DEFAULT_SECURITY_DAC) choice[1-4?]: 4 warning: (ACPI_HOTPLUG_CPU) selects ACPI_CONTAINER which has unmet direct dependencies (ACPI && EXPERIMENTAL) warning: (MEDIA_TUNER) selects MEDIA_TUNER_TEA5761 which has unmet direct dependencies (MEDIA_SUPPORT && VIDEO_MEDIA && I2C && EXPERIMENTAL) root # root # configuration written to .config root # warning: (GFS2_FS) selects DLM which has unmet direct dependencies (EXPERIMENTAL && INET && SYSFS && CONFIGFS_FS && (IPV6
Now comes the most adventurous part!
Building the Kernel
root # make -j8 bzImage root # make -j8 modules root # make modules_install root # make install
Initramfs
Make sure that you have built and installed your kernel sources / modules before building an initramfs.
To get your initramfs up and running, check out the Initramfs page. After following all the directions on the page to get your initramfs set up, continue following the ones here.
Update the grub.cfg with boot update, then reboot and see how it works!
root # boot-update -v root # reboot
No ebuild methods
As chapter title says, there several ways to maintain your kernel sources without using portage system. These methods have their pros and cons and considered advanced, however, not difficult as it may look from start.
Tracking linux kernel with git
Kernel build from upstream git repository is very easy, however it require some additional efforts from users which we will try to describe. This method could be useful for users who avoiding installing and tracking kernel updates with portage ebuild system. Method requires basic git knowledge. In examples, we are going to describe getting linux kernel sources with a stable branch. First, checkout the stable kernel git repository:
root # cd /usr/src root # git clone git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git root # cd linux-stable
Initial clone of whole linux kernel sources is slightly more than 1GB in size.
Now, we have entire development (stable) tree of linux kernel sources. The releases are set as corresponding git tags. Let's see what we have (a snippet of all available tags):
root # git tag -l v3.18.25 v3.4.99 v4.3.6 v4.4 v4.4-rc7 v4.4-rc8 v4.4.3 v4.5.3 root #
Notice a *rc* tags, these are release candidates and not a stable releases recommended to use. Switching to a specific stable releases is as simple as:
root # git checkout v4.5.3
Now, we set a sources tree to track upstream 4.5.3 release. It is necessary to setup a symlink, so that /usr/src/linux points to existing kernel sources.
root # pwd root # /usr/src root # ls root # linux-stable/ root # ln -s /usr/src/linux-stable /usr/src/linux
Now, we are able to configure and compiling our linux kernel by exactly same steps described above in this wiki. Advantage of this method is that you controlling, changing, updating or downgrading you kernel by power of git without using any ebuilds.
If kernel version you set not good for various reasons, it is very easy to step back and choose older version as well as setting entirely different branch of development tree:
root # git checkout v4.5.1
This will change your kernel sources tree 2 versions back within 4.5 releases. If you want entirely different branch:
root # git checkout v3.4.99
Of course, when performing such "downgrades" a good idea would be running make oldconfig, so you aware of kernel configuration changes between different kernel versions.
A virtuals case
Now that we built our custom kernel without portage management, we can get into situation of necessity of building 3-rd party kernel modules, such as virtualbox modules. Such ebuilds require kernel sources to be present on your box. However, portage does not have information about our custom built kernel. Normally, ebuilds have additional dependency of virtual/linux-sources, which makes portage installing kernel prior to 3-rd party modules. Details can be found in http://www.funtoo.org/Virtual_Packages. Let's see what will happen in case we built kernel without ebuilds.
Below output is an example (not the real output) for a clarification on how virtuals will work.
root # USE=headless emerge virtualbox -pv These are the packages that would be merged, in order: Calculating dependencies... done! [ebuild N ] sys-devel/bin86-0.16.21::gentoo 151 KiB [ebuild N ] dev-libs/libaio-0.3.110::gentoo USE="-static-libs {-test}" ABI_X86="(64) -32 (-x32)" 0 KiB [ebuild N ] sys-power/iasl-20150717::gentoo USE="{-test}" 1 468 KiB [ebuild N ] sys-block/thin-provisioning-tools-0.6.1::gentoo USE="-static {-test}" 193 KiB [ebuild N ] sys-fs/lvm2-2.02.116::gentoo USE="lvm1 readline static thin udev -clvm -cman -device-mapper-only -lvm2create_initrd (-selinux) -static-libs (-systemd)" 0 KiB [ebuild N ] dev-util/kbuild-0.1.9998_pre20131130::gentoo 1 668 KiB [ebuild N ] dev-libs/libIDL-0.8.14::gentoo 418 KiB [ebuild N ] sys-fs/mdadm-3.4::gentoo USE="static" 498 KiB [ebuild N ] sys-fs/cryptsetup-1.6.7::gentoo USE="gcrypt nls python udev -kernel -nettle -openssl -pwquality -reencrypt -static -static-libs -urandom" PYTHON_SINGLE_TARGET="python3_4 -python2_7 -python3_3" PYTHON_TARGETS="python2_7 python3_4 -python3_3" 1 162 KiB [ebuild N ] sys-kernel/genkernel-3.4.40.9-r2::gentoo USE="cryptsetup -btrfs (-ibm) (-selinux)" 12 966 KiB [ebuild N ] sys-kernel/debian-sources-4.5.2:4.5.2::gentoo USE="binary" 88 077 KiB [ebuild N ] virtual/linux-sources-2.6::gentoo USE="-hardened" 0 KiB [ebuild N ] app-emulation/virtualbox-modules-5.0.20::gentoo USE="-pax_kernel" 582 KiB [ebuild N ] app-emulation/virtualbox-5.0.20::gentoo USE="alsa headless opengl pam python qt4 sdk udev -debug -doc -java -libressl -lvm -pulseaudio -vboxwebsrv -vnc" PYTHON_TARGETS="python2_7" 108 629 KiB Total: 14 packages (14 new), Size of downloads: 215 805 KiB * IMPORTANT: 3 news items need reading for repository 'gentoo'. * Use eselect news read to view new items.
Notice, that portage now attempting to install debian-sources. That's the case we are not satisfied with. Portage have an ability to by-pass this. In older versions of portage we had --inject package argument. inject would create a fake vardb entry for the package specified so deps would be satisfied for anything needing that package. Nowadays, this replaced with package.provided. Details about it can be found in man portage. For this, you would do following:
root # install -d /etc/portage/profile root # echo "sys-kernel/vanilla-sources-4.1.24" >> /etc/portage/profile/package.provided
Above trick makes portage think that your box has vanilla-sources-4.1.24 installed. You can merge virtualbox without complains. We find this approach not that handy. In Funtoo Linux, we added additional stub ebuild, called dummy-sources, which is dependency in virtual/linux-sources. This stub ebuild installs no any files but satisfying virtual. Details are in https://bugs.funtoo.org/browse/FL-393. No need to play with package.provided and, of course, save time for reading man pages :)
How it works:
root # USE=headless emerge virtualbox -pv These are the packages that would be merged, in order: Calculating dependencies... done! [ebuild N ] sys-devel/bin86-0.16.21::gentoo 151 KiB [ebuild N ] sys-power/iasl-20150717::gentoo USE="{-test}" 1 468 KiB [ebuild N ] dev-util/kbuild-0.1.9998_pre20131130::gentoo 1 668 KiB [ebuild N ] dev-libs/libIDL-0.8.14::gentoo 418 KiB [ebuild N ] sys-kernel/dummy-sources-4.5.3::gentoo 0 KiB [ebuild N ] virtual/linux-sources-2.6::gentoo USE="-hardened" 0 KiB [ebuild N ] app-emulation/virtualbox-modules-5.0.20::gentoo USE="-pax_kernel" 582 KiB [ebuild N ] app-emulation/virtualbox-5.0.20::gentoo USE="alsa headless opengl pam python qt4 sdk udev -debug -doc -java -libressl -lvm -pulseaudio -vboxwebsrv -vnc" PYTHON_TARGETS="python2_7" 108 629 KiB Total: 8 packages (8 new), Size of downloads: 112 913 KiB * IMPORTANT: 3 news items need reading for repository 'gentoo'. * Use eselect news read to view new items.
Et voilà, we are avoiding unnecessary kernel installation by portage!