Note

The Funtoo Linux project has transitioned to "Hobby Mode" and this wiki is now read-only.

Difference between revisions of "News:New OpenGL management in Funtoo"

From Funtoo
Jump to navigation Jump to search
(example update command + explanation)
(simplify, explain a bit more rationale)
Line 9: Line 9:
== New OpenGL management ==
== New OpenGL management ==
=== System principles ===
=== System principles ===
The new OpenGL management design assumes that the reference OpenGL implementation (mesa/Xorg) is to be used to build packages. After switching to the new system, all packages will use the mesa/Xorg headers and link to the mesa/Xorg libraries. This improves portability of software built on Funtoo and solves some of the build failures when non-standard OpenGL provider was enabled.
Proprietary video drivers such as {{Package|x11-drivers/ati-drivers}} and {{Package|x11-drivers/nvidia-drivers}} provide non-standard versions of core OpenGL system libraries, Xorg server modules and OpenGL headers. Those drivers do not work correctly with libraries provided by mesa/Xorg. Funtoo makes it possible to install those drivers by moving the colliding files into dedicated subtrees. Afterwards, user can use {{Package|app-admin/eselect-opengl}} to switch between different library providers, therefore selecting the implementation matching video driver used.


The third-party OpenGL libraries and modules provided by proprietary driver vendors can be enabled for run-time program use. They will not affect how the program is built. However, they will be loaded by the dynamic loader when starting executables. The Xorg server will also load the modules provided by blob driver vendor if appropriate.
Before, the system focused on exchanging the system libraries and headers by creating symlinks to the dedicated subtrees. This system caused a number of issues, most importantly:
* the packages were built against currently selected OpenGL implementation, resulting in inconsistencies between binary packages created on different Funtoo systems and causing build failures on some packages requiring newer OpenGL headers than ones provided by the selected implementation,
* the switching process was non-atomic and fragile. The user's system may have ended up with partially switched OpenGL implementation or dangling symlinks.
 
The new system provides a clear distinction between libraries and headers used at build-time, and libraries used at run-time. All packages are built consistently against the reference OpenGL implementation (mesa/Xorg), while user is allowed to override the implementation used at run-time. The overrides are done purely using system configuration.


=== Implementation ===
=== Implementation ===
Line 21: Line 25:


== Upgrade information ==
== Upgrade information ==
=== Before upgrade ===
=== Automatic upgrade ===
Please note that the OpenGL subsystem upgrade is a lock-step update involving file collisions and blockers. This means that a few packages need to be upgraded consecutively during a single emerge run, and during that process the OpenGL support may become temporarily broken. If the upgrade is interrupted, your system may require manual attention.
Please note that the OpenGL subsystem upgrade is a lock-step update involving file collisions and blockers. This means that a few packages need to be upgraded consecutively during a single emerge run, and during that process the OpenGL support may become temporarily broken. If the upgrade is interrupted, your system may require manual attention.


Therefore, before upgrading please make sure that you can upgrade all the following packages, if installed:
For most of our users, a regular @world upgrade should be sufficient:
* x11-base/xorg-server to 1.16.4-r1 or newer,
{{console|body=
* media-libs/mesa to 10.3.4-r1 or newer,
###i## emerge -vDu @world
* x11-proto/glproto to 1.4.17-r1 or newer,
}}
* x11-drivers/ati-drivers to 14.9-r2 or newer,
* app-emulation/emul-linux-x86-opengl to 20140508-r1 or newer.
 
If you need to use an older version of one of those packages long-term, please report a bug so that we can backport the support for the new system to it.
 
Additionally, please make sure to not enable FEATURES=collision-protect for the upgrade since it will involve replacing some of externally created symlinks with package files. FEATURES=protect-owned (enabled by default) is fine. If you don't want to disable FEATURES=collision-protect world-upgrade-wide, please see below for manual upgrade method.


=== The upgrade process ===
However, please make sure that FEATURES=collision-protect is '''not''' enabled during the world upgrade. It involves replacing some of externally created symlinks with package files. FEATURES=protect-owned (enabled by default) is fine. If you don't want to disable FEATURES=collision-protect world-upgrade-wide, please see below for manual upgrade method.
Normally, the upgrade should be performed as part of a regular @world upgrade.


However, if one desires to perform the upgrade stand-alone, he needs to pass all installed packages from the following list to emerge:
=== Manual upgrade ===
If one desires to perform the upgrade stand-alone (without upgrading other packages), he needs to pass all installed packages from the following list to emerge:
* app-admin/eselect-opengl,
* app-admin/eselect-opengl,
* app-emulation/emul-linux-x86-opengl,
* app-emulation/emul-linux-x86-opengl,
Line 57: Line 55:
# ''-n'' will prevent Portage from unnecessarily rebuilding packages that were upgraded already,
# ''-n'' will prevent Portage from unnecessarily rebuilding packages that were upgraded already,
# ''-u'' will cause Portage to upgrade the remaining packages.
# ''-u'' will cause Portage to upgrade the remaining packages.
=== Post upgrade ===
There should be no manual steps needed after the upgrade. The currently selected OpenGL implementation will be activated automatically.


{{NewsFooter}}
{{NewsFooter}}

Revision as of 21:55, March 10, 2015

New OpenGL management in Funtoo

Funtoo is switching to an improved system for managing multiple OpenGL providers (Mesa/Xorg, AMD and nVidia). The update may involve blockers and file collisions.

By Mgorny / February 28, 2015

New OpenGL management

System principles

Proprietary video drivers such as x11-drivers/ati-drivers and x11-drivers/nvidia-drivers provide non-standard versions of core OpenGL system libraries, Xorg server modules and OpenGL headers. Those drivers do not work correctly with libraries provided by mesa/Xorg. Funtoo makes it possible to install those drivers by moving the colliding files into dedicated subtrees. Afterwards, user can use app-admin/eselect-opengl to switch between different library providers, therefore selecting the implementation matching video driver used.

Before, the system focused on exchanging the system libraries and headers by creating symlinks to the dedicated subtrees. This system caused a number of issues, most importantly:

  • the packages were built against currently selected OpenGL implementation, resulting in inconsistencies between binary packages created on different Funtoo systems and causing build failures on some packages requiring newer OpenGL headers than ones provided by the selected implementation,
  • the switching process was non-atomic and fragile. The user's system may have ended up with partially switched OpenGL implementation or dangling symlinks.

The new system provides a clear distinction between libraries and headers used at build-time, and libraries used at run-time. All packages are built consistently against the reference OpenGL implementation (mesa/Xorg), while user is allowed to override the implementation used at run-time. The overrides are done purely using system configuration.

Implementation

The reference implementation (mesa/Xorg) packages install headers and libraries into standard system locations (/usr/include, /usr/lib*). The compiler and linker finds them using the usual rules and uses them.

The third-party OpenGL vendors install libraries and server extension modules into vendor-named subdirectories of /usr/lib*/opengl. Those files are not used directly.

app-admin/eselect-opengl is used to select OpenGL implementation used at run-time. The choice of implementation is controlled via dynamic linker configuration (ld.so.conf) and Xorg server configuration. If the reference implementation is selected, the eselect module outputs null configuration that causes the linker and server to use the standard paths. If an another implementation is selected, the configuration prepends /usr/lib*/opengl paths to linker and server configuration, causing them to prefer the third-party libraries over reference.

Upgrade information

Automatic upgrade

Please note that the OpenGL subsystem upgrade is a lock-step update involving file collisions and blockers. This means that a few packages need to be upgraded consecutively during a single emerge run, and during that process the OpenGL support may become temporarily broken. If the upgrade is interrupted, your system may require manual attention.

For most of our users, a regular @world upgrade should be sufficient:

root # emerge -vDu @world

However, please make sure that FEATURES=collision-protect is not enabled during the world upgrade. It involves replacing some of externally created symlinks with package files. FEATURES=protect-owned (enabled by default) is fine. If you don't want to disable FEATURES=collision-protect world-upgrade-wide, please see below for manual upgrade method.

Manual upgrade

If one desires to perform the upgrade stand-alone (without upgrading other packages), he needs to pass all installed packages from the following list to emerge:

  • app-admin/eselect-opengl,
  • app-emulation/emul-linux-x86-opengl,
  • media-libs/mesa,
  • x11-base/xorg-server,
  • x11-drivers/ati-drivers,
  • x11-proto/glproto.

For example, the following command may be used to commence a manual update:

root # FEATURES=-collision-protect emerge -1nu app-admin/eselect-opengl media-libs/mesa x11-base/xorg-server x11-proto/glproto

Explanation:

  1. FEATURES=-collision-protect will ensure that Portage can replace the symlinks created by old versions of eselect-opengl with real libraries.
  2. -1 will ensure that none of intermediate packages end up in @world, causing issues in the future,
  3. -n will prevent Portage from unnecessarily rebuilding packages that were upgraded already,
  4. -u will cause Portage to upgrade the remaining packages.