Edit Project: Funtoo:Telemetry

You do not have permission to edit this page, for the following reason:

The action you have requested is limited to users in one of the groups: Bureaucrats, wiki-editors, wiki-sysops.

Summary Telemetry is a new project to upgrade all the core Prometheus and Grafana related packages in Funtoo so that the latest real time metrics collection and analysis tools are available to both desktop and server users. Also, it will track the build out of a new internal observability and alerting platform based on Prometheus for core Funtoo Infrastructure. Most of the development for this project will take place over Discord Live Streams with the Funtoo Community.

Keywords

Category

Leads

Members

Contributors

Subpages

Related Pages

Translate

If yes, then a languages bar will appear on the page. The page still needs to be set up and marked for translation.

Components

Components are used to define the "scope" of the project -- what stuff is included. It's a tool to help you structure the project. The support level indicates whether the component fully falls under the project, or partially, or not at all -- if you need to explicitly exclude something from your scope.

Components

Name
Support
Summary	Convert all Prometheus and Grafana related Gentoo staging packages to funtoo-metatools autogenerated binary packages, that dynamically pull the latest release from the associated package's GitHub Releases

Name
Support
Summary	Create new funtoo-metaltools powered compile based autogenerated packages that build from the upstream Prometheus related package source code

Name
Support
Summary	Engineer a custom Funtoo Prometheus exporter on code.funtoo.org that can expose all types of fun and useful Prometheus metrics about a Funtoo Linux system

Name
Support
Summary	Deploy any new or needed Prometheus related infrastructure including Prometheus instances and Prometheus exporters to measure different metrics all throughout and across the Funtoo internal infrastructure.

Name
Support
Summary	Create and launch a publicly viewable Grafana Site running atop Funtoo Infrastructure to visualize all Funtoo Infrastructure related Prometheus data. Instrument a new Discord channel called #alerts-feed that streams Prometheus Alertmanager Alerts directly to Funtoo Discord Server and to the community regarding infrastructure health

Add another

Updates

Place status updates below. They propagate to the main page and you can also display them on your page via the

{{Project/UpdateList}}

template.

Updates

Date
Status	Phase 1 completed on the Funtoo Discord Live Stream. The final *-bin Prometheus exporter (mysqld_exporter-bin-0.13.0) autogen is now completed.

Date

Status

Date
Status	Memcached_exporter-bin 0.9.0 and redis_exporter-bin v1.35.1 auto-generated packages created during a Funtoo Discord Community Live Stream and are now available in Funtoo 1.4 and next

Date
Status	Alertmanager-bin v0.23.0 and blackbox_exporter-bin v0.19.0 auto-generated packages are now available in Funtoo 1.4 and next

Date

Status

Date

Status

Date
Status	Refactored of all of the autogens created during the Project Telemetry's Phase 1 to group autogens in preparation for starting Phase 2

Date
Status	Started mapping Phase 2 of the Funtoo Project Telemetry. Promu is required before starting and will be the first Golang source based autogen of Phase 2.

Date
Status	Phase 2 is currently ongoing but partially blocked. Phase 3, building a Funtoo Linux Prometheus Exporter, has officially started its R&D phase. New Project Telemetry [[Funtoo:Telemetry/Activities\|Activities]] have been published.

Date

Status

Add another

Free text:

Telemetry is a new project to upgrade all the core Prometheus and Grafana related packages in Funtoo so that the latest real time metrics collection and analysis tools are available to both desktop and server users. == What are the Benefits? == Modern time series and real time Telemetry and Observibility tools like [https://github.com/prometheus/prometheus Prometheus] and [https://github.com/grafana/grafana Grafana] are great to precisely monitor and alert on various computer application based infrastructure that run at production web scale web. They are also highly useful in the hobbyist realm instrumenting and measuring all types of different technologies such as smart home devices, energy production systems like solar arrays, any remote devices that can be scraped for useful data, and just abut anything that can run the Linux operating system. Having the most recent up to date versions of Prometheus tools allows Funtoo users to leverage them for whatever monitoring and alerting project and task they desire. In addition to ensuring these packages have the latest security patches, having them updated a maintained ndregularly is very useful for folks running Funtoo Servers and would like to leverage them to monitor those systems. Lastly, having these packages available and automatically generating in the Funtoo Portage tree will allow them to the be leveraged for any internal Funtoo Infrastructure. == What are we Building? == We are going to be building out complete support for the latest and greatest Prometheus and Grafana software in Funtoo Linux in addition to engineering new telemetry software for Funtoo Linux. This project is being approached in multiple phases to better track overall progress and features. Some Phases may be ongoing in parallel. Below are the current Phases in sequential order: === [[Funtoo:Telemetry/Activities/Phase1|Phase 1 (Completed)]] === * '''Parent Issue:''' '''[https://bugs.funtoo.org/browse/FL-9365 FL-9365 Refactor all Prometheus and Grafana related CatPkgs to kit-fixups autogen ebuild] ''' * '''Details:''' Convert all Prometheus and Grafana related Gentoo staging packages to funtoo-metatools autogenerated binary packages, that dynamically pull the latest release from the associated package's GitHub Releases. Also, during this Phase, the initial foundation of autogenerated templates will be worked through so if can be built upon in Phase 2. '''Scope:''' Prometheus and Grafana related packages that are pulled from Gentoo Staging. Only '''Official''' core or '''High Quality''' community Prometheus and Grafana software will be targeted === [[Funtoo:Telemetry/Activities/Phase2|Phase 2]] === * '''Parent Issue:''' '''[https://bugs.funtoo.org/browse/FL-9365 FL-9365 Refactor all Prometheus and Grafana related CatPkgs to kit-fixups autogen ebuild] ''' * '''Details:''' Create new funtoo-metaltools powered compile based autogenerated packages that build from the upstream Prometheus related package source code. References to Gentoo staging packages will be removed during this phases to avoid any package name collisions. === [[Funtoo:Telemetry/Activities/Phase3|Phase 3]] === * '''Parent Issue:''' '''[https://bugs.funtoo.org/browse/FL-9559 core-server-kit] app-metrics/funtoo_exporter: Engineer new Funtoo Prometheus Exporter]''' * '''Details:''' Engineer a custom Golang Funtoo Prometheus exporter on code.funtoo.org that can expose all types of fun and useful Prometheus metrics about a Funtoo Linux system. Create associated Grafana dashboard JSON template that Funtoo Usesrs can use with this exporter in their local Grafana instances. === [[Funtoo:Telemetry/Activities/Phase4|Phase 4]] === * '''Parent Issue:''' '''Not created yet''' * '''Details:''' Deploy any new or needed Prometheus related infrastructure including Prometheus instances and Prometheus exporters to measure different metrics all throughout and across the Funtoo internal infrastructure. This phase will leverage all of the autogenerated and up-to-date packages created in Phase 1 through 3. === Phase 5 === * '''Parent Issue:''' '''Not created yet''' * '''Details:''' Create and launch a publicly viewable Grafana Site running atop Funtoo Infrastructure to visualize all Funtoo Infrastructure related Prometheus data. Make it available through a domain like '''observe.funtoo.org''' and integrate Grafana's authentication and authorization directly with '''auth.funtoo.org''' (possibly protected by VPN if public DNS and IP space is not available) . Instrument a new Discord channel called '''#observe-feed''' or '''#alerts-feed'''that streams Alertmanager Alerts directly to Funtoo Discord Server and to the community regarding infrastructure health just like the #wiki-feed and #bugs-feed == How Can I Get Involved? == Join us on [https://discord.gg/BNUSpUU Funtoo Discord] and also see below for status updates and instructions on how to join our collaborative effort. == Status Updates == {{Project/UpdateList}}

Summary:

Cancel

Edit Project: Funtoo:Telemetry

Navigation menu

Search