elixir-europe / elixir-europe/compute_wp5

Assess available open solutions for metrics collection, roll-up and dashboarding.

Open
#8 1 comment 0 reactions 1 assignee Claimed by @nilshoffmann View on GitHub
WP5 Activity 1
Dominant language
No language data
Stars
2
Forks
1
PR merge metrics
No merged PRs in 30d

Description

In one of the recent WP5 Meetings, ELIXIR LU presented their Datacatalog solution to collect data and study metadata https://datacatalog.elixir-luxembourg.org/
With some extensions, this could serve as an aggregation point for Tool and Workflow metrics provider registration.
However, for roll-up reporting and visualization, their data schema may not be suitable, depending on the expected traffic.
de.NBI Cloud is using Elastic Search (FileBeat and MetricBeat) to record monitoring different OS and other metrics over time and query / visualize this via grafana.

- [ ] Discuss necessary schema changes and setup for providers in Datacatalog (maybe new name: Tool Metrics Catalog?)
- [ ] Test deployment and at least one test provider (potentially with simulated tool metrics at first) using the schema defined in #4
- [ ] Define a Grafana dashboard that can display a selection of metrics
- [ ] Survey existing solutions for tracing and metrics collection (e.g. [OpenTelemetry](https://last9.io/blog/what-is-opentelemetry/)) and suitable databases

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.