lablup / lablup/backend.ai

Improve Component Metrics Collection and Add Log Collection

Open
#6,511 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
670
Forks
183
Avg merge
17h 7m
Merged PRs (30d)
358

Description

## Motivation  

- Although metrics collection has been added for components like manager and agent, only general metrics are being collected, which are insufficient for comprehensive service analysis.
- There are metrics to track the execution results after receiving requests, but no metrics are being collected for the client layer that makes requests to other components.
- While Prometheus metrics are being collected, logs cannot be easily tracked.

## Objective  

- Collect Prometheus metrics for Redis, Etcd, and DB requests.
- Collect RPC Server in agent component.
- Enable easy log visualization and collection.

## Expected Sub Issue

- Register Fluent Bit and Kibana for log collection and visualization.
- Add Prometheus metrics for Redis, Etcd, DB requests and RPC server.

JIRA Issue: BA-540

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.