elastic / elastic/integrations

[Meta] [TSDB] Eliminate fingerprinting of dimensions and labels added as part of TSDB Enablement

Open
#9,910 1 comment 0 reactions 0 assignees View on GitHub
enhancement Integration:aws Integration:azure_application_insights Integration:azure_metrics Integration:elasticsearch Integration:etcd Integration:gcp Integration:istio Integration:microsoft_sqlserver Integration:mysql Integration:oracle Integration:postgresql Integration:prometheus
Dominant language
Handlebars
Stars
333
Forks
647
Avg merge
3d 4h
Merged PRs (30d)
209

Description

The Elasticsearch issues
- https://github.com/elastic/elasticsearch/issues/93564
- https://github.com/elastic/elasticsearch/pull/98023
are resolved.

These changes help to overcome the dimension limit and the need to hashing the labels and dimensions that are part of the Elastic Integration package fields.

The changes are presently [evaluated & tested](https://github.com/elastic/integrations/pull/9785) for the Prometheus package.

This meta issue captures the scope of the integration package (datasets) which could take the benefit of above mentioned improvements added to Elasticsearch.

**Requirements**
- 8.14 or above.

**Related Issues**
- https://github.com/elastic/kibana/pull/183334#issuecomment-2114660315 (Blocking)

**Pass Criteria**
- No document drop should happen after applying the changes

**Testing Methodology.**
- Manual verification
- [TSDB Test toolkit evaluation](https://github.com/elastic/TSDB-migration-test-kit)

```[tasklist]
### Applicable Integration package list.
- [ ] AWS/cloudwatch_metrics
- [ ] azure_application_insights
- [ ] azure_metrics/monitor
- [ ] elasticsearch/ingest_pipeline
- [ ] etcd/metrics
- [ ] gcp/cloudrun_metrics
- [ ] gcp/cloudsql_mysql
- [ ] gcp/cloudsql_postgresql
- [ ] gcp/cloudsql_sqlserver
- [ ] gcp/compute
- [ ] gcp/dataproc
- [ ] gcp/gke
- [ ] gcp/loadbalancing_metrics
- [ ] gcp/pubsub
- [ ] gcp/redis
- [ ] gcp/storage
- [ ] istio/istiod_metrics
- [ ] istio/proxy_metrics
- [ ] microsoft_sqlserver/transaction_log
- [ ] mysql/performance
- [ ] oracle/performance
- [ ] postgresql/activity
- [ ] prometheus/collector : https://github.com/elastic/integrations/pull/9785
- [ ] prometheus/query : https://github.com/elastic/integrations/pull/9785
- [ ] prometheus/remote_write : https://github.com/elastic/integrations/pull/9785
```

```[tasklist]
### Update Developer Guidelines Document
- [ ] TSDB Guidelines document (github)
- [ ] Developer Documentation Page (if applicable)
```

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.