apache / apache/apisix

bug: Apisix promethues metrics service request much greater than the actual request

Open
#12,449 7 comments 0 reactions 0 assignees View on GitHub
checking question
Dominant language
Lua
Stars
17.1k
Forks
2.9k
Avg merge
3d 16h
Merged PRs (30d)
63

Description

### Current Behavior

```
sum(rate(apisix_http_status{service=~"$service",route=~"$route",instance=~"$instance"}[$__rate_interval])) by (service)

sum(rate(apisix_http_status{service=~"$service",route=~"$route",instance=~"$instance"}[$__rate_interval])) by (route)
```

view http://dev-minio.bcnyyun.com/download/apisix-dashbord.png

According to the log statistics, the number of interface calls is less than 1,000.

### Expected Behavior

null

### Error Logs

null

### Steps to Reproduce

null

### Environment

- APISIX version 3.11
- Operating system: Centos 7.9.x linux
- Apisix install by helm

Contributor guide

Open the contributing guide

Research direction

Start with the two Prometheus queries in the issue and inspect the linked dashboard, then compare their service and route rates with the request counts from the logs. No source files or tests are identified; done means determining why APISIX 3.11 reports inflated metrics and confirming the corrected counts against logs.

Written by the indexing model from the issue text.

Assessment

Tech stack
helm, prometheus
Domain
backend-api-design, observability
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.