influxdata / influxdata/influxdb

influx disk quota exceeded error

Open
#16,230 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
31.7k
Forks
3.7k
Avg merge
13h 37m
Merged PRs (30d)
8

Description

###### URL for relevant page?

influxd[1772]: ts=2019-12-15T08:14:56.898123Z lvl=error msg="[500] - \"[shard 712] open /var/lib/influxdb/wal/telegraf/a_year/712/_02899.wal: no such file or directory\"" log_id=0Jj9MPO0000 service=httpd

But this file exists

ls -lart /var/lib/influxdb/wal/telegraf/a_year/712/_02899.wal
-rwxrwxrwx 1 root root 10076940 Dec 10 22:42 /var/lib/influxdb/wal/telegraf/a_year/712/_02899.wal
root@host:/var/lib/influxdb/wal/telegraf/a_year/712#

Dec 15 07:44:55 host influxd[22407]: ts=2019-12-15T07:44:55.288156Z lvl=info msg="Write failed" log_id=0Jj6q0f0000 service=write shard=712 error="[shard 712] error opening file /var/lib/influxdb/data/telegraf/a_year/712/000001280-000000005.tsm: open /var/lib/influxdb/data/telegraf/a_year/712/000001280-000000005.tsm: disk quota exceeded"

recently there were disk space fill issues, however we added additional space and restarted the services.

###### What products and version are you using?
Influxdb 1.7.2, telegraf
###### Where did you look before opening the issue?
searched in the community pages but did not get any references

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the InfluxDB 1.7.2 log entries for shard 712 and compare the WAL path with the data path shown in the report. Check the reported disk-quota failure and the existence and permissions of _02899.wal and 000001280-000000005.tsm. Done means identifying a reproducible cause for the misleading missing-file error and documenting or testing the resulting fix.

Written by the indexing model from the issue text.

Assessment

Domain
databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.