influxdata / influxdata/influxdb

Missing data

Open
#10,287 52 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

1.x area/2.x
Dominant language
Rust
Stars
31.7k
Forks
3.7k
Avg merge
13h 37m
Merged PRs (30d)
8

Description

We have 2 databases on same host. From time to time we notice that huge chunk of data is missing across all measurements. I'ts like someone hit delete from where time > X and time < Y.
First two times we tried to re-create the data in influx manually because it was in smaller DB ("only" few thousand records were missing). By accident i figured that if we backup our database and just restore it back, all the data is back. So data is not lost, but influx is not showing them. Few days ago we had identical situation with our larger database. Everything from July 12, 2018 to August 23, 2018 - gone!
We did backup/restore (12 GB dump), everything is back! Any ideas?
We use default RP, so none/infinite, no CQ, version is 1.5.2. It happened before with 1.2.4 also.
Debian 8 x64

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing the reported gaps across measurements, including the July 12–August 23, 2018 interval, the default retention policy, and the backup/restore behavior. Compare the InfluxDB 1.5.2 and 1.2.4 reports on Debian 8; done means identifying why data is hidden and documenting a reproducible cause or fix.

Written by the indexing model from the issue text.

Assessment

Tech stack
debian
Domain
databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.