influxdata / influxdata/influxdb
Scrapers stop scraping randomly
- Dominant language
- Rust
- Stars
- 31.7k
- Forks
- 3.7k
- Avg merge
- 13h 37m
- Merged PRs (30d)
- 8
Description
__Steps to reproduce:__
List the minimal actions needed to reproduce the behavior.
1. Create scrapers in UI
2. Wait couple hours
__Expected behavior:__
Scrapers to scrape consistently
__Actual behavior:__
One or multiple scrappers stops scrapping randomly after 5-10hours, I can see the requests still being made in logs without errors, but no data saved. Only way to fix it, to remove and re-add the scrapper in the UI, even reboot does not solve the issue.
__Environment info:__
* System info: Linux 5.4.0-113-generic x86_64
* InfluxDB version: Druid influxdb:latest (InfluxDB v2.2.0 Server: a2f8538 Frontend: cc65325)
(happens on nightly as well)
Contributor guide
Research direction
The report names no source files, tests, or entry points. Start by reproducing the issue with a scraper created in the UI and inspect logs and saved data after several hours. Done means scrapers continue saving data consistently without needing to be removed and re-added.
Written by the indexing model from the issue text.
Assessment
- Domain
- databases
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 30/100