influxdata / influxdata/influxdb
Error: failed to write data: 422 Unprocessable Entity
- Dominant language
- Rust
- Stars
- 31.7k
- Forks
- 3.7k
- Avg merge
- 13h 37m
- Merged PRs (30d)
- 8
Description
__Steps to reproduce:__
List the minimal actions needed to reproduce the behavior.
https://docs.influxdata.com/influxdb/v2.0/upgrade/v1-to-v2/manual-upgrade/
I was trying to Manually upgrade from InfluxDB 1.x to 2.0 , did all the 4 steps
1 - [Install InfluxDB 2.0](https://docs.influxdata.com/influxdb/v2.0/upgrade/v1-to-v2/manual-upgrade/#install-influxdb-20)
2 - [Migrate custom configuration settings](https://docs.influxdata.com/influxdb/v2.0/upgrade/v1-to-v2/manual-upgrade/#migrate-custom-configuration-settings)
3 - [Create DBRP mappings](https://docs.influxdata.com/influxdb/v2.0/upgrade/v1-to-v2/manual-upgrade/#create-dbrp-mappings)
4 - [Create authorizations](https://docs.influxdata.com/influxdb/v2.0/upgrade/v1-to-v2/manual-upgrade/#create-authorizations)
Getting issue in Step 5th
[Migrate time series data](https://docs.influxdata.com/influxdb/v2.0/upgrade/v1-to-v2/manual-upgrade/#migrate-time-series-data)
__Expected behavior:__
Able to migrate my data into a bucket
__Actual behavior:__
`[root@x-x-x-x-x:/usr/local/bin] ./influx write --bucket telegraf --file /data/influxdatabackup/telegraf-autogen.lp
Error: Failed to write data: 422 Unprocessable Entity: failure writing points to database: partial write: points beyond retention policy dropped=6306`
__Environment info:__
* System info: Linux 3.10.0-1127.19.1.el7.x86_64 x86_64
* InfluxDB version: InfluxDB v2.4.0 (git: de247bab08) build_date: 2022-08-18T19:41:15Z
__Logs:__
Error: failed to write data: 422 Unprocessable Entity: failure writing points to database: partial write: points beyond retention policy dropped=6306
Getting this after trying to manually debug it ->
```
[root@x-x-x-x-x:/usr/local/bin] ./influx write --bucket-id c31580d6bbe0xxxxf --file /data/influxdatabackup/test_data2.lp --skipRowOnError
2022/10/13 17:05:22 invalid point on line 56: unable to parse 'cpu,cpu=cpu-total,host=x-x': missing fields
2022/10/13 17:05:22 invalid point on line 111: unable to parse 'cpu,cpu=cpu-total,host=x-x-influxdb-1-b usage_guest=': missing field value
2022/10/13 17:05:22 invalid point on line 111: unable to parse '0 1656883130000000000': invalid field format
2022/10/13 17:05:22 invalid point on line 167: unable to parse 'cpu,': missing tag key
2022/10/13 17:05:22 invalid point on line 222: unable to parse 'cpu,cpu=cpu-total,host=x-x-inf': missing fields
2022/10/13 17:05:22 invalid point on line 277: unable to parse '56884820000000000': missing fields
2022/10/13 17:05:22 invalid point on line 333: unable to parse 'cpu,cpu=': missing tag value
2022/10/13 17:05:22 invalid point on line 388: unable to parse 'cpu,cpu=cpu-total,host=x-x-influxd': missing fields
2022/10/13 17:05:22 invalid point on line 443: unable to parse '6520000000000': missing fields
2022/10/13 17:05:22 invalid point on line 499: unable to parse 'cpu,cpu=cpu-': missing fields
2022/10/13 17:05:22 invalid point on line 554: unable to parse 'cpu,cpu=cpu-total,host=x-x-influxdb-1-': missing fields
2022/10/13 17:05:22 invalid point on line 609: unable to parse '000000000': missing fields
2022/10/13 17:05:22 invalid point on line 665: unable to parse 'cpu,cpu=cpu-tota': missing fields
2022/10/13 17:05:22 invalid point on line 720: unable to parse 'cpu,cpu=cpu-total,host=x-x-influxdb-1-b us': invalid field format
2022/10/13 17:05:22 invalid point on line 720: unable to parse 'age_guest=0 1656889330000000000': invalid field format
2022/10/13 17:05:22 invalid point on line 775: unable to parse '00000': missing fields
2022/10/13 17:05:22 invalid point on line 831: unable to parse 'cpu,cpu=cpu-total,ho': missing tag value
2022/10/13 17:05:22 invalid point on line 886: unable to parse 'cpu,cpu=cpu-total,host=x-x-influxdb-1-b usage_': invalid field format
2022/10/13 17:05:22 invalid point on line 886: unable to parse 'guest=0 1656891020000000000': invalid field format
2022/10/13 17:05:22 invalid point on line 941: unable to parse '0': missing fields
Error: failed to write data: 400 Bad Request: unable to parse 'cpu,cpu=cpu-total,host=x-x-influxdb-1-b usage_guest=0 16cpu,cpu=cpu-total,host=x-x-influxdb-1-b usage_guest=0 1656884830000000000': bad timestamp\
```
Contributor guide
Research direction
Start with the Manual upgrade documentation, especially “Migrate time series data,” and the ./influx write entry point shown in the report. Reproduce the provided --bucket/--file commands with the .lp data, then determine how the retention-policy and line-protocol errors should be handled; done means the migration path is corrected or its required conditions are documented.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- linux, shell
- Domain
- cli, databases
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 22/100