influxdata / influxdata/influxdb

Very difficult error; unexpected error writing points to database: [shard 12] unexpected end of JSON input, Docker Compose, need help

Open
#24,959 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Rust
Stars
31.7k
Forks
3.7k
Avg merge
13h 37m
Merged PRs (30d)
8

Description

I have been searching and experimenting for hours now. The problem is that in my docker compose project i cannot send data from nodered to influxdb anymore. Everythig used to work fine. But, after letting the containers run for 3 days, it stopped working. Docker daemon couldnt start up anymore. After research, I came to the conclusion that there was not enough storage left, which ended up being the case. So, i checked what was using so much space and truncated the docker container that used up most space (it was 46Gb somehow and i have 55GB in total). This somehow solved the issue of docker daemon not starting up. However, after succesfully starting up the containers I got the following error message in nodered.

error message in nodered, regarding influxdbout node;
"HttpError: unexpected error writing points to database: [shard 12] unexpected end of JSON input"

I checked the container logs of influxdb;
repeated lines in the influxdb container logs;
ts=2024-05-05T19:38:23.123011Z lvl=info msg="Write failed" log_id=0ozXsPcG000 service=storage-engine service=write shard=12 error="[shard 12] unexpected end of JSON input"
ts=2024-05-05T19:38:23.123100Z lvl=error msg="Recorder handler error" log_id=0ozXsPcG000 error="[shard 12] unexpected end of JSON input"
ts=2024-05-05T19:38:31.533197Z lvl=info msg="Write failed" log_id=0ozXsPcG000 service=storage-engine service=write shard=12 error="[shard 12] unexpected end of JSON input"
ts=2024-05-05T19:38:33.095098Z lvl=info msg="Write failed" log_id=0ozXsPcG000 service=storage-engine service=write shard=12 error="[shard 12] unexpected end of JSON input"
ts=2024-05-05T19:38:33.123268Z lvl=info msg="Write failed" log_id=0ozXsPcG000 service=storage-engine service=write shard=12 error="[shard 12] unexpected end of JSON input"
ts=2024-05-05T19:38:33.123348Z lvl=error msg="Recorder handler error" log_id=0ozXsPcG000 error="[shard 12] unexpected end of JSON input"
ts=2024-05-05T19:38:33.189497Z lvl=info msg="Write failed" log_id=0ozXsPcG000 service=storage-engine service=write shard=12 error="[shard 12] unexpected end of JSON input"
ts=2024-05-05T19:38:40.309153Z lvl=info msg="Write failed" log_id=0ozXsPcG000 service=storage-engine service=write shard=12 error="[shard 12] unexpected end of JSON input"

removing all containers by doing docker compose down and then up again sadly doesn't work... I feel like im so fcked right now, because this is part of my bachelor's project... I didn't expect this to come up

extra info; im working on a debian linux 11 environment. I only have acces to this computer via ssh

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

This is a diagnosis request rather than a scoped code change, and it names no source file or test. Start by reviewing the Docker Compose setup, the Node-RED influxdbout node, and the InfluxDB container logs for shard 12; done would require identifying a reproducible cause and a verified recovery or fix.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker-compose
Domain
database, devops
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
12/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.