influxdata / influxdata/influx-cli

UX improvements for influx write

Open
#78 4 comments 1 reaction 1 assignee View on GitHub

Nobody has claimed this yet.

Epic
Dominant language
Go
Stars
75
Forks
22
PR merge metrics
No merged PRs in 30d

Description

__Proposal:__
To support large data imports, `influx write` should have the following improvements:
- [ ] Error handling - failing lines are written out to a log file with the error message, for easy correction and re-importation
- [ ] Error threshold - an import will halt when it reaches a given error-threshold
- [ ] Restart-ability - record its progress through each file and record when it failed or was halted
- [ ] Progress reporting - report on the status of import periodically, with lines imported, lines failed, est. percentage completion, etc.
- [x] Handles compressed files - compressed line protocol or CSV files should be able to be read
- [ ] Respond to standard HTTP errors to throttle uploads dynamically

__Use case:__
These features will make importing very large data sets into Influx much simpler and more robust, helping new customers on-board with less pain.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.