performance of insertion
Open
Nobody has claimed this yet.
performance
- Dominant language
- C
- Stars
- 25.1k
- Forks
- 5k
- Avg merge
- 4d 59m
- Merged PRs (30d)
- 7
Description
Performance Issue
如何提高数据写入性能，希望能达到秒级10万以上？
Problem Description
- 用属性点创建子表，同一时间采集的6万条数据，批量写入（都是不同的子表6万个），花了3秒，有点慢
- 第二次同样写入，也是3秒时间
- 一次写入6万个表，每个表一行，一共6万行
Environment (please complete the following information):
- tdengine version：3.0.4.1
- 三个节点组成的集群：cpu为8核，内存16G，3台都一样的配置
- 操作系统：centos7
- jar驱动：taos-jdbcdriver version：3.0.4
- jdk8
如何提高数据写入性能，希望能达到秒级10万以上？
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reproducing the reported JDBC batch write of 60,000 rows across 60,000 subtables on the stated three-node environment, using TDengine 3.0.4.1 and the taos-jdbcdriver 3.0.4. Measure both the first and second writes. Done means identifying the limiting factor and documenting or implementing a path that reaches the requested 100,000-plus writes per second.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- databases, distributed-systems, performance
- Issue type
- Bug
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100