apache / apache/iotdb

import-csv.bat导入数据时提示路径全数字问题

Open
#6,858 2 comments 1 reaction 0 assignees View on GitHub
Dominant language
Java
Stars
6.4k
Forks
1.2k
Avg merge
1d 23h
Merged PRs (30d)
115

Description

windows下执行以下命令导入路径(root.sg.T01601)的数据时,有三个小问题:

```
set JAVA_HOME=D:\jdk8_x64
D:/iotdb/tools/import-csv.bat -h 127.0.0.1 -p 6667 -u root -pw root -aligned false -batch 100000 -f D:\20211207\20211207_T01601.csv -fd D:\20211207\failed\ > log.txt

```

(1)import-csv.bat会执行select * from root.sg limit 1,导致服务端报错:
```
2022-08-01 21:34:00,922 [pool-16-IoTDB-RPC-Client-13] ERROR o.a.i.d.u.ErrorHandlingUtils:83 - Status code: 411, Query Statement: "select * from root.sg limit 1". executeQueryStatement failed
org.apache.iotdb.db.exception.query.PathNumOverLimitException: Too many paths in one query! Currently allowed max deduplicated path number is 1000. Please use slimit or adjust max_deduplicated_path_num in iotdb-engine.properties.
```

(2)import-csv.bat提示全数字路径(purely digital path),实际的路径(root.sg.T01601)不是全数字
import-csv.bat执行的结果log.txt文件内容:

````````````````````````````````````````````````
Starting IoTDB Client Import Script
````````````````````````````````````````````````
21:34:00.893 [main] DEBUG org.apache.iotdb.session.Session - EndPoint(ip:127.0.0.1, port:6667) execute sql select * from root.sg limit 1
Meet error when query the type of timeseries because the IoTDB v0.13 don't support that the path contains any purely digital path.
21:34:01.626 [main] DEBUG org.apache.iotdb.rpc.AutoResizingBuffer - org.apache.iotdb.rpc.AutoResizingBuffer@50d0686 expand from 1024 to 1536, request: 1026
21:34:01.627 [main] DEBUG org.apache.iotdb.rpc.AutoResizingBuffer - org.apache.iotdb.rpc.AutoResizingBuffer@50d0686 expand from 1536 to 2304, request: 1543
......
21:34:01.740 [main] DEBUG org.apache.iotdb.rpc.AutoResizingBuffer - org.apache.iotdb.rpc.AutoResizingBuffer@50d0686 expand from 3405019 to 5107528, request: 3405023
Import completely!

(3)import-csv.bat为什么需要执行select * from root.sg limit 1,感觉这里不需要,路径的类型已经在csv文件里第一行有了

20211207_T01601.csv文件内容:

> Time,root.sg.T01601(FLOAT)
> 2021-12-07T00:00:00.000+0800,1.6395046432176699
> 2021-12-07T00:00:01.000+0800,52.37059846464655
> 2021-12-07T00:00:02.000+0800,245.19064110874533
> ......

**Desktop (please complete the following information):**
- OS: Windows 2012,iotdb 0.13.1

Contributor guide

Open the contributing guide

Research direction

Start with tools/import-csv.bat and the importer entry point it invokes, using the reported Windows command and CSV header as the reproduction case. Trace why it runs `select * from root.sg limit 1` and reports a purely digital path. Done means the import handles `root.sg.T01601` without the path-limit or misleading path warning.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
cli, database
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.