influxdata / influxdata/influxdb

influxd: verify config options before loading tsm data

Open
#21,672 3 comments 0 reactions 0 assignees View on GitHub
area/2.x
Dominant language
Rust
Stars
31.7k
Forks
3.7k
Avg merge
13h 37m
Merged PRs (30d)
8

Description

i was working to turn on https for my OSS instance, and noticed that each time i made a change and needed to restart `influxd`, it seemed to load all my tsm files before erroring out because it couldn't read the tls options.

here's an example. I'm trying to start influxd, and it seems to read all of my date before telling me there's an issue unrelated to my data. In total, it took 30s to tell me something that stopped the instance from starting. The same happens if you have an issue with your tls parameters.

Is it possible to delay the loading of the actual tsm data / indexes until the very end, when we are pretty sure there aren't other config problems?

```
➜ influxdb-telegraf-docker time influxd --tls-cert=/Users/rsavage/workspace/influxdb-telegraf-docker/ssl/influxdb-selfsigned.crt --tls-key=/Users/rsavage/workspace/influxdb-telegraf-docker/ssl/influxdb-selfsigned.key
2021-06-11T22:49:58.747379Z info Welcome to InfluxDB {"log_id": "0UgK7lrl000", "version": "2.0.7", "commit": "none", "build_date": "2021-06-11T22:49:43Z"}
2021-06-11T22:49:58.789597Z info Resources opened {"log_id": "0UgK7lrl000", "service": "bolt", "path": "/Users/rsavage/.influxdbv2/influxd.bolt"}
2021-06-11T22:49:59.049221Z info Checking InfluxDB metadata for prior version. {"log_id": "0UgK7lrl000", "bolt_path": "/Users/rsavage/.influxdbv2/influxd.bolt"}
2021-06-11T22:49:59.049737Z info Using data dir {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "path": "/Users/rsavage/.influxdbv2/engine/data"}
2021-06-11T22:49:59.049806Z info Compaction settings {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "max_concurrent_compactions": 4, "throughput_bytes_per_second": 50331648, "throughput_bytes_per_second_burst": 50331648}
2021-06-11T22:49:59.049827Z info Open store (start) {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "op_event": "start"}
2021-06-11T22:49:59.917401Z info index opened with 8 partitions {"log_id": "0UgK7lrl000", "service": "storage-engine", "index": "tsi"}
2021-06-11T22:49:59.919146Z info index opened with 8 partitions {"log_id": "0UgK7lrl000", "service": "storage-engine", "index": "tsi"}
2021-06-11T22:49:59.923186Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/1/000000001-000000001.tsm", "id": 0, "duration": "3.076ms"}
2021-06-11T22:49:59.923640Z info index opened with 8 partitions {"log_id": "0UgK7lrl000", "service": "storage-engine", "index": "tsi"}
2021-06-11T22:49:59.923785Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/105/000000007-000000002.tsm", "id": 0, "duration": "2.944ms"}
2021-06-11T22:49:59.926043Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/110/000000003-000000002.tsm", "id": 0, "duration": "0.794ms"}
2021-06-11T22:49:59.929460Z info index opened with 8 partitions {"log_id": "0UgK7lrl000", "service": "storage-engine", "index": "tsi"}
2021-06-11T22:49:59.930009Z info index opened with 8 partitions {"log_id": "0UgK7lrl000", "service": "storage-engine", "index": "tsi"}
2021-06-11T22:49:59.934813Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/97/000000009-000000002.tsm", "id": 0, "duration": "2.914ms"}
2021-06-11T22:49:59.935084Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/115/000000005-000000002.tsm", "id": 0, "duration": "2.753ms"}
2021-06-11T22:49:59.945401Z info index opened with 8 partitions {"log_id": "0UgK7lrl000", "service": "storage-engine", "index": "tsi"}
2021-06-11T22:49:59.957220Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/102/000000006-000000002.tsm", "id": 0, "duration": "7.763ms"}
2021-06-11T22:49:59.982914Z info index opened with 8 partitions {"log_id": "0UgK7lrl000", "service": "storage-engine", "index": "tsi"}
2021-06-11T22:49:59.993386Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/12/000000001-000000001.tsm", "id": 0, "duration": "8.910ms"}
2021-06-11T22:50:00.457929Z info Opened shard {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "index_version": "tsi1", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/12", "duration": "586.629ms"}
2021-06-11T22:50:00.457991Z info Opened shard {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "index_version": "tsi1", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/110", "duration": "589.373ms"}
2021-06-11T22:50:00.458163Z info Opened shard {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "index_version": "tsi1", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/1", "duration": "595.623ms"}
2021-06-11T22:50:00.459249Z info Opened shard {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "index_version": "tsi1", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/97", "duration": "598.053ms"}
2021-06-11T22:50:00.459538Z info Opened shard {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "index_version": "tsi1", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/105", "duration": "592.754ms"}
2021-06-11T22:50:00.463873Z info Opened shard {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "index_version": "tsi1", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/115", "duration": "593.775ms"}
2021-06-11T22:50:00.466820Z info Opened shard {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "index_version": "tsi1", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/102", "duration": "601.722ms"}
2021-06-11T22:50:00.466943Z info index opened with 8 partitions {"log_id": "0UgK7lrl000", "service": "storage-engine", "index": "tsi"}
2021-06-11T22:50:00.471213Z info index opened with 8 partitions {"log_id": "0UgK7lrl000", "service": "storage-engine", "index": "tsi"}
2021-06-11T22:50:00.471288Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/129/000000004-000000001.tsm", "id": 1, "duration": "2.543ms"}
2021-06-11T22:50:00.472628Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/129/000000002-000000002.tsm", "id": 0, "duration": "2.987ms"}
2021-06-11T22:50:00.472966Z info index opened with 8 partitions {"log_id": "0UgK7lrl000", "service": "storage-engine", "index": "tsi"}
2021-06-11T22:50:00.472964Z info Reading file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "cacheloader", "path": "/Users/rsavage/.influxdbv2/engine/wal/5dd4bc99653897b0/autogen/129/_00013.wal", "size": 235260}
2021-06-11T22:50:00.474001Z info index opened with 8 partitions {"log_id": "0UgK7lrl000", "service": "storage-engine", "index": "tsi"}
2021-06-11T22:50:00.475882Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/38/000000001-000000001.tsm", "id": 0, "duration": "3.833ms"}
2021-06-11T22:50:00.476048Z info Opened shard {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "index_version": "tsi1", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/38", "duration": "16.726ms"}
2021-06-11T22:50:00.483956Z info index opened with 8 partitions {"log_id": "0UgK7lrl000", "service": "storage-engine", "index": "tsi"}
2021-06-11T22:50:00.485529Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/2/000000022-000000002.tsm", "id": 0, "duration": "9.458ms"}
2021-06-11T22:50:00.485703Z info Opened shard {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "index_version": "tsi1", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/2", "duration": "27.476ms"}
2021-06-11T22:50:00.488184Z info index opened with 8 partitions {"log_id": "0UgK7lrl000", "service": "storage-engine", "index": "tsi"}
2021-06-11T22:50:00.488213Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/46/000000026-000000002.tsm", "id": 0, "duration": "12.325ms"}
2021-06-11T22:50:00.489715Z info index opened with 8 partitions {"log_id": "0UgK7lrl000", "service": "storage-engine", "index": "tsi"}
2021-06-11T22:50:00.490627Z info index opened with 8 partitions {"log_id": "0UgK7lrl000", "service": "storage-engine", "index": "tsi"}
2021-06-11T22:50:00.495588Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/76/000000014-000000002.tsm", "id": 0, "duration": "2.244ms"}
2021-06-11T22:50:00.499302Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/6/000000016-000000002.tsm", "id": 0, "duration": "11.890ms"}
2021-06-11T22:50:00.502553Z info Opened shard {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "index_version": "tsi1", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/129", "duration": "44.537ms"}
2021-06-11T22:50:00.504686Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/121/000000013-000000002.tsm", "id": 0, "duration": "7.157ms"}
2021-06-11T22:50:00.504904Z info Opened shard {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "index_version": "tsi1", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/121", "duration": "46.925ms"}
2021-06-11T22:50:00.508818Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/84/000000034-000000002.tsm", "id": 0, "duration": "16.110ms"}
2021-06-11T22:50:00.516736Z info Opened shard {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "index_version": "tsi1", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/84", "duration": "40.659ms"}
2021-06-11T22:50:00.542215Z info Opened shard {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "index_version": "tsi1", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/46", "duration": "82.638ms"}
2021-06-11T22:50:00.605067Z info Opened shard {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "index_version": "tsi1", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/76", "duration": "138.196ms"}
2021-06-11T22:50:00.614448Z info Opened shard {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "index_version": "tsi1", "path": "/Users/rsavage/.influxdbv2/engine/data/5dd4bc99653897b0/autogen/6", "duration": "150.401ms"}
2021-06-11T22:50:00.710567Z info index opened with 8 partitions {"log_id": "0UgK7lrl000", "service": "storage-engine", "index": "tsi"}
2021-06-11T22:50:00.992647Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/d03b564888610639/autogen/77/000000001-000000001.tsm", "id": 0, "duration": "280.015ms"}
2021-06-11T22:50:00.992899Z info Opened shard {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "index_version": "tsi1", "path": "/Users/rsavage/.influxdbv2/engine/data/d03b564888610639/autogen/77", "duration": "378.405ms"}
2021-06-11T22:50:01.240866Z info index opened with 8 partitions {"log_id": "0UgK7lrl000", "service": "storage-engine", "index": "tsi"}
2021-06-11T22:50:01.282534Z info index opened with 8 partitions {"log_id": "0UgK7lrl000", "service": "storage-engine", "index": "tsi"}
2021-06-11T22:50:01.375280Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/e6a184c43ea296b7/autogen/127/000000001-000000001.tsm", "id": 0, "duration": "132.654ms"}
2021-06-11T22:50:01.375511Z info Opened shard {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "index_version": "tsi1", "path": "/Users/rsavage/.influxdbv2/engine/data/e6a184c43ea296b7/autogen/127", "duration": "382.588ms"}
2021-06-11T22:50:01.415870Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/d03b564888610639/autogen/116/000000001-000000001.tsm", "id": 0, "duration": "131.752ms"}
2021-06-11T22:50:01.416335Z info Opened shard {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "index_version": "tsi1", "path": "/Users/rsavage/.influxdbv2/engine/data/d03b564888610639/autogen/116", "duration": "807.081ms"}
2021-06-11T22:50:01.482952Z info index opened with 8 partitions {"log_id": "0UgK7lrl000", "service": "storage-engine", "index": "tsi"}
2021-06-11T22:50:01.507719Z info index opened with 8 partitions {"log_id": "0UgK7lrl000", "service": "storage-engine", "index": "tsi"}
2021-06-11T22:50:01.605321Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/e6a184c43ea296b7/autogen/125/000000001-000000001.tsm", "id": 0, "duration": "119.618ms"}
2021-06-11T22:50:01.605580Z info Opened shard {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "index_version": "tsi1", "path": "/Users/rsavage/.influxdbv2/engine/data/e6a184c43ea296b7/autogen/125", "duration": "230.041ms"}
2021-06-11T22:50:01.623214Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/e6a184c43ea296b7/autogen/130/000000004-000000002.tsm", "id": 0, "duration": "113.542ms"}
2021-06-11T22:50:01.644384Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/e6a184c43ea296b7/autogen/130/000000006-000000001.tsm", "id": 1, "duration": "135.513ms"}
2021-06-11T22:50:01.644649Z info Opened shard {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "index_version": "tsi1", "path": "/Users/rsavage/.influxdbv2/engine/data/e6a184c43ea296b7/autogen/130", "duration": "228.257ms"}
2021-06-11T22:50:01.677096Z info index opened with 8 partitions {"log_id": "0UgK7lrl000", "service": "storage-engine", "index": "tsi"}
2021-06-11T22:50:01.679013Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/e6a184c43ea296b7/autogen/128/000000002-000000002.tsm", "id": 0, "duration": "0.495ms"}
2021-06-11T22:50:01.680412Z info Opened shard {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "index_version": "tsi1", "path": "/Users/rsavage/.influxdbv2/engine/data/e6a184c43ea296b7/autogen/128", "duration": "74.784ms"}
2021-06-11T22:50:01.687182Z info index opened with 8 partitions {"log_id": "0UgK7lrl000", "service": "storage-engine", "index": "tsi"}
2021-06-11T22:50:01.689022Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/eda96effec8dbb60/autogen/126/000000002-000000002.tsm", "id": 0, "duration": "0.618ms"}
2021-06-11T22:50:01.689210Z info Opened shard {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "index_version": "tsi1", "path": "/Users/rsavage/.influxdbv2/engine/data/eda96effec8dbb60/autogen/126", "duration": "7.433ms"}
2021-06-11T22:50:01.701299Z info index opened with 8 partitions {"log_id": "0UgK7lrl000", "service": "storage-engine", "index": "tsi"}
2021-06-11T22:50:01.703393Z info Reading file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "cacheloader", "path": "/Users/rsavage/.influxdbv2/engine/wal/e6a184c43ea296b7/autogen/131/_00001.wal", "size": 3410}
2021-06-11T22:50:01.704928Z info Opened shard {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "index_version": "tsi1", "path": "/Users/rsavage/.influxdbv2/engine/data/e6a184c43ea296b7/autogen/131", "duration": "60.231ms"}
2021-06-11T22:50:02.211029Z info index opened with 8 partitions {"log_id": "0UgK7lrl000", "service": "storage-engine", "index": "tsi"}
2021-06-11T22:50:02.660655Z info index opened with 8 partitions {"log_id": "0UgK7lrl000", "service": "storage-engine", "index": "tsi"}
2021-06-11T22:50:02.802688Z info index opened with 8 partitions {"log_id": "0UgK7lrl000", "service": "storage-engine", "index": "tsi"}
2021-06-11T22:50:02.870317Z info index opened with 8 partitions {"log_id": "0UgK7lrl000", "service": "storage-engine", "index": "tsi"}
2021-06-11T22:50:02.956393Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/40bc0ef6a903b32e/autogen/109/000000003-000000002.tsm", "id": 0, "duration": "294.208ms"}
2021-06-11T22:50:02.956622Z info Opened shard {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "index_version": "tsi1", "path": "/Users/rsavage/.influxdbv2/engine/data/40bc0ef6a903b32e/autogen/109", "duration": "3107.073ms"}
2021-06-11T22:50:03.020683Z info index opened with 8 partitions {"log_id": "0UgK7lrl000", "service": "storage-engine", "index": "tsi"}
2021-06-11T22:50:03.391918Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/634fd930f0e0beaf/autogen/73/000000269-000000003.tsm", "id": 1, "duration": "1178.248ms"}
2021-06-11T22:50:04.073679Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/634fd930f0e0beaf/autogen/71/000000380-000000003.tsm", "id": 1, "duration": "1201.155ms"}
2021-06-11T22:50:04.084768Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/634fd930f0e0beaf/autogen/70/000000353-000000003.tsm", "id": 1, "duration": "1280.553ms"}
2021-06-11T22:50:04.404049Z info index opened with 8 partitions {"log_id": "0UgK7lrl000", "service": "storage-engine", "index": "tsi"}
2021-06-11T22:50:04.485119Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/634fd930f0e0beaf/autogen/69/000000170-000000003.tsm", "id": 1, "duration": "79.319ms"}
2021-06-11T22:50:04.520401Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/634fd930f0e0beaf/autogen/71/000000380-000000002.tsm", "id": 0, "duration": "1646.953ms"}
2021-06-11T22:50:04.520611Z info Opened shard {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "index_version": "tsi1", "path": "/Users/rsavage/.influxdbv2/engine/data/634fd930f0e0beaf/autogen/71", "duration": "4018.039ms"}
2021-06-11T22:50:04.571041Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/634fd930f0e0beaf/autogen/70/000000353-000000002.tsm", "id": 0, "duration": "1766.245ms"}
2021-06-11T22:50:04.571236Z info Opened shard {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "index_version": "tsi1", "path": "/Users/rsavage/.influxdbv2/engine/data/634fd930f0e0beaf/autogen/70", "duration": "4085.530ms"}
2021-06-11T22:50:05.764314Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/634fd930f0e0beaf/autogen/69/000000170-000000002.tsm", "id": 0, "duration": "1358.530ms"}
2021-06-11T22:50:05.764590Z info Opened shard {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "index_version": "tsi1", "path": "/Users/rsavage/.influxdbv2/engine/data/634fd930f0e0beaf/autogen/69", "duration": "5226.223ms"}
2021-06-11T22:50:06.479655Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/634fd930f0e0beaf/autogen/72/000000391-000000003.tsm", "id": 1, "duration": "3456.891ms"}
2021-06-11T22:50:09.533520Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/634fd930f0e0beaf/autogen/72/000000391-000000002.tsm", "id": 0, "duration": "6510.730ms"}
2021-06-11T22:50:09.533816Z info Opened shard {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "index_version": "tsi1", "path": "/Users/rsavage/.influxdbv2/engine/data/634fd930f0e0beaf/autogen/72", "duration": "9028.925ms"}
2021-06-11T22:50:09.537678Z info Opened file {"log_id": "0UgK7lrl000", "service": "storage-engine", "engine": "tsm1", "service": "filestore", "path": "/Users/rsavage/.influxdbv2/engine/data/634fd930f0e0beaf/autogen/73/000000269-000000002.tsm", "id": 0, "duration": "7323.224ms"}
2021-06-11T22:50:09.537932Z info Opened shard {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "index_version": "tsi1", "path": "/Users/rsavage/.influxdbv2/engine/data/634fd930f0e0beaf/autogen/73", "duration": "8993.578ms"}
2021-06-11T22:50:10.657022Z info Open store (end) {"log_id": "0UgK7lrl000", "service": "storage-engine", "service": "store", "op_name": "tsdb_open", "op_event": "end", "op_elapsed": "11607.244ms"}
2021-06-11T22:50:10.657105Z info Starting retention policy enforcement service {"log_id": "0UgK7lrl000", "service": "retention", "check_interval": "30m"}
2021-06-11T22:50:10.657146Z info Starting precreation service {"log_id": "0UgK7lrl000", "service": "shard-precreation", "check_interval": "10m", "advance_period": "30m"}
2021-06-11T22:50:10.657249Z info Starting query controller {"log_id": "0UgK7lrl000", "service": "storage-reads", "concurrency_quota": 1024, "initial_memory_bytes_quota_per_query": 9223372036854775807, "memory_bytes_quota_per_query": 9223372036854775807, "max_memory_bytes": 0, "queue_size": 1024}
2021-06-11T22:50:10.697127Z info Configuring InfluxQL statement executor (zeros indicate unlimited). {"log_id": "0UgK7lrl000", "max_select_point": 0, "max_select_series": 0, "max_select_buckets": 0}
2021-06-11T22:50:11.099723Z info Starting {"log_id": "0UgK7lrl000", "service": "telemetry", "interval": "8h"}
2021-06-11T22:50:11.099792Z error Failed to set up TCP listener {"log_id": "0UgK7lrl000", "service": "tcp-listener", "addr": ":8086", "error": "listen tcp :8086: bind: address already in use"}
Error: listen tcp :8086: bind: address already in use
See 'influxd -h' for help
influxd 40.42s user 9.49s system 174% cpu 28.683 total
```

Contributor guide

Open the contributing guide

Research direction

Start at the influxd startup path and trace when TLS and other configuration options are validated relative to TSM data, indexes, and WAL loading. Done means an invalid configuration fails before the storage data-loading work begins, without changing the reported configuration error.

Written by the indexing model from the issue text.

Assessment

Domain
databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.