segmentation violation in version 2

Open

#16,351 opened on Dec 30, 2019 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

panic

Dominant language: Rust
Stars: 31.7k
Forks: 3.7k
Avg merge: 13h 37m
Merged PRs (30d): 8

Description

__Steps to reproduce:__
I have a fresh install of 2 alpha. I have yet to have this happen more than once but I felt reporting it might be of some benefit.

__Expected behavior:__
I expected it to not freeze up :)

__Actual behavior:__
I was trying to refresh the dashboard page and the system was unresponsive. I tried to CTRL-C the influxd so I could restart it. After a couple minutes I got a go panic report.

__Environment info:__

* System info: Run `uname -srm` and copy the output here
```
uname -srm
Linux 4.19.0-6-cloud-amd64 x86_64
```
Fresh install of Debian 10 on AWS

* InfluxDB version: Run `influxd version` and copy the output here
```
./influxd version
Error: unknown command "version" for "influxd"
Run 'influxd --help' for usage.
```
It's `influxdb_2.0.0-alpha.21_linux_amd64`

Panic:
```
2019-12-30T14:21:31.048051Z error JSON encoding error {"log_id": "0K0mDGHG000", "error": "stan: connection closed"}
^C

2019-12-30T14:25:42.349361Z error JSON encoding error {"log_id": "0K0mDGHG000", "error": "stan: connection closed"}
2019-12-30T14:25:42.349479Z error JSON encoding error {"log_id": "0K0mDGHG000", "error": "stan: connection closed"}
2019-12-30T14:25:42.350181Z info Stopping {"log_id": "0K0mDGHG000", "service": "scraper"}
2019-12-30T14:25:42.355205Z info Stopping {"log_id": "0K0mDGHG000", "service": "task"}
2019-12-30T14:25:42.356229Z info Stopping {"log_id": "0K0mDGHG000", "service": "nats"}
2019-12-30T14:25:42.366477Z info Stopping {"log_id": "0K0mDGHG000", "service": "bolt"}
2019-12-30T14:25:42.366758Z info Stopping {"log_id": "0K0mDGHG000", "service": "query"}
2019-12-30T14:25:42.367479Z info Stopping {"log_id": "0K0mDGHG000", "service": "storage-engine"}
2019-12-30T14:25:42.367642Z info Stopping {"log_id": "0K0mDGHG000", "service": "storage-engine", "component": "retention_enforcer", "check_interval": "1h"}
2019-12-30T14:25:42.367857Z info Unauthorized {"log_id": "0K0mDGHG000", "error": "database not open"}
2019-12-30T14:25:42.371466Z info Unauthorized {"log_id": "0K0mDGHG000", "error": "database not open"}
unexpected fault address 0x7fcff535d00a
fatal error: fault
[signal SIGSEGV: segmentation violation code=0x1 addr=0x7fcff535d00a pc=0x929f3e]

goroutine 488000 [running]:
runtime.throw(0x1c697d9, 0x5)
/usr/local/go/src/runtime/panic.go:617 +0x72 fp=0xc06ba9d380 sp=0xc06ba9d350 pc=0x42d972
runtime.sigpanic()
/usr/local/go/src/runtime/signal_unix.go:397 +0x401 fp=0xc06ba9d3b0 sp=0xc06ba9d380 pc=0x442ee1
github.com/coreos/bbolt.(*page).leafPageElements(...)
/go/pkg/mod/github.com/coreos/bbolt@v1.3.1-coreos.6/page.go:65
github.com/coreos/bbolt.(*Cursor).nsearch(0xc06ba9d710, 0x3b664c0, 0x14, 0x14)
/go/pkg/mod/github.com/coreos/bbolt@v1.3.1-coreos.6/cursor.go:332 +0x6e fp=0xc06ba9d448 sp=0xc06ba9d3b0 pc=0x929f3e
github.com/coreos/bbolt.(*Cursor).search(0xc06ba9d710, 0x3b664c0, 0x14, 0x14, 0x1d)
/go/pkg/mod/github.com/coreos/bbolt@v1.3.1-coreos.6/cursor.go:263 +0x1cb fp=0xc06ba9d4e8 sp=0xc06ba9d448 pc=0x929a5b
github.com/coreos/bbolt.(*Cursor).searchPage(0xc000713710, 0x3b664c0, 0x14, 0x14, 0x7fcff536c000)
/go/pkg/mod/github.com/coreos/bbolt@v1.3.1-coreos.6/cursor.go:314 +0x153 fp=0xc06ba9d578 sp=0xc06ba9d4e8 pc=0x929e83
github.com/coreos/bbolt.(*Cursor).search(0xc000713710, 0x3b664c0, 0x14, 0x14, 0x2c)
/go/pkg/mod/github.com/coreos/bbolt@v1.3.1-coreos.6/cursor.go:271 +0x18b fp=0xc06ba9d618 sp=0xc06ba9d578 pc=0x929a1b
github.com/coreos/bbolt.(*Cursor).seek(0xc06ba9d710, 0x3b664c0, 0x14, 0x14, 0x40be92, 0xc06ba2e3a0, 0x10, 0x0, 0x31, 0xc0009141fa, ...)
/go/pkg/mod/github.com/coreos/bbolt@v1.3.1-coreos.6/cursor.go:159 +0x7e fp=0xc06ba9d688 sp=0xc06ba9d618 pc=0x92915e
github.com/coreos/bbolt.(*Bucket).Bucket(0xc06ba6c2b8, 0x3b664c0, 0x14, 0x14, 0xc000713800)
/go/pkg/mod/github.com/coreos/bbolt@v1.3.1-coreos.6/bucket.go:105 +0xd5 fp=0xc06ba9d740 sp=0xc06ba9d688 pc=0x925085
github.com/coreos/bbolt.(*Tx).Bucket(...)
/go/pkg/mod/github.com/coreos/bbolt@v1.3.1-coreos.6/tx.go:101
github.com/influxdata/influxdb/bolt.(*Tx).Bucket(0xc06ba6e3a0, 0x3b664c0, 0x14, 0x14, 0x8, 0xc06ba2e3a0, 0xc06ba6e3a0, 0xc0001b8000)
/go/src/github.com/influxdata/influxdb/bolt/kv.go:152 +0x57 fp=0xc06ba9d790 sp=0xc06ba9d740 pc=0xf57ec7
github.com/influxdata/influxdb/kv.authIndexBucket(0x2b3c740, 0xc06ba6e3a0, 0x20, 0x1d, 0xc0007138c0, 0x40be92)
/go/src/github.com/influxdata/influxdb/kv/auth.go:539 +0x59 fp=0xc06ba9d800 sp=0xc06ba9d790 pc=0xedb009
github.com/influxdata/influxdb/kv.(*Service).findAuthorizationByToken(0xc000b663f0, 0x2b4d100, 0xc06ba05050, 0x2b3c740, 0xc06ba6e3a0, 0xc06b92cba6, 0x58, 0x20, 0x1a574a0, 0x2ac0a13)
/go/src/github.com/influxdata/influxdb/kv/auth.go:109 +0x4d fp=0xc06ba9d898 sp=0xc06ba9d800 pc=0xed838d
github.com/influxdata/influxdb/kv.(*Service).FindAuthorizationByToken.func1(0x2b3c740, 0xc06ba6e3a0, 0x42c6ef, 0xc000000008)
/go/src/github.com/influxdata/influxdb/kv/auth.go:91 +0x6f fp=0xc06ba9d900 sp=0xc06ba9d898 pc=0xf34b6f
github.com/influxdata/influxdb/bolt.(*KVStore).View.func1(0xc06ba6c2a0, 0x285f8a8, 0xc06ba6c2a0)
/go/src/github.com/influxdata/influxdb/bolt/kv.go:103 +0x97 fp=0xc06ba9d948 sp=0xc06ba9d900 pc=0xf75027
github.com/coreos/bbolt.(*DB).View(0xc00000a5a0, 0xc0007139c8, 0x0, 0x0)
/go/pkg/mod/github.com/coreos/bbolt@v1.3.1-coreos.6/db.go:698 +0x90 fp=0xc06ba9d998 sp=0xc06ba9d948 pc=0x92c860
github.com/influxdata/influxdb/bolt.(*KVStore).View(0xc00049ce20, 0x2b4d100, 0xc06ba050b0, 0xc06baa2040, 0x0, 0x0)
/go/src/github.com/influxdata/influxdb/bolt/kv.go:102 +0xd5 fp=0xc06ba9d9f8 sp=0xc06ba9d998 pc=0xf57b95
github.com/influxdata/influxdb/kv.(*Service).FindAuthorizationByToken(0xc000b663f0, 0x2b4d100, 0xc06ba05050, 0xc06b92cba6, 0x58, 0xc06ba05080, 0xc06baa2000, 0x0)
/go/src/github.com/influxdata/influxdb/kv/auth.go:90 +0xd7 fp=0xc06ba9da40 sp=0xc06ba9d9f8 pc=0xed8277
github.com/influxdata/influxdb/http.(*AuthenticationHandler).extractAuthorization(0xc0001ef110, 0x2b4d100, 0xc06ba05050, 0xc06ba0ac00, 0x0, 0x0, 0x0, 0x0)
/go/src/github.com/influxdata/influxdb/http/authentication_middleware.go:155 +0xe9 fp=0xc06ba9daa0 sp=0xc06ba9da40 pc=0x1263c69
github.com/influxdata/influxdb/http.(*AuthenticationHandler).ServeHTTP(0xc0001ef110, 0x2b3d300, 0xc06ba6e360, 0xc06ba0ac00)
/go/src/github.com/influxdata/influxdb/http/authentication_middleware.go:95 +0x5b3 fp=0xc06ba9db40 sp=0xc06ba9daa0 pc=0x1263913
github.com/influxdata/influxdb/http.setCORSResponseHeaders.func1(0x2b3d300, 0xc06ba6e360, 0xc06ba0ac00)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:24 +0xab fp=0xc06ba9dbc8 sp=0xc06ba9db40 pc=0x12ddf7b
net/http.HandlerFunc.ServeHTTP(0xc00089b260, 0x2b3d300, 0xc06ba6e360, 0xc06ba0ac00)
/usr/local/go/src/net/http/server.go:1995 +0x44 fp=0xc06ba9dbf0 sp=0xc06ba9dbc8 pc=0x7301f4
github.com/influxdata/influxdb/http.skipOptionsMW.func1(0x2b3d300, 0xc06ba6e360, 0xc06ba0ac00)
/go/src/github.com/influxdata/influxdb/http/middleware.go:23 +0x6d fp=0xc06ba9dc20 sp=0xc06ba9dbf0 pc=0x12dba1d
net/http.HandlerFunc.ServeHTTP(0xc00089b280, 0x2b3d300, 0xc06ba6e360, 0xc06ba0ac00)
/usr/local/go/src/net/http/server.go:1995 +0x44 fp=0xc06ba9dc48 sp=0xc06ba9dc20 pc=0x7301f4
github.com/influxdata/influxdb/http.(*PlatformHandler).ServeHTTP(0xc00089b2c0, 0x2b3d300, 0xc06ba6e360, 0xc06ba0ac00)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:75 +0xe9 fp=0xc06ba9dc78 sp=0xc06ba9dc48 pc=0x12a87c9
github.com/influxdata/influxdb/http.(*Handler).ServeHTTP(0xc000126300, 0x2b43700, 0xc06ba6c1c0, 0xc06ba0ac00)
/go/src/github.com/influxdata/influxdb/http/handler.go:141 +0x214 fp=0xc06ba9dcf0 sp=0xc06ba9dc78 pc=0x1289584
net/http.serverHandler.ServeHTTP(0xc000364a90, 0x2b43700, 0xc06ba6c1c0, 0xc06b996d00)
/usr/local/go/src/net/http/server.go:2774 +0xa8 fp=0xc06ba9dd20 sp=0xc06ba9dcf0 pc=0x7334c8
net/http.(*conn).serve(0xc06b599e00, 0x2b4d040, 0xc06b8d3b00)
/usr/local/go/src/net/http/server.go:1878 +0x851 fp=0xc06ba9dfc8 sp=0xc06ba9dd20 pc=0x72f1b1
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1337 +0x1 fp=0xc06ba9dfd0 sp=0xc06ba9dfc8 pc=0x45cc91
created by net/http.(*Server).Serve
/usr/local/go/src/net/http/server.go:2884 +0x2f4

goroutine 1 [semacquire]:
sync.runtime_SemacquireMutex(0xc000bde0f8, 0xc000bde100)
/usr/local/go/src/runtime/sema.go:71 +0x3d
sync.(*RWMutex).Lock(0xc000bde0f0)
/usr/local/go/src/sync/rwmutex.go:98 +0x79
github.com/influxdata/influxdb/storage.(*Engine).Close(0xc000bde000, 0x0, 0x0)
/go/src/github.com/influxdata/influxdb/storage/engine.go:408 +0x9c
github.com/influxdata/influxdb/cmd/influxd/launcher.(*Launcher).Shutdown(0xc000375b80, 0x2b4d0c0, 0xc06b55acc0)
/go/src/github.com/influxdata/influxdb/cmd/influxd/launcher/launcher.go:396 +0xb71
github.com/influxdata/influxdb/cmd/influxd/launcher.NewCommand.func1(0xc0003d0000, 0x467ba28, 0x0, 0x0)
/go/src/github.com/influxdata/influxdb/cmd/influxd/launcher/launcher.go:109 +0x2a2
github.com/spf13/cobra.(*Command).execute(0xc0003d0000, 0xc00004c280, 0x0, 0x0, 0xc0003d0000, 0xc00004c280)
/go/pkg/mod/github.com/spf13/cobra@v0.0.3/command.go:766 +0x2ae
github.com/spf13/cobra.(*Command).ExecuteC(0xc0003d0000, 0x0, 0x0, 0xc0003d0000)
/go/pkg/mod/github.com/spf13/cobra@v0.0.3/command.go:852 +0x2ec
github.com/spf13/cobra.(*Command).Execute(...)
/go/pkg/mod/github.com/spf13/cobra@v0.0.3/command.go:800
main.main()
/go/src/github.com/influxdata/influxdb/cmd/influxd/main.go:57 +0x75

goroutine 6 [syscall]:
os/signal.signal_recv(0x2b32b80)
/usr/local/go/src/runtime/sigqueue.go:139 +0x9c
os/signal.loop()
/usr/local/go/src/os/signal/signal_unix.go:23 +0x22
created by os/signal.init.0
/usr/local/go/src/os/signal/signal_unix.go:29 +0x41

goroutine 18 [select]:
go.opencensus.io/stats/view.(*worker).start(0xc0001ce820)
/go/pkg/mod/go.opencensus.io@v0.22.0/stats/view/worker.go:154 +0x100
created by go.opencensus.io/stats/view.init.0
/go/pkg/mod/go.opencensus.io@v0.22.0/stats/view/worker.go:32 +0x57

goroutine 488029 [runnable]:
github.com/coreos/bbolt.(*Cursor).nsearch(0xc06bdb9710, 0x3b664c0, 0x14, 0x14)
/go/pkg/mod/github.com/coreos/bbolt@v1.3.1-coreos.6/cursor.go:318 +0x1bb
github.com/coreos/bbolt.(*Cursor).search(0xc06bdb9710, 0x3b664c0, 0x14, 0x14, 0x1d)
/go/pkg/mod/github.com/coreos/bbolt@v1.3.1-coreos.6/cursor.go:263 +0x1cb
github.com/coreos/bbolt.(*Cursor).searchPage(0xc000742710, 0x3b664c0, 0x14, 0x14, 0x7fcff535b000)
/go/pkg/mod/github.com/coreos/bbolt@v1.3.1-coreos.6/cursor.go:314 +0x153
github.com/coreos/bbolt.(*Cursor).search(0xc000742710, 0x3b664c0, 0x14, 0x14, 0x1b)
/go/pkg/mod/github.com/coreos/bbolt@v1.3.1-coreos.6/cursor.go:271 +0x18b
github.com/coreos/bbolt.(*Cursor).seek(0xc06bdb9710, 0x3b664c0, 0x14, 0x14, 0xc0448f7a80, 0x80, 0x80, 0x190bd60, 0x31, 0xc0009141fa, ...)
/go/pkg/mod/github.com/coreos/bbolt@v1.3.1-coreos.6/cursor.go:159 +0x7e
github.com/coreos/bbolt.(*Bucket).Bucket(0xc06ba2cc58, 0x3b664c0, 0x14, 0x14, 0xc000742800)
/go/pkg/mod/github.com/coreos/bbolt@v1.3.1-coreos.6/bucket.go:105 +0xd5
github.com/coreos/bbolt.(*Tx).Bucket(...)
/go/pkg/mod/github.com/coreos/bbolt@v1.3.1-coreos.6/tx.go:101
github.com/influxdata/influxdb/bolt.(*Tx).Bucket(0xc06ba3f4c0, 0x3b664c0, 0x14, 0x14, 0x8, 0xc06ba7aba8, 0xc06ba3f4c0, 0xc04acd0000)
/go/src/github.com/influxdata/influxdb/bolt/kv.go:152 +0x57
github.com/influxdata/influxdb/kv.authIndexBucket(0x2b3c740, 0xc06ba3f4c0, 0x40, 0xa6, 0xc0007428c0, 0x40be92)
/go/src/github.com/influxdata/influxdb/kv/auth.go:539 +0x59
github.com/influxdata/influxdb/kv.(*Service).findAuthorizationByToken(0xc000b663f0, 0x2b4d100, 0xc06ba6bce0, 0x2b3c740, 0xc06ba3f4c0, 0xc06baa0786, 0x58, 0x20, 0x1a574a0, 0x2ac0a13)
/go/src/github.com/influxdata/influxdb/kv/auth.go:109 +0x4d
github.com/influxdata/influxdb/kv.(*Service).FindAuthorizationByToken.func1(0x2b3c740, 0xc06ba3f4c0, 0x42c6ef, 0xc000000008)
/go/src/github.com/influxdata/influxdb/kv/auth.go:91 +0x6f
github.com/influxdata/influxdb/bolt.(*KVStore).View.func1(0xc06ba2cc40, 0x285f8a8, 0xc06ba2cc40)
/go/src/github.com/influxdata/influxdb/bolt/kv.go:103 +0x97
github.com/coreos/bbolt.(*DB).View(0xc00000a5a0, 0xc0007429c8, 0x0, 0x0)
/go/pkg/mod/github.com/coreos/bbolt@v1.3.1-coreos.6/db.go:698 +0x90
github.com/influxdata/influxdb/bolt.(*KVStore).View(0xc00049ce20, 0x2b4d100, 0xc06ba6bd40, 0xc06bcf6100, 0x0, 0x0)
/go/src/github.com/influxdata/influxdb/bolt/kv.go:102 +0xd5
github.com/influxdata/influxdb/kv.(*Service).FindAuthorizationByToken(0xc000b663f0, 0x2b4d100, 0xc06ba6bce0, 0xc06baa0786, 0x58, 0xc06ba6bd10, 0xc06bcf60c0, 0x0)
/go/src/github.com/influxdata/influxdb/kv/auth.go:90 +0xd7
github.com/influxdata/influxdb/http.(*AuthenticationHandler).extractAuthorization(0xc0001ef110, 0x2b4d100, 0xc06ba6bce0, 0xc06b997c00, 0x0, 0x0, 0x0, 0x0)
/go/src/github.com/influxdata/influxdb/http/authentication_middleware.go:155 +0xe9
github.com/influxdata/influxdb/http.(*AuthenticationHandler).ServeHTTP(0xc0001ef110, 0x2b3d300, 0xc06ba3f480, 0xc06b997c00)
/go/src/github.com/influxdata/influxdb/http/authentication_middleware.go:95 +0x5b3
github.com/influxdata/influxdb/http.setCORSResponseHeaders.func1(0x2b3d300, 0xc06ba3f480, 0xc06b997c00)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:24 +0xab
net/http.HandlerFunc.ServeHTTP(0xc00089b260, 0x2b3d300, 0xc06ba3f480, 0xc06b997c00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.skipOptionsMW.func1(0x2b3d300, 0xc06ba3f480, 0xc06b997c00)
/go/src/github.com/influxdata/influxdb/http/middleware.go:23 +0x6d
net/http.HandlerFunc.ServeHTTP(0xc00089b280, 0x2b3d300, 0xc06ba3f480, 0xc06b997c00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.(*PlatformHandler).ServeHTTP(0xc00089b2c0, 0x2b3d300, 0xc06ba3f480, 0xc06b997c00)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:75 +0xe9
github.com/influxdata/influxdb/http.(*Handler).ServeHTTP(0xc000126300, 0x2b43700, 0xc06ba2cb60, 0xc06b997c00)
/go/src/github.com/influxdata/influxdb/http/handler.go:141 +0x214
net/http.serverHandler.ServeHTTP(0xc000364a90, 0x2b43700, 0xc06ba2cb60, 0xc06b997b00)
/usr/local/go/src/net/http/server.go:2774 +0xa8
net/http.(*conn).serve(0xc06ba70280, 0x2b4d040, 0xc06b931fc0)
/usr/local/go/src/net/http/server.go:1878 +0x851
created by net/http.(*Server).Serve
/usr/local/go/src/net/http/server.go:2884 +0x2f4

goroutine 34 [select]:
github.com/influxdata/influxdb/tsdb/tsm1.(*Engine).compact(0xc0003666c0, 0xc0002630b0)
/go/src/github.com/influxdata/influxdb/tsdb/tsm1/engine.go:987 +0x12f
github.com/influxdata/influxdb/tsdb/tsm1.(*Engine).enableLevelCompactions.func1(0xc0002630b0, 0xc0003666c0)
/go/src/github.com/influxdata/influxdb/tsdb/tsm1/engine.go:332 +0x5b
created by github.com/influxdata/influxdb/tsdb/tsm1.(*Engine).enableLevelCompactions
/go/src/github.com/influxdata/influxdb/tsdb/tsm1/engine.go:332 +0x131

goroutine 33 [select]:
github.com/influxdata/influxdb/tsdb/tsm1.(*Engine).compactCache(0xc0003666c0)
/go/src/github.com/influxdata/influxdb/tsdb/tsm1/engine.go:899 +0x11d
github.com/influxdata/influxdb/tsdb/tsm1.(*Engine).enableSnapshotCompactions.func1(0xc0002630a0, 0xc0003666c0)
/go/src/github.com/influxdata/influxdb/tsdb/tsm1/engine.go:411 +0x51
created by github.com/influxdata/influxdb/tsdb/tsm1.(*Engine).enableSnapshotCompactions
/go/src/github.com/influxdata/influxdb/tsdb/tsm1/engine.go:411 +0x129

goroutine 89 [select, 7 minutes]:
github.com/influxdata/influxdb/query/control.(*Controller).processQueryQueue(0xc0003cbe40)
/go/src/github.com/influxdata/influxdb/query/control/controller.go:379 +0xd0
github.com/influxdata/influxdb/query/control.New.func1(0xc0003cbe40)
/go/src/github.com/influxdata/influxdb/query/control/controller.go:190 +0x57
created by github.com/influxdata/influxdb/query/control.New
/go/src/github.com/influxdata/influxdb/query/control/controller.go:188 +0x7fb

goroutine 90 [select, 7 minutes]:
github.com/influxdata/influxdb/query/control.(*Controller).processQueryQueue(0xc0003cbe40)
/go/src/github.com/influxdata/influxdb/query/control/controller.go:379 +0xd0
github.com/influxdata/influxdb/query/control.New.func1(0xc0003cbe40)
/go/src/github.com/influxdata/influxdb/query/control/controller.go:190 +0x57
created by github.com/influxdata/influxdb/query/control.New
/go/src/github.com/influxdata/influxdb/query/control/controller.go:188 +0x7fb

goroutine 91 [select, 5 minutes]:
github.com/influxdata/influxdb/query/control.(*Controller).processQueryQueue(0xc0003cbe40)
/go/src/github.com/influxdata/influxdb/query/control/controller.go:379 +0xd0
github.com/influxdata/influxdb/query/control.New.func1(0xc0003cbe40)
/go/src/github.com/influxdata/influxdb/query/control/controller.go:190 +0x57
created by github.com/influxdata/influxdb/query/control.New
/go/src/github.com/influxdata/influxdb/query/control/controller.go:188 +0x7fb

goroutine 92 [select, 5 minutes]:
github.com/influxdata/influxdb/query/control.(*Controller).processQueryQueue(0xc0003cbe40)
/go/src/github.com/influxdata/influxdb/query/control/controller.go:379 +0xd0
github.com/influxdata/influxdb/query/control.New.func1(0xc0003cbe40)
/go/src/github.com/influxdata/influxdb/query/control/controller.go:190 +0x57
created by github.com/influxdata/influxdb/query/control.New
/go/src/github.com/influxdata/influxdb/query/control/controller.go:188 +0x7fb

goroutine 93 [select, 5 minutes]:
github.com/influxdata/influxdb/query/control.(*Controller).processQueryQueue(0xc0003cbe40)
/go/src/github.com/influxdata/influxdb/query/control/controller.go:379 +0xd0
github.com/influxdata/influxdb/query/control.New.func1(0xc0003cbe40)
/go/src/github.com/influxdata/influxdb/query/control/controller.go:190 +0x57
created by github.com/influxdata/influxdb/query/control.New
/go/src/github.com/influxdata/influxdb/query/control/controller.go:188 +0x7fb

goroutine 94 [select, 7 minutes]:
github.com/influxdata/influxdb/query/control.(*Controller).processQueryQueue(0xc0003cbe40)
/go/src/github.com/influxdata/influxdb/query/control/controller.go:379 +0xd0
github.com/influxdata/influxdb/query/control.New.func1(0xc0003cbe40)
/go/src/github.com/influxdata/influxdb/query/control/controller.go:190 +0x57
created by github.com/influxdata/influxdb/query/control.New
/go/src/github.com/influxdata/influxdb/query/control/controller.go:188 +0x7fb

goroutine 95 [select, 7 minutes]:
github.com/influxdata/influxdb/query/control.(*Controller).processQueryQueue(0xc0003cbe40)
/go/src/github.com/influxdata/influxdb/query/control/controller.go:379 +0xd0
github.com/influxdata/influxdb/query/control.New.func1(0xc0003cbe40)
/go/src/github.com/influxdata/influxdb/query/control/controller.go:190 +0x57
created by github.com/influxdata/influxdb/query/control.New
/go/src/github.com/influxdata/influxdb/query/control/controller.go:188 +0x7fb

goroutine 96 [select, 5 minutes]:
github.com/influxdata/influxdb/query/control.(*Controller).processQueryQueue(0xc0003cbe40)
/go/src/github.com/influxdata/influxdb/query/control/controller.go:379 +0xd0
github.com/influxdata/influxdb/query/control.New.func1(0xc0003cbe40)
/go/src/github.com/influxdata/influxdb/query/control/controller.go:190 +0x57
created by github.com/influxdata/influxdb/query/control.New
/go/src/github.com/influxdata/influxdb/query/control/controller.go:188 +0x7fb

goroutine 97 [select, 7 minutes]:
github.com/influxdata/influxdb/query/control.(*Controller).processQueryQueue(0xc0003cbe40)
/go/src/github.com/influxdata/influxdb/query/control/controller.go:379 +0xd0
github.com/influxdata/influxdb/query/control.New.func1(0xc0003cbe40)
/go/src/github.com/influxdata/influxdb/query/control/controller.go:190 +0x57
created by github.com/influxdata/influxdb/query/control.New
/go/src/github.com/influxdata/influxdb/query/control/controller.go:188 +0x7fb

goroutine 98 [select, 7 minutes]:
github.com/influxdata/influxdb/query/control.(*Controller).processQueryQueue(0xc0003cbe40)
/go/src/github.com/influxdata/influxdb/query/control/controller.go:379 +0xd0
github.com/influxdata/influxdb/query/control.New.func1(0xc0003cbe40)
/go/src/github.com/influxdata/influxdb/query/control/controller.go:190 +0x57
created by github.com/influxdata/influxdb/query/control.New
/go/src/github.com/influxdata/influxdb/query/control/controller.go:188 +0x7fb

goroutine 487845 [runnable]:
compress/flate.(*decompressor).huffSym(0xc06b658000, 0xc06b658850, 0x10e, 0x0, 0x0)
/usr/local/go/src/compress/flate/inflate.go:707 +0x24a
compress/flate.(*decompressor).huffmanBlock(0xc06b658000)
/usr/local/go/src/compress/flate/inflate.go:564 +0x541
compress/flate.(*decompressor).nextBlock(0xc06b658000)
/usr/local/go/src/compress/flate/inflate.go:327 +0x16d
compress/flate.(*decompressor).Read(0xc06b658000, 0xc000489600, 0x200, 0x200, 0x7fcff9889008, 0xb, 0xc)
/usr/local/go/src/compress/flate/inflate.go:347 +0x77
compress/gzip.(*Reader).Read(0xc0000b7600, 0xc000489600, 0x200, 0x200, 0xc000489600, 0x0, 0x0)
/usr/local/go/src/compress/gzip/gunzip.go:251 +0x87
bytes.(*Buffer).ReadFrom(0xc06b6c8e38, 0x2b0c820, 0xc0000b7600, 0x1c6c4c4, 0x7, 0xc06b6c8e60)
/usr/local/go/src/bytes/buffer.go:207 +0xbd
io/ioutil.readAll(0x2b0c820, 0xc0000b7600, 0x200, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/io/ioutil/ioutil.go:36 +0xe5
io/ioutil.ReadAll(...)
/usr/local/go/src/io/ioutil/ioutil.go:45
github.com/influxdata/influxdb/http.(*WriteHandler).handleWrite(0xc0002c0f60, 0x2b3d300, 0xc06b356fe0, 0xc06b7c0300)
/go/src/github.com/influxdata/influxdb/http/write_handler.go:208 +0xda9
net/http.HandlerFunc.ServeHTTP(0xc00077fe00, 0x2b3d300, 0xc06b356fe0, 0xc06b7c0300)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/httprouter.(*Router).Handler.func1(0x2b3d300, 0xc06b356fe0, 0xc06b7c0300, 0x0, 0x0, 0x0)
/go/pkg/mod/github.com/influxdata/httprouter@v1.3.1-0.20191122104820-ee83e2772f69/router.go:325 +0x1b2
github.com/influxdata/httprouter.(*Router).ServeHTTP(0xc000126280, 0x2b3d300, 0xc06b356fe0, 0xc06b7c0200)
/go/pkg/mod/github.com/influxdata/httprouter@v1.3.1-0.20191122104820-ee83e2772f69/router.go:453 +0x882
github.com/go-chi/chi.(*Mux).Mount.func1(0x2b3d300, 0xc06b356fe0, 0xc06b7c0200)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:292 +0x127
net/http.HandlerFunc.ServeHTTP(0xc00089b080, 0x2b3d300, 0xc06b356fe0, 0xc06b7c0200)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi.(*Mux).routeHTTP(0xc000117020, 0x2b3d300, 0xc06b356fe0, 0xc06b7c0200)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:425 +0x27f
net/http.HandlerFunc.ServeHTTP(0xc00067bc20, 0x2b3d300, 0xc06b356fe0, 0xc06b7c0200)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.setCORSResponseHeaders.func1(0x2b3d300, 0xc06b356fe0, 0xc06b7c0200)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:24 +0xab
net/http.HandlerFunc.ServeHTTP(0xc000382f00, 0x2b3d300, 0xc06b356fe0, 0xc06b7c0200)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi/middleware.StripSlashes.func1(0x2b3d300, 0xc06b356fe0, 0xc06b7c0200)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/middleware/strip.go:25 +0xf0
net/http.HandlerFunc.ServeHTTP(0xc000382f20, 0x2b3d300, 0xc06b356fe0, 0xc06b7c0200)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.skipOptionsMW.func1(0x2b3d300, 0xc06b356fe0, 0xc06b7c0200)
/go/src/github.com/influxdata/influxdb/http/middleware.go:23 +0x6d
net/http.HandlerFunc.ServeHTTP(0xc000382f40, 0x2b3d300, 0xc06b356fe0, 0xc06b7c0200)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi.(*Mux).ServeHTTP(0xc000117020, 0x2b3d300, 0xc06b356fe0, 0xc06b2c1d00)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:82 +0x294
github.com/influxdata/influxdb/http.(*AuthenticationHandler).ServeHTTP(0xc0001ef110, 0x2b3d300, 0xc06b356fe0, 0xc06b528400)
/go/src/github.com/influxdata/influxdb/http/authentication_middleware.go:120 +0x29e
github.com/influxdata/influxdb/http.setCORSResponseHeaders.func1(0x2b3d300, 0xc06b356fe0, 0xc06b528400)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:24 +0xab
net/http.HandlerFunc.ServeHTTP(0xc00089b260, 0x2b3d300, 0xc06b356fe0, 0xc06b528400)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.skipOptionsMW.func1(0x2b3d300, 0xc06b356fe0, 0xc06b528400)
/go/src/github.com/influxdata/influxdb/http/middleware.go:23 +0x6d
net/http.HandlerFunc.ServeHTTP(0xc00089b280, 0x2b3d300, 0xc06b356fe0, 0xc06b528400)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.(*PlatformHandler).ServeHTTP(0xc00089b2c0, 0x2b3d300, 0xc06b356fe0, 0xc06b528400)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:75 +0xe9
github.com/influxdata/influxdb/http.(*Handler).ServeHTTP(0xc000126300, 0x2b43700, 0xc06b520000, 0xc06b528400)
/go/src/github.com/influxdata/influxdb/http/handler.go:141 +0x214
net/http.serverHandler.ServeHTTP(0xc000364a90, 0x2b43700, 0xc06b520000, 0xc06b28bd00)
/usr/local/go/src/net/http/server.go:2774 +0xa8
net/http.(*conn).serve(0xc0556b10e0, 0x2b4d040, 0xc06b1ebec0)
/usr/local/go/src/net/http/server.go:1878 +0x851
created by net/http.(*Server).Serve
/usr/local/go/src/net/http/server.go:2884 +0x2f4

goroutine 487838 [runnable]:
github.com/influxdata/influxdb/tsdb/tsm1.CollectionToValues(0xc06ba6c460, 0x2864a70, 0xc000bde0f0, 0x3b65001)
/go/src/github.com/influxdata/influxdb/tsdb/tsm1/value.go:57 +0x67
github.com/influxdata/influxdb/storage.(*Engine).WritePoints(0xc000bde000, 0x2b4d100, 0xc06ba05470, 0xc06b50ea80, 0x65d, 0x6a8, 0x0, 0x0)
/go/src/github.com/influxdata/influxdb/storage/engine.go:519 +0x106f
github.com/influxdata/influxdb/http.(*WriteHandler).handleWrite(0xc0002c0f60, 0x2b3d300, 0xc06b4e6440, 0xc06b529000)
/go/src/github.com/influxdata/influxdb/http/write_handler.go:247 +0x1a0b
net/http.HandlerFunc.ServeHTTP(0xc00077fe00, 0x2b3d300, 0xc06b4e6440, 0xc06b529000)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/httprouter.(*Router).Handler.func1(0x2b3d300, 0xc06b4e6440, 0xc06b529000, 0x0, 0x0, 0x0)
/go/pkg/mod/github.com/influxdata/httprouter@v1.3.1-0.20191122104820-ee83e2772f69/router.go:325 +0x1b2
github.com/influxdata/httprouter.(*Router).ServeHTTP(0xc000126280, 0x2b3d300, 0xc06b4e6440, 0xc06b2c1900)
/go/pkg/mod/github.com/influxdata/httprouter@v1.3.1-0.20191122104820-ee83e2772f69/router.go:453 +0x882
github.com/go-chi/chi.(*Mux).Mount.func1(0x2b3d300, 0xc06b4e6440, 0xc06b2c1900)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:292 +0x127
net/http.HandlerFunc.ServeHTTP(0xc00089b080, 0x2b3d300, 0xc06b4e6440, 0xc06b2c1900)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi.(*Mux).routeHTTP(0xc000117020, 0x2b3d300, 0xc06b4e6440, 0xc06b2c1900)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:425 +0x27f
net/http.HandlerFunc.ServeHTTP(0xc00067bc20, 0x2b3d300, 0xc06b4e6440, 0xc06b2c1900)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.setCORSResponseHeaders.func1(0x2b3d300, 0xc06b4e6440, 0xc06b2c1900)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:24 +0xab
net/http.HandlerFunc.ServeHTTP(0xc000382f00, 0x2b3d300, 0xc06b4e6440, 0xc06b2c1900)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi/middleware.StripSlashes.func1(0x2b3d300, 0xc06b4e6440, 0xc06b2c1900)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/middleware/strip.go:25 +0xf0
net/http.HandlerFunc.ServeHTTP(0xc000382f20, 0x2b3d300, 0xc06b4e6440, 0xc06b2c1900)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.skipOptionsMW.func1(0x2b3d300, 0xc06b4e6440, 0xc06b2c1900)
/go/src/github.com/influxdata/influxdb/http/middleware.go:23 +0x6d
net/http.HandlerFunc.ServeHTTP(0xc000382f40, 0x2b3d300, 0xc06b4e6440, 0xc06b2c1900)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi.(*Mux).ServeHTTP(0xc000117020, 0x2b3d300, 0xc06b4e6440, 0xc06b2c1800)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:82 +0x294
github.com/influxdata/influxdb/http.(*AuthenticationHandler).ServeHTTP(0xc0001ef110, 0x2b3d300, 0xc06b4e6440, 0xc06b2c0d00)
/go/src/github.com/influxdata/influxdb/http/authentication_middleware.go:120 +0x29e
github.com/influxdata/influxdb/http.setCORSResponseHeaders.func1(0x2b3d300, 0xc06b4e6440, 0xc06b2c0d00)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:24 +0xab
net/http.HandlerFunc.ServeHTTP(0xc00089b260, 0x2b3d300, 0xc06b4e6440, 0xc06b2c0d00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.skipOptionsMW.func1(0x2b3d300, 0xc06b4e6440, 0xc06b2c0d00)
/go/src/github.com/influxdata/influxdb/http/middleware.go:23 +0x6d
net/http.HandlerFunc.ServeHTTP(0xc00089b280, 0x2b3d300, 0xc06b4e6440, 0xc06b2c0d00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.(*PlatformHandler).ServeHTTP(0xc00089b2c0, 0x2b3d300, 0xc06b4e6440, 0xc06b2c0d00)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:75 +0xe9
github.com/influxdata/influxdb/http.(*Handler).ServeHTTP(0xc000126300, 0x2b43700, 0xc06ac49dc0, 0xc06b2c0d00)
/go/src/github.com/influxdata/influxdb/http/handler.go:141 +0x214
net/http.serverHandler.ServeHTTP(0xc000364a90, 0x2b43700, 0xc06ac49dc0, 0xc06b2c0c00)
/usr/local/go/src/net/http/server.go:2774 +0xa8
net/http.(*conn).serve(0xc055629e00, 0x2b4d040, 0xc06b4ee140)
/usr/local/go/src/net/http/server.go:1878 +0x851
created by net/http.(*Server).Serve
/usr/local/go/src/net/http/server.go:2884 +0x2f4

goroutine 487824 [chan receive]:
github.com/influxdata/influxdb/storage/wal.(*WAL).writeToLog(0xc0000d84d0, 0x2b56a00, 0xc065385920, 0x467ba28, 0x2b4d100, 0xc069c75d10)
/go/src/github.com/influxdata/influxdb/storage/wal/wal.go:482 +0x328
github.com/influxdata/influxdb/storage/wal.(*WAL).WriteMulti(0xc0000d84d0, 0x2b4d100, 0xc06bcf4330, 0xc06bcf4360, 0x0, 0x0, 0x0)
/go/src/github.com/influxdata/influxdb/storage/wal/wal.go:324 +0xd3
github.com/influxdata/influxdb/storage.(*Engine).WritePoints(0xc000bde000, 0x2b4d100, 0xc06bcf4330, 0xc000240a00, 0x41a, 0x550, 0x0, 0x0)
/go/src/github.com/influxdata/influxdb/storage/engine.go:525 +0x10c6
github.com/influxdata/influxdb/http.(*WriteHandler).handleWrite(0xc0002c0f60, 0x2b3d300, 0xc06b3562c0, 0xc06b2c1a00)
/go/src/github.com/influxdata/influxdb/http/write_handler.go:247 +0x1a0b
net/http.HandlerFunc.ServeHTTP(0xc00077fe00, 0x2b3d300, 0xc06b3562c0, 0xc06b2c1a00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/httprouter.(*Router).Handler.func1(0x2b3d300, 0xc06b3562c0, 0xc06b2c1a00, 0x0, 0x0, 0x0)
/go/pkg/mod/github.com/influxdata/httprouter@v1.3.1-0.20191122104820-ee83e2772f69/router.go:325 +0x1b2
github.com/influxdata/httprouter.(*Router).ServeHTTP(0xc000126280, 0x2b3d300, 0xc06b3562c0, 0xc06b528f00)
/go/pkg/mod/github.com/influxdata/httprouter@v1.3.1-0.20191122104820-ee83e2772f69/router.go:453 +0x882
github.com/go-chi/chi.(*Mux).Mount.func1(0x2b3d300, 0xc06b3562c0, 0xc06b528f00)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:292 +0x127
net/http.HandlerFunc.ServeHTTP(0xc00089b080, 0x2b3d300, 0xc06b3562c0, 0xc06b528f00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi.(*Mux).routeHTTP(0xc000117020, 0x2b3d300, 0xc06b3562c0, 0xc06b528f00)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:425 +0x27f
net/http.HandlerFunc.ServeHTTP(0xc00067bc20, 0x2b3d300, 0xc06b3562c0, 0xc06b528f00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.setCORSResponseHeaders.func1(0x2b3d300, 0xc06b3562c0, 0xc06b528f00)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:24 +0xab
net/http.HandlerFunc.ServeHTTP(0xc000382f00, 0x2b3d300, 0xc06b3562c0, 0xc06b528f00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi/middleware.StripSlashes.func1(0x2b3d300, 0xc06b3562c0, 0xc06b528f00)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/middleware/strip.go:25 +0xf0
net/http.HandlerFunc.ServeHTTP(0xc000382f20, 0x2b3d300, 0xc06b3562c0, 0xc06b528f00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.skipOptionsMW.func1(0x2b3d300, 0xc06b3562c0, 0xc06b528f00)
/go/src/github.com/influxdata/influxdb/http/middleware.go:23 +0x6d
net/http.HandlerFunc.ServeHTTP(0xc000382f40, 0x2b3d300, 0xc06b3562c0, 0xc06b528f00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi.(*Mux).ServeHTTP(0xc000117020, 0x2b3d300, 0xc06b3562c0, 0xc06b528e00)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:82 +0x294
github.com/influxdata/influxdb/http.(*AuthenticationHandler).ServeHTTP(0xc0001ef110, 0x2b3d300, 0xc06b3562c0, 0xc06b28b500)
/go/src/github.com/influxdata/influxdb/http/authentication_middleware.go:120 +0x29e
github.com/influxdata/influxdb/http.setCORSResponseHeaders.func1(0x2b3d300, 0xc06b3562c0, 0xc06b28b500)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:24 +0xab
net/http.HandlerFunc.ServeHTTP(0xc00089b260, 0x2b3d300, 0xc06b3562c0, 0xc06b28b500)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.skipOptionsMW.func1(0x2b3d300, 0xc06b3562c0, 0xc06b28b500)
/go/src/github.com/influxdata/influxdb/http/middleware.go:23 +0x6d
net/http.HandlerFunc.ServeHTTP(0xc00089b280, 0x2b3d300, 0xc06b3562c0, 0xc06b28b500)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.(*PlatformHandler).ServeHTTP(0xc00089b2c0, 0x2b3d300, 0xc06b3562c0, 0xc06b28b500)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:75 +0xe9
github.com/influxdata/influxdb/http.(*Handler).ServeHTTP(0xc000126300, 0x2b43700, 0xc05583b7a0, 0xc06b28b500)
/go/src/github.com/influxdata/influxdb/http/handler.go:141 +0x214
net/http.serverHandler.ServeHTTP(0xc000364a90, 0x2b43700, 0xc05583b7a0, 0xc06b28b400)
/usr/local/go/src/net/http/server.go:2774 +0xa8
net/http.(*conn).serve(0xc0556b0fa0, 0x2b4d040, 0xc06b352900)
/usr/local/go/src/net/http/server.go:1878 +0x851
created by net/http.(*Server).Serve
/usr/local/go/src/net/http/server.go:2884 +0x2f4

goroutine 487971 [runnable]:
github.com/influxdata/influxdb/models.parsePointsAppend.func1(0xc06be0653c, 0x7, 0x98c4, 0xc06be06544, 0x2, 0x98bc, 0xc06be0653c, 0xa, 0x98c4, 0xc069fb8a01)
/go/src/github.com/influxdata/influxdb/models/points.go:504 +0x83
github.com/influxdata/influxdb/models.walkFields(0xc06be06546, 0x36, 0x98bc, 0xc069fb8b90, 0xed59bfeae, 0x0)
/go/src/github.com/influxdata/influxdb/models/points.go:1655 +0x1f0
github.com/influxdata/influxdb/models.parsePointsAppend(0xc06be5a000, 0x426, 0x600, 0xc06be064dc, 0xb4, 0x9924, 0xc069fb8f98, 0x10, 0x10, 0xbf7aa0199301d31e, ...)
/go/src/github.com/influxdata/influxdb/models/points.go:492 +0x5f2
github.com/influxdata/influxdb/models.parsePointsWithPrecision(0xc06be00000, 0xdc85, 0xfe00, 0xc069fb8f98, 0x10, 0x10, 0xbf7aa0199301d31e, 0x3ec2792f6b77, 0x465dce0, 0x1c67560, ...)
/go/src/github.com/influxdata/influxdb/models/points.go:408 +0x377
github.com/influxdata/influxdb/models.ParsePointsWithPrecision(...)
/go/src/github.com/influxdata/influxdb/models/points.go:373
github.com/influxdata/influxdb/http.(*WriteHandler).handleWrite(0xc0002c0f60, 0x2b3d300, 0xc06ba3e0c0, 0xc06b997f00)
/go/src/github.com/influxdata/influxdb/http/write_handler.go:235 +0x1574
net/http.HandlerFunc.ServeHTTP(0xc00077fe00, 0x2b3d300, 0xc06ba3e0c0, 0xc06b997f00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/httprouter.(*Router).Handler.func1(0x2b3d300, 0xc06ba3e0c0, 0xc06b997f00, 0x0, 0x0, 0x0)
/go/pkg/mod/github.com/influxdata/httprouter@v1.3.1-0.20191122104820-ee83e2772f69/router.go:325 +0x1b2
github.com/influxdata/httprouter.(*Router).ServeHTTP(0xc000126280, 0x2b3d300, 0xc06ba3e0c0, 0xc06b997e00)
/go/pkg/mod/github.com/influxdata/httprouter@v1.3.1-0.20191122104820-ee83e2772f69/router.go:453 +0x882
github.com/go-chi/chi.(*Mux).Mount.func1(0x2b3d300, 0xc06ba3e0c0, 0xc06b997e00)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:292 +0x127
net/http.HandlerFunc.ServeHTTP(0xc00089b080, 0x2b3d300, 0xc06ba3e0c0, 0xc06b997e00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi.(*Mux).routeHTTP(0xc000117020, 0x2b3d300, 0xc06ba3e0c0, 0xc06b997e00)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:425 +0x27f
net/http.HandlerFunc.ServeHTTP(0xc00067bc20, 0x2b3d300, 0xc06ba3e0c0, 0xc06b997e00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.setCORSResponseHeaders.func1(0x2b3d300, 0xc06ba3e0c0, 0xc06b997e00)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:24 +0xab
net/http.HandlerFunc.ServeHTTP(0xc000382f00, 0x2b3d300, 0xc06ba3e0c0, 0xc06b997e00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi/middleware.StripSlashes.func1(0x2b3d300, 0xc06ba3e0c0, 0xc06b997e00)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/middleware/strip.go:25 +0xf0
net/http.HandlerFunc.ServeHTTP(0xc000382f20, 0x2b3d300, 0xc06ba3e0c0, 0xc06b997e00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.skipOptionsMW.func1(0x2b3d300, 0xc06ba3e0c0, 0xc06b997e00)
/go/src/github.com/influxdata/influxdb/http/middleware.go:23 +0x6d
net/http.HandlerFunc.ServeHTTP(0xc000382f40, 0x2b3d300, 0xc06ba3e0c0, 0xc06b997e00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi.(*Mux).ServeHTTP(0xc000117020, 0x2b3d300, 0xc06ba3e0c0, 0xc06b997d00)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:82 +0x294
github.com/influxdata/influxdb/http.(*AuthenticationHandler).ServeHTTP(0xc0001ef110, 0x2b3d300, 0xc06ba3e0c0, 0xc06b996a00)
/go/src/github.com/influxdata/influxdb/http/authentication_middleware.go:120 +0x29e
github.com/influxdata/influxdb/http.setCORSResponseHeaders.func1(0x2b3d300, 0xc06ba3e0c0, 0xc06b996a00)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:24 +0xab
net/http.HandlerFunc.ServeHTTP(0xc00089b260, 0x2b3d300, 0xc06ba3e0c0, 0xc06b996a00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.skipOptionsMW.func1(0x2b3d300, 0xc06ba3e0c0, 0xc06b996a00)
/go/src/github.com/influxdata/influxdb/http/middleware.go:23 +0x6d
net/http.HandlerFunc.ServeHTTP(0xc00089b280, 0x2b3d300, 0xc06ba3e0c0, 0xc06b996a00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.(*PlatformHandler).ServeHTTP(0xc00089b2c0, 0x2b3d300, 0xc06ba3e0c0, 0xc06b996a00)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:75 +0xe9
github.com/influxdata/influxdb/http.(*Handler).ServeHTTP(0xc000126300, 0x2b43700, 0xc06ba2c0e0, 0xc06b996a00)
/go/src/github.com/influxdata/influxdb/http/handler.go:141 +0x214
net/http.serverHandler.ServeHTTP(0xc000364a90, 0x2b43700, 0xc06ba2c0e0, 0xc06b996400)
/usr/local/go/src/net/http/server.go:2774 +0xa8
net/http.(*conn).serve(0xc06b4dfd60, 0x2b4d040, 0xc06b8d33c0)
/usr/local/go/src/net/http/server.go:1878 +0x851
created by net/http.(*Server).Serve
/usr/local/go/src/net/http/server.go:2884 +0x2f4

goroutine 487960 [runnable]:
github.com/influxdata/flux/compiler.(*objEvaluator).Eval(0xc03c9c87c0, 0x2b4d100, 0xc067e1c840, 0x2b77f00, 0xc008bf3080, 0x2b7be00, 0xc06b55a5a0, 0x0, 0x0)
/go/pkg/mod/github.com/influxdata/flux@v0.57.0/compiler/runtime.go:226 +0xe2
github.com/influxdata/flux/compiler.(*memberEvaluator).Eval(0xc00bfbec60, 0x2b4d100, 0xc067e1c840, 0x2b77f00, 0xc008bf3080, 0x2b7c480, 0xc06bcf1120, 0x0, 0x0)
/go/pkg/mod/github.com/influxdata/flux@v0.57.0/compiler/runtime.go:548 +0x60
github.com/influxdata/flux/compiler.eval(...)
/go/pkg/mod/github.com/influxdata/flux@v0.57.0/compiler/runtime.go:104
github.com/influxdata/flux/compiler.(*binaryEvaluator).Eval(0xc01e97c240, 0x2b4d100, 0xc067e1c840, 0x2b77f00, 0xc008bf3080, 0xc008bf3080, 0x2b824c0, 0xc067dc56e0, 0x0)
/go/pkg/mod/github.com/influxdata/flux@v0.57.0/compiler/runtime.go:334 +0xe1
github.com/influxdata/flux/compiler.eval(...)
/go/pkg/mod/github.com/influxdata/flux@v0.57.0/compiler/runtime.go:104
github.com/influxdata/flux/compiler.compiledFn.Eval(0x2b2a700, 0xc01e97c240, 0x2b666a0, 0xc003152780, 0x2b77f00, 0xc008bf3080, 0x2b4d100, 0xc067e1c840, 0x2b824c0, 0xc067dc56e0, ...)
/go/pkg/mod/github.com/influxdata/flux@v0.57.0/compiler/runtime.go:71 +0xbc
github.com/influxdata/flux/execute.(*RowPredicateFn).Eval(0xc067dc5740, 0x2b4d100, 0xc067e1c840, 0x2b824c0, 0xc06b55a5a0, 0xc00027a500, 0x0, 0x0)
/go/pkg/mod/github.com/influxdata/flux@v0.57.0/execute/row_fn.go:215 +0xeb
github.com/influxdata/flux/stdlib/universe.(*filterTransformation).filter(0xc067e1cc90, 0x2b74700, 0xc0682627d0, 0x2b824c0, 0xc06b55a5a0, 0xc06b6c2ba0, 0x8, 0x20301a, 0xc000bdf500)
/go/pkg/mod/github.com/influxdata/flux@v0.57.0/stdlib/universe/filter.go:246 +0x24f
github.com/influxdata/flux/stdlib/universe.(*filterTransformation).filterTable.func1.1(0x2b74700, 0xc0682627d0, 0x0, 0x0)
/go/pkg/mod/github.com/influxdata/flux@v0.57.0/stdlib/universe/filter.go:208 +0xa5
github.com/influxdata/influxdb/storage/reads.(*table).do(0xc0127a98c0, 0xc06b9306c0, 0xc000bfcec8, 0x0, 0x0)
/go/src/github.com/influxdata/influxdb/storage/reads/table.go:81 +0xaa
github.com/influxdata/influxdb/storage/reads.(*floatTable).Do(0xc0127a98c0, 0xc06b9306c0, 0xc00014be00, 0x4)
/go/src/github.com/influxdata/influxdb/storage/reads/table.gen.go:77 +0x5a
github.com/influxdata/flux/stdlib/universe.(*filterTransformation).filterTable.func1(0x2b4d040, 0xc06b930640, 0xc06b930680, 0x7fcff74a6201, 0xc00027a7c8)
/go/pkg/mod/github.com/influxdata/flux@v0.57.0/stdlib/universe/filter.go:207 +0xe7
github.com/influxdata/flux/internal/execute/tableutil.StreamWithContext.func1(0xc06b8b5aa0, 0xc06b8b5a40, 0xc06b8d3200, 0x2b4d040, 0xc06b930640, 0xc06b930680)
/go/pkg/mod/github.com/influxdata/flux@v0.57.0/internal/execute/tableutil/stream.go:109 +0xa5
created by github.com/influxdata/flux/internal/execute/tableutil.StreamWithContext
/go/pkg/mod/github.com/influxdata/flux@v0.57.0/internal/execute/tableutil/stream.go:106 +0x1a7

goroutine 212 [runnable]:
net/http.(*Server).newConn(...)
/usr/local/go/src/net/http/server.go:622
net/http.(*Server).Serve(0xc000364a90, 0x2b43440, 0xc000c42900, 0x0, 0x0)
/usr/local/go/src/net/http/server.go:2882 +0x265
github.com/influxdata/influxdb/cmd/influxd/launcher.(*Launcher).run.func4(0xc000375b80, 0x1c6840e, 0x4, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
/go/src/github.com/influxdata/influxdb/cmd/influxd/launcher/launcher.go:910 +0x78c
created by github.com/influxdata/influxdb/cmd/influxd/launcher.(*Launcher).run
/go/src/github.com/influxdata/influxdb/cmd/influxd/launcher/launcher.go:901 +0x6349

goroutine 213 [runnable]:
go.uber.org/zap/zapcore.glob..func1(0x42b9e20, 0x0)
/go/pkg/mod/go.uber.org/zap@v1.9.1/zapcore/console_encoder.go:33 +0x5d
sync.(*Pool).Get(0x42b9e20, 0xc00049c324, 0x0)
/usr/local/go/src/sync/pool.go:151 +0xa6
go.uber.org/zap/zapcore.getSliceEncoder(...)
/go/pkg/mod/go.uber.org/zap@v1.9.1/zapcore/console_encoder.go:38
go.uber.org/zap/zapcore.consoleEncoder.EncodeEntry(0xc00030b530, 0x0, 0xbf7aa01123646d94, 0x3eba9f033247, 0x465dce0, 0x0, 0x0, 0x1c6dd8d, 0x8, 0x0, ...)
/go/pkg/mod/go.uber.org/zap@v1.9.1/zapcore/console_encoder.go:75 +0x58
go.uber.org/zap/zapcore.(*ioCore).Write(0xc00030b560, 0x0, 0xbf7aa01123646d94, 0x3eba9f033247, 0x465dce0, 0x0, 0x0, 0x1c6dd8d, 0x8, 0x0, ...)
/go/pkg/mod/go.uber.org/zap@v1.9.1/zapcore/core.go:86 +0xa9
go.uber.org/zap/zapcore.(*CheckedEntry).Write(0xc06b0dcb00, 0x0, 0x0, 0x0)
/go/pkg/mod/go.uber.org/zap@v1.9.1/zapcore/entry.go:215 +0x119
go.uber.org/zap.(*Logger).Info(0xc0002c14a0, 0x1c6dd8d, 0x8, 0x0, 0x0, 0x0)
/go/pkg/mod/go.uber.org/zap@v1.9.1/logger.go:187 +0x7f
github.com/influxdata/influxdb/telemetry.(*Reporter).Report(0xc00089b5e0, 0x2b4d040, 0xc000808000)
/go/src/github.com/influxdata/influxdb/telemetry/reporter.go:51 +0x7be
github.com/influxdata/influxdb/cmd/influxd/launcher.NewCommand.func1.1(0xc00038f760, 0xc00089b5e0, 0xc0008833d0)
/go/src/github.com/influxdata/influxdb/cmd/influxd/launcher/launcher.go:100 +0x67
created by github.com/influxdata/influxdb/cmd/influxd/launcher.NewCommand.func1
/go/src/github.com/influxdata/influxdb/cmd/influxd/launcher/launcher.go:98 +0x4c0

goroutine 488021 [runnable]:
runtime.Gosched(...)
/usr/local/go/src/runtime/proc.go:266
github.com/nats-io/go-nats.(*Conn).doReconnect(0xc000024580)
/go/pkg/mod/github.com/nats-io/go-nats@v1.7.0/nats.go:1722 +0x14b
created by github.com/nats-io/go-nats.(*Conn).processOpErr
/go/pkg/mod/github.com/nats-io/go-nats@v1.7.0/nats.go:1839 +0x1a8

goroutine 487881 [runnable]:
github.com/influxdata/influxdb/models.parsePointsAppend.func1(0xc06bb10d14, 0x6, 0xf0ec, 0xc06bb10d1b, 0x2, 0xf0e5, 0xc06bb10d14, 0x9, 0xf0ec, 0xc069fe4a01)
/go/src/github.com/influxdata/influxdb/models/points.go:492 +0x41f
github.com/influxdata/influxdb/models.walkFields(0xc06bb10d1d, 0xb, 0xf0e5, 0xc069fe4b90, 0xed59bfecc, 0x0)
/go/src/github.com/influxdata/influxdb/models/points.go:1655 +0x1f0
github.com/influxdata/influxdb/models.parsePointsAppend(0xc0001f9500, 0x8c, 0x92, 0xc06bb10c6e, 0xce, 0xf192, 0xc069fe4f98, 0x10, 0x10, 0xbf7aa0198eefc23f, ...)
/go/src/github.com/influxdata/influxdb/models/points.go:492 +0x5f2
github.com/influxdata/influxdb/models.parsePointsWithPrecision(0xc06bb10000, 0xb49c, 0xfe00, 0xc069fe4f98, 0x10, 0x10, 0xbf7aa0198eefc23f, 0x3ec2751d5aa2, 0x465dce0, 0x1c67560, ...)
/go/src/github.com/influxdata/influxdb/models/points.go:408 +0x377
github.com/influxdata/influxdb/models.ParsePointsWithPrecision(...)
/go/src/github.com/influxdata/influxdb/models/points.go:373
github.com/influxdata/influxdb/http.(*WriteHandler).handleWrite(0xc0002c0f60, 0x2b3d300, 0xc06b67da40, 0xc06b996500)
/go/src/github.com/influxdata/influxdb/http/write_handler.go:235 +0x1574
net/http.HandlerFunc.ServeHTTP(0xc00077fe00, 0x2b3d300, 0xc06b67da40, 0xc06b996500)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/httprouter.(*Router).Handler.func1(0x2b3d300, 0xc06b67da40, 0xc06b996500, 0x0, 0x0, 0x0)
/go/pkg/mod/github.com/influxdata/httprouter@v1.3.1-0.20191122104820-ee83e2772f69/router.go:325 +0x1b2
github.com/influxdata/httprouter.(*Router).ServeHTTP(0xc000126280, 0x2b3d300, 0xc06b67da40, 0xc06ba0a100)
/go/pkg/mod/github.com/influxdata/httprouter@v1.3.1-0.20191122104820-ee83e2772f69/router.go:453 +0x882
github.com/go-chi/chi.(*Mux).Mount.func1(0x2b3d300, 0xc06b67da40, 0xc06ba0a100)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:292 +0x127
net/http.HandlerFunc.ServeHTTP(0xc00089b080, 0x2b3d300, 0xc06b67da40, 0xc06ba0a100)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi.(*Mux).routeHTTP(0xc000117020, 0x2b3d300, 0xc06b67da40, 0xc06ba0a100)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:425 +0x27f
net/http.HandlerFunc.ServeHTTP(0xc00067bc20, 0x2b3d300, 0xc06b67da40, 0xc06ba0a100)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.setCORSResponseHeaders.func1(0x2b3d300, 0xc06b67da40, 0xc06ba0a100)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:24 +0xab
net/http.HandlerFunc.ServeHTTP(0xc000382f00, 0x2b3d300, 0xc06b67da40, 0xc06ba0a100)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi/middleware.StripSlashes.func1(0x2b3d300, 0xc06b67da40, 0xc06ba0a100)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/middleware/strip.go:25 +0xf0
net/http.HandlerFunc.ServeHTTP(0xc000382f20, 0x2b3d300, 0xc06b67da40, 0xc06ba0a100)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.skipOptionsMW.func1(0x2b3d300, 0xc06b67da40, 0xc06ba0a100)
/go/src/github.com/influxdata/influxdb/http/middleware.go:23 +0x6d
net/http.HandlerFunc.ServeHTTP(0xc000382f40, 0x2b3d300, 0xc06b67da40, 0xc06ba0a100)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi.(*Mux).ServeHTTP(0xc000117020, 0x2b3d300, 0xc06b67da40, 0xc06b7c1f00)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:82 +0x294
github.com/influxdata/influxdb/http.(*AuthenticationHandler).ServeHTTP(0xc0001ef110, 0x2b3d300, 0xc06b67da40, 0xc06b7c0900)
/go/src/github.com/influxdata/influxdb/http/authentication_middleware.go:120 +0x29e
github.com/influxdata/influxdb/http.setCORSResponseHeaders.func1(0x2b3d300, 0xc06b67da40, 0xc06b7c0900)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:24 +0xab
net/http.HandlerFunc.ServeHTTP(0xc00089b260, 0x2b3d300, 0xc06b67da40, 0xc06b7c0900)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.skipOptionsMW.func1(0x2b3d300, 0xc06b67da40, 0xc06b7c0900)
/go/src/github.com/influxdata/influxdb/http/middleware.go:23 +0x6d
net/http.HandlerFunc.ServeHTTP(0xc00089b280, 0x2b3d300, 0xc06b67da40, 0xc06b7c0900)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.(*PlatformHandler).ServeHTTP(0xc00089b2c0, 0x2b3d300, 0xc06b67da40, 0xc06b7c0900)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:75 +0xe9
github.com/influxdata/influxdb/http.(*Handler).ServeHTTP(0xc000126300, 0x2b43700, 0xc06b568ee0, 0xc06b7c0900)
/go/src/github.com/influxdata/influxdb/http/handler.go:141 +0x214
net/http.serverHandler.ServeHTTP(0xc000364a90, 0x2b43700, 0xc06b568ee0, 0xc06b2c1600)
/usr/local/go/src/net/http/server.go:2774 +0xa8
net/http.(*conn).serve(0xc06b4df0e0, 0x2b4d040, 0xc06b685a00)
/usr/local/go/src/net/http/server.go:1878 +0x851
created by net/http.(*Server).Serve
/usr/local/go/src/net/http/server.go:2884 +0x2f4

goroutine 487844 [semacquire]:
sync.runtime_SemacquireMutex(0xc000bde0fc, 0x400)
/usr/local/go/src/runtime/sema.go:71 +0x3d
sync.(*RWMutex).RLock(...)
/usr/local/go/src/sync/rwmutex.go:50
github.com/influxdata/influxdb/storage.(*Engine).WritePoints(0xc000bde000, 0x2b4d100, 0xc069ca48d0, 0xc001636000, 0x4bc, 0x600, 0x0, 0x0)
/go/src/github.com/influxdata/influxdb/storage/engine.go:511 +0x11f5
github.com/influxdata/influxdb/http.(*WriteHandler).handleWrite(0xc0002c0f60, 0x2b3d300, 0xc06b357040, 0xc06b7c0500)
/go/src/github.com/influxdata/influxdb/http/write_handler.go:247 +0x1a0b
net/http.HandlerFunc.ServeHTTP(0xc00077fe00, 0x2b3d300, 0xc06b357040, 0xc06b7c0500)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/httprouter.(*Router).Handler.func1(0x2b3d300, 0xc06b357040, 0xc06b7c0500, 0x0, 0x0, 0x0)
/go/pkg/mod/github.com/influxdata/httprouter@v1.3.1-0.20191122104820-ee83e2772f69/router.go:325 +0x1b2
github.com/influxdata/httprouter.(*Router).ServeHTTP(0xc000126280, 0x2b3d300, 0xc06b357040, 0xc06b7c0000)
/go/pkg/mod/github.com/influxdata/httprouter@v1.3.1-0.20191122104820-ee83e2772f69/router.go:453 +0x882
github.com/go-chi/chi.(*Mux).Mount.func1(0x2b3d300, 0xc06b357040, 0xc06b7c0000)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:292 +0x127
net/http.HandlerFunc.ServeHTTP(0xc00089b080, 0x2b3d300, 0xc06b357040, 0xc06b7c0000)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi.(*Mux).routeHTTP(0xc000117020, 0x2b3d300, 0xc06b357040, 0xc06b7c0000)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:425 +0x27f
net/http.HandlerFunc.ServeHTTP(0xc00067bc20, 0x2b3d300, 0xc06b357040, 0xc06b7c0000)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.setCORSResponseHeaders.func1(0x2b3d300, 0xc06b357040, 0xc06b7c0000)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:24 +0xab
net/http.HandlerFunc.ServeHTTP(0xc000382f00, 0x2b3d300, 0xc06b357040, 0xc06b7c0000)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi/middleware.StripSlashes.func1(0x2b3d300, 0xc06b357040, 0xc06b7c0000)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/middleware/strip.go:25 +0xf0
net/http.HandlerFunc.ServeHTTP(0xc000382f20, 0x2b3d300, 0xc06b357040, 0xc06b7c0000)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.skipOptionsMW.func1(0x2b3d300, 0xc06b357040, 0xc06b7c0000)
/go/src/github.com/influxdata/influxdb/http/middleware.go:23 +0x6d
net/http.HandlerFunc.ServeHTTP(0xc000382f40, 0x2b3d300, 0xc06b357040, 0xc06b7c0000)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi.(*Mux).ServeHTTP(0xc000117020, 0x2b3d300, 0xc06b357040, 0xc06b2c1f00)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:82 +0x294
github.com/influxdata/influxdb/http.(*AuthenticationHandler).ServeHTTP(0xc0001ef110, 0x2b3d300, 0xc06b357040, 0xc06b528500)
/go/src/github.com/influxdata/influxdb/http/authentication_middleware.go:120 +0x29e
github.com/influxdata/influxdb/http.setCORSResponseHeaders.func1(0x2b3d300, 0xc06b357040, 0xc06b528500)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:24 +0xab
net/http.HandlerFunc.ServeHTTP(0xc00089b260, 0x2b3d300, 0xc06b357040, 0xc06b528500)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.skipOptionsMW.func1(0x2b3d300, 0xc06b357040, 0xc06b528500)
/go/src/github.com/influxdata/influxdb/http/middleware.go:23 +0x6d
net/http.HandlerFunc.ServeHTTP(0xc00089b280, 0x2b3d300, 0xc06b357040, 0xc06b528500)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.(*PlatformHandler).ServeHTTP(0xc00089b2c0, 0x2b3d300, 0xc06b357040, 0xc06b528500)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:75 +0xe9
github.com/influxdata/influxdb/http.(*Handler).ServeHTTP(0xc000126300, 0x2b43700, 0xc06b5201c0, 0xc06b528500)
/go/src/github.com/influxdata/influxdb/http/handler.go:141 +0x214
net/http.serverHandler.ServeHTTP(0xc000364a90, 0x2b43700, 0xc06b5201c0, 0xc06b28bc00)
/usr/local/go/src/net/http/server.go:2774 +0xa8
net/http.(*conn).serve(0xc0556b1040, 0x2b4d040, 0xc06b3530c0)
/usr/local/go/src/net/http/server.go:1878 +0x851
created by net/http.(*Server).Serve
/usr/local/go/src/net/http/server.go:2884 +0x2f4

goroutine 487839 [runnable]:
bufio.(*Reader).ReadByte(0xc06b55a2a0, 0xc06b9fec09, 0x0, 0x0)
/usr/local/go/src/bufio/bufio.go:243 +0xd2
compress/flate.(*decompressor).huffSym(0xc06b65a600, 0xc06b65a628, 0x15, 0x0, 0x0)
/usr/local/go/src/compress/flate/inflate.go:719 +0x81
compress/flate.(*decompressor).huffmanBlock(0xc06b65a600)
/usr/local/go/src/compress/flate/inflate.go:494 +0xd0
compress/flate.(*decompressor).nextBlock(0xc06b65a600)
/usr/local/go/src/compress/flate/inflate.go:327 +0x16d
compress/flate.(*decompressor).Read(0xc06b65a600, 0xc000489400, 0x200, 0x200, 0x7fcff9889008, 0xa, 0xb)
/usr/local/go/src/compress/flate/inflate.go:347 +0x77
compress/gzip.(*Reader).Read(0xc0118bb080, 0xc000489400, 0x200, 0x200, 0xc000489400, 0x0, 0x0)
/usr/local/go/src/compress/gzip/gunzip.go:251 +0x87
bytes.(*Buffer).ReadFrom(0xc06b9fee38, 0x2b0c820, 0xc0118bb080, 0x1c6c4c4, 0x7, 0xc06b9fee60)
/usr/local/go/src/bytes/buffer.go:207 +0xbd
io/ioutil.readAll(0x2b0c820, 0xc0118bb080, 0x200, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/io/ioutil/ioutil.go:36 +0xe5
io/ioutil.ReadAll(...)
/usr/local/go/src/io/ioutil/ioutil.go:45
github.com/influxdata/influxdb/http.(*WriteHandler).handleWrite(0xc0002c0f60, 0x2b3d300, 0xc06b67c5c0, 0xc06b529c00)
/go/src/github.com/influxdata/influxdb/http/write_handler.go:208 +0xda9
net/http.HandlerFunc.ServeHTTP(0xc00077fe00, 0x2b3d300, 0xc06b67c5c0, 0xc06b529c00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/httprouter.(*Router).Handler.func1(0x2b3d300, 0xc06b67c5c0, 0xc06b529c00, 0x0, 0x0, 0x0)
/go/pkg/mod/github.com/influxdata/httprouter@v1.3.1-0.20191122104820-ee83e2772f69/router.go:325 +0x1b2
github.com/influxdata/httprouter.(*Router).ServeHTTP(0xc000126280, 0x2b3d300, 0xc06b67c5c0, 0xc06b7c1000)
/go/pkg/mod/github.com/influxdata/httprouter@v1.3.1-0.20191122104820-ee83e2772f69/router.go:453 +0x882
github.com/go-chi/chi.(*Mux).Mount.func1(0x2b3d300, 0xc06b67c5c0, 0xc06b7c1000)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:292 +0x127
net/http.HandlerFunc.ServeHTTP(0xc00089b080, 0x2b3d300, 0xc06b67c5c0, 0xc06b7c1000)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi.(*Mux).routeHTTP(0xc000117020, 0x2b3d300, 0xc06b67c5c0, 0xc06b7c1000)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:425 +0x27f
net/http.HandlerFunc.ServeHTTP(0xc00067bc20, 0x2b3d300, 0xc06b67c5c0, 0xc06b7c1000)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.setCORSResponseHeaders.func1(0x2b3d300, 0xc06b67c5c0, 0xc06b7c1000)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:24 +0xab
net/http.HandlerFunc.ServeHTTP(0xc000382f00, 0x2b3d300, 0xc06b67c5c0, 0xc06b7c1000)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi/middleware.StripSlashes.func1(0x2b3d300, 0xc06b67c5c0, 0xc06b7c1000)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/middleware/strip.go:25 +0xf0
net/http.HandlerFunc.ServeHTTP(0xc000382f20, 0x2b3d300, 0xc06b67c5c0, 0xc06b7c1000)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.skipOptionsMW.func1(0x2b3d300, 0xc06b67c5c0, 0xc06b7c1000)
/go/src/github.com/influxdata/influxdb/http/middleware.go:23 +0x6d
net/http.HandlerFunc.ServeHTTP(0xc000382f40, 0x2b3d300, 0xc06b67c5c0, 0xc06b7c1000)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi.(*Mux).ServeHTTP(0xc000117020, 0x2b3d300, 0xc06b67c5c0, 0xc06b529a00)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:82 +0x294
github.com/influxdata/influxdb/http.(*AuthenticationHandler).ServeHTTP(0xc0001ef110, 0x2b3d300, 0xc06b67c5c0, 0xc06b2c1200)
/go/src/github.com/influxdata/influxdb/http/authentication_middleware.go:120 +0x29e
github.com/influxdata/influxdb/http.setCORSResponseHeaders.func1(0x2b3d300, 0xc06b67c5c0, 0xc06b2c1200)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:24 +0xab
net/http.HandlerFunc.ServeHTTP(0xc00089b260, 0x2b3d300, 0xc06b67c5c0, 0xc06b2c1200)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.skipOptionsMW.func1(0x2b3d300, 0xc06b67c5c0, 0xc06b2c1200)
/go/src/github.com/influxdata/influxdb/http/middleware.go:23 +0x6d
net/http.HandlerFunc.ServeHTTP(0xc00089b280, 0x2b3d300, 0xc06b67c5c0, 0xc06b2c1200)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.(*PlatformHandler).ServeHTTP(0xc00089b2c0, 0x2b3d300, 0xc06b67c5c0, 0xc06b2c1200)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:75 +0xe9
github.com/influxdata/influxdb/http.(*Handler).ServeHTTP(0xc000126300, 0x2b43700, 0xc06b5682a0, 0xc06b2c1200)
/go/src/github.com/influxdata/influxdb/http/handler.go:141 +0x214
net/http.serverHandler.ServeHTTP(0xc000364a90, 0x2b43700, 0xc06b5682a0, 0xc06b2c1100)
/usr/local/go/src/net/http/server.go:2774 +0xa8
net/http.(*conn).serve(0xc055629ea0, 0x2b4d040, 0xc06b353500)
/usr/local/go/src/net/http/server.go:1878 +0x851
created by net/http.(*Server).Serve
/usr/local/go/src/net/http/server.go:2884 +0x2f4

goroutine 487795 [runnable]:
github.com/influxdata/influxdb/models.parsePointsAppend.func1(0xc06ba64741, 0xc, 0x36bf, 0xc06ba6474e, 0x2, 0x36b2, 0xc06ba64741, 0xf, 0x36bf, 0xc012c72a01)
/go/src/github.com/influxdata/influxdb/models/points.go:492 +0x41f
github.com/influxdata/influxdb/models.walkFields(0xc06ba64750, 0x56, 0x36b2, 0xc012c72b90, 0xed59bfe90, 0x0)
/go/src/github.com/influxdata/influxdb/models/points.go:1655 +0x1f0
github.com/influxdata/influxdb/models.parsePointsAppend(0xc000330a80, 0x52, 0xa8, 0xc06ba64105, 0x6b5, 0x3cfb, 0xc012c72f98, 0x10, 0x10, 0xbf7aa009a0a33b25, ...)
/go/src/github.com/influxdata/influxdb/models/points.go:492 +0x5f2
github.com/influxdata/influxdb/models.parsePointsWithPrecision(0xc06ba64000, 0x3111, 0x3e00, 0xc012c72f98, 0x10, 0x10, 0xbf7aa009a0a33b25, 0x3eb3a01e53ec, 0x465dce0, 0x1c67560, ...)
/go/src/github.com/influxdata/influxdb/models/points.go:408 +0x377
github.com/influxdata/influxdb/models.ParsePointsWithPrecision(...)
/go/src/github.com/influxdata/influxdb/models/points.go:373
github.com/influxdata/influxdb/http.(*WriteHandler).handleWrite(0xc0002c0f60, 0x2b3d300, 0xc06b277680, 0xc06b528900)
/go/src/github.com/influxdata/influxdb/http/write_handler.go:235 +0x1574
net/http.HandlerFunc.ServeHTTP(0xc00077fe00, 0x2b3d300, 0xc06b277680, 0xc06b528900)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/httprouter.(*Router).Handler.func1(0x2b3d300, 0xc06b277680, 0xc06b528900, 0x0, 0x0, 0x0)
/go/pkg/mod/github.com/influxdata/httprouter@v1.3.1-0.20191122104820-ee83e2772f69/router.go:325 +0x1b2
github.com/influxdata/httprouter.(*Router).ServeHTTP(0xc000126280, 0x2b3d300, 0xc06b277680, 0xc06b528800)
/go/pkg/mod/github.com/influxdata/httprouter@v1.3.1-0.20191122104820-ee83e2772f69/router.go:453 +0x882
github.com/go-chi/chi.(*Mux).Mount.func1(0x2b3d300, 0xc06b277680, 0xc06b528800)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:292 +0x127
net/http.HandlerFunc.ServeHTTP(0xc00089b080, 0x2b3d300, 0xc06b277680, 0xc06b528800)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi.(*Mux).routeHTTP(0xc000117020, 0x2b3d300, 0xc06b277680, 0xc06b528800)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:425 +0x27f
net/http.HandlerFunc.ServeHTTP(0xc00067bc20, 0x2b3d300, 0xc06b277680, 0xc06b528800)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.setCORSResponseHeaders.func1(0x2b3d300, 0xc06b277680, 0xc06b528800)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:24 +0xab
net/http.HandlerFunc.ServeHTTP(0xc000382f00, 0x2b3d300, 0xc06b277680, 0xc06b528800)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi/middleware.StripSlashes.func1(0x2b3d300, 0xc06b277680, 0xc06b528800)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/middleware/strip.go:25 +0xf0
net/http.HandlerFunc.ServeHTTP(0xc000382f20, 0x2b3d300, 0xc06b277680, 0xc06b528800)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.skipOptionsMW.func1(0x2b3d300, 0xc06b277680, 0xc06b528800)
/go/src/github.com/influxdata/influxdb/http/middleware.go:23 +0x6d
net/http.HandlerFunc.ServeHTTP(0xc000382f40, 0x2b3d300, 0xc06b277680, 0xc06b528800)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi.(*Mux).ServeHTTP(0xc000117020, 0x2b3d300, 0xc06b277680, 0xc06b528700)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:82 +0x294
github.com/influxdata/influxdb/http.(*AuthenticationHandler).ServeHTTP(0xc0001ef110, 0x2b3d300, 0xc06b277680, 0xc06b28a900)
/go/src/github.com/influxdata/influxdb/http/authentication_middleware.go:120 +0x29e
github.com/influxdata/influxdb/http.setCORSResponseHeaders.func1(0x2b3d300, 0xc06b277680, 0xc06b28a900)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:24 +0xab
net/http.HandlerFunc.ServeHTTP(0xc00089b260, 0x2b3d300, 0xc06b277680, 0xc06b28a900)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.skipOptionsMW.func1(0x2b3d300, 0xc06b277680, 0xc06b28a900)
/go/src/github.com/influxdata/influxdb/http/middleware.go:23 +0x6d
net/http.HandlerFunc.ServeHTTP(0xc00089b280, 0x2b3d300, 0xc06b277680, 0xc06b28a900)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.(*PlatformHandler).ServeHTTP(0xc00089b2c0, 0x2b3d300, 0xc06b277680, 0xc06b28a900)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:75 +0xe9
github.com/influxdata/influxdb/http.(*Handler).ServeHTTP(0xc000126300, 0x2b43700, 0xc05583afc0, 0xc06b28a900)
/go/src/github.com/influxdata/influxdb/http/handler.go:141 +0x214
net/http.serverHandler.ServeHTTP(0xc000364a90, 0x2b43700, 0xc05583afc0, 0xc06b28a800)
/usr/local/go/src/net/http/server.go:2774 +0xa8
net/http.(*conn).serve(0xc0556b0dc0, 0x2b4d040, 0xc06b2739c0)
/usr/local/go/src/net/http/server.go:1878 +0x851
created by net/http.(*Server).Serve
/usr/local/go/src/net/http/server.go:2884 +0x2f4

goroutine 487799 [runnable]:
github.com/influxdata/influxdb/models.walkTags(0xc06b6c5380, 0x39, 0x39, 0xc06b6ccb50)
/go/src/github.com/influxdata/influxdb/models/points.go:1600 +0x306
github.com/influxdata/influxdb/models.parseTags(0xc06b6c5380, 0x39, 0x39, 0x0, 0x0, 0x3, 0xc06b6c5380, 0x2ac0a17, 0x32)
/go/src/github.com/influxdata/influxdb/models/points.go:1690 +0x13a
github.com/influxdata/influxdb/models.(*point).Tags(0xc06bab64b0, 0xc06b6c5380, 0x10, 0x39)
/go/src/github.com/influxdata/influxdb/models/points.go:1575 +0x71
github.com/influxdata/influxdb/tsdb.NewSeriesCollection(0xc06bada000, 0x265, 0x300, 0x467ba28)
/go/src/github.com/influxdata/influxdb/tsdb/series_collection.go:54 +0x394
github.com/influxdata/influxdb/storage.(*Engine).WritePoints(0xc000bde000, 0x2b4d100, 0xc06ba6af30, 0xc06bada000, 0x265, 0x300, 0x0, 0x0)
/go/src/github.com/influxdata/influxdb/storage/engine.go:452 +0xce
github.com/influxdata/influxdb/http.(*WriteHandler).handleWrite(0xc0002c0f60, 0x2b3d300, 0xc06b356a80, 0xc06b529400)
/go/src/github.com/influxdata/influxdb/http/write_handler.go:247 +0x1a0b
net/http.HandlerFunc.ServeHTTP(0xc00077fe00, 0x2b3d300, 0xc06b356a80, 0xc06b529400)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/httprouter.(*Router).Handler.func1(0x2b3d300, 0xc06b356a80, 0xc06b529400, 0x0, 0x0, 0x0)
/go/pkg/mod/github.com/influxdata/httprouter@v1.3.1-0.20191122104820-ee83e2772f69/router.go:325 +0x1b2
github.com/influxdata/httprouter.(*Router).ServeHTTP(0xc000126280, 0x2b3d300, 0xc06b356a80, 0xc06b528d00)
/go/pkg/mod/github.com/influxdata/httprouter@v1.3.1-0.20191122104820-ee83e2772f69/router.go:453 +0x882
github.com/go-chi/chi.(*Mux).Mount.func1(0x2b3d300, 0xc06b356a80, 0xc06b528d00)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:292 +0x127
net/http.HandlerFunc.ServeHTTP(0xc00089b080, 0x2b3d300, 0xc06b356a80, 0xc06b528d00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi.(*Mux).routeHTTP(0xc000117020, 0x2b3d300, 0xc06b356a80, 0xc06b528d00)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:425 +0x27f
net/http.HandlerFunc.ServeHTTP(0xc00067bc20, 0x2b3d300, 0xc06b356a80, 0xc06b528d00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.setCORSResponseHeaders.func1(0x2b3d300, 0xc06b356a80, 0xc06b528d00)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:24 +0xab
net/http.HandlerFunc.ServeHTTP(0xc000382f00, 0x2b3d300, 0xc06b356a80, 0xc06b528d00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi/middleware.StripSlashes.func1(0x2b3d300, 0xc06b356a80, 0xc06b528d00)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/middleware/strip.go:25 +0xf0
net/http.HandlerFunc.ServeHTTP(0xc000382f20, 0x2b3d300, 0xc06b356a80, 0xc06b528d00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.skipOptionsMW.func1(0x2b3d300, 0xc06b356a80, 0xc06b528d00)
/go/src/github.com/influxdata/influxdb/http/middleware.go:23 +0x6d
net/http.HandlerFunc.ServeHTTP(0xc000382f40, 0x2b3d300, 0xc06b356a80, 0xc06b528d00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi.(*Mux).ServeHTTP(0xc000117020, 0x2b3d300, 0xc06b356a80, 0xc06b528c00)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:82 +0x294
github.com/influxdata/influxdb/http.(*AuthenticationHandler).ServeHTTP(0xc0001ef110, 0x2b3d300, 0xc06b356a80, 0xc06b528000)
/go/src/github.com/influxdata/influxdb/http/authentication_middleware.go:120 +0x29e
github.com/influxdata/influxdb/http.setCORSResponseHeaders.func1(0x2b3d300, 0xc06b356a80, 0xc06b528000)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:24 +0xab
net/http.HandlerFunc.ServeHTTP(0xc00089b260, 0x2b3d300, 0xc06b356a80, 0xc06b528000)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.skipOptionsMW.func1(0x2b3d300, 0xc06b356a80, 0xc06b528000)
/go/src/github.com/influxdata/influxdb/http/middleware.go:23 +0x6d
net/http.HandlerFunc.ServeHTTP(0xc00089b280, 0x2b3d300, 0xc06b356a80, 0xc06b528000)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.(*PlatformHandler).ServeHTTP(0xc00089b2c0, 0x2b3d300, 0xc06b356a80, 0xc06b528000)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:75 +0xe9
github.com/influxdata/influxdb/http.(*Handler).ServeHTTP(0xc000126300, 0x2b43700, 0xc06ac49c00, 0xc06b528000)
/go/src/github.com/influxdata/influxdb/http/handler.go:141 +0x214
net/http.serverHandler.ServeHTTP(0xc000364a90, 0x2b43700, 0xc06ac49c00, 0xc06b28a700)
/usr/local/go/src/net/http/server.go:2774 +0xa8
net/http.(*conn).serve(0xc0556b0e60, 0x2b4d040, 0xc06b273ac0)
/usr/local/go/src/net/http/server.go:1878 +0x851
created by net/http.(*Server).Serve
/usr/local/go/src/net/http/server.go:2884 +0x2f4

goroutine 488019 [runnable]:
runtime.Gosched(...)
/usr/local/go/src/runtime/proc.go:266
github.com/nats-io/go-nats.(*Conn).doReconnect(0xc0000b8b00)
/go/pkg/mod/github.com/nats-io/go-nats@v1.7.0/nats.go:1722 +0x14b
created by github.com/nats-io/go-nats.(*Conn).processOpErr
/go/pkg/mod/github.com/nats-io/go-nats@v1.7.0/nats.go:1839 +0x1a8

goroutine 487803 [runnable]:
github.com/influxdata/influxdb/tsdb/tsm1.(*Engine).WriteValues(0xc0003666c0, 0xc06b7ac840, 0x0, 0x0)
/go/src/github.com/influxdata/influxdb/tsdb/tsm1/engine.go:625 +0xf2
github.com/influxdata/influxdb/storage.(*Engine).writePointsLocked(0xc000bde000, 0x2b4d100, 0xc06b7ac750, 0xc06b568fc0, 0xc06b7ac840, 0x0, 0x0)
/go/src/github.com/influxdata/influxdb/storage/engine.go:557 +0xd6
github.com/influxdata/influxdb/storage.(*Engine).WritePoints(0xc000bde000, 0x2b4d100, 0xc06b7ac750, 0xc06b7f6000, 0x27d, 0x400, 0x0, 0x0)
/go/src/github.com/influxdata/influxdb/storage/engine.go:529 +0x1140
github.com/influxdata/influxdb/http.(*WriteHandler).handleWrite(0xc0002c0f60, 0x2b3d300, 0xc06b1e3840, 0xc06b28b800)
/go/src/github.com/influxdata/influxdb/http/write_handler.go:247 +0x1a0b
net/http.HandlerFunc.ServeHTTP(0xc00077fe00, 0x2b3d300, 0xc06b1e3840, 0xc06b28b800)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/httprouter.(*Router).Handler.func1(0x2b3d300, 0xc06b1e3840, 0xc06b28b800, 0x0, 0x0, 0x0)
/go/pkg/mod/github.com/influxdata/httprouter@v1.3.1-0.20191122104820-ee83e2772f69/router.go:325 +0x1b2
github.com/influxdata/httprouter.(*Router).ServeHTTP(0xc000126280, 0x2b3d300, 0xc06b1e3840, 0xc06b28b700)
/go/pkg/mod/github.com/influxdata/httprouter@v1.3.1-0.20191122104820-ee83e2772f69/router.go:453 +0x882
github.com/go-chi/chi.(*Mux).Mount.func1(0x2b3d300, 0xc06b1e3840, 0xc06b28b700)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:292 +0x127
net/http.HandlerFunc.ServeHTTP(0xc00089b080, 0x2b3d300, 0xc06b1e3840, 0xc06b28b700)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi.(*Mux).routeHTTP(0xc000117020, 0x2b3d300, 0xc06b1e3840, 0xc06b28b700)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:425 +0x27f
net/http.HandlerFunc.ServeHTTP(0xc00067bc20, 0x2b3d300, 0xc06b1e3840, 0xc06b28b700)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.setCORSResponseHeaders.func1(0x2b3d300, 0xc06b1e3840, 0xc06b28b700)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:24 +0xab
net/http.HandlerFunc.ServeHTTP(0xc000382f00, 0x2b3d300, 0xc06b1e3840, 0xc06b28b700)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi/middleware.StripSlashes.func1(0x2b3d300, 0xc06b1e3840, 0xc06b28b700)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/middleware/strip.go:25 +0xf0
net/http.HandlerFunc.ServeHTTP(0xc000382f20, 0x2b3d300, 0xc06b1e3840, 0xc06b28b700)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.skipOptionsMW.func1(0x2b3d300, 0xc06b1e3840, 0xc06b28b700)
/go/src/github.com/influxdata/influxdb/http/middleware.go:23 +0x6d
net/http.HandlerFunc.ServeHTTP(0xc000382f40, 0x2b3d300, 0xc06b1e3840, 0xc06b28b700)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi.(*Mux).ServeHTTP(0xc000117020, 0x2b3d300, 0xc06b1e3840, 0xc06b28b600)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:82 +0x294
github.com/influxdata/influxdb/http.(*AuthenticationHandler).ServeHTTP(0xc0001ef110, 0x2b3d300, 0xc06b1e3840, 0xc05500bb00)
/go/src/github.com/influxdata/influxdb/http/authentication_middleware.go:120 +0x29e
github.com/influxdata/influxdb/http.setCORSResponseHeaders.func1(0x2b3d300, 0xc06b1e3840, 0xc05500bb00)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:24 +0xab
net/http.HandlerFunc.ServeHTTP(0xc00089b260, 0x2b3d300, 0xc06b1e3840, 0xc05500bb00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.skipOptionsMW.func1(0x2b3d300, 0xc06b1e3840, 0xc05500bb00)
/go/src/github.com/influxdata/influxdb/http/middleware.go:23 +0x6d
net/http.HandlerFunc.ServeHTTP(0xc00089b280, 0x2b3d300, 0xc06b1e3840, 0xc05500bb00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.(*PlatformHandler).ServeHTTP(0xc00089b2c0, 0x2b3d300, 0xc06b1e3840, 0xc05500bb00)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:75 +0xe9
github.com/influxdata/influxdb/http.(*Handler).ServeHTTP(0xc000126300, 0x2b43700, 0xc06ac48c40, 0xc05500bb00)
/go/src/github.com/influxdata/influxdb/http/handler.go:141 +0x214
net/http.serverHandler.ServeHTTP(0xc000364a90, 0x2b43700, 0xc06ac48c40, 0xc05500ba00)
/usr/local/go/src/net/http/server.go:2774 +0xa8
net/http.(*conn).serve(0xc055629360, 0x2b4d040, 0xc06b1eb000)
/usr/local/go/src/net/http/server.go:1878 +0x851
created by net/http.(*Server).Serve
/usr/local/go/src/net/http/server.go:2884 +0x2f4

goroutine 488098 [runnable]:
syscall.Syscall(0x4a, 0x22, 0x0, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/syscall/asm_linux_amd64.s:18 +0x5
syscall.Fsync(0x22, 0x2863d90, 0xc039083f20)
/usr/local/go/src/syscall/zsyscall_linux_amd64.go:449 +0x40
internal/poll.(*FD).Fsync(0xc039083f20, 0x0, 0x0)
/usr/local/go/src/internal/poll/fd_fsync_posix.go:17 +0x86
os.(*File).Sync(0xc01868b500, 0x0, 0x0)
/usr/local/go/src/os/file_posix.go:133 +0x4b
github.com/influxdata/influxdb/storage/wal.(*WALSegmentWriter).sync(0xc01c1e8d20, 0x405a1f, 0xc009e34c58)
/go/src/github.com/influxdata/influxdb/storage/wal/wal.go:1117 +0x62
github.com/influxdata/influxdb/storage/wal.(*WAL).sync(0xc0000d84d0)
/go/src/github.com/influxdata/influxdb/storage/wal/wal.go:302 +0x33
github.com/influxdata/influxdb/storage/wal.(*WAL).scheduleSync.func1(0xc0000d84d0)
/go/src/github.com/influxdata/influxdb/storage/wal/wal.go:289 +0x88
created by github.com/influxdata/influxdb/storage/wal.(*WAL).scheduleSync
/go/src/github.com/influxdata/influxdb/storage/wal/wal.go:263 +0x52

goroutine 487805 [semacquire]:
sync.runtime_SemacquireMutex(0xc000bde0fc, 0x300)
/usr/local/go/src/runtime/sema.go:71 +0x3d
sync.(*RWMutex).RLock(...)
/usr/local/go/src/sync/rwmutex.go:50
github.com/influxdata/influxdb/storage.(*Engine).WritePoints(0xc000bde000, 0x2b4d100, 0xc069ca4630, 0xc06b3a3000, 0x366, 0x500, 0x0, 0x0)
/go/src/github.com/influxdata/influxdb/storage/engine.go:511 +0x11f5
github.com/influxdata/influxdb/http.(*WriteHandler).handleWrite(0xc0002c0f60, 0x2b3d300, 0xc06b356d00, 0xc06b7c0100)
/go/src/github.com/influxdata/influxdb/http/write_handler.go:247 +0x1a0b
net/http.HandlerFunc.ServeHTTP(0xc00077fe00, 0x2b3d300, 0xc06b356d00, 0xc06b7c0100)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/httprouter.(*Router).Handler.func1(0x2b3d300, 0xc06b356d00, 0xc06b7c0100, 0x0, 0x0, 0x0)
/go/pkg/mod/github.com/influxdata/httprouter@v1.3.1-0.20191122104820-ee83e2772f69/router.go:325 +0x1b2
github.com/influxdata/httprouter.(*Router).ServeHTTP(0xc000126280, 0x2b3d300, 0xc06b356d00, 0xc06b2c1c00)
/go/pkg/mod/github.com/influxdata/httprouter@v1.3.1-0.20191122104820-ee83e2772f69/router.go:453 +0x882
github.com/go-chi/chi.(*Mux).Mount.func1(0x2b3d300, 0xc06b356d00, 0xc06b2c1c00)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:292 +0x127
net/http.HandlerFunc.ServeHTTP(0xc00089b080, 0x2b3d300, 0xc06b356d00, 0xc06b2c1c00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi.(*Mux).routeHTTP(0xc000117020, 0x2b3d300, 0xc06b356d00, 0xc06b2c1c00)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:425 +0x27f
net/http.HandlerFunc.ServeHTTP(0xc00067bc20, 0x2b3d300, 0xc06b356d00, 0xc06b2c1c00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.setCORSResponseHeaders.func1(0x2b3d300, 0xc06b356d00, 0xc06b2c1c00)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:24 +0xab
net/http.HandlerFunc.ServeHTTP(0xc000382f00, 0x2b3d300, 0xc06b356d00, 0xc06b2c1c00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi/middleware.StripSlashes.func1(0x2b3d300, 0xc06b356d00, 0xc06b2c1c00)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/middleware/strip.go:25 +0xf0
net/http.HandlerFunc.ServeHTTP(0xc000382f20, 0x2b3d300, 0xc06b356d00, 0xc06b2c1c00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.skipOptionsMW.func1(0x2b3d300, 0xc06b356d00, 0xc06b2c1c00)
/go/src/github.com/influxdata/influxdb/http/middleware.go:23 +0x6d
net/http.HandlerFunc.ServeHTTP(0xc000382f40, 0x2b3d300, 0xc06b356d00, 0xc06b2c1c00)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/go-chi/chi.(*Mux).ServeHTTP(0xc000117020, 0x2b3d300, 0xc06b356d00, 0xc06b2c1b00)
/go/pkg/mod/github.com/go-chi/chi@v4.0.2+incompatible/mux.go:82 +0x294
github.com/influxdata/influxdb/http.(*AuthenticationHandler).ServeHTTP(0xc0001ef110, 0x2b3d300, 0xc06b356d00, 0xc06b528300)
/go/src/github.com/influxdata/influxdb/http/authentication_middleware.go:120 +0x29e
github.com/influxdata/influxdb/http.setCORSResponseHeaders.func1(0x2b3d300, 0xc06b356d00, 0xc06b528300)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:24 +0xab
net/http.HandlerFunc.ServeHTTP(0xc00089b260, 0x2b3d300, 0xc06b356d00, 0xc06b528300)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.skipOptionsMW.func1(0x2b3d300, 0xc06b356d00, 0xc06b528300)
/go/src/github.com/influxdata/influxdb/http/middleware.go:23 +0x6d
net/http.HandlerFunc.ServeHTTP(0xc00089b280, 0x2b3d300, 0xc06b356d00, 0xc06b528300)
/usr/local/go/src/net/http/server.go:1995 +0x44
github.com/influxdata/influxdb/http.(*PlatformHandler).ServeHTTP(0xc00089b2c0, 0x2b3d300, 0xc06b356d00, 0xc06b528300)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:75 +0xe9
github.com/influxdata/influxdb/http.(*Handler).ServeHTTP(0xc000126300, 0x2b43700, 0xc06ac49ce0, 0xc06b528300)
/go/src/github.com/influxdata/influxdb/http/handler.go:141 +0x214
net/http.serverHandler.ServeHTTP(0xc000364a90, 0x2b43700, 0xc06ac49ce0, 0xc05500bc00)
/usr/local/go/src/net/http/server.go:2774 +0xa8
net/http.(*conn).serve(0xc0556294a0, 0x2b4d040, 0xc06b273ec0)
/usr/local/go/src/net/http/server.go:1878 +0x851
created by net/http.(*Server).Serve
/usr/local/go/src/net/http/server.go:2884 +0x2f4

goroutine 487963 [runnable]:
bytes.makeSlice(0x1fe00, 0x0, 0x0, 0x0)
/usr/local/go/src/bytes/buffer.go:232 +0x6d
bytes.(*Buffer).grow(0xc06ba6a480, 0x200, 0x7e00)
/usr/local/go/src/bytes/buffer.go:145 +0x16f
bytes.(*Buffer).ReadFrom(0xc06ba6a480, 0x2b0c820, 0xc0118bb8c0, 0x7fcff74a5eb0, 0xc06ba6a480, 0xc06ba55601)
/usr/local/go/src/bytes/buffer.go:205 +0x4b
io.copyBuffer(0x2b0c760, 0xc06ba6a480, 0x2b0c820, 0xc0118bb8c0, 0x0, 0x0, 0x0, 0x7fcff45a8d01, 0xc03de51e00, 0xc001164758)
/usr/local/go/src/io/io.go:388 +0x2fc
io.Copy(...)
/usr/local/go/src/io/io.go:364
github.com/influxdata/influxdb/chronograf/dist.bindataRead(0x3c944c0, 0x17a4e, 0x17a4e, 0x1c9ac1d, 0x1d, 0x30ea55b, 0xc001164780, 0x4fc5e2, 0xc06b8bbbc0, 0x1d)
/go/src/github.com/influxdata/influxdb/chronograf/dist/dist_gen.go:84 +0x24c
github.com/influxdata/influxdb/chronograf/dist.UiBuild2bb64b4255SvgBytes(...)
/go/src/github.com/influxdata/influxdb/chronograf/dist/dist_gen.go:432
github.com/influxdata/influxdb/chronograf/dist.UiBuild2bb64b4255Svg(0x1967780, 0xc000118bd0, 0xc06b8bbbc0)
/go/src/github.com/influxdata/influxdb/chronograf/dist/dist_gen.go:439 +0x6d
github.com/influxdata/influxdb/chronograf/dist.Asset(0xc06b8bbbc0, 0x1d, 0x5, 0x10, 0x1e, 0x5, 0xc06b6070a0)
/go/src/github.com/influxdata/influxdb/chronograf/dist/dist_gen.go:1255 +0xc8
github.com/influxdata/influxdb/chronograf/dist.(*BindataAssets).ServeHTTP.func1(0xc06b8bbbc0, 0x1d, 0x2, 0xc06b8bbbc0, 0x1d, 0x3d, 0x0)
/go/src/github.com/influxdata/influxdb/chronograf/dist/dist.go:59 +0x6b
github.com/elazarl/go-bindata-assetfs.(*AssetFS).Open(0xc06ba6a150, 0xc06b8bbbc0, 0x1d, 0xc0447eb800, 0x8, 0x2, 0xc06ba6a150)
/go/pkg/mod/github.com/elazarl/go-bindata-assetfs@v1.0.0/assetfs.go:147 +0xfe
net/http.serveFile(0x2b3d300, 0xc06ba3e3c0, 0xc06ba0a700, 0x2b0cbe0, 0xc06ba6a150, 0xc06b8bb944, 0xf, 0x1a0a301)
/usr/local/go/src/net/http/fs.go:551 +0xb1
net/http.(*fileHandler).ServeHTTP(0xc06b8a3800, 0x2b3d300, 0xc06ba3e3c0, 0xc06ba0a700)
/usr/local/go/src/net/http/fs.go:723 +0xa2
github.com/influxdata/influxdb/chronograf/dist.(*BindataAssets).ServeHTTP(0xc06ba6a120, 0x2b3d300, 0xc06ba3e3c0, 0xc06ba0a700)
/go/src/github.com/influxdata/influxdb/chronograf/dist/dist.go:87 +0x142
github.com/influxdata/influxdb/http.(*AssetHandler).ServeHTTP(0xc00077fe70, 0x2b3d300, 0xc06ba3e3c0, 0xc06ba0a700)
/go/src/github.com/influxdata/influxdb/http/assets.go:49 +0x12d
github.com/influxdata/influxdb/http.(*PlatformHandler).ServeHTTP(0xc00089b2c0, 0x2b3d300, 0xc06ba3e3c0, 0xc06ba0a700)
/go/src/github.com/influxdata/influxdb/http/platform_handler.go:71 +0xaf
github.com/influxdata/influxdb/http.(*Handler).ServeHTTP(0xc000126300, 0x2b43700, 0xc06b521ea0, 0xc06ba0a700)
/go/src/github.com/influxdata/influxdb/http/handler.go:141 +0x214
net/http.serverHandler.ServeHTTP(0xc000364a90, 0x2b43700, 0xc06b521ea0, 0xc06b7c1d00)
/usr/local/go/src/net/http/server.go:2774 +0xa8
net/http.(*conn).serve(0xc06b599a40, 0x2b4d040, 0xc06b8d3440)
/usr/local/go/src/net/http/server.go:1878 +0x851
created by net/http.(*Server).Serve
/usr/local/go/src/net/http/server.go:2884 +0x2f4
```

Contributor guide

Open the contributing guide

First steps

Read the whole issue, then the project's contributing guide.
Comment on the issue to say you are picking it up — it saves two people doing the same work.
Fork the repository and make your change on a branch.
Open a pull request that references the issue number.

Research direction

Start with the panic path in bolt/kv.go and kv/auth.go, especially authIndexBucket and findAuthorizationByToken, then review the related shutdown path in cmd/influxd/launcher/launcher.go. Reproduce the dashboard refresh and shutdown sequence if possible, and use the reported bbolt cursor fault as the failure signal. Done means the sequence no longer freezes or causes a segmentation violation.

Written by the indexing model from the issue text.

Assessment

Tech stack: go
Domain: authentication, backend, databases
Issue type: Bug
Difficulty: 4/5
Estimated time: 3-5 days
Activity status: Stale
Clarity: Needs clarification
Newbie friendliness: 25/100