influxdata / influxdata/kapacitor

Issue in connecting remote InfluxDB from local Kapacitor

Open
#1,407 6 comments 0 reactions 0 assignees View on GitHub
Dominant language
Go
Stars
2.4k
Forks
479
Avg merge
4d 16h
Merged PRs (30d)
4

Description

Hi,
I want to connect an remote instance of InfluxDB from my local Kapacitor and do some processing on the data and put back the processed data to the same remote instance of InfluxDB.
I have made changes to the kapacitor.conf file changing the **urls** parameter to desired remote Influx's IP something like **urls = ["http://10.0.10.10:8086"]**
By doing this Influx have correct subscription mapping of this kapacitor instance. I will be posting output below.
However, when I try to run a batch task, it runs well. Data get picks from remote Influx and processed data is put back into the remote Influx. But when I run **stream** task, it doesn't run. The ouput is null. In **kapacitor show task** everything is with value 0.

Could you please help me setting up this.

Kapacitor is spinning on docker on Linux machine and the InfluxDB which I'm trying to connect is somewhere on the network.

**kapacitor.config**
```
[[influxdb]]
enabled = true
name = "default"
default = true
urls = ["http://10.0.10.10:8086"]
username = ""
password = ""
ssl-ca = ""
ssl-cert = ""
ssl-key = ""
insecure-skip-verify = false
timeout = "0s"
disable-subscriptions = false
subscription-protocol = "http"
kapacitor-hostname = ""
http-port = 0
udp-bind = ""
udp-buffer = 1000
udp-read-buffer = 0
startup-timeout = "5m0s"
subscriptions-sync-interval = "1m0s"
[influxdb.excluded-subscriptions]
_kapacitor = ["autogen"]
```
**kapacitor stats general**
```
ClusterID: 291ddf7a-ef34-43eb-a472-2ef181f04fd7
ServerID: 414a85e0-99df-4ce0-b149-218f2303759d
Host: ef12c0ed23ed
Tasks: 8
Enabled Tasks: 2
Subscriptions: 3
Version: 1.2.0
```
**kapacitor stats ingress**
```
Database Retention Policy Measurement Points Received
_kapacitor autogen edges 840
_kapacitor autogen ingress 713
_kapacitor autogen kapacitor 120
_kapacitor autogen nodes 720
_kapacitor autogen runtime 120
_kapacitor autogen topics 840
```
**SHOW SUBSCRIPTIONS**
```
name: _internal
retention_policy name mode destinations
---------------- ---- ---- ------------
monitor kapacitor-291ddf7a-ef34-43eb-a472-2ef181f04fd7 ANY [http://ef12c0ed23ed:9092]

name: cxg
retention_policy name mode destinations
---------------- ---- ---- ------------
autogen kapacitor-291ddf7a-ef34-43eb-a472-2ef181f04fd7 ANY [http://ef12c0ed23ed:9092]

name: mydb
retention_policy name mode destinations
---------------- ---- ---- ------------
autogen kapacitor-291ddf7a-ef34-43eb-a472-2ef181f04fd7 ANY [http://ef12c0ed23ed:9092]
```

Contributor guide

Open the contributing guide

Research direction

Start with the kapacitor.conf [influxdb] settings and compare the batch and stream task behavior using kapacitor show task and stats ingress. Check whether the stream task receives points from the listed subscriptions; done means the cause is reproduced and the required configuration or task setup is documented.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker, linux
Domain
backend, databases, stream-processing
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.