Aiven-Open / Aiven-Open/http-connector-for-apache-kafka

How can I get the connector to submit the follow curl?

未關閉
#170 0 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
question
主要語言
Java
星號
119
分支
63
PR 合併指標
30 天內沒有已合併 PR

描述

There are not enough examples of how to get the http connector to work. Best example I could find is https://redpanda.com/blog/unify-log-data-parseable-redpanda

Here's what I need to submit
```
curl -v --location-trusted -u : -H "strict_mode: true" \
-H "format: json" -H "jsonpaths: [\"$.name\", \"$.code\"]" \
-H "columns: city,tmp_id, id = tmp_id * 100" \
-T example2.json -XPUT \
http://someserver:<443>/api/test_db/table2/_stream_load
```

I need multiple headers to be submitted but the following won't work since http.headers.additional is a String.

```
{
"name": "http-sink-test",
"config": {
"connector.class": "io.aiven.kafka.connect.http.HttpSinkConnector",
"topics.regex": "m1",
"http.authorization.type": "oauth2",
"oauth2.client.id": "username",
"oauth2.client.secret": "password",
"http.headers.additional": [
{
"format": "json"
},
{
"jsonpaths": "[\"$.userid\",\"$.time\",\"$._time\",\"$.remote_user\",\"$.ip\",\"$.request\",\"$.status\",\"$.bytes\",\"$.referrer\",\"$.agent\"]"
}
],
"http.url": "http://https://6dihxzedg.cloud-app.celerdata.com/api/demo/visits/_stream_load",
"batching.enabled": true,
"batch.max.size": 2,
"tasks.max": "1",
"key.converter": "org.apache.kafka.connect.storage.StringConverter",
"value.converter": "org.apache.kafka.connect.json.JsonConverter"
}
}
```

Any advice?

貢獻指南

這個儲存庫沒有索引到貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。