deepfence / deepfence/ThreatMapper

support to use of Kafka and Kafka rest proxy instead of HTTP server to ingest scans data

Open
#433 1 comment 0 reactions 2 assignees Claimed by @gnmahanth View on GitHub
area/agent area/api Backend enhancement WIP
Dominant language
TypeScript
Stars
5.3k
Forks
631
PR merge metrics
No merged PRs in 30d

Description

Agent sends scan logs and scan report to console http server, replace this http server with Kafka and Kafka rest proxy to receive scan data

As part of this also replace agent side http push with fluent-bit to send scan related data

Also implement consumer to consume data from required kafka topics which dumps data to Elasticsearch after applying custom parsing logic on scan data

**Components/Services**

- [ ] UI/Frontend
- [x] API/Backend
- [x] Agent
- [ ] Deployment/YAMLs
- [ ] CI/CD Integration
- [ ] Other (specify)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.