Json deserialization support in java client

Open
#125 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
5/5
Estimated time
Over a week
Newbie friendliness
30/100
Issue type
Feature
Clarity
Needs clarification
Activity status
Stale
Tech stack
java, json
Domain
api, backend

Research direction

Start by comparing KafkaJsonSchemaDeserializer.java, KafkaAvroDeserializer.java, and KafkaProtobufDeserializer.java, then inspect the Java client’s current protobuf deserialization entry point. Resolve the deserializer contract and return-type choice, and define how schema compatibility is validated. Done means the Java client accepts JSON input for firehose use with compatibility checks.

Written by the indexing model from the issue text.

Description

enhancement json

Is your feature request related to a problem? Please describe.
We want to add support to deserialize json data based on the provided schema

Describe the solution you'd like
As of now the client only has protobuf deserialization support, need to create generic interface contract for Deserializer which will be implemented for various data formats. On the lines of

  1. KafkaJsonSchemaDeserializer.java
  2. KafkaAvroDeserializer.java
  3. KafkaProtobufDeserializer.java
    We need to do some poc on return type, whether to return actual class object or generic json object. But regardless of it, it should validate whether the given input data is compatible with the schema or no.

Additional context
We need this because we want to support different input data types in firehose, which currently only supports protobuf.

Dominant language
Go
Stars
237
Forks
42
PR merge metrics
No merged PRs in 30d

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from raystack/stencil

All issues in raystack/stencil

Similar issues

More Go issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.