AbsaOSS / AbsaOSS/enceladus

Import Avro schema from subject definitions

Offen
#1,403 0 Kommentare 0 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen
feature Menas priority: medium request
Vorherrschende Sprache
Scala
Sterne
33
Forks
16
PR-Merge-Kennzahlen
Keine gemergten PRs in 30 T.

Beschreibung

## Background
Currently, if the Confluent control panel can show an Avro schema for a topic. But when you click "Download" it downloads a subject definition containing key and value schemas as JSON fields.

## Feature
Add ability for the Avro schema uploader to recognize that the JSON is a full subject definition. If that is the case:
- Extract key and value schemas (or only one of them if only one of them is present)
- Combine the key schema with the value schema by appending value schema after the key schema.
- Import such a combined schema to Menas.

## Additional context
We support:
```json
{
"type": "record",
"name": "test",
"namespace": "some.name.space",
"fields": [
{
"name": "id",
"type": [
"null",
"int"
]
}
]
}
```

but we also need to support
```json
{
"subject": "some.subject.topic-value",
"version": 1,
"id": 2,
"schema": "{\"type\":\"record\",\"name\":\"test\",\"namespace\":\"some.name.space\",\"fields\":[{\"name\":\"id\",\"type\":[\"null\",\"int\"]}]}"
}
```
*Note. Both JSONs specify the same schema.*

Beitragsleitfaden

Beitragsleitfaden öffnen

Bewertung

Dieses Issue wurde noch nicht bewertet.

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.