apache / apache/flink-agents

[Feature] Support making use of the native capabilities of models for structure output.

Open
#280 9 comments 0 reactions 1 assignee Claimed by @weiqingy View on GitHub
feature priority/major
Dominant language
Java
Stars
452
Forks
167
Avg merge
5d 9h
Merged PRs (30d)
49

Description

### Search before asking

- [x] I searched in the [issues](https://github.com/apache/flink-agents/issues) and found nothing similar.

### Description

Currently, when configured `output_schema`, the react agent directly prompt the model to use a specific format, and use an output parser to extract the structured response from the raw model output. This is the only way for models which don't support tool calling or json mode.

For models support tool calling or json mode, we can makes use of these capabilities to generate structured output.

See https://python.langchain.com/docs/how_to/structured_output/ for details.

### Are you willing to submit a PR?

- [ ] I'm willing to submit a PR!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.