neo4j / neo4j/neo4j-graphrag-python
[QUESTION]: How can I log intermediate LLM Responses
Open
Nobody has claimed this yet.
question
- Dominant language
- Python
- Stars
- 1.3k
- Forks
- 246
- Avg merge
- 1d 8h
- Merged PRs (30d)
- 11
Description
Question
I get an "LLM Response has improper format" error from my extractor step in the pipeline, but I dont really know what the model actually responded with.
Is there a way to tell the pipeline to increase the logging level to show the LLM responses?
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the pipeline's extractor step and its logging configuration, then reproduce the improper-format error while checking existing logs. The issue is complete when the supported way to inspect intermediate LLM responses is established and documented, or the request is clearly identified as unsupported.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- ai, observability
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100