dimensionalOS / dimensionalOS/dimos
Investigate Agentic understanding of 2D graphs
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 4.5k
- Forks
- 808
- Avg merge
- 3d 5h
- Merged PRs (30d)
- 233
Description
if memory2 query returns a graph, how can we present it to a LLM model in a way in which it understands it?
write an eval, ask basic questions like
"what is the time range of this graph"
"where is the lowest point"
"what's the general shape of the graph"
"do you see any peaks, and at what points in time?"
Find a format that allows agent to answer these things without running aditional analysis on the data.
But also potentially allow model to do aditional analysis and see which formats work best.
As an experiment, we can ask real questions from an agent, like "describe the scene before you entered dark room to the south"
"how many times have you passed the couch in the middle of the office"
Synced from DIM-810 by summer
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the memory2 query path that returns a graph and review how its output is currently represented to an agent. Build an eval using the listed questions and compare formats, including whether the model can answer without additional analysis; done means identifying a format and documenting which questions it supports.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- ai, data-visualization
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100