dimensionalOS / dimensionalOS/dimos

Investigate Agentic understanding of 2D graphs

Open
#1,912 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

memory
Dominant language
Python
Stars
4.5k
Forks
808
Avg merge
3d 5h
Merged PRs (30d)
233

Description

if memory2 query returns a graph, how can we present it to a LLM model in a way in which it understands it?

write an eval, ask basic questions like

"what is the time range of this graph"
"where is the lowest point"
"what's the general shape of the graph"
"do you see any peaks, and at what points in time?"

Find a format that allows agent to answer these things without running aditional analysis on the data.
But also potentially allow model to do aditional analysis and see which formats work best.

As an experiment, we can ask real questions from an agent, like "describe the scene before you entered dark room to the south"

"how many times have you passed the couch in the middle of the office"


Synced from DIM-810 by summer

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the memory2 query path that returns a graph and review how its output is currently represented to an agent. Build an eval using the listed questions and compare formats, including whether the model can answer without additional analysis; done means identifying a format and documenting which questions it supports.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, data-visualization
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.