microsoft / microsoft/FLAML

Agent Implementation of MathChat

Open
#1,066 3 comments 0 reactions 1 assignee Claimed by @yiranwu0 View on GitHub
Dominant language
Jupyter Notebook
Stars
4.4k
Forks
565
Avg merge
5d 8m
Merged PRs (30d)
17

Description

Implement the [MathChat paper](https://arxiv.org/abs/2306.01337) with the current agent framework:
- Put the specified math problem-solving prompt in system message of `AssistantAgent` for the LLM. If the behavior is not desired, the assistant agent need to be modified to accept this prompt in user message.
- Implement a `MathUserProxyAgent` from `UserProxyAgent`, need to inherit the `autoreply` function.
- MathChat proposes a conversational framework to solve math problems, which is equivalent to interactions between the two agents. Building on the agents also allow human inputs.
```[tasklist]
### Tasks
- [x] Review PR https://github.com/microsoft/FLAML/pull/1056
- [x] Evaluate the performance of AssistantAgent and UserProxyAgent on math problem solving (on several representative problems)
- [ ] Agent implementation of MathChat. PR made and approvals from reviewers pending in https://github.com/microsoft/FLAML/pull/1076
- [ ] Update arxiv: Update link to implementation(keep the old one for the purpose of reproducing the exp results)
- [ ] Update FLAML's autogen documentation: mention MathChat
- [ ] Write a blogpost about MathChat
```

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.