microsoft / microsoft/FLAML

Improve logging in autogen.oai

Open
#1,069 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Jupyter Notebook
Stars
4.4k
Forks
565
Avg merge
5d 8m
Merged PRs (30d)
17

Description

Currently, the `autogen.oai` package has an experimental support for logging: https://microsoft.github.io/FLAML/docs/Use-Cases/Auto-Generation#logging-experimental
The data are logged in memory as a dictionary. This feature needs to be improved to persist the log automatically and support log analytics, and support #1063 .

```[tasklist]
### Tasks
- [ ] Check whether the data format needs to be changed.
- [ ] Choose a logging solution. For example, mlflow.
- [ ] Write documentation and test.
- [ ] Implement.
- [ ] Write a notebook example.
```

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.