automl / automl/DACBench

Integrate Offline DAC Interface

Open
#156 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
PDDL
Stars
39
Forks
19
PR merge metrics
No merged PRs in 30d

Description

In his thesis, Jannis wrote a logger for DE runs and parsing into D4RL-style datasets so we can train offline RL algorithms from unifloral. This would be a generally really nice feature to have, so we should integrate this functionality. Proposal:

- [ ] Add an abstract class based on the DE DAC Logger
- [ ] Use the env.reset() and env.step() functions in the Logger
- [ ] Append dataset parsing immediately after the Logger runs
- [ ] Add example using this for training with unifloral

Related: Jannis used detpy as DE implementation which might be nice to add as its own env since it has several dynamic baselines (and we already have the datasets). He mentioned it should be doable, but it not fully trivial for the baselines. Might need investigation.

Code: https://github.com/automl-private/Bsc-JannisKastner-DeDAC/tree/main

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the linked DeDAC implementation and trace how its logger uses env.reset() and env.step(). Compare that design with the proposed abstract logger, dataset parsing, and unifloral training example; done means all four proposal items are integrated, with detpy and its dynamic baselines investigated separately.

Written by the indexing model from the issue text.

Assessment

Domain
data, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.