facebookresearch / facebookresearch/BenchMARL

Training from checkpoints / executing trained policies

Open
#207 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
661
Forks
135
PR merge metrics
No merged PRs in 30d

Description

Hello,

Thank you for the great library!

Is it possible to continue training from checkpoints or executing a trained policy in BenchMARL?

A bit of context: I'm experimenting with policy transfer/reuse across multi-agent teams and would like to test the scenario, when a MARL team kicks-off with a model learned for a related task in the same environment, and adapts it for the target task (i.e. in MPE, reuses the model learned for simple_spread to solve simple_adversary).

Thanks in advance!

Contributor guide

Open the contributing guide

Research direction

No files, tests, or entry points are named in the issue. First map how BenchMARL currently trains policies and handles checkpoints, then determine the expected behavior for resuming training and executing or transferring a trained policy; done requires a documented, tested workflow for these use cases.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.