instadeepai / instadeepai/flashbax

This line prevents the use of jax.distributed.initialize when importing flashbax

Open
#65 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
283
Forks
22
PR merge metrics
No merged PRs in 30d

Description

https://github.com/instadeepai/flashbax/blob/f518aa8a795ca0c3341816e9f0268b6deb853de6/flashbax/buffers/prioritised_trajectory_buffer.py#L778

As the title says, you cannot call jax.devices or similar functions before using jax.distributed.initialize, if people want to use flashbax in a distributed setup, it might be worthwhile finding an alternative to use or just not validating devices that way. i don't think its strictly necessary to explicitly check.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.