AI4Finance-Foundation / AI4Finance-Foundation/ElegantRL
🐛 Fix bug PER moudle.
- Ngôn ngữ chính
- Python
- Star
- 4.4k
- Fork
- 978
- Chỉ số merge pull request
- Không có pull request nào được merge trong 30 ngày
Mô tả
After updating the vectorized env and the corresponding multiprocessing training module, support for the PER algorithm has been affected.
Corresponding Pull Request: https://github.com/AI4Finance-Foundation/ElegantRL/pull/269
---
The related issue is as follows, PER appears nan because multiprocessing is not adapted to PER.
With multiprocessing, there are `num_envs * num_workers` parallel subenvironments available for a learner to learn. The way I used before, I had a PER sumTree(Binary search tree) with so many subenvironments producing trajectory at the same time, which led to bugs.
After modification, I let each subenvironment output trajectory correspond to one sumTree(Binary search tree). This solves the bug and reduces the size of each sumTree
Hướng dẫn đóng góp
Chưa lập chỉ mục được hướng dẫn đóng góp cho kho mã nguồn này
Đánh giá
Issue này chưa được đánh giá.