InternLM / InternLM/InternEvo

[Feature] 不使用memory pool

Open
#324 1 comment 0 reactions 1 assignee Assigned to @blankde View on GitHub
enhancement
Dominant language
Python
Stars
421
Forks
67
PR merge metrics
No merged PRs in 30d

Description

### Describe the feature

实际使用过程中,不需要memory_pool,memory pool的逻辑可能和其他芯片的显存分配策略有冲突,建议统一去除memory pool的实现和使用,包括moe对memory pool的使用

### Will you implement it?

- [ ] I would like to implement this feature and create a PR!

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.