EleutherAI / EleutherAI/oslo

Fix TP embedding layers

Open
#152 0 comments 0 reactions 1 assignee Claimed by @jason9693 View on GitHub
Dominant language
Python
Stars
176
Forks
26
PR merge metrics
No merged PRs in 30d

Description

## Describe a TODO feature

- Force tp_wrapper do not parallelize emb-layer if model has not embedding layer. (for vision model competible)
https://discord.com/channels/729741769192767510/1012603449910759504/1083785802930192434

## Assignees

- @jason9693

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.