explosion / explosion/curated-transformers

Add suggested PyTorch LLM optimizations

Open
#356 0 comments 2 reactions 0 assignees View on GitHub
feat/generation feat/model
Dominant language
Python
Stars
890
Forks
36
PR merge metrics
No merged PRs in 30d

Description

Most of these optimizations should be easy to add: https://pytorch.org/blog/accelerating-generative-ai-2/

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.