Owner

Lightning-AI

13 indexed repositories · View on GitHub

pytorch-lightning
Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

Python · 31351 stars
litgpt
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Python · 13670 stars
lit-llama
Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Ad...

Python · 6082 stars
LitServe
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.

Python · 3942 stars
torchmetrics
Machine learning metrics for distributed, scalable PyTorch applications.

Python · 2473 stars
lightning-thunder
PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily wri...

Python · 1473 stars
litData
Speed up model training by fixing data loading.

Python · 614 stars
utilities
Common Python utilities and GitHub Actions in Lightning Ecosystem

Python · 62 stars
litAI
LLM router + minimal agent framework in one. Call any LLM API with OpenAI format. Unified billing, tools, retries, fallback, logging. Bui...

Python · 52 stars
LitModels
Save, load, host, and share AI model checkpoints without slowing down training. Host on Lightning AI or your own cloud with enterprise-gr...

Python · 40 stars
LitLogger
A minimal Python logger that tracks everything you try when building AI - metrics, prompts, models, etc, so you can see what changed and ...

Python · 37 stars
sdk
SDK and CLI for lightning.ai platform. Develop and train AI with ease.

Python · 10 stars
Lightning-multinode-templates
Multinode templates for Pytorch Lightning

Python · 9 stars

Open All

Turn on strict `pytest.mark.xfail` Open

Lightning-AI/lightning-thunder#305 · 3 comments · 2 reactions · 0 assignees · Indexed Sep 19, 2026
Build op provenance tracking into compile trace output Open

Lightning-AI/lightning-thunder#255 · 0 comments · 3 reactions · 0 assignees · Indexed Sep 19, 2026
`disable_torch_autograd_support` should consider `no_grad` and `inference_mode` Open

Lightning-AI/lightning-thunder#315 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 19, 2026
`python_print` should support `*args` Open

Lightning-AI/lightning-thunder#314 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 19, 2026
Implement VJP for `python_print` Open

Lightning-AI/lightning-thunder#313 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 19, 2026
`python_print` doesn't work as expected Open

Lightning-AI/lightning-thunder#312 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 19, 2026
A mechanism for easily calling a module's traces Open

Lightning-AI/lightning-thunder#311 · 0 comments · 2 reactions · 0 assignees · Indexed Sep 19, 2026
Dtype mismatch with LitGPT and autocast Open

amp bug

Lightning-AI/lightning-thunder#310 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 19, 2026
Weight tying + FSDP = out of bounds Open

bug distributed

Lightning-AI/lightning-thunder#257 · 4 comments · 0 reactions · 1 assignee · Indexed Sep 19, 2026
[FSDP] Support gradient clipping by norm Open

Lightning-AI/lightning-thunder#309 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 19, 2026
[FSDP] Support optimizer state checkpointing Open

Lightning-AI/lightning-thunder#308 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 19, 2026
Debug mode that associates backward ops to forward ops in the trace Open

Lightning-AI/lightning-thunder#306 · 0 comments · 4 reactions · 0 assignees · Indexed Sep 19, 2026
Support `torch.Tensor.register_hook` Open

Lightning-AI/lightning-thunder#307 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 19, 2026
Label tracking meta-issue (edit me to get automatically CC'ed on issues!) Open

Lightning-AI/lightning-thunder#72 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 19, 2026
`test_vjp_correctness` fails with ops that return tensors that do not require grads. Open

bug help wanted

Lightning-AI/lightning-thunder#120 · 1 comment · 0 reactions · 1 assignee · Indexed Sep 19, 2026
How do I access the `ThunderModule` if I'm compiling a function? Open

enhancement help wanted

Lightning-AI/lightning-thunder#121 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 19, 2026
Curious about the torch.compile baseline in benchmark_litgpt Open

question

Lightning-AI/lightning-thunder#123 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 19, 2026
Support `torch.where(condition)` with thunder.jit Open

enhancement help wanted operators

Lightning-AI/lightning-thunder#124 · 12 comments · 0 reactions · 0 assignees · Indexed Sep 19, 2026
[feature request] Indexing with boolean masks Open

enhancement help wanted operators

Lightning-AI/lightning-thunder#126 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 19, 2026
Skipped distributed tests show up as passed (return 0) Open

ci / tests

Lightning-AI/lightning-thunder#131 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 19, 2026
Functional JIT loading closures sharp edge Open

bug design required jit

Lightning-AI/lightning-thunder#132 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 19, 2026
Non-supported diffusion transformer operators Open

operators

Lightning-AI/lightning-thunder#133 · 2 comments · 1 reaction · 0 assignees · Indexed Sep 19, 2026
Improve the logic of fsdp bucket naming function Open

Lightning-AI/lightning-thunder#134 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 19, 2026
Updating a nn.Module attribute in forward raises an exception in prologue trace. Open

bug jit warnings & errors

Lightning-AI/lightning-thunder#137 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 19, 2026
Handling inplace through SSA Open

enhancement help wanted

Lightning-AI/lightning-thunder#145 · 16 comments · 1 reaction · 0 assignees · Indexed Sep 19, 2026
Handle returning NamedTuples from the JIT Open

enhancement help wanted jit

Lightning-AI/lightning-thunder#147 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 19, 2026
Better name for elements of list in `prologue_trace` and `computation_trace` Open

enhancement help wanted jit

Lightning-AI/lightning-thunder#152 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 19, 2026
Sunset `thunder/benchmarks/distributed.py` and Improve `thunder/benchmarks/benchmark_litgpt.py` Open

benchmarking distributed

Lightning-AI/lightning-thunder#158 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 19, 2026
Represent slices natively in traces Open

enhancement operators

Lightning-AI/lightning-thunder#160 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 19, 2026
Partial function is not supported in `grad_transform` Open

autograd enhancement

Lightning-AI/lightning-thunder#171 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 19, 2026
Implement `TensorBase.is_contiguous` Open

enhancement MegatronImagen memory format nemo

Lightning-AI/lightning-thunder#172 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 19, 2026
`TensorBase.repeat_interleave` Open

enhancement MegatronImagen nemo

Lightning-AI/lightning-thunder#173 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 19, 2026
Implement `conv_transpose2d` Open

enhancement MegatronImagen nemo

Lightning-AI/lightning-thunder#178 · 2 comments · 0 reactions · 1 assignee · Indexed Sep 19, 2026
Support NeMo MegatronImagen network Open

enhancement MegatronImagen nemo

Lightning-AI/lightning-thunder#179 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 19, 2026
Automated benchmarking and reporting Open

benchmarking enhancement

Lightning-AI/lightning-thunder#183 · 5 comments · 0 reactions · 1 assignee · Indexed Sep 19, 2026
Consistency in the order of applying a transform and using `thunder.jit` Open

bug transforms

Lightning-AI/lightning-thunder#185 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 19, 2026
einsum performance regression after disabling bookend optimization Open

bug

Lightning-AI/lightning-thunder#193 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 19, 2026
Mixtral 8x7B network support for thunder.jit path Open

enhancement network support

Lightning-AI/lightning-thunder#194 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 19, 2026
Support `torch.nonzero` Open

enhancement operators

Lightning-AI/lightning-thunder#195 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 19, 2026
Support non_blocking in Tensor.to Open

bug operators

Lightning-AI/lightning-thunder#197 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 19, 2026
test_grad.py assumes all ops in OpInfo database can be run on CPU Open

testing

Lightning-AI/lightning-thunder#199 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 19, 2026
optimizer: jitting the optimizer step Open

enhancement

Lightning-AI/lightning-thunder#204 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 19, 2026
value_and_grad returns None gradients with thunder.jit Open

bug jit transforms

Lightning-AI/lightning-thunder#211 · 3 comments · 1 reaction · 1 assignee · Indexed Sep 19, 2026
Enable xfailed tests from test_apex_executor.py Open

apex bug ci / tests

Lightning-AI/lightning-thunder#220 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 19, 2026
Setup a nightly job that runs the benchmarking suite Open

benchmarking ci / tests enhancement

Lightning-AI/lightning-thunder#226 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 19, 2026
executor should be able to put checks into prologue trace Open

dynamic constraints enhancement

Lightning-AI/lightning-thunder#263 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 19, 2026
Support NeMo StableDiffusion network Open

enhancement nemo

Lightning-AI/lightning-thunder#266 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 19, 2026
Run `examine` automatically when hit unsupported operator failure Open

enhancement

Lightning-AI/lightning-thunder#270 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 19, 2026
jit: `torch.cuda.stream` and other related functionality are silently ignored when jitting. Open

bug warnings & errors

Lightning-AI/lightning-thunder#280 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 19, 2026
Timeout for Platypus-30B and Thunder compile Open

bug distributed mixology

Lightning-AI/lightning-thunder#294 · 4 comments · 1 reaction · 1 assignee · Indexed Sep 19, 2026

Showing the newest 100

This page lists what was indexed most recently. Advanced filter has the whole inventory, narrowed by language, difficulty and how long a task takes.

Open advanced filter

Lightning-AI

Showing the newest 100

Get new issues in your inbox