A HF/Docker/Modal reproducible training/inference example
- Dominant language
- Jupyter Notebook
- Stars
- 7k
- Forks
- 541
- PR merge metrics
- No merged PRs in 30d
Description
Considering that it depends on specific torch (torch==2.2.1) and possibly CUDA, many MacBooks won't be able to run some of the examples. If you want to run tests and notebooks, you'll need lfs and so on - so it becomes an infra nightmare.
1. Is there any plan to create a template for training/inference on Docker / Modal.com, using say `pytorch/pytorch:2.2.1-cuda12.1-cudnn8-devel`?
2. Is there any plan to create a HuggingFace space on at least one of the 10+ demos?
3. I see that pip install with mlx support already requires `huggingface_hub`. Is there a reason why?
Contributor guide
Research direction
The issue names no files, tests, or entry points; begin by reviewing the existing training and inference demos, notebooks, and their dependency setup. Compare the requested Docker/Modal and Hugging Face approaches, then establish a concrete scope and acceptance criteria for a reproducible example and the mlx-support dependency rationale.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- docker, jupyter-notebook, pytorch
- Domain
- cloud, devops, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100