Forward Convolution Kernel
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 811
- Forks
- 87
- Avg merge
- 6d 4h
- Merged PRs (30d)
- 9
Description
Hello, I'm interested in helping implement the forward convolution kernel, which is marked as 📅 Planned in ROADMAP.md.
After browsing through the repository, I've come up with a couple of questions/thoughts to shape the implementation direction
Design proposal:
- Following the existing convention that op signatures mirror PyTorch's, I plan on implementing separate variants, such as
conv1d,conv2d, etc., as opposed to one masterconvop - I think starting with conv1d first would be more effective. Perhaps I can create a draft PR so that I can receive feedback before expanding the scope for larger dimensions
- bf16/fp16 inputs with FP32 accumulation. FP32 inputs via TF32 on tensor cores to match
matmul.py - NCHW layout
- Benchmark against
F.convNd(cuDNN)
Questions:
- Are there any internal blockers or overlapping work not yet reflected in the repository that I should be aware of?
- Is an NHCW eventually needed or is NCHW sufficient?
- I am currently using an RTX 5060 Ti, meaning that if I conduct performance profiling before making a PR, my numbers likely won't be as decisive compared to a B200 card. Is that ok?
Any additional tips/help/feedback would be much appreciated. Thank you! :D
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with ROADMAP.md to confirm the planned forward convolution scope, then read the existing matmul.py implementation and its conventions. Review the proposed conv1d, layout, dtype, and benchmarking questions with maintainers before coding; completion criteria are an agreed scope and implementation plan, followed by benchmarks against PyTorch F.convNd.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- backend, performance
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Active
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100