AnswerDotAI / AnswerDotAI/gpu.cpp

Support for 4bit or 8bit tensor

Open
#5 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
4k
Forks
199
Avg merge
2m
Merged PRs (30d)
3

Description

Although it may be out of scope, it would be nice to have an example of computing 4bit and 8bit tensors, to save memory bandwidth.

Contributor guide

No contributing guide indexed for this repository

Research direction

No files, tests, or entry points are named. First clarify the intended 4-bit and 8-bit tensor representation and the example's expected scope, then identify the relevant tensor and GPU-computation entry points; done should include a working example that demonstrates the requested reduced memory bandwidth.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
hpc, performance
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.