70b

### Checklist

- [ ] 1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/kvcache-ai/ktransformers/discussions. Otherwise, it will be closed.
- [ ] 2. To help the community, I will use Chinese/English or attach an Chinese/English translation if using another language. Non-English/Chinese content without translation may be closed.

### Motivation

Can small models be supported?

32b
70b

### Related resources

??????????

The issue asks whether smaller models, specifically 32b and 70b, can be supported, but it names no files, tests, or entry points. Start by reviewing the current model-support and inference paths; done would require a defined support scope and confirmation that the targeted models work.

Written by the indexing model from the issue text.