caikit/caikit-nlp

View on GitHub

Stars: 12
Forks: 55
Open beginner issues: 0
Indexed issues: 54

Dominant language: Python
License: Apache-2.0
Last GitHub push: Oct 6, 2025
Latest indexed: Sep 14, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue help wanted
PR merge metrics: No merged PRs in 30d

Open All

54 open issues indexed

Improve Validation in Prompt Tuning Module Open

enhancement good first issue

caikit/caikit-nlp#20 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 14, 2026
Make .load() in Prompt Tuning Module Generic Open

good first issue tech-debt

caikit/caikit-nlp#21 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Improve Metrics Evaluation in Prompt Tuning Open

enhancement

caikit/caikit-nlp#22 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Quality Evaluation API Open

enhancement

caikit/caikit-nlp#23 · 0 comments · 0 reactions · 2 assignees · Indexed Sep 14, 2026
Early Stopping in Prompt Tuning Open

enhancement

caikit/caikit-nlp#24 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Implement Batch Prediction for Inference on Prompt Tuned Models Open

enhancement good first issue

caikit/caikit-nlp#25 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
HyperParameter Optimization Open

enhancement

caikit/caikit-nlp#26 · 0 comments · 0 reactions · 2 assignees · Indexed Sep 14, 2026
Add Support for Building Against TGIS Open

caikit/caikit-nlp#27 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Remove configuration of bos_token etc from text-gen module Open

good first issue help wanted

caikit/caikit-nlp#48 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Change SimpleIterableStreamWrapper to work with multiple workers allowing shuffling Open

caikit/caikit-nlp#74 · 1 comment · 0 reactions · 1 assignee · Indexed Sep 14, 2026
Test fine-tuning on various sizes of model Open

caikit/caikit-nlp#76 · 15 comments · 0 reactions · 1 assignee · Indexed Sep 14, 2026
Experiment: Try fine-tuning of a torch.compile model Open

low priority

caikit/caikit-nlp#82 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Create documentation showcasing how to use scripts in examples folder Open

caikit/caikit-nlp#83 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add import tracker to avoid dependency overflow Open

low priority

caikit/caikit-nlp#86 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add support for fine-tuned models to be directly usable for prompt-tuning Open

low priority

caikit/caikit-nlp#87 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add csv training data support Open

enhancement

caikit/caikit-nlp#113 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Cleanup: Add check in fine-tuning modules to make sure there aren't duplicate params passed in kwargs Open

good first issue

caikit/caikit-nlp#115 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Experiment and implement sharding configurations for various target model types Open

caikit/caikit-nlp#117 · 1 comment · 0 reactions · 2 assignees · Indexed Sep 14, 2026
Add max seq len check for prompt tuning and fine-tuning Open

enhancement good first issue

caikit/caikit-nlp#118 · 2 comments · 0 reactions · 1 assignee · Indexed Sep 14, 2026
Document TGIS build / integration process for example scripts Open

good first issue

caikit/caikit-nlp#119 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Cleanup logs getting generated while performing fine-tuning Open

caikit/caikit-nlp#124 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add classification block for prompt tuning Open

caikit/caikit-nlp#133 · 3 comments · 0 reactions · 1 assignee · Indexed Sep 14, 2026
Add support for LoRA in prompt tuning module (Investigate) Open

caikit/caikit-nlp#136 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Verify fine-tuning working with multi-gpu with half precision Open

caikit/caikit-nlp#138 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add bootstrap functionality for prompt tuning Open

caikit/caikit-nlp#141 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add test to verify eos_token is working as expected Open

good first issue

caikit/caikit-nlp#166 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Text generation API field marked with incorrect type Open

bug good first issue

caikit/caikit-nlp#167 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add LoRA configuration support for fine-tuning module Open

caikit/caikit-nlp#169 · 5 comments · 0 reactions · 1 assignee · Indexed Sep 14, 2026
Quality evaluation of LoRA via fine-tuning on llama-7b single GPU Open

caikit/caikit-nlp#170 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Replace training loop in peft_prompt_tuning with HF Trainer Open

caikit/caikit-nlp#175 · 2 comments · 0 reactions · 3 assignees · Indexed Sep 14, 2026
Enable FSDP for Prompt Tuning via Peft Open

caikit/caikit-nlp#177 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add tool to easily assess model compatibility Open

caikit/caikit-nlp#178 · 5 comments · 0 reactions · 1 assignee · Indexed Sep 14, 2026
Issue converting mpt-7b-instruct to caikit format Open

bug

caikit/caikit-nlp#182 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Allow saving of fine-tuned models in safetensors Open

caikit/caikit-nlp#186 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Save larger fine-tuned models in sharded form Open

caikit/caikit-nlp#187 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add adopter_config based save method for prompt tuning Open

caikit/caikit-nlp#194 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Standard Proto Interface Dump Open

caikit/caikit-nlp#196 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add auto batch size estimator for training to avoid OOM Open

caikit/caikit-nlp#207 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add a dry-run capability to estimate memory requirement for training without training Open

caikit/caikit-nlp#226 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 14, 2026
Add ability to save intermediate checkpoints as caikit models Open

enhancement

caikit/caikit-nlp#229 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add auto training param estimation Open

caikit/caikit-nlp#230 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Local text generation model inference appears slower than prompt tuning inference Open

bug

caikit/caikit-nlp#233 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Different Caikit server instances returns different protos Open

caikit/caikit-nlp#237 · 8 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
The TextGeneration ModuleBases raises exception when loading weights from a path Open

caikit/caikit-nlp#248 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Test Llama-7b-model Open

caikit/caikit-nlp#250 · 3 comments · 0 reactions · 1 assignee · Indexed Sep 14, 2026
generate_text_func: support `finish_reason=TOKEN_LIMIT` Open

caikit/caikit-nlp#253 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Handle OOM for HF Trainer fine-tuning Open

enhancement

caikit/caikit-nlp#254 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Fine tuning with llama-7b-model failure Open

caikit/caikit-nlp#256 · 3 comments · 0 reactions · 1 assignee · Indexed Sep 14, 2026
Add ways to configure "default" value for training data limit Open

enhancement good first issue help wanted

caikit/caikit-nlp#260 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Multi-gpu prompt tuning hanging when running in kube cluster Open

caikit/caikit-nlp#271 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026

caikit/caikit-nlp

Get new issues in your inbox