abetlen / abetlen/llama-cpp-python

Question - Batch Processing

Open
#1,902 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
10.6k
Forks
1.4k
PR merge metrics
PR metrics pending

Description

I'm processing a batch of approximately 100 prompts, each ranging from 1,200 to 14,000 tokens in length. Given that the input context length must be specified during model initialisation, I'm considering two options:

1. Initialize the model with the maximum token length of 14,000 tokens.
OR
2. Instantiate the model each time with the required context length.

Are there other avenues I should be exploring?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.