Handling last token in tokenized_continuation

Hi,

In:

https://github.com/huggingface/lighteval/blob/a98210fd3a2d1e8bface1c32b72ebd5017173a4c/src/lighteval/models/base_model.py#L842

if single_token:
inputs = [request.tokenized_context for request in batch]
else:
inputs = [
request.tokenized_context + request.tokenized_continuation[:-1] for request in batch
] # The last token (an eos) doesn't need to be given to the model

However, I cannot find where we strictly set "tokenized_continuation" to be ended with .

If this is true, then the eval results are not correct, especially for short tokenized_continuation