huggingface / huggingface/lighteval

[FT] The word "pretrained" is required in model_args but not in model_config_path

Open
#405 1 comment 1 reaction 1 assignee Claimed by @clefourrier View on GitHub
feature
Dominant language
Python
Stars
2.5k
Forks
555
Avg merge
1d 6h
Merged PRs (30d)
1

Description

## Issue encountered
We need to pass "pretrained:MODEL_ID" in --model_args, but this is not necessary in --model_config_path? Can we remove it?

## Solution/Feature
It should be handled identically in both cases: without the word "pretrained"?

As discussed with @clefourrier.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.