flagos-ai / flagos-ai/FlagScale

Dead reference to non-existent module

Open
#1,077 0 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Python
Stars
537
Forks
174
Avg merge
4d 1h
Merged PRs (30d)
12

Description

In https://github.com/flagos-ai/FlagScale/blob/main/flagscale/train/megatron/training/tokenizer/gpt2_tokenization.py#L118,
we are referencing a non-existent module named `.file_utils`.
This has to be removed.

Contributor guide

No contributing guide indexed for this repository

Research direction

Open flagscale/train/megatron/training/tokenizer/gpt2_tokenization.py at line 118 and inspect the reference to the non-existent .file_utils module. Remove that dead reference, then verify that the tokenizer module imports successfully.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
1/5
Estimated time
Under an hour
Activity status
Stale
Clarity
Clearly specified
Newbie friendliness
55/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.