AOSSIE-Org / AOSSIE-Org/EduAid
Update deprecated pad_to_max_length argument in tokenization pipeline
- 主要語言
- JavaScript
- 星號
- 171
- 分支
- 423
- PR 合併指標
- 30 天內沒有已合併 PR
描述
## Description
While running EduAid locally, warnings appear from the HuggingFace Transformers library related to deprecated parameters used in the tokenization pipeline.
The following warning is shown during execution:
FutureWarning: The `pad_to_max_length` argument is deprecated and will be removed in future versions.
The current implementation uses:
pad_to_max_length=True
This parameter has been deprecated and should be replaced with the newer argument format recommended by the Transformers library.
## Expected Behavior
Tokenization should use the updated padding parameter recommended by the Transformers library.
## Current Behavior
The code currently uses deprecated arguments which trigger warnings during execution.
## Proposed Improvement
Replace the deprecated parameter:
pad_to_max_length=True
with the updated format:
padding='max_length'
This will align the codebase with the latest Transformers API.
## Benefits
• removes deprecation warnings
• ensures compatibility with future Transformers versions
• improves long-term maintainability of the codebase
貢獻指南
這個儲存庫沒有索引到貢獻指南
評估
這個 Issue 還沒有評估資料。