InseeFrLab / InseeFrLab/torchTextClassifiers

Issue in reproducibility

未关闭
#95 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
主要语言
Python
星标
23
派生
7
PR 合并指标
30 天内没有已合并 PR

描述

I am unable to get the exact result after training a ttc model on my data (synthetic data), even after setting every possible seed:
```{python}
torch.manual_seed(42)
random.seed(42)
np.random.seed(42)

torch.use_deterministic_algorithms(True)
if torch.cuda.is_available():
torch.cuda.manual_seed_all(42)
torch.backends.cudnn.deterministic = True
torch.backends.cudnn.benchmark = False

pytorch_lightning.seed_everything(42)
```

For full reproducibility:

```{bash}
git clone -b main https://github.com/mateomorin/ttc-training.git
# uncomment last test of test_reproducibility
# potentialy change your data path if you do not have access to bucket projet-ape
uv run pytest # should have 2 passed, 1 failed and potential warnings
```

贡献指南

这个仓库没有索引到贡献指南

调研方向

Clone the main branch of mateomorin/ttc-training, uncomment the last test in test_reproducibility, and run uv run pytest with the provided seeding setup. Compare the reproducibility test results and warnings; done should mean the test no longer demonstrates differing results after training on the synthetic data.

由索引模型根据 Issue 内容生成。

评估

技术栈
python, pytorch
领域
machine-learning, testing-qa
Issue 类型
缺陷
难度
4/5
预计耗时
3-5 天
活跃度
冷清
描述清晰度
需要澄清
新手友好度
42/100

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。