benchopt / benchopt/benchmark_resnet_classif

NOTE differences between Torch and TensorFlow

Open
#30 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
12
Forks
4
PR merge metrics
No merged PRs in 30d

Description

ResNet implem:
- stride > 2 (can be corrected) is done a bit different
- init of weights is different (for conv and dense)
- Empirically: SGD works much better for PyTorch (reaching 95.5%).
- Batch norm seems to be implemented differently for the 2 frameworks: it causes a difference in loss at training time. But we can't verify that when comparing the batch norm implem in isolation.

Contributor guide

No contributing guide indexed for this repository

Research direction

Review the ResNet implementations and the PyTorch/TensorFlow behavior described in this issue, focusing on stride handling, weight initialization, SGD results, and batch normalization. Determine where benchmark differences are documented; done means the relevant differences and any verification limits are recorded clearly.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch, tensorflow
Domain
machine-learning
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.