iiitl / iiitl/Neural-Networks

Compare ReLU, Sigmoid, and Tanh activation functions

Open
#6 7 comments 0 reactions 0 assignees View on GitHub
medium track: library
Dominant language
Jupyter Notebook
Stars
1
Forks
11
PR merge metrics
No merged PRs in 30d

Description

Modify your PyTorch or sklearn baseline to test three different hidden layer activation functions (ReLU, Sigmoid, Tanh). Plot their training loss curves on the same graph and write a short summary of which converges the fastest and why.

Contributor guide

Open the contributing guide

Research direction

Start by locating the existing PyTorch or scikit-learn baseline in the repository and run it to understand its training-loss output. Compare hidden-layer ReLU, Sigmoid, and Tanh runs on one graph, then write the requested convergence summary; the work is done when all three curves and the explanation are included.

Written by the indexing model from the issue text.

Assessment

Tech stack
pytorch, scikit-learn
Domain
machine-learning
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
65/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.