iiitl / iiitl/Neural-Networks

Implement backpropagation and gradient descent step

Open
#3 6 comments 0 reactions 0 assignees View on GitHub
exceptionally hard track: scratch
Dominant language
Jupyter Notebook
Stars
1
Forks
11
PR merge metrics
No merged PRs in 30d

Description

Extend the scratch forward pass to compute gradients for a single hidden-layer network using binary cross-entropy loss. Implement the backward pass (chain rule) and update weights using a basic learning rate. Show the loss decreasing over 10 iterations on a small data batch.

Contributor guide

Open the contributing guide

Research direction

Locate the notebook containing the scratch forward pass and read how the single hidden-layer network and binary cross-entropy loss are represented. Trace the forward-pass values first, then use the issue's chain-rule and weight-update requirements as the scope. Run the notebook on the small batch and verify that the reported loss decreases across 10 iterations.

Written by the indexing model from the issue text.

Assessment

Tech stack
jupyter-notebook
Domain
machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.