huggingface / huggingface/deep-rl-class

[QUESTION] Missing Σ (sigma) symbol in Unit 4 "Gradient Ascent and the Policy-gradient Theorem"

Open
#527 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
MDX
Stars
5k
Forks
811
PR merge metrics
No merged PRs in 30d

Description

I am referring to [this section](https://huggingface.co/learn/deep-rl-course/unit4/policy-gradient#gradient-ascent-and-the-policy-gradient-theorem) and specifically to this image:

![image](https://huggingface.co/datasets/huggingface-deep-rl-course/course-images/resolve/main/en/unit6/policy_gradient_theorem.png)

Shouldn't there be a Σ (sigma) symbol right before the gradient operator? For reference, here is how the Policy-gradient Theorem is derived in OpenAI's ["Spinning Up" course](https://spinningup.openai.com/en/latest/spinningup/rl_intro3.html#deriving-the-simplest-policy-gradient).
![image](https://github.com/huggingface/deep-rl-class/assets/55794994/19eda673-2d8f-408f-838e-82b68284b583)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.