JupiterBroadcasting / JupiterBroadcasting/show-scraper

Missing Episodes direct download links

Open
#16 4 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Python
Stars
5
Forks
5
PR merge metrics
No merged PRs in 30d

Description

First identified with [Self-Hosted Episode 0](https://selfhosted.show/0) which is listed on Fireside, but not on JB.com

https://www.jupiterbroadcasting.com/show/self-hosted/page/7/

![image](https://user-images.githubusercontent.com/10230166/181178640-f75a9615-a87e-4882-acb0-def70c533cf7.png)

JB.net is just putting in no reference to the downloadable media, so failing silently because of [this](https://github.com/elreydetoda/show-scraper/blob/9adc48d71962b5642f4d2c641d9409454e018383/scraper.py#L148).

![image](https://user-images.githubusercontent.com/10230166/181178867-43040096-71a4-4858-864e-7ddae0e70bb5.png)

This was the error thrown after changing how the data-structure works.

![image](https://user-images.githubusercontent.com/10230166/181247567-dc157448-82d0-4751-a16e-f24d591ea57a.png)

Now with [this](https://github.com/elreydetoda/show-scraper/blob/34a8317f64dc632e75f659b60589cf8971189941/scraper.py#L164-L172) change we'll log when this happens (eventually notify) and it'll be an `AttributeError` on a `None` object.

Comprehensive list of shows identified with this issue are as follows:

- [ ] Self-hosted 0 (validated)
- [ ] LAN 00 (validated)
![image](https://user-images.githubusercontent.com/10230166/181250625-1fd53900-4a74-4197-9501-ab21984340f4.png)
- [ ] JE 1 (validated)
- [ ] JE 2 (validated)
- [ ] JE 3 (validated)
- [ ] JE 4 (validated)
- [ ] JE 5 (validated)
- [ ] JE 6 (validated)
- [ ] JE 7 (validated)
- [ ] JE 8 (validated)
- [ ] JE 9 (validated)
- [ ] JE 10 (validated)
- [ ] JE 11 (validated)
- [ ] JE 12 (validated)
- [ ] JE 13 (validated)
- [ ] JE 14 (validated)
- [ ] JE 15 (validated)
- [ ] JE 16 (validated)
- [ ] JE 17 (validated)
- [ ] JE 18 (validated)
- [ ] JE 19 (validated)
- [ ] JE 20 (validated)
- [ ] JE 21 (validated)
- [ ] JE 22 (validated)
- [ ] JE 23 (validated)
- [ ] JE 24 (validated)
- [ ] JE 25 (validated)
- [ ] JE 26 (validated)
- [ ] JE 27 (validated)
- [ ] JE 28 (validated)
- [ ] JE 29 (validated)
![image](https://user-images.githubusercontent.com/10230166/181389655-08e5565e-a0b7-40f8-b5c8-0f8f2b1fe077.png)
- [ ] Office Hours 1 (validated)
![image](https://user-images.githubusercontent.com/10230166/181253944-c5c7ff49-1be6-4fa1-acfc-b86f20003725.png)

---

So...for some reason these shows are in JB's main website but aren't being in the JB_DATA when building the episodes... :thinking:

![image](https://user-images.githubusercontent.com/10230166/181418873-9e0429e5-70a9-4bd8-8e81-d8afc2318369.png)

- [ ] LAN 36
- [ ] LAN 37
- [ ] LAN 38
- [ ] LAN 39
- [ ] LAN 40
- [ ] LAN 41

Same error as before, but posting so it's documented

![image](https://user-images.githubusercontent.com/10230166/181419024-6d7e2560-8492-4b35-8b4a-fe151bc8b322.png)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.