DragonflyRobotics / DragonflyRobotics/MAGIST-Algorithm

Google Image Search API Caps at 100 Images Download

Aperta
#7 1 commento 0 reazioni 1 assegnatario Rivendicata da @DragonflyRobotics Vedi su GitHub
bug
Lingua principale
Python
Stelle
5
Fork
0
Metriche di merge delle PR
Nessuna PR unita negli ultimi 30g

Descrizione

**Description**
The Google Image Search API was updated to have a limit of 100 images per query. This means that consecutively downloading, for example, 200 images will fail.

**To Reproduce**
To reproduce the behavior, run the following code:
```python
from MAGIST.Utils.WebScraper.google import GoogleScraper

g = GoogleScraper("config.json")
g.download_raw_img_dataset("cars", 200, "Data/")
```

**Expected behavior**
It should ideally download 200 images and verify their integrity before downloading.

**Screenshots**
![image](https://user-images.githubusercontent.com/85193239/174666564-bfb6e210-d09f-4540-a27e-caaa3415cc73.png)
![image](https://user-images.githubusercontent.com/85193239/174666602-8d2e890b-077d-47a4-8062-4075412a7c35.png)

**Additional context**
I have teamed up with [@arrrlo](https://github.com/arrrlo) who made the `GoogleImageSearch` module for Python with the [issue](https://github.com/arrrlo/Google-Images-Search/issues/149) also posted on [@arrrlo's](https://github.com/arrrlo) [repo](https://github.com/arrrlo/Google-Images-Search).

This requires the module `pyparsing==2.4.2` which is part of a circular dependency issue(#4 ).

Guida per i contributori

Apri la guida per i contributori

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.