DragonflyRobotics / DragonflyRobotics/MAGIST-Algorithm
Google Image Search API Caps at 100 Images Download
- Lingua principale
- Python
- Stelle
- 5
- Fork
- 0
- Metriche di merge delle PR
- Nessuna PR unita negli ultimi 30g
Descrizione
**Description**
The Google Image Search API was updated to have a limit of 100 images per query. This means that consecutively downloading, for example, 200 images will fail.
**To Reproduce**
To reproduce the behavior, run the following code:
```python
from MAGIST.Utils.WebScraper.google import GoogleScraper
g = GoogleScraper("config.json")
g.download_raw_img_dataset("cars", 200, "Data/")
```
**Expected behavior**
It should ideally download 200 images and verify their integrity before downloading.
**Screenshots**


**Additional context**
I have teamed up with [@arrrlo](https://github.com/arrrlo) who made the `GoogleImageSearch` module for Python with the [issue](https://github.com/arrrlo/Google-Images-Search/issues/149) also posted on [@arrrlo's](https://github.com/arrrlo) [repo](https://github.com/arrrlo/Google-Images-Search).
This requires the module `pyparsing==2.4.2` which is part of a circular dependency issue(#4 ).
Guida per i contributori
Apri la guida per i contributori
Valutazione
Questa issue non è ancora stata valutata.