DragonflyRobotics / DragonflyRobotics/MAGIST-Algorithm
Google Image Search API Caps at 100 Images Download
- Dominant language
- Python
- Stars
- 5
- Forks
- 0
- PR merge metrics
- No merged PRs in 30d
Description
**Description**
The Google Image Search API was updated to have a limit of 100 images per query. This means that consecutively downloading, for example, 200 images will fail.
**To Reproduce**
To reproduce the behavior, run the following code:
```python
from MAGIST.Utils.WebScraper.google import GoogleScraper
g = GoogleScraper("config.json")
g.download_raw_img_dataset("cars", 200, "Data/")
```
**Expected behavior**
It should ideally download 200 images and verify their integrity before downloading.
**Screenshots**


**Additional context**
I have teamed up with [@arrrlo](https://github.com/arrrlo) who made the `GoogleImageSearch` module for Python with the [issue](https://github.com/arrrlo/Google-Images-Search/issues/149) also posted on [@arrrlo's](https://github.com/arrrlo) [repo](https://github.com/arrrlo/Google-Images-Search).
This requires the module `pyparsing==2.4.2` which is part of a circular dependency issue(#4 ).
Contributor guide
Assessment
This issue has not been assessed yet.