DragonflyRobotics / DragonflyRobotics/MAGIST-Algorithm
Google Image Search API Caps at 100 Images Download
- Ngôn ngữ chính
- Python
- Star
- 5
- Fork
- 0
- Chỉ số merge pull request
- Không có pull request nào được merge trong 30 ngày
Mô tả
**Description**
The Google Image Search API was updated to have a limit of 100 images per query. This means that consecutively downloading, for example, 200 images will fail.
**To Reproduce**
To reproduce the behavior, run the following code:
```python
from MAGIST.Utils.WebScraper.google import GoogleScraper
g = GoogleScraper("config.json")
g.download_raw_img_dataset("cars", 200, "Data/")
```
**Expected behavior**
It should ideally download 200 images and verify their integrity before downloading.
**Screenshots**


**Additional context**
I have teamed up with [@arrrlo](https://github.com/arrrlo) who made the `GoogleImageSearch` module for Python with the [issue](https://github.com/arrrlo/Google-Images-Search/issues/149) also posted on [@arrrlo's](https://github.com/arrrlo) [repo](https://github.com/arrrlo/Google-Images-Search).
This requires the module `pyparsing==2.4.2` which is part of a circular dependency issue(#4 ).
Hướng dẫn đóng góp
Đánh giá
Issue này chưa được đánh giá.