gosom / gosom/google-maps-scraper

How do I get more reviews with the API?

Open
#227 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Go
Stars
5.9k
Forks
924
Avg merge
5d 13h
Merged PRs (30d)
3

Description

I'm trying to use the scraper with the Docker image and the API (/api/v1/jobs), and I'm stuck getting more than just the first few reviews (like 8 or so).

I know the CLI has that -extra-reviews flag to make it scroll and grab more stuff, but I can't figure out how to do that strictly using the REST API. I tried sending extra_reviews: true and extraReviews: true in my JSON, but it just ignores it and finishes super fast with only the initial reviews.

I also tried cranking up the depth setting (set it to 10), hopping that would trigger it, but I still just get the basic 8 reviews.

Is there a specific key I'm missing to make it scroll for reviews via the API? Or is that feature just not hooked up to the web endpoint yet?

Here's exactly what I'm sending if it helps:

```
curl -X POST "http://localhost:8080/api/v1/jobs" \
-H "Content-Type: application/json" \
-d '{
"name": "My Check",
"keywords": ["Gordon Ramsay Burger Las Vegas"],
"max_time": 600,
"depth": 10,
"extra_reviews": true
}'
```
Any pointers would be
huge. Thanks!

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.