JustAnotherArchivist / JustAnotherArchivist/snscrape

BlueSky AT Protocol Support

Open
#1,051 0 comments 2 reactions 0 assignees View on GitHub
enhancement modules
Dominant language
Python
Stars
5.4k
Forks
783
PR merge metrics
No merged PRs in 30d

Description

### Describe the feature

With Bluesky taking off recently it would be really useful to be able to scrape posts and profiles there in the same way that the legacy twitter module used to work.

The API documentation suggests that calls can be made against a public endpoint without authentication https://docs.bsky.app/docs/advanced-guides/api-directory and the calls look to be well documented.

### Would this fix a problem you're experiencing? If so, specify.

_No response_

### Did you consider other alternatives?

_No response_

### Additional context

_No response_

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading the linked Bluesky AT Protocol API documentation and inspect the existing legacy Twitter scraper for its post and profile behavior. Identify the scraper entry points and tests that govern service support. Done means Bluesky posts and profiles can be scraped through the public API with equivalent coverage and passing tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
backend
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.