aws-samples / aws-samples/aws-blockchain-node-runners

Took hours to download mainnet-beta snapshot

Open
#139 4 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
TypeScript
Stars
103
Forks
63
Avg merge
2d 23h
Merged PRs (30d)
15

Description

### Community Note

* Please vote on this issue by adding a 👍 [reaction](https://blog.github.com/2016-03-10-add-reactions-to-pull-requests-issues-and-comments/) to the original issue to help the community and maintainers prioritize this request
* Please do not leave "+1" or other comments that do not add relevant new information or questions, they generate extra noise for issue followers and do not help prioritize the request
* If you are interested in working on this issue or have submitted a pull request, please leave a comment

#### What is the outcome that you are trying to reach?

Reducing time to download snapshot
Downloading snapshot from known validator can take hours to finish since the speed is low.

#### Describe the solution you would like

1. Adding downloading snapshot in user-data script. Following is a sample script
```
cd /var/solana/data/ledger
wget --trust-server-names http://entrypoint3.mainnet-beta.solana.com/snapshot.tar.bz2
wget --trust-server-names http://entrypoint3.mainnet-beta.solana.com/incremental-snapshot.tar.bz2
sed -i "s/--log -/--no-snapshot-fetch --log -/g" /home/solana/bin/validator.sh
cd -
```

2. leverage https://github.com/c29r3/solana-snapshot-finder
3. TBD

#### Describe alternatives you have considered

#### Additional context

Contributor guide

Open the contributing guide

Research direction

Start by locating the user-data script and the validator.sh path mentioned in the issue, then review how the mainnet-beta node is initialized. Compare the current startup flow with the supplied wget commands and the snapshot-finder alternative. Done means the documented or implemented startup path reduces snapshot download time without breaking validator startup.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, shell
Domain
blockchain, cloud, infrastructure
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.