Skip to main content

Node Data Snapshots

Before you start running a node, you must first sync with the network. This means your node needs to download all the headers and blocks that other nodes in the network already have. You can speed up this process by downloading the latest data snapshots from a public cloudfront endpoint.

Here are the available snapshots directories based on node type and network. Please note that the RPC snapshots are updated every 12 hours. Split-Storage Archival snapshots are updated every 72 hours due to the size of cold storage data.

Node Type and NetworkCloudFront Path
RPC testnethttps://dcf58hz8pnro2.cloudfront.net/backups/testnet/rpc/latest
RPC mainnethttps://dcf58hz8pnro2.cloudfront.net/backups/mainnet/rpc/latest
Archival testnethttps://dcf58hz8pnro2.cloudfront.net/backups/testnet/archive/latest_split_storage
Archival mainnethttps://dcf58hz8pnro2.cloudfront.net/backups/mainnet/archive/latest_split_storage

Prerequisite:

Recommended download client rclone. This tool is present in many Linux distributions. There is also a version for Windows. And its main merit is multithread. You can read about it on ** rclone version needs to be v1.66.0 or higher

First, install rclone:

$ sudo -v ; curl https://rclone.org/install.sh | sudo bash

Next, prepare config, so you don't need to specify all the parameters interactively:

mkdir -p ~/.config/rclone
touch ~/.config/rclone/rclone.conf

, and paste exactly the following config into rclone.conf:

[near_cf]
type = s3
provider = AWS
download_url = https://dcf58hz8pnro2.cloudfront.net/
acl = public-read
server_side_encryption = AES256
region = ca-central-1

Commands to run for RPC|Validator Data Download:

chain="mainnet"  # or "testnet"
kind="rpc"       
rclone copy --no-check-certificate near_cf://near-protocol-public/backups/${chain:?}/${kind:?}/latest ./
latest=$(cat latest)
rclone copy --no-check-certificate --progress --transfers=6 --checkers=6 \
  near_cf://near-protocol-public/backups/${chain:?}/${kind:?}/${latest:?} ~/.near/data

Commands to run for Archival Split Storage Data Download:

chain="mainnet"  # or "testnet"
kind="archive"       
rclone copy --no-check-certificate near_cf://near-protocol-public/backups/${chain:?}/${kind:?}/latest_split_storage ./
latest=$(cat latest_split_storage)
rclone copy --no-check-certificate --progress --transfers=6 --checkers=6 \
  near_cf://near-protocol-public/backups/${chain:?}/${kind:?}/${latest:?} ~/.near/data

Got a question?

Ask it on StackOverflow!