How to choose a

data provider for

your web3 project?

Feb23
@footprint_data
 01 Requirements

Contents 02 Common indexer pipeline

03 What are the options?

04 Footprint Analytics
01 Requirements
Things to consider when working with historical data
 Things to consider

1. Data requirements: solution should meet on your specific needs and goals.
2. Data quality: data should be accurate and reliable.
3. Data coverage: data must cover your specific needs for specific cases.
4. Data integration: supplied data should be in a format that is compatible with your systems and
tools.
5. Pricing: pricing should be reasonable and in line with industry standards.
6. Support: good customer support should be done.
7. Legal compliance: compliance with data privacy and regulation laws.
02 Common indexer pipeline
From raw data to abstractions
Indexing pipeline
 JSON RPC
RPC node
● JSON-RPC is a stateless,
light-weight remote procedure
call (RPC) protocol. It defines
several data structures and the
rules around their processing
● RPC node use RPC protocol to
implement.
 Rpc Nodes type

light* normal*
● Usually there is only a pointer, ● Have a x block limit for the
the information you need ta history, If over the limit, it will
request support from the full drop the detail message, And
node response ”There is no such
● Light, even in mobile phone. Block”.

full* arichive*
● Include all history block data in ● group with full , which in clude
this node, no limit. all data and all traces.
● Large, 10 or 20 times of normal ● Very large, 5 times of full.

* Each chain, each node quotient has a different definition, but the general meaning is close
 Key api Methods

eth_getBlockByNumber eth_getTransactionReceipt
● Get block’s basic data. ● Get transaction execution data.
○ Include block & ○ Include transactions
transactions basic data running status(success,
fail), the contract which
created by this
transaction, and logs
debug_traceBlockByNumber
● get block’s execute traces message
○ Include the input and output for each contract function, each gas fee ,
native token transfer information.
○ Because it involves backward recalculations, requests take a long time
and easy to lose some information when the node is busy.

* More method, click here https://geth.ethereum.org/docs/interacting-with-geth/rpc

Data Mapping for Etherscan

mapping table via etherscan

● Blocks
● Transactions
● Token transfers
● Logs/Events
Why raw data is not enough?

EVM
● Transactions
● Logs
● Traces

Polkadot
● Extrinsics
● Intrinsics
● Events

Bitcoin
● UTXO
EVM Data Provided by Footprint

Difficulties of data analysis

● Difficult access to off chain data
● Events cannot be queried quickly

Footprint data structure

● Relational Databases
● Provides on chain raw data
● Provides silver level data generated
by combining off chain and on chain
data
 Shortly about abstractions (not to be
used on a community session)
1. Contract is recognised as ERC721 or ERC1155 (no unique solution)
2. https://docs.getdbt.com/docs/build/materializations are being executed
a. https://dune.com/spellbook#!/source/source.spellbook.erc721_ethereum.evt_transfer
b. https://dune.com/spellbook#!/model/model.spellbook.nft_ethereum_transfers
c. https://dune.com/spellbook#!/model/model.spellbook.nft_transfers
03 What are the options?
 What are the options?

Advantages Disadvantages

Third-party API ● Easy to use ● Dependable

● Good for advanced search ● Limited customisation
● Scalable ● Pricy
● Realiable

SDK ● Good for advanced seach ● Hard to set-up and maintain

● Highly customisable ● Pricy
SDK repo example
04 Footprint Analytics
Indexing pipeline
REST API
Restful API
(MAYC collection contract address:0x60E4d786628Fea6478F785A6d7e704777c86a7c6)

Build your NFT dapps with Footprint,

including:
● NFT explorer
● NFT wallets
● NFT trackers
● NFT marketplaces
● NFT games

Try for free

SQL API
SQL API - Customized for specific needs
A flexible SQL API customization for robust requirements
Zero Coding Required to Get Blockchain Insights
Create a New Chart for OpenSea Trading Volume

Complex of SQL code Drag and drop in 1 minute

VS
Most Comprehensive Coverage of Chains and Domains
Footprint Analytics provides a comprehensive, timely and accurate overview of the full blockchain ecosystem

24 700,000+ 17
Chains NFT Collections NFT Marketplaces

1,987 519 108,005

GameFi Protocols DeFi Protocols Tokens

Chains

Marketplace

Cryptopunks Walken
 Q A &

# Send 5 monthly free trail accounts for the members who ask questions
# Please sign up Footprint Analytics via the link
https://www.footprint.network/?channel=cyberAcademy and send your account to Admin
in Footprint Discord.
Welcome to join our
community

Twitter: https://twitter.com/Footprint_Data

Discord: https://discord.com/invite/3HYaR6USM7

API Data API: https://www.footprint.network/data-api

Github: https://github.com/footprint-network Scan QR Code to Join

Footprint Discord
Email: [email protected]