Data Sources and Methodology
Learn about the data sources used by DexVolume and the methodology behind our volume analytics.
Data Sources Overview
DexVolume aggregates data from multiple sources to provide comprehensive and accurate trading volume information. Our platform combines on-chain data, exchange APIs, and proprietary data collection methods to ensure the most complete picture of market activity.
On-Chain Data
Direct blockchain data from multiple networks including Ethereum, Binance Smart Chain, Solana, Polygon, and other major blockchains.
Exchange APIs
Direct integration with decentralized exchange APIs to capture real-time trading data and order book information.
Supported Platforms
DexVolume currently tracks trading volume data from the following decentralized exchanges:
- Uniswap (v2 & v3): Ethereum-based AMM DEX with concentrated liquidity in v3.
- SushiSwap: Multi-chain DEX deployed across numerous networks.
- PancakeSwap: Leading DEX on Binance Smart Chain.
- Curve: Specialized DEX focused on stablecoin and like-asset swaps.
- dYdX: Decentralized perpetual exchange with leverage trading.
- Balancer: Multi-token pool AMM with customizable parameters.
- Raydium: Leading DEX on the Solana blockchain.
- QuickSwap: Major DEX on the Polygon network.
- Trader Joe: Popular DEX on the Avalanche network.
- Osmosis: Leading DEX in the Cosmos ecosystem.
Data Collection Methodology
On-Chain Data Collection
Our on-chain data collection process involves:
- Block Monitoring: Continuous monitoring of new blocks across all supported blockchains.
- Transaction Filtering: Identifying and extracting relevant DEX transactions from the blockchain.
- Smart Contract Analysis: Decoding transaction data using smart contract ABIs to extract trade details.
- Historical Indexing: Maintaining a comprehensive index of historical trading data for trend analysis.
API Integration
Our API integration approach includes:
- Real-Time Data Feeds: Direct connections to exchange APIs for up-to-the-second data.
- Rate Limiting Management: Sophisticated handling of API rate limits to ensure continuous data flow.
- Fallback Mechanisms: Multiple data retrieval paths to maintain service during API outages.
- Data Normalization: Standardizing data formats across different exchanges for consistent analysis.
Data Validation
To ensure accuracy, all collected data undergoes a rigorous validation process:
- Cross-Source Verification: Comparing data from multiple sources to identify discrepancies.
- Anomaly Detection: Automated systems to flag unusual data patterns for manual review.
- Historical Consistency Checks: Ensuring new data aligns with established patterns.
- Manual Auditing: Regular human review of data samples to verify accuracy.
Data Processing and Aggregation
Volume Calculation
DexVolume calculates trading volume using the following methodology:
- Base Currency Normalization: Converting all trading pairs to a common base currency (USD) for consistent comparison.
- Price Oracle Integration: Using reliable price oracles to ensure accurate conversion rates.
- Time-Weighted Aggregation: Aggregating volume data across specified time periods with appropriate weighting.
- Wash Trading Detection: Algorithms to identify and exclude potential wash trading activity.
Data Aggregation Levels
Volume data is aggregated at multiple levels:
- Token Level: Volume data for individual cryptocurrencies across all platforms.
- Pair Level: Volume data for specific trading pairs.
- Platform Level: Volume data aggregated by exchange.
- Network Level: Volume data aggregated by blockchain network.
- Global Level: Total volume across all tracked platforms and networks.
Update Frequency
Different data types are updated at different frequencies:
- Real-Time Data: Updated continuously as new transactions occur (typically within seconds).
- Short-Term Aggregates: 1H, 4H, and 24H data updated every few minutes.
- Medium-Term Aggregates: 7D data updated hourly.
- Long-Term Aggregates: 30D and longer timeframes updated daily.
Data Reliability and Limitations
Known Limitations
While we strive for complete accuracy, users should be aware of certain limitations:
- API Outages: Occasional exchange API outages may result in temporary data gaps.
- Blockchain Congestion: During periods of extreme network congestion, on-chain data may be delayed.
- New Platforms: Recently launched exchanges may have limited historical data available.
- Private Transactions: Some DEX protocols with privacy features may have limited visibility.
Reliability Measures
To maximize data reliability, DexVolume implements:
- Redundant Data Sources: Multiple data collection paths for each exchange.
- Automated Recovery: Systems to automatically recover and backfill data after outages.
- Confidence Scoring: Internal metrics to indicate the reliability of specific data points.
- Transparency Indicators: Visual cues in the UI to indicate data quality and completeness.
Data Retention and History
DexVolume maintains historical data with the following retention policies:
- Granular Data: Minute-by-minute data retained for 90 days.
- Hourly Data: Hourly aggregates retained for 1 year.
- Daily Data: Daily aggregates retained indefinitely.
- Historical Snapshots: Complete market snapshots taken at regular intervals for long-term analysis.