Logo

Automated Crypto Data Pipeline

A full-stack data engineering project demonstrating an end-to-end automated ETL pipeline.

Market Analytics

Top 5 Assets Performance (%)

Relative performance rebased to 0% at the start of the period. Comparing BTC, ETH, USDT, BNB, XRP.

Market Capitalization

Top 5 assets by market cap (Billions USD).

Architecture & Data Flow

1

Extract & Transform (Python)

Fetches real-time data from API using Python requests library. Cleans, normalizes nested JSON, and adds timestamps using Pandas DataFrames.

2

Load (Neon Postgres)

Upserts processed data into Serverless PostgreSQL via SQLAlchemy engine.

3

Automate (GitHub Actions)

Orchestrates the pipeline to run daily via scheduled Cron jobs (Serverless CI/CD).

4

Visualize (Next.js and Recharts)

Displays live and historical data using a Next.js frontend and Recharts with dynamic Server Components.

Live Market Data (DB)

Live Connection
RankAssetPrice (USD)Market CapUpdated (Local)
#1
BitcoinBTC
$84,119.00$1,690B9/24/2026, 1:57:39 AM
#2
EthereumETH
$2,676.39$327B9/24/2026, 1:57:39 AM
#3
TetherUSDT
$0.9998$184B9/24/2026, 1:57:39 AM
#4
BNBBNB
$766.55$102B9/24/2026, 1:57:39 AM
#5
XRPXRP
$1.49$94B9/24/2026, 1:57:39 AM
#6
USDCUSDC
$0.9999$75B9/24/2026, 1:57:39 AM
#7
SolanaSOL
$114.75$67B9/24/2026, 1:57:39 AM
#8
TRONTRX
$0.3429$33B9/24/2026, 1:57:39 AM
#9
ZcashZEC
$1,493.50$25B9/24/2026, 1:57:39 AM
#10
Figure HelocFIGR_HELOC
$1.04$24B9/24/2026, 1:57:39 AM
#11
Lido Staked EtherSTETH
$2,240.59$21B2/4/2026, 1:02:01 AM
#12
HyperliquidHYPE
$92.39$21B9/24/2026, 1:57:39 AM
#13
DogecoinDOGE
$0.09275$14B9/24/2026, 1:57:39 AM
#14
MoneroXMR
$558.78$11B9/24/2026, 1:57:39 AM
#15
WhiteBIT CoinWBT
$84.50$10B9/24/2026, 1:57:39 AM
#16
Wrapped stETHWSTETH
$2,742.38$10B2/4/2026, 1:02:01 AM
#17
USDSUSDS
$0.9997$10B9/24/2026, 1:57:39 AM
#18
Wrapped BitcoinWBTC
$75,650.00$9B2/4/2026, 1:02:01 AM
#19
ChainlinkLINK
$12.25$9B9/24/2026, 1:57:39 AM
#20
Binance Bridged USDT (BNB Smart Chain)BSC-USD
$0.9982$9B2/4/2026, 1:02:01 AM
#21
CardanoADA
$0.2369$9B9/24/2026, 1:57:39 AM
#22
Wrapped eETHWEETH
$2,938.44$9B1/31/2026, 1:00:12 AM
#23
RainRAIN
$0.01221$9B9/24/2026, 1:57:39 AM
#24
LEO TokenLEO
$8.96$8B9/24/2026, 1:57:39 AM
#25
Wrapped Beacon ETHWBETH
$2,437.66$8B2/4/2026, 1:02:01 AM
#26
StellarXLM
$0.2$7B9/24/2026, 1:57:39 AM
#27
Bitcoin CashBCH
$333.94$7B5/28/2026, 1:51:44 AM
#28
RaveDAORAVE
$26.11$6B4/18/2026, 1:15:22 AM
#29
ToncoinTON
$2.31$6B5/13/2026, 1:56:54 AM
#30
MemeCoreM
$4.74$6B4/24/2026, 1:24:17 AM
#31
LABLAB
$19.07$6B6/27/2026, 2:00:34 AM
#32
Ethena USDeUSDE
$0.9994$6B4/19/2026, 1:24:28 AM
#33
CantonCC
$0.1426$6B7/1/2026, 2:11:21 AM