Back to Home
Data EngineeringCompleted

Multi-Source Crypto Analytics Pipeline

Real-time crypto pipeline comparing CoinGecko and Kraken using Snowflake and Prefect orchestration.

Screenshot 1

Tech Stack

PythonSnowflakePrefectREST API
Problem
Crypto data varies significantly across exchanges, making price comparison unreliable.
Solution
Built multi-source ingestion pipeline normalizing CoinGecko and Kraken into unified Snowflake schema.
Architecture
  • CoinGecko API ingestion
  • Kraken API ingestion
  • Python normalization layer
  • Prefect orchestration
  • Snowflake warehouse
Results
  • Enabled cross-exchange price comparison
  • Normalized multi-source financial data
  • Real-time 5-minute refresh pipeline
Back to ProjectsContact