Crypto Pipeline
A CoinGecko-to-Tableau pipeline moving crypto market data through Bronze, Silver and Gold layers into Snowflake.
Voir le codeProblème
Free-tier market data APIs are rate-limited and inconsistent, making a reliable, repeatable analytics pipeline hard to guarantee.
Approche
Designed a clean Bronze → Silver → Gold flow with clients, seeds and transformation layers cleanly separated, using hardcoded reference-data seeds for categories and platforms to avoid burning rate limits on data that barely changes.
Défi
Airflow version upgrades deprecated scheduling parameters mid-project, and a primary-key restart bug in the fact table needed a clean migration path rather than a quick patch.
Résultat
A fully orchestrated, dated pipeline landing in Snowflake and visualized in Tableau — architecture reused as the template for the later real-estate and football projects.