Financial market analytics platform
An end-to-end ELT platform ingesting daily prices, company profiles and news sentiment for the three most actively traded stocks. Built twice: a Bronze–Silver–Gold medallion architecture of four PySpark notebooks in Microsoft Fabric, and the original open-source stack on GCP.
- Developed a financial market analytics platform to analyze the day’s three most actively traded stocks, identify potentialdrivers of sharp price and volume movements, and present market data through Power BI.
- Extracted and transformed raw API data into analysis-ready Delta tables using PySpark and a medallion architecture in Microsoft Fabric, applying data cleaning, validation, and aggregation.
- Designed a Power BI semantic model and DAX measures comparing closing prices and trading volumes with 100-day averages to highlight unusual activity and support analysis of market trends.
- Built and deployed a GCP version of the platform, running Airflow and dbt in Docker on a virtual machine for daily incremental PostgreSQL updates and hosting a Streamlit dashboard on Cloud Run.