The main goal of the project was to create a scalable real-time analytics platform for a US-based education technology company. This platform leveraged Azure Databricks and Delta Lake to provide enhanced educational insights, optimize resource allocation, and improve student performance tracking. Data was collected from various educational systems into Azure Storage using Azure Data Factory. ELT pipelines were implemented in Azure Databricks to clean, transform, and aggregate data in a modern data warehouse, with Delta Lake used for scalable data storage. Additionally, data processing logs were collected and monitored using Azure Log Analytics, and Power BI dashboards were developed to analyze this log data for tracking pipeline performance, error rates, and processing times. Integration with third-party services provided comprehensive data analysis, and Azure DevOps was used to automate pipeline deployment and monitoring.