Role Overview:
We are seeking a highly skilled Senior Data Engineer to design, build, and maintain scalable data infrastructure for a fast-growing financial services organization. The ideal candidate will have strong experience in cloud-based data platforms, modern data architecture, and building reliable data pipelines that support analytics and business intelligence.
You will play a key role in developing robust data systems that enable real-time reporting, regulatory compliance, and advanced analytics across multiple business units.
Key Responsibilities:
- Design, develop, and maintain ETL/ELT pipelines for ingesting data from APIs, databases, and third-party systems.
- Build and optimize data pipelines using Azure Data Factory (ADF), Databricks, or similar tools.
- Develop and manage data warehouse/lakehouse architectures (e.g., Microsoft Fabric, Azure Synapse, BigQuery, Redshift)
- Implement medallion architecture (Bronze, Silver, Gold layers) for structured data processing.
- Integrate data from multiple sources including SQL Server, PostgreSQL, APIs, and flat files.
- Ensure data quality, governance, and compliance with regulatory standards
- Optimize performance of data pipelines and queries for speed and cost efficiency
- Support real-time and batch data processing workflows
- Collaborate with BI teams to enable Power BI dashboards and reporting
- Implement monitoring, logging, and alerting for data pipelines
- Work closely with stakeholders to translate business needs into data solutions