Senior Data Engineer

• Strong expertise in Azure Databricks, Python, and Spark.
• Solid experience with Azure Data Services, such as ADLS Gen2, Azure Data Factory, and Azure Synapse.
• Experience with API (REST or equivalent).
• Solid understanding of ETL processes, data modeling, and fundamental data architecture principles.
• Familiarity with CI/CD pipelines and version control (Git).
• Strong problem-solving skills and structured way of working within an agile delivery model.
• Excellent communication and collaboration skills.

Nice to have:

• Experience with big data processing and structured streaming in Databricks.
• Familiarity with Declarative Automation Bundles (formerly Databricks Asset Bundles).
• Knowledge of data governance, lineage, and security best practices; experience working with Unity Catalog.
• Exposure to Power BI or similar visualization tools.

• Design, develop, and optimize data pipelines and workflows using Azure Databricks and Python.
• Implement and maintain data solutions across the Azure Data Platform (Data Lake, Data Factory, Synapse, etc.).
• Develop and maintain Data Products exposed by Unity Catalog.
• Collaborate closely with business stakeholders to gather requirements and translate them into technical solutions.
• Ensure data quality, security, and compliance across all solutions.
• Integrate data solutions into existing business processes and cross-functional systems.
• Continuously improve performance, cost-efficiency, and scalability of data systems.