Databricks Data Engineer

We are looking for an experienced Data Engineer responsible for planning, developing, and maintaining cloud environments for our clients.

• Minimum 3 years of experience in a Data Engineer role or similar position
• Strong knowledge of Azure data services (Azure Data Factory, Azure Synapse Analytics, Azure Data Lake)
• Extensive experience with Databricks and Apache Spark
• Proficiency in SQL and experience with relational databases
• Experience in creating and optimizing data pipelines (ETL/ELT) in cloud environments
• Strong programming skills in Python, Scala, or Java
• Experience with Delta Lake architecture and optimization techniques
• Knowledge of data modeling and schema design

Nice to have:

• Experience with Azure DevOps and CI/CD pipelines for data solutions
• Knowledge of Databricks Delta Live Tables and Databricks workflows
• Experience with real-time data processing using Azure Event Hubs or Kafka
• Familiarity with Azure Purview or other data governance tools
• Databricks or Azure certifications

• Design, implement, and maintain scalable and efficient data pipelines in Azure and Databricks
• Develop and optimize ETL processes using Azure Data Factory and Databricks
• Build Big Data solutions aligned with business requirements
• Collaborate with Data Science, BI, and development teams to ensure high-quality data
• Monitor performance of data processing systems and implement improvements
• Implement data security standards and practices
• Research and evaluate new technologies in the data engineering space