Senior Big Data Engineer (AWS + Databricks)

SoftServe is a global digital solutions company headquartered in Austin, Texas, founded in 1993. The Big Data & Analytics Center of Excellence is a data consulting and data engineering branch with hundreds of data engineers and architects building end-to-end data & analytics solutions. They serve customers in healthcare, finance, manufacturing, retail, and energy domains and hold top-level partnerships with major cloud providers and technology partners like AWS, GCP, Microsoft, Databricks, Snowflake, and Confluent.

• 4+ years of experience in the Big Data field
• Proficient in Python (PySpark) and SQL
• Experienced in developing data solutions on the AWS cloud platform
• Specializing in big data engineering with a focus on data pipeline creation
• Adept at batch and streaming processing
• Hands-on experience with Databricks on AWS, building and managing data pipelines
• Skilled in Apache Spark and Databricks, including large-scale data processing
• Familiar with Delta Lake and core Databricks components (Workflows, Jobs)
• Familiar with orchestration tools like Apache Airflow or Managed Apache Airflow (MWAA)
• Knowledgeable about Apache Kafka, Amazon MSK, or Kinesis for data streaming

• Address different business and technology challenges and engage in impactful projects as part of the Center of Excellence
• Support technical and personal growth with a dedicated career plan
• Investigate new technologies, build internal prototypes, and share knowledge within the SoftServe data community
• Upskill with full access to Udemy learning courses
• Pass professional certifications encouraged and covered by the company
• Adopt best practices from experts while working in a team of engineers and architects
• Collaborate with world-leading companies and attend professional events
• Be part of a team of data-focused engineers dedicated to continuous learning, improvement, and daily knowledge-sharing
• Work with a cutting-edge technology stack including services from major cloud providers
• Engage with customers from diverse backgrounds including large global corporations and emerging crypto startups
• Be involved in the entire project lifecycle from initial design and proof of concepts to MVP development and full-scale implementation