Senior Data Engineer

Devire Outsourcing IT is a collaboration model dedicated to IT specialists based on self-employment (B2B), executing projects for leading clients running innovative and modern projects. The client is one of the largest banks in Poland.

• Minimum 5 years of experience as a Data Engineer.
• Very good knowledge of GCP databases: GCP Big Query, GCP Big Table, Scylla Cloud.
• Knowledge of ETL Flow tools on GCP: Apache AirFlow, GCP Data Flow.
• At least 4 years of experience as an ETL Developer in data integration processes on-prem.
• Expert knowledge of relational databases Oracle, PostgreSQL, ScyllaDB.
• Very good knowledge of the Automate Now scheduling tool by Infinity Data.
• Experience with Rest API.
• Fluent knowledge of Python and PySpark.
• Knowledge of Rust.
• Basic knowledge of Java.

• Designing, developing, and maintaining data integration processes in GCP and on-premise environments.
• Building and optimizing efficient ETL/ELT pipelines for large data volumes.
• Designing, developing, and tuning databases and optimizing data processing performance.
• Programming integration solutions and data processing tools in Python and PySpark.
• Co-creating high-performance components for data loading and processing using Rust.
• Working in a Linux environment and using tools supporting monitoring and CI/CD.