Senior Data Engineer

Devire Outsourcing IT is a form of cooperation dedicated to IT specialists based on self-employment (B2B), executing projects for leading clients conducting innovative and modern projects. Currently, for their client - one of the largest banks in Poland, they are looking for a Senior Data Engineer.

• Minimum 5 years of experience as a Data Engineer.
• Very good knowledge of GCP databases: GCP Big Query, GCP Big Table, Scylla Cloud.
• Knowledge of ETL Flow tools on GCP: Apache AirFlow, GCP Data Flow.
• At least 4 years of experience as an ETL Developer in data integration processes on-premise.
• Expert knowledge of relational databases Oracle, PostgreSQL, ScyllaDB.
• Very good knowledge of the scheduling tool Automate Now by Infinity Data.
• Experience with REST API.
• Fluent knowledge of Python and PySpark.
• Knowledge of Rust programming language.
• Basic knowledge of Java.

• Designing, developing, and maintaining data integration processes in GCP and on-premise environments.
• Building and optimizing efficient ETL/ELT pipelines for large data volumes.
• Designing, developing, and tuning databases and optimizing data processing performance.
• Programming integration solutions and tools supporting data processing in Python and PySpark.
• Co-creating high-performance components for data loading and processing using Rust.
• Working in a Linux environment and using tools supporting monitoring and CI/CD.