#301294•Dodano Invalid Date•0•źródło: nofluffjobs.com
Senior Data Engineer
25 200 - 29 400 PLN(znormalizowane)
Doświadczenie
Senior
Lokalizacja
Tryb pracy
Hybryda
Wymiar
Full-time
Data engineeringCloudOLAPPythonPL/SQLETLIBM DataStageAzure Data FactoryOracleMS SQL ServerSnowflakeDevOpsGitDockerKubernetesTerraformJenkinsBambooAzure DevOpsTest automationRobot FrameworkGitHubGitLabAirflowKafka
Wymagania
- Experience with designing OLAP systems and applying techniques such as STAR schema and denormalization
- Proficiency in Python and PL/SQL development
- Experience with ELT/ETL development using GUI-based tools such as IBM DataStage, Azure Data Factory (ADF), Stitch, and Matillion
- Knowledge of database management systems including Oracle, MS SQL Server, and Snowflake
- Understanding of DevOps and CI/CD practices, including Git, Docker, Kubernetes, Terraform, and CI/CD tools such as Jenkins, Bamboo, and Azure DevOps
- Experience with test automation tools such as Robot Framework and Selenium, including knowledge of different test scenarios
- Knowledge of version control systems including Git, GitHub, and GitLab
- Experience with workflow orchestration tools such as Airflow and Prefect
- Knowledge of streaming and batch processing concepts, including Kafka
- Very good command of English, both spoken and written
Obowiązki
- Design, build and maintain scalable ELT pipelines
- Develop and optimize PLSQL queries and database objects for high performance data storage in Oracle
- Write python-based data engineering scripts to process data
- Implement CI/CD pipelines for data infrastructure and workflow automation
- Understand and have experience of database change management
- Work with one or more of the major cloud vendors
- Integrate and manage modern data stack
- Monitor, debug and optimize data workflows and infrastructure performance
- Ensure data quality, governance, and compliance with good practices
Benefity
- Private medical care
- Co-financing for the sports card
- Constant support of dedicated consultant
- Employee referral program