Data Engineer - Smart City
1000 - 1400 PLN/ dzień.B2B (netto)
MidFull-time·B2B
#331898·Dodano 2 miesiące temu·14
Źródło: IncublyTech Stack / Keywords
TestingAWSSnowflakeAirflowDevOpsCI/CDSQLPython
Firma i stanowisko
Incubly is a company supporting tech companies and startups (scaleups) in fast, high-quality scaling up of their teams and boosting product development, testing, and deployment. They are currently working with Arrive, a global mobility platform active in over 90 countries and 20,000 cities, providing solutions like smart payments, optimized parking, and EV charging to create more livable cities and better travel experiences.
Wymagania
- Master's or Engineering studies specialized in the data domain
- 3-5 years of experience in a similar domain
- Knowledge of SQL, DBT, and Python (must have)
- Knowledge of Airflow, Trino, S3, Iceberg, Hive Metastore, Kafka with Redpanda (good to have)
- Knowledge of Avro and Druid (nice to have)
- Understanding of Kubernetes concepts and ability to use it
- Knowledge of Snowflake and AWS (good to have)
Obowiązki
- Cooperate with the Data Scientist and Architects to understand the inputs and outputs of the models, as well as the transformations required to design the features
- Participate in moving and extending data pipelines on Snowflake as part of migration to AWS
- Participate in the design phase of the data processing flow to fulfil the use cases' requirements
- Develop data flow by creating DBT models and transformations
- Implement DBT tests based on the product-defined test strategy
- Implement and configure Airflow DAGs to meet data flow quality attributes
- Cooperate with the DevOps team to deliver platform constraints and improve CI/CD
Oferta
- Knowledge sharing within the company
- Agile and friendly atmosphere with non-violent communication and full respect for diversity
- Hybrid work model from the Łódź office
- Monthly remuneration: 1,000 - 1,400 PLN net/day on B2B contract
Incubly
23 aktywne oferty