Data Engineer/Consultant (Senior/Staff)

21 000 - 31 080 PLN/ mies.B2B (netto)
SeniorFull-time·B2B
#330349·Dodano 12 dni temu·23
Źródło: nofluffjobs.com
Aplikuj teraz

Tech Stack / Keywords

PythonData warehouseBigQueryRedshiftSnowflakeDatabricksData modellingData pipelinesAWSGCPAzure CloudAWS S3Amazon EMRMWAAADFAWS GlueInfrastructure as CodeTerraform

Firma i stanowisko

VirtusLab is a technology company building a small (4-6 people), agile, cross-functional team to deliver a complete data platform for a fast-scaling client in the Insurance sector. The project involves architecting a modern Data Platform consolidating fragmented legacy systems, organizing data from numerous sources, and establishing a standardized, governed, and future-proof data foundation to enable faster decision-making and AI readiness.


Wymagania

  • Proactive approach and flexibility in action.
  • Very good command of English (written and spoken).
  • Hands-on experience with Python.
  • Proven experience with data warehouse solutions such as BigQuery, Redshift, Snowflake.
  • Experience with Databricks or data lakehouse platforms.
  • Strong background in data modelling, data catalogue concepts, data formats, and data pipelines/ETL design, implementation, and maintenance.
  • Ability to thrive in an Agile environment and collaborate transparently.
  • Experience with AWS, GCP, or Azure cloud services including GCS/S3/ABS, EMR/Dataproc, MWAA/Composer or Microsoft Fabric, ADF/AWS Glue.
  • Experience in ecosystems requiring improvements and drive to implement best practices.
  • Experience with Infrastructure as Code practices, particularly Terraform, is an advantage.

Obowiązki

  • Collaborate closely with client specialists and stakeholders to define requirements, develop data pipelines, and data quality metrics.
  • Participate in defining requirements and architecture for the new platform, implement the solution, and remain involved in its operations and maintenance post-launch.
  • Introduce data governance and management to enable accurate and comprehensive reporting.
  • Build data ingestion and processing pipelines focused on customer needs.
  • Establish a production-ready, fully operational Snowflake environment and drive operational excellence.
  • Translate complex business logic into accurate data models reflecting business reality.
  • Integrate diverse data sources to build reliable data products and comprehensive data dictionaries.
  • Manage the full Data Engineering and Data Science lifecycle to support production ML and AI experimentation.
  • Take ownership from concept to deployment.
  • Promote automation, CI/CD, and rigorous engineering standards.

Oferta

  • Building tech community.
  • Flexible hybrid work model.
  • Home office reimbursement.
  • Language lessons.
  • MyBenefit points.
  • Private healthcare.
  • Training package.
  • Virtusity / in-house training.
Elastyczne godziny
Kursy językowe
Opieka zdrowotna
Dofinansowanie szkoleń
VirtusLab

VirtusLab

21 aktywnych ofert

Zobacz wszystkie oferty
Aplikuj teraz