#300724Dodano Invalid Date2źródło: nofluffjobs.com
Margo
Margo

Senior Data Engineer - Diamond ID

30 240 - 33 600 PLN(znormalizowane)
Doświadczenie

Senior

Lokalizacja

Tryb pracy

Zdalnie

Wymiar

Full-time

PythonSQLSQLAlchemydbtData analysisCloudCloud platformAWSJSONJsonbMLFlowSagemakerML

O ofercie

Client is developing a system of record for the diamond supply chain. A critical part of this is the diamond matching project.

Wymagania

  • Advanced SQL knowledge (window functions, CTEs, optimization queries).
  • Advanced knowledge of Data Build Tool (dbt) or similar.
  • Working knowledge of code versioning and peer code reviewing process.
  • Working knowledge of deduplication and normalization strategies.
  • Working knowledge of Cloud infrastructure.
  • Working knowledge of Python coding principles and data libraries.
  • Knowledge of ORMs such as SQLAlchemy.

Nice to have:

  • Knowledge of ML tooling, such as MLFlow and Sagemaker.
  • Experience with AWS.

Obowiązki

  • Building and maintaining a robust, end-to-end data and analytics platform.
  • Developing and optimizing data pipelines to move data from online environments to the data warehouse and reporting layers.
  • Writing high-quality, production-ready code in SQL and Python, utilizing libraries such as pandas and SQLAlchemy.
  • Troubleshooting and resolving issues related to cloud data configuration, synchronization, and data latency.
  • Managing and processing diverse data types, including both structured and unstructured data, such as JSONB.
  • Designing, deploying, and maintaining automated business intelligence dashboards and internal monitoring tools.

Benefity

  • Sport subscription
  • Training budget
  • Private healthcare
  • Flat structure
  • Small teams
  • International projects