Senior Data Engineer

Auctane Poland Sp. z o.o. is a company focused on data products, working with large-scale data processing and modern data architecture patterns. The team operates in a flat and open engineering culture with autonomous, cross-functional teams, emphasizing data-driven decisions and continuous improvement of their data platform and engineering stack.

• At least 5 years of proven experience in data engineering roles.
• Strong background in data warehouse or data lake architecture.
• Experience working with AWS or GCP cloud infrastructure.
• Proficient in developing and supporting automated and reliable data pipelines using Python and SQL.
• Experience with data processing frameworks such as Spark, Athena, or Pandas.
• Knowledge of data orchestration solutions, preferably Airflow.
• Knowledge of relational database design and experience with Snowflake, Redshift, or similar.

Nice to have:

• Production experience with very large datasets.
• Experience with AWS big data technologies like EMR, Athena, Glue, and EC2.
• Experience with Infrastructure as Code tools such as Terraform or CloudFormation.
• Knowledge and experience with business intelligence and analytics tools (Tableau, Looker, Power BI).
• Interest in new technologies like Apache Iceberg, Dagster, DBT, GreatExpectations, Prefect, Snowflake.
• Understanding of core machine learning concepts and large language model concepts.

• Contribute to the design, build, and operational management of data pipelines and analytics solutions using AWS data technologies such as S3, Athena, Lambda, and Kinesis.
• Collaborate with the Product Owner and other stakeholders to implement the Data Products strategy.
• Develop frameworks and solutions to acquire, process, monitor, and extract value from large datasets.
• Drive the design and architecture of Auctane's data product.
• Contribute directly to the implementation and operations of data systems.
• Advocate for data quality and observability principles using technologies like Airflow, dbt, and Spark.
• Foster engineering excellence by delivering reliable software and data pipelines using best practices including automation, version control, CI/CD, testing, and security.