Data Ingestion Engineer

About the role

We are looking for a Data Ingestion Engineer (m/f) to build and operate the ingestion layer of a modern data platform. You will integrate source systems, design streaming and batch pipelines, and ensure data arrives reliably, accurately, and on time.

Key responsibilities

• Design, build, and maintain integrations for structured, semi‑structured, and event‑based data.
• Develop and operate Kafka‑based streaming pipelines for near‑real‑time ingestion.
• Build batch ingestion workflows using Logstash, object storage, Parquet, Python and orchestration tools.
• Implement MySQL replica synchronization and other source‑aligned extraction patterns.
• Define and maintain source‑to‑raw data contracts, including schema, freshness and SLA expectations.
• Monitor ingestion SLAs, throughput, latency, failures and overall pipeline health.

Required profile

• Hands‑on experience building and operating both streaming and batch data ingestion pipelines.
• Strong knowledge of Kafka (producer/consumer patterns, partitioning, offsets, monitoring).
• Experience with Logstash, object storage, Parquet, JSON and CSV formats.
• Proficiency in Python and SQL.
• Experience with Airflow or similar orchestration tools.
• Understanding of relational sources (MySQL) and analytical stores (ClickHouse).

Required skills

• Kafka
• Logstash
• Python
• SQL
• Airflow
• MySQL
• ClickHouse
• GCP (Cloud Composer, cloud storage)
• Git and CI/CD practices

What we offer

• Flexible working (hybrid/remote).
• Learning and development opportunities.
• Strong engineering ownership and impact.
• Modern cloud‑native tech stack and high‑impact projects.