Senior Data Platform Engineer

Who you are

• Python or Java Expert: 6+ years of experience with object-oriented programming
• Collaborative Enabler: A strong communicator who thrives on building bridges between the teams you enable (analysts, data scientists) and the teams you depend on (infrastructure, security)
• Distributed Systems Architect: Proven experience developing and maintaining:
• Distributed compute/data systems (e.g., Spark, Trino, Druid, ClickHouse)
• Real-time and batch pipelines (Kafka, Spark Streaming) with a focus on user-friendliness and reliability
• DevOps pipelines and data modeling tooling

What the job involves

• You’ll collaborate with data engineers and ML scientists and engineers to build and roll-out these tools. Along with DataOps Engineers, you’ll develop and operate multiple big data platforms, of which the biggest is 500+ nodes, with 25k+ CPU cores, 240+ TBs of RAM, and 23+ PBs of storage capacity, running tens of thousands of spark jobs a day
• We are currently expanding our platform capabilities. Depending on your expertise, your immediate focus will be driving one of these two key ecosystems:
• The OLAP Ecosystem: Scaling and optimizing our real-time analytical powerhouses (Druid, FastAPI, Java, Kafka)
• The Data Engineering Ecosystem: Designing and building data contracts, validation frameworks, optimization tooling, and robust Kafka ingestion pipelines
• You will balance building innovative new tools from scratch with relentlessly improving our existing infrastructure. This role is a perfect fit if you are passionate about:
• Scale: Developing and maintaining high-performance, distributed big data platforms
• Distributed Systems: Working deeply with various flavors of databases, filesystems, and compute engines
• Data Quality & Discoverability: Building tools that enhance metadata collection, data lineage, and platform-wide data quality
• CI/CD & Infrastructure: Optimizing continuous release/deployment environments within a large-scale private cloud system
• Streaming: Developing stream processing applications and frameworks to reduce time-to-insight for analysts and data scientists

Benefits

• Global exchange program
• Weekly happy hour
• Delicious healthy lunches
• Phantom share package
• Yearly trip to Amsterdam
• Paid holidays
• Work from home opportunities