Senior Data Platform Engineer
Sword HealthPortugalhá mais de um mês
- Presencial
- Tempo inteiro
- Sénior
Descrição
At Sword Health, we're building the data foundation that powers our mission to create a pain-free world. As a Senior Data Platform Engineer, you'll design and operate our streaming lakehouse — the infrastructure every data consumer in the company depends on. You'll build distributed streaming pipelines moving data at low latency and high reliability, own durable workflows coordinating complex data movement, and shape the API surface that enables self-service data access without infrastructure context.
This role is ideal for an engineer who thinks about data platforms as products. You'll have deep experience building or operating data systems at scale, reasoning fluently from storage formats to query engines, and want to shape self-service and agentic experiences on top. You'll partner cross-functionally with data engineers, analysts, and ML teams while working in a regulated healthcare environment where audit, compliance, and governance are embedded in every design decision.
You'll leverage AI coding assistants and LLMs to accelerate development, drive vendor platform evaluations, and build AI-ready infrastructure that powers ML and AI-driven products. This is a role for someone with strong platform instincts, service orientation, and a reliability-first mindset.
Competências
- Data Lakehouse Architecture
- Apache Iceberg
- Delta Lake
- Apache Hudi
- Data Catalog Management
- Apache Flink
- Apache Spark
- Kafka
- Durable Execution
- Temporal
- Restate
- REST APIs
- gRPC
- Snowflake
- Starburst
- Databricks
- Event-driven Architecture
- Healthcare Compliance
- HIPAA
- dbt
- DataHub
- Prometheus
- Grafana
- OpenTelemetry
- AI and Machine Learning Infrastructure
- Data Governance
Responsabilidades
- Design and evolve Sword's streaming lakehouse — the foundation that every data consumer depends on
- Build and operate distributed streaming pipelines that move data at low latency and high reliability
- Own the durable workflows that coordinate complex data movement across systems
- Shape the platform's API surface so producers and consumers can serve themselves without infrastructure context
- Drive evaluations and integrations with vendor data platforms at the architectural level
- Contribute to the self-service and agentic layer with interfaces for humans, systems, and AI agents
- Partner with data engineers and analysts on contracts, governance, and lineage
- Build and maintain AI-ready data infrastructure that powers ML and AI-driven products
- Leverage AI coding assistants and LLMs to accelerate development and raise code quality
- Work in a regulated environment where audit, compliance, and governance are part of every design
Conhece alguém para esta vaga?
Empregos semelhantes
