
Senior Data Engineer
Talkdeskhá mais de um mês
- Tempo inteiro
- Sénior
Descrição
We are looking for a Senior Data Engineer to join our growing Data team at Talkdesk. You will be responsible for expanding and optimizing our data pipeline architecture, managing data flow and collection for cross-functional teams, and maintaining governance over our lakehouse. Working alongside software engineers, you'll design and deploy big data solutions that ingest, process, and store data to power Talkdesk's business, while ensuring scalability, reliability, and high performance.
In this role, you'll develop batch or streaming dataflows capable of processing large quantities of fast-moving unstructured data, monitor dataflows and underlying systems, and promote necessary changes to maintain world-class, data-driven solutions. You'll partner closely with the rest of Talkdesk's engineering team to solve complex data-related problems and deliver innovative solutions that support our Customer Experience Automation platform.
Competências
- Distributed computing
- Distributed systems
- Data lake architecture
- Lakehouse architecture
- Java
- Kotlin
- Scala
- Python
- Kafka
- RabbitMQ
- ActiveMQ
- Apache Flink
- Apache Spark
- Kafka Streams
- Trino
- Dremio
- Impala
- Hive
- Iceberg
- Delta Lake
- Hudi
- Relational databases
- Data modeling
- AWS
- Azure
- Google Cloud
- MongoDB
- Cassandra
- Elasticsearch
- Redis
- Docker
- Kubernetes
- Lambda Architecture
- Kappa Architecture
Responsabilidades
- Develop, deploy, and maintain Big Data solutions that ingest, process, and store data to power Talkdesk's business
- Design batch or streaming dataflows capable of processing large quantities of fast-moving unstructured data
- Monitor dataflows and underlying systems, promoting necessary changes to ensure scalable, reliable, and high-performance solutions
- Work closely with the rest of Talkdesk's engineering to deliver world-class data-driven solutions
Empregos semelhantes
