Data Engineering Mastermind
Critical TechWorksBragahá mais de um mês
- Presencial
- Tempo inteiro
- Intermédio
Descrição
Critical TechWorks is seeking experienced Data Engineers to join their innovative team transforming the BMW Group into a data-driven powerhouse. In this pivotal role, you will design and maintain robust data pipelines, craft optimized data models, implement rigorous data quality assurance protocols, and troubleshoot complex data processing systems. You'll work on large-scale projects utilizing frameworks like Apache Spark for efficient data handling and engage in cutting-edge real-time data streaming projects that process and analyze data at scale.
You bring at least 3 years of data engineering experience with strong proficiency in public cloud platforms (especially AWS), Infrastructure-as-Code tools like Terraform, and at least one programming language (Python, Java, JavaScript, or Scala). Your expertise spans SQL/noSQL databases, Big Data ecosystems (Hadoop, Cassandra, Apache Hive, Apache Spark), and data modeling. Familiarity with orchestration tools like Airflow is highly valued. You thrive in fast-paced, fully agile environments, embrace Scrum practices, operate with autonomy while collaborating cross-functionally, and maintain excellent English communication skills (German is a plus).
Critical TechWorks offers a dynamic culture of growth, innovation, and engineering excellence where you'll contribute to groundbreaking mobility technology. You'll have opportunities for continuous learning, occasional international travel to support product development, and work in an inclusive environment that values diverse perspectives. Candidates must have legal right to work in Portugal at the time of application.
Competências
- Data Pipeline Development
- Data Modeling
- Data Quality Assurance
- Apache Spark
- AWS
- Terraform
- Python
- Java
- JavaScript
- Scala
- SQL
- NoSQL
- Hadoop
- Cassandra
- Apache Hive
- Apache Airflow
- CI/CD
- Version Control
- DevOps
- Scrum
Responsabilidades
- Design and maintain robust data pipelines, ensuring seamless data flow from various sources to storage and analytical platforms
- Craft and optimize data models for efficient data retrieval and analysis, balancing performance and scalability
- Implement rigorous testing and validation protocols to guarantee the accuracy and integrity of data
- Proactively identify and solve data processing issues, enhancing the performance and reliability of data systems
- Engage in large-scale data projects, utilizing frameworks like Apache Spark for efficient data handling and processing
- Work on cutting-edge projects that process and analyze data in real-time, ensuring swift data delivery and insights
- Embrace agile practices and Scrum methodologies to foster high-performing team collaboration
- Apply standard engineering practices using version control, IDEs, and dashboards for organized development
- Adopt DevOps best practices, including CI/CD pipelines for building, testing, and deploying reliable software
- Operate software post-deployment, including outside working hours if needed
Benefícios
- Growth and Innovation opportunities in shaping the future of mobility
- Engineering Excellence environment valuing engineering process and tangible impact
- Autonomy and Collaboration culture blending independent work with teamwork
- Continuous Learning opportunities in a dynamic workplace
- Inclusive corporate culture valuing diverse viewpoints and experiences