Overview:
Senior Data Engineer Shape the Future of Data with Us!
Location Dubai, UAE
Introduction: We are seeking a skilled and motivated Senior/Medior Data Engineer who combines deep expertise in modern cloud-based data engineering with a solid working knowledge of AI/ML systems. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure, ensuring the efficient processing and storage of large datasets. You will collaborate with cross-functional teams to deliver high-quality data solutions that drive business insights and support decision-making.
About the team: The D&A team is a young team of data specialists within the broader IT organization. Our team focuses on supporting the business in all its data and analytics needs. Established to enhance efficiency and effectiveness, the team plays a crucial role in ensuring correct, fact-based decision-making. The team operates from our offices in Schiedam and Dubai. With the rollout of a new IT landscape in full swing, we are working on setting up a modern data landscape that integrates and centralizes all data initiatives. Additionally, we are actively involved in developing new AI initiatives, and we hope you can make an active contribution to that.
The function: As a Data Engineer, you work side by side with the other Data Engineers and our skilled Cloud & Security colleagues. You are the driving force behind transforming and processing data, fully leveraging the possibilities of the Azure technologies and tools. Every project you undertake is a new challenge because it has its own specific needs and questions regarding data. You know how to distill valuable insights from raw data and transform them into a streamlined and optimized data pipeline. You ensure that the data transformation process runs smoothly and that the business benefits from reliable, secure, and high-quality data platforms. You are always looking for ways to improve efficiency, explore new possibilities, and implement innovative solutions. You are not only a technical mastermind but also a valued partner for our business. You understand their specific needs and work closely with them to design, implement, and maintain customized data solutions.
Responsibilities:
* Design, develop, and maintain robust data pipelines to support analytics initiatives, including real-time data from IoT devices.
* Collaborate with Data Analysts and business teams to build scalable data solutions.
* Manage and optimize data storage, data flow, and data integration strategies.
* Monitor and troubleshoot data pipelines to ensure data quality and consistency.
* Provide on-call support and monitoring for data pipelines.
* Design, monitor, and maintain machine learning pipelines and APIs
* Debug and support AI/ML models in production, including diagnosing data issues, environment mismatches, and inference failures.
* Mentor and provide data engineering best practices across the organization.
Qualifications:
* In the possession of a bachelor's or master's degree
* AI900, DP203 Microsoft certification or equivalent
* Proven experience in data engineering (3+ years), with a focus on designing and developing data pipelines.
* Strong knowledge of data modeling, data warehousing, and ETL processes.
* Proficiency in programming languages such as Python, SQL, and PySpark
* Advanced knowledge in cloud platforms like Azure Synapse, Databricks or Snowflake
* Advanced knowledge with data orchestration tools, including CI/CD (Git, Azure DevOps)
* Infrastructure-as-code: Terraform, CloudFormation
* Familiarity with ML and AI solutions and products
Share this job:
Share this Job
