Data Engineer - Azure & Automotive

About the role

techcarrot FZ LLC is looking for a Data Engineer in Dubai to assess complex new data sources from SAP and non-SAP systems and turn them into business-ready data sets. The role builds and supports the integration of these sources into the Azure data platform, and works closely with other engineering teams to bring prototypes into core intelligence products.

Key responsibilities

• Analyse structured, semi-structured and unstructured data sources for quality, completeness and business value.
• Design, document, develop, implement and test rapid prototypes that show the value of the data and present them to diverse audiences.
• Take part in early-stage design and feature definition activities.
• Design, develop and implement robust, scalable data pipelines using the Azure data platform and the Azure Databricks ecosystem.
• Create reusable and scalable data pipelines.
• Collaborate with team members across multiple engineering teams to integrate proven prototypes into core intelligence products.

Required profile

• 7+ years of experience in the Azure domain, with a minimum of 5+ years of relevant experience.
• At least 3 implementations from concept to delivery of analytics capabilities on the Azure platform.
• Automotive domain experience is a must.
• Bachelor's degree in Computer Science or an allied field.

Required skills

• Azure Data Factory, Databricks, Event Hub, Azure Synapse and SQL.
• Python and PySpark.
• Azure DevOps (mandatory to deploy data objects).
• Relational and non-relational databases; big data pipelines and architectures.
• Added advantage: SAP IS-Auto, SAP BW/BO, Tableau, Power BI; Azure certifications.