Senior Data Engineer (Azure, Power BI, OCR)
TMC Middle East · Abou Dabi
Job description
About the role
A Senior Data Engineer delivers end-to-end data solutions across client and internal projects, from ingestion and transformation to dashboards and applications used by business users. The role is centred on the Microsoft Azure stack (Azure Data Factory, ADLS, Azure Databricks and Azure AI Document Intelligence), switching to pure Python and PySpark when needed, and includes OCR document extraction, Power BI dashboards and low-code Power Platform solutions. The engineer partners with data scientists, engineers and stakeholders and mentors junior team members.
Key responsibilities
- Build and maintain scalable ETL/ELT pipelines in Azure Data Factory with error handling, logging and alerting, using metadata-driven patterns and the Medallion Architecture (Bronze/Silver/Gold) on ADLS Gen2 and Delta Lake.
- Ingest data from relational databases, REST APIs, flat files, SharePoint and SaaS apps, supporting near-real-time ingestion with Event Hubs or Kafka where needed.
- Develop transformations in Azure Databricks with PySpark and Spark SQL, and standalone Python/PySpark solutions (Pandas, SQLAlchemy).
- Build document processing pipelines with Azure AI Document Intelligence to extract text, tables and fields from invoices, forms and contracts, validating results and combining OCR with Azure OpenAI / LLMs for classification and field extraction.
- Design Power BI dashboards and reports, build star-schema models, write DAX and use Power Query, and manage workspaces, row-level security, refresh schedules and deployment pipelines.
- Build Power Apps and Power Automate flows connected to Dataverse, SharePoint and custom connectors.
- Use AI coding assistants (Claude Code, GitHub Copilot) in VS Code, reviewing generated code for correctness, security and performance.
- Design dimensional and lakehouse data models, implement validation and quality checks, and apply access control and lineage with Unity Catalog or Microsoft Purview.
- Use Git and CI/CD (Azure DevOps or GitHub Actions) to deploy artifacts, and containerise Python workloads with Docker where required.
- Mentor juniors, lead code reviews, set coding standards and manage several projects in parallel.
Required profile
- Bachelor's or Master's degree in Computer Science, Information Systems, Data Engineering or a related field.
- 8+ years of professional data engineering experience with multiple end-to-end projects on Azure.
- Expert Python and PySpark, advanced SQL and query tuning.
- Hands-on OCR/document extraction, preferably with Azure AI Document Intelligence.
- Proven Power BI development and working experience with Power Apps and Power Automate.
- Practical experience with AI coding assistants in VS Code and with Git and CI/CD.
- Preferred: Microsoft or Databricks certifications, experience with Fabric, Synapse, Event Hubs, Kafka, Azure OpenAI / LLMs, or JavaScript/TypeScript.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in the United Arab Emirates.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 41 minutes ago
Expires 1 month from now
5 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
TMC Middle East
Abou Dabi
Related job offers
-
Network & Security Engineer (Data Center)
NTT DATA, Inc. Abou Dabi -
Digital Identity Consultant | Electronic Verification Specialist
E Ticaret Uzmanı Abou Dabi -
Data Engineer - Azure & Power BI
TMC Middle East Abou Dabi -
Backend Software Engineer – DMarts Network Management
Delivery Hero Dubai -
Principal - Data Science & Applied AI
cigna UAE Dubai - Nas Neuron