Senior Data Engineer (Azure, Power BI, OCR)
TMC Middle East · Abou Dabi
وصف الوظيفة
About the role
A Senior Data Engineer delivers end-to-end data solutions across client and internal projects, from ingestion and transformation to dashboards and applications used by business users. The role is centred on the Microsoft Azure stack (Azure Data Factory, ADLS, Azure Databricks and Azure AI Document Intelligence), switching to pure Python and PySpark when needed, and includes OCR document extraction, Power BI dashboards and low-code Power Platform solutions. The engineer partners with data scientists, engineers and stakeholders and mentors junior team members.
Key responsibilities
- Build and maintain scalable ETL/ELT pipelines in Azure Data Factory with error handling, logging and alerting, using metadata-driven patterns and the Medallion Architecture (Bronze/Silver/Gold) on ADLS Gen2 and Delta Lake.
- Ingest data from relational databases, REST APIs, flat files, SharePoint and SaaS apps, supporting near-real-time ingestion with Event Hubs or Kafka where needed.
- Develop transformations in Azure Databricks with PySpark and Spark SQL, and standalone Python/PySpark solutions (Pandas, SQLAlchemy).
- Build document processing pipelines with Azure AI Document Intelligence to extract text, tables and fields from invoices, forms and contracts, validating results and combining OCR with Azure OpenAI / LLMs for classification and field extraction.
- Design Power BI dashboards and reports, build star-schema models, write DAX and use Power Query, and manage workspaces, row-level security, refresh schedules and deployment pipelines.
- Build Power Apps and Power Automate flows connected to Dataverse, SharePoint and custom connectors.
- Use AI coding assistants (Claude Code, GitHub Copilot) in VS Code, reviewing generated code for correctness, security and performance.
- Design dimensional and lakehouse data models, implement validation and quality checks, and apply access control and lineage with Unity Catalog or Microsoft Purview.
- Use Git and CI/CD (Azure DevOps or GitHub Actions) to deploy artifacts, and containerise Python workloads with Docker where required.
- Mentor juniors, lead code reviews, set coding standards and manage several projects in parallel.
Required profile
- Bachelor's or Master's degree in Computer Science, Information Systems, Data Engineering or a related field.
- 8+ years of professional data engineering experience with multiple end-to-end projects on Azure.
- Expert Python and PySpark, advanced SQL and query tuning.
- Hands-on OCR/document extraction, preferably with Azure AI Document Intelligence.
- Proven Power BI development and working experience with Power Apps and Power Automate.
- Practical experience with AI coding assistants in VS Code and with Git and CI/CD.
- Preferred: Microsoft or Databricks certifications, experience with Fabric, Synapse, Event Hubs, Kafka, Azure OpenAI / LLMs, or JavaScript/TypeScript.
Questions fréquentes
لماذا تبلغ عن هذا العرض؟
اكتشف المزيد
الرواتب والأدلة وعمليات البحث في الإمارات العربية المتحدة.
الرواتب حسب المهنة
قدم طلبك في 30 ثانية
أدخل بريدك الإلكتروني للتقديم. سيتم إنشاء حساب تلقائياً.
بالمتابعة، أنت توافق على شروط الاستخدام.
لديك حساب بالفعل؟ تسجيل الدخول
لديك سؤال حول هذا العرض؟
اطرحه هنا: ستصلك تفاصيل العرض كاملة عبر البريد الإلكتروني، فوراً.
عزز فرصك
حمّل سيرتك الذاتية وسنقترح عليك الوظائف التي تناسب ملفك.
جاري تحليل سيرتك الذاتية...
TMC Middle East
Abou Dabi
عروض عمل ذات صلة
-
Network & Security Engineer (Data Center)
NTT DATA, Inc. Abou Dabi -
Digital Identity Consultant | Electronic Verification Specialist
E Ticaret Uzmanı Abou Dabi -
Data Engineer - Azure & Power BI
TMC Middle East Abou Dabi -
Backend Software Engineer – DMarts Network Management
Delivery Hero Dubai -
Principal - Data Science & Applied AI
cigna UAE Dubai - Nas Neuron