Data Engineer (Microsoft Fabric)
# Data Engineer (Microsoft Fabric) **LIFE Pharmacy** · Dubai · `On-site` 🕒 **Статус:** *Опубликовано: 7 дней назад* · *Источник: Indeed* --- ### About the Role The Data Engineer is responsible for designing, developing, and maintaining the enterprise data platform within Microsoft Fabric. Key Responsibilities Design, develop, and maintain scalable data pipelines that ingest data from Microsoft Dynamics 365 Finance & Operations, Commerce, cloud applications, APIs, relational databases, and legacy file-based systems into Microsoft Fabric. Build and maintain layered Lakehouse architectures (Bronze, Silver, Gold) using Delta Lake principles and enterprise data engineering best practices. Develop, optimize, and maintain PySpark and Spark SQL notebooks to transform, cleanse, enrich, and integrate high-volume datasets across finance, retail, supply chain, procurement, inventory, and commercial domains. Implement efficient incremental loading strategies using watermarking, change tracking, merge operations, and other source-appropriate techniques to minimize full data reloads. Configure and manage OneLake shortcuts, workspace organization, item-level security, and controlled data access across Fabric environments. Monitor and optimize Microsoft Fabric capacity utilization across notebooks, pipelines, warehouses, and related workloads to ensure efficient resource consumption. Troubleshoot pipeline failures, notebook errors, schema changes, partitioning issues, capacity constraints, and data quality problems, identifying and resolving root causes. Investigate discrepancies between business reports and source systems by tracing data lineage, validating business rules, and reconciling transformed datasets. Develop reusable engineering components, parameterized notebooks, metadata-driven processing patterns, and shared utilities to reduce duplicated development effort. Implement monitoring, logging, reconciliation, watermark tracking, and data quality controls to improve operational visibility and support production support activities. Participate in code reviews, Git-based source control, deployment processes, and technical documentation to ensure maintainable and supportable solutions. Document data lineage, transformation logic, data models, and engineering standards to facilitate long-term support and knowledge transfer. Collaborate with business application teams to understand source system behaviour, integration requirements, and future platform enhancements. Pay: AED10,000.00 - AED15,000.00 per month Work Location: In person
Наблюдалась 2026-09-15, впервые 2026-09-07, источник — Indeed.