Data Engineer (Databricks + Fabric)

Responsibilities:

-

Build and run production data platforms for our clients. This is hands-on work, not an architect who only reviews.

-

Design and build ETL/ELT pipelines in Databricks and Fabric.

-

Set up lakehouses with Medallion architecture (Bronze, Silver, Gold) on Delta Lake.

-

Govern data with Unity Catalog: permissions, lineage and quality.

-

Automate deployments with CI/CD and infrastructure as code.

-

Gather requirements with the client and with other teams.

-

Spot improvements in the client's platforms that could turn into new projects.

Requirements:

-

Hands-on Databricks in production. PySpark, Delta Lake, Workflows and Unity Catalog (catalogs, permissions and lineage), with Medallion architecture.

-

Microsoft Fabric in production, across the full platform. Lakehouse, OneLake, Data Pipelines, Notebooks, Dataflows Gen2 and Warehouse. A proof of concept does not count.

-

Advanced SQL and Python.

-

A current DP-900 or DP-700 certification, with a commitment to earn the other one within the first 60 days. Verify it with the Microsoft Learn link.

-

English B2 or higher and fluent Spanish.

Originally posted on Himalayas