Databricks Practice Lead

We are seeking an experienced Databricks Practice Lead to drive the technical vision, growth, and delivery excellence of our Databricks practice. This role combines deep hands-on expertise in modern data engineering with leadership responsibilities, including defining technical standards, mentoring engineering teams, supporting business development, and delivering scalable cloud-based data solutions for enterprise clients.

You will work closely with clients, engineering teams, solution architects, delivery leaders, and business stakeholders to design innovative data platforms, guide technical decision-making, and expand the organization's Databricks capabilities. The ideal candidate is both a strong technical leader and a trusted advisor who can bridge business objectives with modern data engineering solutions.

Responsibilities

-

Lead the technical direction and growth of the Databricks Practice, establishing standards, best practices, and reusable solution accelerators.

-

Design and review enterprise-scale data platform architectures using Databricks, Apache Spark, and Microsoft Azure.

-

Provide technical leadership and architectural guidance across multiple client engagements.

-

Partner with clients to understand business challenges and recommend scalable data and analytics solutions.

-

Lead technical discovery sessions, solution workshops, architecture reviews, and design discussions with clients.

-

Mentor and coach Data Engineers, Technical Leads, and Solution Architects, fostering technical excellence and career development.

-

Define best practices for data engineering, software engineering, DevOps, security, governance, and operational excellence.

-

Establish standards for ETL/ELT development, data quality, monitoring, performance optimization, and production support.

-

Drive adoption of modern data architectures, including Lakehouse, Delta Lake, and event-driven data processing.

-

Collaborate with Delivery Managers and Engineering Managers to support project planning, staffing, technical risk management, and solution quality.

-

Support pre-sales activities, including solution design, technical proposals, effort estimation, client presentations, and proof-of-concept initiatives.

-

Stay current with Databricks platform capabilities and emerging technologies, identifying opportunities to improve services and expand practice offerings.

-

Promote the adoption of AI-assisted software development and engineering best practices across the practice.

-

8+ years of professional experience in Data Engineering, Data Platform Engineering, or related disciplines.

-

3+ years of experience leading technical teams, architecture initiatives, or data engineering practices.

-

Deep expertise with Databricks, including workspace administration, notebooks, jobs, workflows, Unity Catalog, Delta Lake, and Lakehouse architecture.

-

Strong experience developing scalable data pipelines using Apache Spark (PySpark).

-

Extensive experience with Microsoft Azure, including services such as Azure Data Lake Storage (ADLS), Azure Data Factory, Azure Event Hubs, Azure Key Vault, and Azure DevOps.

-

Strong programming skills in Python, including clean coding practices and object-oriented programming principles.

-

Experience with orchestration tools such as Apache Airflow or Dagster.

-

Experience working with streaming technologies such as Apache Kafka or Azure Event Hubs.

-

Strong understanding of data architecture, dimensional data modeling, metadata management, and enterprise data platform design.

-

Experience implementing data governance, data quality, security, and compliance practices.

-

Experience building and optimizing enterprise ETL/ELT solutions.

-

Strong knowledge of SQL and relational database concepts.

-

Experience deploying cloud-native data solutions, preferably on Microsoft Azure.

-

Excellent consulting, presentation, and stakeholder management skills with experience interacting directly with enterprise clients.

-

Experience leading architecture discussions, technical governance, and solution reviews.

-

Ability to lead multiple initiatives simultaneously while providing technical direction across distributed teams.

-

Experience working in Agile development environments.

Perks you enjoy at KMS Mexico

• Mexican law benefits
• 15 days of PTO (in year zero, from the first year onwards it is 3 days per year).
• 5 days' leave for the death of immediate family members, negotiable.
• Major Medical Expenses Insurance with coverage for immediate dependents (spouse and children).
• Annual performance bonus (≈10% of annualized salary).
• Annual salary adjustment.
• Employee Referral Bonus.
• Paid Certifications / Courses
• Coursera License.
• 5% Savings Fund.
• 5% Grocery Vouchers.

At KMS Technology Mexico, we are passionate about building innovative software solutions that drive impact. As part of an international tech company, we offer a collaborative and inclusive environment where your ideas matter and your growth is our priority.

Originally posted on Himalayas