Technical Lead - Data Engineering (Databricks)

Full-time

Guadalajara

Engineering

June 27, 2024

KMS Mexico is a leading software development company dedicated to delivering innovative and high-quality software solutions to our clients. We are committed to excellence in every aspect of our work, and our team of talented professionals plays a key role in achieving this commitment.

Responsibilities

We are looking for a talented Technical Lead - Data Engineering with expertise in Databricks to lead our data team. In this role, you will oversee the design, development, and implementation of scalable data pipelines and analytics solutions using Databricks. You will collaborate closely with data scientists, analysts, and other stakeholders to deliver high-quality data solutions and drive data-driven decision-making processes.

 

You will collaborate closely with data scientists, analysts, and other stakeholders across the United States, Vietnam, and Mexico to deliver high-quality data solutions and drive data-driven decision-making processes.

Key Responsibilities:

  • Lead the design and architecture of data solutions using Databricks, ensuring scalability, reliability, and performance.

  • Mentor and guide a team of data engineers, providing technical leadership and fostering a culture of innovation and excellence.

  • Design and implement robust ETL processes and data pipelines on the Databricks platform.

  • Collaborate with cross-functional teams to define data requirements and translate them into technical solutions.

  • Optimize Databricks jobs and clusters for efficiency and cost-effectiveness, monitoring performance and troubleshooting issues as needed.

  • Ensure data quality and integrity across various data sources and platforms.

  • Stay updated with industry trends and advancements in Databricks and related technologies, recommending and implementing best practices.

  • Lead technical discussions and present solutions to stakeholders, including senior management.

  • Warehouse Management: Experience with warehouse operations and management systems, integrating warehouse data into broader analytics frameworks.

  • Work closely with warehouse teams to optimize data flows and ensure seamless integration with Databricks-based analytics solutions.

  • Provide guidance on warehouse data integration strategies, ensuring alignment with overall data architecture goals.

Qualifications

  • Experience: Minimum of 8 years in data engineering roles, with significant hands-on experience in Databricks and warehouse management systems.

  • Bachelor’s degree in Computer Science, Engineering, or a related field. Advanced degrees or certifications in data engineering or warehouse management are a plus.

  • Proficiency in designing and implementing scalable data pipelines and ETL processes using Databricks.

  • Strong leadership and mentoring skills, with a proven track record of leading successful data engineering teams.

  • Familiarity with warehouse management systems and their integration with analytical platforms.

  • Proven experience in data warehouse projects, with successful track record 

  • Excellent problem-solving abilities and the capacity to manage multiple projects simultaneously.

Benefits and Perks

URL Copied

Apply For This Job

Upload CV
0%

By clicking submit, you agree to KMS’ privacy policy and terms of use, and in particular, you expressly agree to the transfer of your personal information for the purposes described in that policy.

THANK YOU!

Your CV has been sent to HR team!