Senior Data Engineer (Databricks)

Senior Databricks Data Engineer
Contractor · Remote in Mexico or Brazil · Full-time · 6 - 12 months project
We are looking for a Senior Databricks Data Engineer with 5–10 years of experience building and optimizing modern data platforms. You will work on large-scale data transformation initiatives, developing scalable pipelines, enabling self-service analytics, and supporting AI-driven insights using the Databricks Lakehouse ecosystem.
Responsibilities
Design, develop, and maintain scalable data pipelines using Databricks and Spark.
Build and optimize ETL/ELT workflows for large volumes of structured and unstructured data.
Leverage Databricks Genie to enable natural-language querying and self-service insights.
Develop and manage Lakehouse architectures using Delta Lake and Databricks best practices.
Implement data governance, lineage, security, and access controls using Unity Catalog.
Perform Spark workload and distributed data processing optimization.
Work across the SDLC, from requirements and design through development, testing, deployment, and support.
Collaborate with architects, analysts, business stakeholders, and cross-functional teams.
Mentor junior engineers and contribute to engineering best practices.
Drive data quality, monitoring, and operational excellence.
Communicate effectively with Portuguese-speaking stakeholders.
Requirements
5–10 years of experience in Data Engineering, Big Data, or Analytics Engineering.
Strong hands-on experience with Databricks.
Expertise in:
Databricks Genie
Databricks Workflows
Databricks SQL
Delta Lake
Unity Catalog
Lakehouse Architecture
Strong SQL programming skills.
Experience designing enterprise-scale data pipelines and transformation frameworks.
Strong understanding of relational, dimensional, and modern data modeling.
Experience with large-scale distributed data processing.
Knowledge of data governance, data quality, metadata management, and security.
Experience with Git and CI/CD.
English proficiency for global collaboration.
Bachelor’s/Master’s degree in Computer Science, IT, Engineering, or a related field, or equivalent professional experience.
Nice to Have
Databricks Data Engineer certification.
Experience with Data Intelligence and AI-powered analytics in Databricks.
Familiarity with ML workflows and MLOps.
Experience integrating Databricks with enterprise data sources and BI platforms.
Knowledge of Spark Structured Streaming or Kafka.
Experience working in global delivery environments.
CPG/FMCG industry experience.
Portuguese proficiency (read, write, and speak).
Key Skills
Databricks · Databricks Genie · Delta Lake · Unity Catalog · Databricks SQL · Databricks Workflows · SQL · Data Modeling · ETL/ELT · Data Governance · Lakehouse · Git · CI/CD · Stakeholder Management · Mentoring
Why join us?
Competitive compensation paid in USD.
100% Remote.
Paid Time Off: 12 PTO days per year.
Local Holidays: All official holidays in your country.
Birthday Off.
Career Growth opportunities.
Recognition Program.
Paid approved leaves

Work arrangement
No