Databricks Consultant

About the job
Company Description
Yoda Tech Pte. Ltd., headquartered in Singapore, specializes in breaking down digitalization into focused micro-initiatives rather than large-scale transformations. By leveraging ready-to-use micro-bots, the company aims to reduce IT operations spending and deliver faster, more targeted value. Yoda Tech’s approach centers on Automate + Robotize to streamline processes and improve efficiency. The organization also emphasizes power application development, infrastructure, maintenance, and support to help clients modernize and optimize their technology landscape.
Role Description
The Databricks Consultant is a full-time remote role responsible for designing, implementing, and optimizing data solutions on the Databricks platform. This role oversees the development of scalable data pipelines, manages data integration from multiple sources, and ensures data reliability and performance. The Databricks Consultant collaborates closely with data engineers, data analysts, and business stakeholders to translate requirements into robust technical solutions, while promoting best practices in data engineering and cloud architecture. Day-to-day responsibilities include leading technical design reviews, mentoring team members, monitoring production workloads, troubleshooting issues, and continuously improving data processes and standards to support Yoda Tech’s automation and micro-initiative strategy.
Key Responsibilities
• Lead the design, development, and implementation of Databricks-based data solutions.
• Build scalable data pipelines using Databricks, Apache Spark, and Python.
• Work with business and technical teams to understand requirements and deliver solutions.
• Mentor and guide the development team on Databricks best practices.
• Optimize data processing performance and ensure high-quality deliverables.
• Collaborate with cloud and data engineering teams.
Required Skills
• 8+ years of experience in Data Engineering.
• 3+ years of hands-on experience with Databricks.
• Strong knowledge of Apache Spark, PySpark, SQL, and Python.
• Experience with Azure Databricks (preferred).
• Good understanding of Delta Lake, ETL, and data warehousing concepts.
• Experience with Azure Data Factory, Azure Data Lake, or similar cloud data services is a plus.
• Strong communication and leadership skills.
Good to Have
• Experience with Power BI or other visualization tools.
• Knowledge of CI/CD and DevOps practices.
• Databricks or Azure certifications.

Work arrangement
No