Software Engineer (Python ETL)

Strictly Malaysia Citizen due to employment statutory regulation.
Role Overview
We are seeking skilled Software Developers who are adept at using AI tools for rapid prototyping and development.
The successful candidates will be instrumental in developing and maintaining ETL connectors using our proprietary Python-based framework, built on Snowflake Apps. This role requires a robust understanding of API interactions, data engineering principles, Snowflake development, and a commitment to test-driven development.
Responsibilities
Design, develop, and maintain ETL pipelines and connectors to SaaS applications using an in-house Python-based framework.
Build and maintain data pipeline logic using Python, with exposure to cloud data warehouse platforms.
Use AI coding tools like GitHub Copilot and other LLM-based agents to prototype pipelines faster, while assessing quality and making adjustments as needed.
Work with APIs to handle data exchange, implementing authentication methods and secure communications.
Manipulate and manage data using Python dataframes and third-party Python packages.
Conduct testing and quality assurance to keep pipelines reliable and scalable.
Quickly adapt to and understand enterprise B2B data systems to build effective solutions.
Qualifications
Qualifications in Computer Science, Engineering, or a related field.
3 to 7 years proven experience in data engineering or software development, with very solid, hands-on Python skills.
Strong familiarity with data engineering concepts, ETL/ELT processes, and pipeline design.
Experience with API interactions and protocols.
Experience with cloud data warehouse platforms (Snowflake, BigQuery, Redshift, or similar) is a plus.
Knowledge of test-driven development practices.
Good command of English, written and spoken, to work closely with an AU/NZ based team.
Strong soft skills alongside strong hard skills. Excellent problem-solving ability and capacity to work independently.

Work arrangement
No