Data Engineer

The Senior Data Engineer will contribute to the Company's success by partnering with business, analytics and infrastructure teams to design and build data pipelines to facilitate measuring subscriber movements and metrics. Collaborating across disciplines, they will identify internal/external data sources, design table structure, define ETL strategy, and automate data quality checks.
Responsibilities:
Focus on major areas of work, typically 20% or more of role % of Time.
Partner with technical and non-technical colleagues to understand data and reporting requirements.
Work with engineering teams to collect required data from internal and external systems.
Design table structures and define ETL pipelines to build performant Data solutions that are reliable and scalable in a fast-growing data ecosystem.
Develop Data Quality checks.
Develop and maintain ETL routines using ETL and orchestration tools such as Airflow.
Implement database deployments using tools like Schema Change.
Perform ad hoc analysis as necessary.
Perform SQL and ETL tuning as necessary.
Requirements:
Minimum and Preferred. Inclusive of Licenses/Certs (include functional experience as well as behavioural attributes and/or leadership capabilities)
5+ years of relevant data engineering experience.
Strong understanding of data modelling principles, including Dimensional modeling data normalisation principles.
Good understanding of SQL Engines and able to conduct advanced performance tuning.
Ability to think strategically, analyse, and interpret market and consumer information.
Strong communication skills - written and verbal presentations.
Excellent conceptual and analytical reasoning competencies.
Comfortable working in a fast-paced and highly collaborative environment.
Familiarity with Agile Scrum principles and ceremonies
Preferred Qualifications:
2+ years of work experience implementing and reporting on business key performance indicators in data warehousing environments, required.
2+ years of experience using analytic SQL, working with traditional relational databases and/or distributed systems (Snowflake or Redshift), required.
1+ years of experience with programming languages (e. g., Python, Pyspark), preferred.
1+ years of experience with data orchestration/ETL tools (Airflow, NiFi), preferred.
Experience with Snowflake, Databricks/EMR/Spark, and/or Airflow.
Bachelor's Degree in computer science, information systems, or a related field or equivalent work experience.

Skills
Python, Databricks, ETL, Data Engineering, Data Analysis, Data Warehousing, Airflow, Spark, SQL, Snowflake, Amazon Redshift

Experience
5-9 yrs