Initio ETL & Data Engineering Lead – GDE | Co>Operating System | EME | Parallel Processing | ETL Graph Optimization | SQL | Unix Shell Scripting

Specialist - Data Engineering
5+ year
Job description:
Architect and implement core ETL graphs choose partitioning keys sortmerge strategies and memory settings to meet SLAs
Handson technical lead for a Ab Initio delivery team design graphs enforce standards mentor devs own performance and production readiness for assigned modules
Do deep code reviews of GDE graphs naming parameterization component reuse error handling and logging
Lead performance investigations identify skew repartition points costly sorts and recommend rewritepartitioning improvements
Prepare test datasets and scripts for unitregressionperformance testing
Work with Ops to ensure CoOperating scheduling appropriate restart strategies and runbook snippets for each graph
Working Basic knowledge in Bigdata Hadoop Eco system
Experience and expertise on SQL and Unix shell scripting Knowledge on Abinitio air commands and m commands
Musthave technical skills
Expert with GDE graph authoring and debugging comfortable editing cfg parameter files and using graph debuggerslogs
Strong knowledge of Ab Initio operators Join Reformat Dedup RollupAggregate Rank Sort Partition Merge Lookup and when to use each optimally in a parallel environment
Mastery of partitioning strategies and the impact on network IO memory and mergesort costs
Familiarity with EME for metadata component checkins and versioning
Ability to write auxiliary shell scripts and SQL for test data and postprocessing
Own delivery of large ETL landscapes built on Ab Initio GDE graphs CoOperating deployment EME metadata
Define and enforce an Ab Initiospecific delivery model component library governance naming conventions asset versioning in EME release pipelines for graphs and sandboxes
Set organizationlevel standards for metadatadriven development shared enterprise components and reuse of transform libraries and parameter sets
Lead major production incident response for Ab Initio stacks triage root cause postmortem defecttochange feedthrough
Skills:
Mandatory Skills : AbInitio

Work arrangement
Hybrid