Live opening · Posted 1 day ago
At a glance
The key details from the original listing.
Your early-applicant advantage
Live timing from JobBeeper.
About the role
Description supplied by the original job listing.
We are looking for highly skilled Senior PySpark Developers with strong expertise in Core Python, PySpark, SQL, UNIX scripting, and ELT/ETL data processing. The ideal candidate should have hands-on experience building scalable data pipelines, processing large datasets, and developing batch and streaming solutions.
Mandatory Skills:
• Strong Core Python programming skills with expertise in coding, data processing, and performance optimization
• Strong hands-on experience in PySpark development
• Experience in PySpark application design, job execution, performance tuning, and troubleshooting
• Hands-on experience in SQL coding
• Experience in ELT/ETL pipeline development and data integration frameworks
• Proficiency in UNIX/Linux Shell Scripting
• Experience in creating, modifying, and troubleshooting Shell scripts
• Experience with batch and real-time/streaming data processing
• Ability to handle large-scale data processing
• Experience in optimizing data workflows for performance and scalability
• Good understanding of Distributed Computing and Big Data Architecture
• Experience in requirement gathering, solution design, technical documentation, and implementation
• Strong analytical and problem-solving skills
• Excellent verbal and written communication skills
Work arrangement
No
More openings worth a look
Recently tracked roles with full details and direct application links.