Live opening · Posted 13 hours ago
The key details from the original listing.
Live timing from JobBeeper.
Description supplied by the original job listing.
Role: Senior PySpark Developer
Experience: 5–10 Years
Employment Type: Full-Time
Notice Period: Immediate- 30 Days
We are looking for highly skilled Senior PySpark Developers with strong expertise in Core Python, PySpark, SQL, UNIX scripting, and ELT/ETL data processing. The ideal candidate should have hands-on experience building scalable data pipelines, processing large datasets, and developing batch and streaming solutions.
Mandatory Skills:
• Strong Core Python programming skills with expertise in coding, data processing, and performance optimization
• Strong hands-on experience in PySpark development
• Experience in PySpark application design, job execution, performance tuning, and troubleshooting
• Hands-on experience in SQL coding
• Experience in ELT/ETL pipeline development and data integration frameworks
• Proficiency in UNIX/Linux Shell Scripting
• Experience in creating, modifying, and troubleshooting Shell scripts
• Experience with batch and real-time/streaming data processing
• Ability to handle large-scale data processing
• Experience in optimizing data workflows for performance and scalability
• Good understanding of Distributed Computing and Big Data Architecture
• Experience in requirement gathering, solution design, technical documentation, and implementation
• Strong analytical and problem-solving skills
• Excellent verbal and written communication skills
Work arrangement
No
Recently tracked roles with full details and direct application links.