Live opening · Posted 2 days ago
The key details from the original listing.
Description supplied by the original job listing.
Business Function
Group Technology enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation. In Group Technology, we manage the majority of the Bank's operational processes and inspire to delight our business partners through our multiple banking delivery channels.
Responsibilities
Design, develop, and maintain scalable data pipelines and applications within the Hadoop ecosystem.
Perform performance tuning of SQL and Spark ETL processing to optimize system efficiency and reduce latency.
Implement batch automation using Shell scripts and REST APIs, including job triggering and result parsing.
Manage data storage, ingestion, and retrieval processes using HDFS and Parquet
Develop robust scripts using Shell, Python, and Scala to automate operational workflows and system integrations.
Utilize AWS products, such as S3 Storage, for cloud-based data management and integration.
Troubleshoot, debug, and resolve complex technical issues within Linux/Unix environments.
Requirements
Proven experience in application development within a large-scale enterprise technology environment.
Strong technical expertise in Hadoop, HDFS, Hive, and Impala.
Proficiency in Spark (Scala/Java) and SQL.
Hands-on experience with data serialization and storage formats including Parquet
Demonstrated ability in the performance tuning of SQL and Spark ETL processing.
Strong command of Linux/Unix systems and command-line tools.
Expertise in scripting using Shell, Python, and Scala.
Experience in batch automation using Shell scripts and REST APIs, including triggering and result parsing.
Familiarity with cloud technologies, specifically AWS products such as S3 Storage.
Strong problem-solving skills and a can-do attitude, with the ability to develop solutions.
Location:
DBS Asia Hub
Job:
Technology
Schedule:
Regular
Employee Status:
Full time
Live timing from JobBeeper.
Recently tracked roles with full details and direct application links.