PARTNER CONSULTANT - Hive

TNB to migrate its existing Cloudera data ecosystem to the modern Databricks Data Intelligence Platform (Lakehouse Architecture). This migration is not a mere technical uplift, but a critical enabler aligned directly with TNB's Reimagining TNB 2025 (RT25) strategy and its overarching Energy Transition (ET) Aspiration Plan, specifically supporting the Grid of the Future and Sustainability Pathway 2050 pillars.TNBs existing Cloudera environment (v7.1.7) to the Databricks Lakehouse Platform using a Lift-and-Shift, then Modernize approach.
This approach ensures minimal operational disruption during migration while establishing a scalable foundation for advanced analytics, AI, and domain-led modernization.
Database Architect
Role Summary
Responsible for designing and implementing scalable data storage, migration, performance optimization, and data management solutions across Cloudera, AWS, and Databricks platforms.
Key Responsibilities
Define migration approach for Hive tables, HDFS datasets, and relational databases.
Design Delta Lake storage architecture and partitioning strategy.
Develop archival and retention policies using AWS storage services.
Ensure data integrity and reconciliation during migration.
Perform performance tuning and optimization.
Define backup, recovery, and disaster recovery strategies.
Support database security and access control requirements.
Required Skills
Hive, HDFS, Impala
Delta Lake Architecture
SQL and Data Warehousing
AWS S3, Glacier, RDS
Data Migration Tools (AWS DMS, DistCp)
Database Performance Tuning
Data Replication and Recovery
Data Security and Encryption
ETL/ELT Architecture
Hive,SQL,AWS Data Lake

Work arrangement
No