Senior Data Engineer

QAT Global is a U.S.-based IT consulting firm with more than 30 years of experience delivering software solutions for enterprise clients, with nearshore operations in the US, Brazil, and Costa Rica.
We are looking for a Senior Data Engineer to own our client's enterprise data processing framework supporting Medicaid Encounter Processing. Following the State's migration to Cloudera Data Platform (CDP), you will keep this mission-critical platform reliable, maintainable, and ready for ongoing regulatory change.
What You'll Do
Maintain and enhance the Scala and Apache Spark application framework.
Maintain Drools business rules and deliver rule updates.
Manage enterprise data ingestion for master data and source-system files.
Develop and optimize Spark and Hive batch-processing workflows.
Resolve production issues and application defects.
Coordinate releases, version management, and deployments.
Maintain documentation and provide knowledge transfer.
Perform basic CDP administration and monitoring with infrastructure and cloud teams.
Required Qualifications
7+ years developing enterprise-scale distributed data-processing applications.
Strong hands-on experience with Scala and Apache Spark 2.x/3.x.
Experience with Cloudera Data Platform 7.x or equivalent Hadoop distributions.
Experience with Apache Hive 3.x and the Drools Rules Engine.
Strong SQL and query-optimization skills.
Experience supporting Linux production environments and troubleshooting Spark in production.
Experience with Git and modern version-control practices.
Nice to Have
Medicaid or healthcare experience, especially Encounter Processing.
Experience with Cloudera Manager, HDFS, YARN, IBM DataStage, or AWS.
Experience with Agile, Jira, and Confluence.
What Makes Someone Successful in This Role
Strong ownership of production stability.
A root-cause mindset with maintainable solutions.
Precision when implementing regulatory changes.
Clear communication with infrastructure and cloud teams.
Why Join QAT Global?
Work on mission-critical enterprise projects in public healthcare.
Collaborate with teams across the U.S., Brazil, and Costa Rica.
Fully remote within the United States.
If you take pride in keeping critical data platforms reliable, apply today.

Work arrangement
Yes