Data Engineering Consultant (Python,Pyspark OR Scala, Data Bricks)

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.
Primary Responsibilities
Design, Code, Test, document, and maintain high-quality and scalable Big Data, application using PySpark and Scala Spark on Cloud solutions on Azure
Develop and implement analytics rules engines and Predictive Algorithm and Unit Testing framework eg PyTest
Research, evaluate, and deploy new automation tools, frameworks, and patterns to build sustainable Big Data platform for batch and streaming applications using Kafka
Identify gaps and opportunities for improvement of existing solutions
Ensure the code is meeting the desired quality checks using Sonar
Schedule the deployed pipelines using Airflow following proper dependency hierarchy of jobs
Write technical documentation and participate in production support
Performance Optimization and application migration experience
Builder Responsibilities:
Design, develop, and deploy AI-powered solutions using no-code, low-code, and advanced platforms, translating business needs into scalable applications that enhance products, workflows, and decision-making
Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so
Required Qualifications
Bachelor/master's degree in computer science or information technology or equivalent with 7+ years of work experience
Solid experience in programming languages like Python,Pyspark, Scala
Good experience in job schedulers like Airflow
Good experience in working on cloud environment, preferably Azure
Proven experience in cloud services like Azure Kubernetes, Azure Data Lake, Azure Databricks, Azure Container Registries, Azure Service Bus, Azure Key Vault
Solid experience and expertise in writing complex queries in SQL and PL/SQL
Experience in writing Shell scripting and Snowflake
Experience with Continuous Integration CI/CD pipelines using Jenkins, GitHub Actions
Experience working in an agile environment
Experience working across teams and proven track record in solution focused problem-solving skills
Expertise in BigData frameworks like Spark and good understanding of Hadoop concepts
At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.

Work arrangement
No