Solution Architect

Description
The Solutions Architect is APAJ's technical lead for automated quality judgment. The role partners with Quality Specialists, QOMs, Science and Engineering to move workflows from sampled batch inspection to trustworthy unit-level judgment, and acts as a Technical Bar Raiser for judge builders.
Key job responsibilities
Turn workflow requirements and conventions into judge designs, deterministic checks and transformation logic, and review difficult designs.
Streamline existing judge measurement and onboarding mechanisms — including precision measurement, judge onboarding decisions and the handoff to DCE — so they run consistently and at scale.
Provide technical input to RED certification and data-classification work for critical-data workflows.
Develop and assess judge-builder candidates; contribute reusable components, runbooks and lessons to the network.
Basic Qualifications
2+ years of design, implementation, or consulting in applications and infrastructures experience
4+ years of specific technology domain areas (e.g. software development, cloud computing, systems engineering, infrastructure, security, networking, data & analytics) experience
5+ years of IT development or implementation/consulting in the software or Internet industries experience
Experience using a current programming language, such as Python, to build scripts, prototypes or reusable components
Experience with large language models, prompt design or automated evaluation
Preferred Qualifications
Experience working within software development or Internet-related industries
Experience working with AWS technologies from a dev/ops perspective
Experience building or evaluating ML- or LLM-based quality or evaluation systems in production
Experience interpreting precision, recall, calibration, agreement or error-analysis results
Experience with data annotation, labelling or content-quality workflows
Familiarity with data-classification, access-control or security review requirements
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
Company - ADCI MAA 12 SEZ
Job ID: A10588349