Live opening · Posted 7 days ago
AI Senior Software Engineer
EDZ Systems · United States (Remote)
You are 7 days behind. JobBeeper subscribers saw this role while it was still new.
At a glance
The key details from the original listing.
CompanyEDZ Systems
LocationUnited States (Remote)
Work modeYes
Source
Linkedin
Listed7 days ago
Your early-applicant advantage
Live timing from JobBeeper.
12 min
from Linkedin publishing this role to us finding it
5 min
median time from a role going live to a subscriber being told
6 hours
subscribers had this role before this page existed
71,893
roles found in the last 24 hours — the newest are not on this site yet
About the role
Description supplied by the original job listing.
AI Sr Software Engineer
We are seeking an experienced professional to lead the configuration, implementation, and deployment an AI Gateway solution (e.g. litellm) on-premise in our AWS boundary. This role will focus on delivering a production-ready fully automated AI Gateway infrastructure with comprehensive documentation and initial rollout support.
Key Responsibilities
Implementation & Configuration
Design and implement AI Gateway infrastructure using Infrastructure as Code (IaC)
Configure and customize according to our organizational requirements (security and standards)
Deploy solution within our AWS environment
Conduct comprehensive testing including functional, performance, and integration testing
Ensure solution meets security, scalability, and reliability requirements
Documentation & Knowledge Transfer
Create detailed technical documentation for the implemented solution
Develop onboarding guides and operational runbooks
Document configuration standards and deployment procedures
Provide architecture diagrams and system documentation
Rollout Support
Support initial production rollout and deployment
Provide troubleshooting and issue resolution during launch phase
Conduct knowledge transfer sessions with internal teams
Assist with early adoption and usage optimization
Required Skills & Experience
Primary Requirements
AWS Expertise: Strong experience with AWS services and cloud architecture
Infrastructure as Code: Proficiency with IaC tools (Terraform, CloudFormation, CDK, or similar)
AI Gateway Experience: Hands-on experience with LiteLLM or similar AI Gateway platforms
Demonstrated ability to implement and configure cloud-based infrastructure solutions
Experience with API management and gateway technologies
Strong documentation and technical writing skills
Nice to Have
Security certifications or specialized security experience (AWS Security, cloud security best practices)
Experience with AI/ML model deployment and management
Knowledge of rate limiting, token management, and API cost optimization
Familiarity with observability and monitoring tools (CloudWatch, Grafana)
Experience with CI/CD pipelines and DevOps practices
Deliverables:
Production-ready AI Gateway implementation
Complete IaC codebase with version control
Comprehensive technical documentation
Onboarding guides and operational procedures
Post-implementation support through initial rollout period
Work arrangement
Yes
More openings worth a look
Recently tracked roles with full details and direct application links.
Good roles move before most people even see them.
Tell JobBeeper what you want and get fresh matches delivered in minutes.
Start your free trial →