Senior Python Developer

Job Title: Senior Python Developer
Reports to: Lead Machine Learning Engineer
Intelligent Audit is a rapidly expanding freight audit and business analytics technology company helping our customers become smarter shippers – shipping to their customers faster, cheaper, and with fewer delivery exceptions. We leverage big data and sophisticated analytics to remove inefficiencies in global transportation spend.
As a Senior Python Developer, you will build and maintain backend systems focused on automating internal processes and supporting the Data Science team. Your primary responsibility will be developing scalable web scraping solutions and data pipelines to extract, transform, and load data from multiple external sources. You will use AI coding assistants and agents throughout the software development lifecycle to accelerate delivery, improve code quality, and automate repetitive engineering work, while maintaining ownership of technical decisions and production outcomes.
What You Will Do:
Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. The individual with this position in our company will be expected, on a regular basis, to:
Process Automation & Backend Development
Design and develop automated systems for internal process optimization.
Build scalable backend services that integrate with existing infrastructure.
Ensure services are reliable, performant, and maintainable.
Web Scraping & Data Extraction
Develop and maintain web scraping solutions for multiple external websites.
Handle dynamic content, rate limiting, authentication, and anti-scraping measures.
Implement robust error handling, logging, and retry mechanisms.
Data Manipulation & Processing
Clean, transform, and process large volumes of structured and unstructured data.
Build and maintain data pipelines to deliver usable datasets to downstream systems.
Monitoring & Observability
Implement monitoring for system performance, data quality, and operational metrics (e.g., Datadog).
Create dashboards and alerts to ensure system reliability and data integrity.
Data Science Team Support
Provide backend infrastructure, data pipelines, and tooling for Data Science projects.
Collaborate with data scientists to deliver data and services that enable experimentation and model deployment.
Code Quality & Best Practices
Apply test-driven development and maintain solid unit/integration test coverage.
Perform code reviews using engineering judgment and AI-assisted review tools to identify defects, security issues, and maintainability concerns.
Validate AI-generated code through appropriate testing and inspection, and follow company policies for source code, credentials, and customer data when using AI tools.
Follow best practices in Python packaging, dependency management (e.g., uv, conda), and documentation.
CI/CD & Infrastructure
Design and maintain CI/CD pipelines (e.g., GitHub Actions) for automated testing and deployment.
Work with DevOps to support containerization and orchestration (Docker, Kubernetes).
Lifecycle Management & Continuous Improvement
Own the software lifecycle from development through deployment and maintenance.
Identify opportunities to reduce technical debt and improve performance and reliability.
What You Will Bring:
Technical Expertise
Advanced Python proficiency with experience in backend frameworks (e.g., FastAPI).
Strong understanding of HTTP, RESTful API design, and general web technologies.
Experience working in Linux-based environments.
Web Scraping & Automation
Hands-on experience with web scraping tools and libraries (e.g., BeautifulSoup, Scrapy, Selenium, Playwright).
Ability to handle JavaScript-rendered content, cookies, sessions, and complex authentication flows.
Data Manipulation
Strong experience with Python data libraries (e.g., pandas, polars, NumPy).
Strong SQL skills and familiarity with common data formats (JSON, XML, CSV, HTML).
Monitoring & Observability
Experience with monitoring and observability tools (e.g., Datadog).
Ability to define useful metrics, logs, and dashboards, and configure alerting.
Database & Data Storage
Experience with relational databases (e.g. PostgreSQL).
Familiarity with ETL/ELT concepts and data warehousing basics.
CI/CD & DevOps Collaboration
Experience with automated build/test/deploy pipelines and containerized workloads.
Familiarity with Docker and Kubernetes.
Data Science Collaboration
Understanding of data science workflows and model deployment needs.
Experience building tools and services that support ML and analytics use cases.
AI-Assisted Development & Automation
Use AI development tools (e.g., Codex, Claude Code, Cursor) for implementation, debugging, refactoring, testing, and documentation.
Guide coding agents with clear requirements, relevant codebase context, and acceptance criteria; review and validate their output before integration.
Develop reusable instructions, workflows, and integrations that make AI tools more effective across the tea
Minimum Qualifications:
Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related field, or equivalent practical experience.
5+ years of professional Python backend development experience.
3+ years of experience with web scraping and data extraction from multiple sources.
Demonstrated experience building scalable backend systems and automated processes.
Experience with monitoring and observability tools (Datadog or similar).
Strong SQL skills and experience with relational databases.
Proficiency with Linux, Git, and Bash command-line tools.
Preferred Characteristics:
Experience with asynchronous and concurrent processing (e.g., asyncio, Celery).
Prior exposure to logistics, freight, or supply chain domains.
Experience with distributed systems and microservices architectures.
Familiarity with data engineering tools and practices (e.g., dbt, Airflow, Prefect).
Experience building APIs and services that integrate with machine learning models.
Contributions to open-source projects related to web scraping, data engineering, or backend automation.

Work arrangement
Yes