【Full Remote 11M JPY】Software Engineer – Data Platform | Python / AWS

One of the leading AI companies we work closely with is looking for a Software Engineer – Data Platform to build and scale the data infrastructure powering its Generative AI products.
This is a Full Remote position from anywhere in Japan, with an annual salary of up to ¥11M.
Japanese Business Level Required
You will develop and operate large-scale data pipelines responsible for collecting, processing, and delivering hundreds of millions of documents from sources including web content, news, patents, and academic papers.
The platform serves as a core data foundation shared across the company’s AI products, including enterprise AI agents and Generative AI solutions.
Job Responsibilities
・Develop and operate large-scale data platforms using Python and TypeScript / Node.js
・Design and develop data pipelines processing web content, news, patents, academic papers, and other large-scale document data
・Develop and improve large-scale Web crawlers
・Design scalable distributed processing architectures in serverless environments
・Improve monitoring, reliability, scalability, and maintainability of data infrastructure
・Design and implement data processing workflows and distributed systems
・Work across requirements definition, system design, implementation, and production operation
・Collaborate with Product Managers, Customer Success, AI Engineers, and other engineering teams
・Propose and implement improvements based on product requirements and customer challenges
・Contribute to technical leadership and improve the productivity of the Data Platform team
The platform processes hundreds of millions of documents, while its Web crawler collects information from tens of thousands of websites.
Development Environment
Languages: Python / TypeScript / Node.js
Cloud: AWS
Container: Docker
IaC: Terraform
Data / Distributed Processing: PySpark
Web Crawling: Puppeteer
AI Development Tools: Cursor / CodeRabbit / Devin
About the Company
The company is a Japan-based AI technology company with strong expertise in Generative AI and LLM technologies.
Rather than simply utilizing external AI models, the company has the technical capabilities to develop large-scale Japanese-language LLMs in-house.
Its technology powers enterprise AI products including an AI agent platform for the manufacturing industry and a new PaaS business supporting enterprise AI implementation.
Its solutions have already been adopted by more than 300 companies, including approximately 30% of Nikkei 225 companies.
In 2024, the company raised ¥4.5 billion, bringing total funding to approximately ¥8.8 billion, and the organization has grown to approximately 150 employees.
Why Join This Role?
・Build the core data infrastructure powering multiple Generative AI products
・Work with hundreds of millions of documents at large scale
・Design and operate large-scale distributed processing in serverless environments
・Develop Web crawlers collecting data from tens of thousands of websites
・Work across the complete engineering lifecycle from requirements definition to production operation
・Collaborate directly with Product Managers and business teams on product improvements
・Contribute technically to products using advanced Generative AI and proprietary LLM technologies
・Work fully remotely from anywhere in Japan
Requirements
・3+ years of professional engineering experience
・Professional experience developing applications using Python
・Experience across the full development lifecycle, including requirements definition, system design, implementation, and production operation
・Experience in at least one of the following:
A. Serverless / Full-Stack Development
Experience developing, operating, or leading serverless systems using technologies such as AWS Lambda, ECS, Fargate, or Step Functions
OR
B. Data Platform / Data Pipeline Engineering
Experience developing and operating data pipelines, ETL systems, workflow engines, or distributed processing frameworks such as Spark
・Ability to communicate smoothly in business-level Japanese, including technical discussions
・Currently residing in Japan
Compensation
Expected Annual Salary: ¥6.5M – ¥11M
Salary Review: Twice a year
Location
Tokyo / Full Remote Work Available Within Japan
You can work remotely from anywhere in Japan. Employees are already working remotely from locations including Osaka, Kyoto and Sendai.
Working Style
・Primarily full remote
・Work from anywhere within Japan regardless of region
・Flex-time system
・Core hours: 10:00 – 14:00
・Average monthly overtime: approximately 10 – 20 hours
Holidays & Leave
・123 annual holidays
・Five-day workweek (Saturdays, Sundays, and national holidays off)
・Year-end and New Year holidays
・Paid annual leave
・Maternity leave
・Childcare leave
Benefits
・Full social insurance coverage
・Corporate defined contribution pension plan
・Up to ¥240,000 per year in financial support for professional development and AI-related activities
・Transportation expenses
・Regular health checkups
・Influenza vaccinations
・Company-provided MacBook Pro
・Five-day onboarding program after joining

Work arrangement
Yes