Live opening · Posted 19 hours ago
The key details from the original listing.
Live timing from JobBeeper.
Description supplied by the original job listing.
About The Opportunity
Careerbloc is a next-generation talent and AI evaluation platform empowering enterprises to hire with precision by assessing technical skills through real-world, code-first evaluations. We blend human expertise with AI-powered validation to deliver unbiased, scalable assessments for software engineering and technical roles across the globe—helping companies future-proof their tech teams and candidates showcase their true capabilities.
Role & Responsibilities
Design, validate, and execute AI-driven evaluation frameworks for software engineering candidates—focusing on code quality, algorithmic efficiency, and system design patterns.
Build and maintain scalable code evaluation rubrics using real-world programming challenges (Python, Java, JavaScript, SQL, etc.) aligned with industry-grade engineering standards.
Analyze candidate submissions using static analysis tools, automated test suites, and manual code reviews to ensure fair, objective, and context-aware scoring.
Collaborate with AI/ML engineers to fine-tune LLM-based evaluation models for assessing code correctness, readability, edge-case handling, and optimization.
Identify and eliminate evaluation biases in test cases, improve scoring logic, and contribute to continuous feedback loops for model refinement.
Document evaluation workflows, maintain test case libraries, and train QA/assessment teams on evaluation best practices and tooling.
Skills & Qualifications
Must-Have
Python
Java
JavaScript
SQL
Git
Unit Testing
Code Review
CI/CD Pipelines
Preferred
Experience with LLM evaluation frameworks (e.g., LangChain, RAG, LlamaIndex)
Familiarity with code quality tools (SonarQube, Codacy, ESLint)
Knowledge of SDE interview patterns (LeetCode, HackerRank-style assessments)
Benefits & Culture Highlights
100% remote with flexible hours—work from anywhere in India.
Impact-driven culture: your work directly shapes how millions of engineers are assessed globally.
Continuous learning: access to AI/tech workshops, certification stipends, and peer mentorship.
Skills: java,computer science,engineers,software development,javascript,coding,python,sql,software,design
Work arrangement
No
Recently tracked roles with full details and direct application links.