Software Engineer

About The Company
Quik Hire Staffing is a leading recruitment agency dedicated to connecting talented professionals with innovative organizations across various industries. With a focus on quality, integrity, and personalized service, Quik Hire Staffing strives to facilitate seamless employment solutions that align with both client needs and candidate aspirations. Our extensive network and industry expertise enable us to identify top-tier talent for specialized roles, ensuring that organizations can build dynamic and effective teams. We are committed to fostering diversity and inclusion in the workplace, supporting our clients and candidates through every step of the hiring process.
About The Role
We are seeking a highly skilled and motivated Software Engineer specializing in Ruby to join our client's dynamic team on a full-time, remote basis. This role focuses on evaluating and validating large language models (LLMs) by developing robust datasets and evaluation frameworks that address real-world software engineering challenges. The successful candidate will work closely with AI researchers and development teams to analyze open-source repositories, set up reproducible testing environments, and assess model performance in complex coding tasks. This position offers an exciting opportunity to contribute to cutting-edge AI research and influence the future of AI-assisted software development tools.
Qualifications
Minimum of three years of professional experience in software engineering with a strong command of Ruby and Ruby on Rails frameworks.
Proficiency in version control systems, particularly Git, and experience with containerization tools such as Docker.
Solid understanding of software development pipelines, including environment setup, testing, and deployment for reproducibility.
Experience working with complex codebases, capable of running, modifying, and troubleshooting code locally.
Familiarity with Ruby testing frameworks such as RSpec and Minitest, as well as gem management tools like Bundler.
Prior contributions to open-source projects or experience in evaluating open-source codebases is highly desirable.
Strong analytical skills with the ability to assess code quality and coverage metrics effectively.
Excellent communication skills and the ability to collaborate with cross-functional teams in a remote environment.
Responsibilities
Analyze and triage issues from trending open-source repositories on GitHub to identify suitable evaluation scenarios for LLM testing.
Set up and configure code repositories, including creating Docker containers and preparing environments to ensure reproducible testing conditions.
Evaluate unit test coverage and quality metrics to determine baseline code health and robustness of test suites.
Modify and run Ruby codebases locally to assess the performance of large language models in bug fixing, code completion, and other programming tasks.
Collaborate closely with AI researchers to design and select repositories and issues that challenge LLM capabilities, ensuring comprehensive evaluation coverage across various programming languages and complexity levels.
Document testing procedures, results, and insights to support continuous improvement of evaluation methodologies.
Stay updated with the latest developments in AI, machine learning, and software engineering best practices to enhance evaluation strategies.
Benefits
Our client offers a competitive salary package, flexible work arrangements, and opportunities for professional growth. Employees benefit from a collaborative remote work environment, access to cutting-edge AI research projects, and participation in ongoing training and development programs. Additionally, the role provides exposure to innovative technologies and the chance to contribute to impactful AI advancements that shape the future of software engineering and artificial intelligence industries.
Equal Opportunity
We are an equal opportunity employer committed to fostering an inclusive environment for all employees. We hire based on skills, experience, and qualifications without regard to race, ethnicity, gender, age, sexual orientation, disability, or any other protected characteristic. All qualified candidates are encouraged to apply, and we ensure that the hiring process is fair, transparent, and free from discrimination.
Apply Now!

Work arrangement
Yes