Software Engineer

About The Company
Quik Hire Staffing is a leading recruitment agency dedicated to connecting talented professionals with innovative organizations across various industries. Our mission is to facilitate seamless talent acquisition by providing tailored staffing solutions that meet the unique needs of our clients. With a strong focus on technology and digital transformation, Quik Hire Staffing prides itself on maintaining a vast network of qualified candidates and fostering long-term partnerships. Our commitment to excellence and integrity ensures that both clients and candidates receive exceptional service, making us a trusted partner in the recruitment process.
About The Role
We are currently seeking a highly skilled Software Engineer specializing in Ruby to join our client's dynamic team on a full-time, remote basis. This role focuses on the evaluation and validation of large language models (LLMs) within the context of software engineering. The successful candidate will work on developing datasets and evaluation frameworks that address real-world software engineering challenges. The projects involve creating verifiable tasks from public repository histories using synthetic methods combined with human-in-the-loop approaches, aiming to expand coverage across multiple programming languages and difficulty levels. This position offers an exciting opportunity to contribute to cutting-edge AI research and development, impacting the future of AI-assisted software engineering tools.
Qualifications
Minimum of three years of professional experience in software engineering, with a strong proficiency in Ruby and Ruby on Rails.
Proven expertise in version control systems, particularly Git, along with experience in Docker and setting up reproducible software pipelines.
Ability to understand and navigate complex, real-world codebases, including running, modifying, and testing code locally.
Experience with Ruby testing frameworks such as RSpec and Minitest, as well as gem management using Bundler and code quality tools.
Experience contributing to or evaluating open-source projects is considered a plus.
Responsibilities
The successful candidate will be responsible for a variety of tasks, including:
Analyzing and triaging GitHub issues across trending open-source libraries to identify suitable evaluation scenarios for LLMs.
Setting up and configuring code repositories, including containerization with Docker and preparing environments for reproducible testing.
Evaluating unit test coverage and quality metrics to assess the baseline health of codebases and the robustness of test suites.
Modifying and executing Ruby codebases locally to measure the performance of LLMs in bug-fixing and code-completion tasks.
Collaborating with AI researchers to design and select repositories and issues that pose challenging cases for language models, ensuring the datasets are comprehensive and representative.
Benefits
Joining our client's team offers numerous benefits, including competitive salary packages, flexible remote working arrangements, and opportunities for professional growth in the rapidly evolving field of artificial intelligence. Employees will have access to ongoing training and development programs, a collaborative work environment, and the chance to work on innovative projects that have a tangible impact on the future of software engineering and AI technologies. Additionally, the organization promotes a healthy work-life balance and values diversity and inclusion within its workforce.
Equal Opportunity
Quik Hire Staffing is an equal opportunity employer. We are committed to fostering an inclusive environment where all employees and applicants are treated with respect and fairness. We hire based on skills, qualifications, and experience, regardless of race, gender, age, religion, sexual orientation, disability, or any other protected characteristic. We believe that diversity enhances our ability to innovate and serve our clients effectively. All qualified candidates are encouraged to apply, and we look forward to welcoming talented professionals from all backgrounds.

Work arrangement
Yes