Summary

This role provides hands on ownership of training and evaluation pipelines, benchmark development, and model improvement initiatives that directly influence deployed systems.

Your Impact

1. Design and implement a lightweight supervised fine tuning training pipeline using open source LLMs.
2. Create new benchmarks to evaluate frontier models across defined scientific and performance criteria.
3. Analyze production models to identify measurable areas for improvement.
4. Improve model performance through targeted retraining and hyperparameter search.
5. Deploy improved models while maintaining core model characteristics and avoiding regression.
6. Build Python tooling to automate training, evaluation, benchmarking, and experimentation workflows.
7. Implement structured evaluation methods, including rubric based scoring and LLM as a judge workflows.
8. Document experimental design, benchmark methodology, and performance results with clarity and precision.
9. Iterate rapidly in a research driven environment to increase model quality and reliability.

What You Bring

1. Current enrollment in or recent completion of a Master’s or PhD in Computer Science, AI, Machine Learning, Computer Engineering, or a closely related technical field.
2. Strong experience working with large language models, including supervised fine tuning, prompt engineering, or model evaluation.
3. Hands on experience building machine learning pipelines or research infrastructure.
4. Experience improving model performance through retraining or hyperparameter tuning.
5. Proficiency in Python and comfort working with machine learning frameworks and open source model ecosystems.
6. Familiarity with cloud environments such as AWS or Azure.
7. Strong technical problem solving ability, including use of LLMs as development aids for building and iteration.
8. Ability to work independently with minimal hand holding.
9. Strong written communication skills for summarising research and drafting technical documentation.
10. Ability to collaborate effectively in a remote research environment.

Skills

• Communications Skills
• Development
• Machine Learning
• Problem Solving
• Software Engineering
• Team Collaboration