Coherent
51-200 employees
electrical-electronic-manufacturing
co2-lasers
commercial
diode-lasers
electrical
electronic-manufacturing
fiber-lasers
laser
laser-applications
laser-cutters
laser-cutting
laser-manufacturing
laser-markers
laser-solutions
laser-systems
lasers
lenses
machinery-manufacturing
manual-welding-lasers
manufacturing
materials-processing
microelectronics
optical-instruments
photonics
scientific
short-pulse-lasers
solid-state-lasers
ultrashort-pulse-lasers
communications
electronics
industrial
life sciences
materials
medical
optics
science
About Coherent
Coherent is a leading provider of lasers and laser-based solutions for scientific, commercial and industrial customers. Our technology makes a positive impact on a broad range of users that make tangible improvements to daily human life. We make amazing things possible by harnessing light that touches many aspects of daily life. Smartphones and tablets have higher resolution and can run better with the production of microchips our lasers support. In the medical field, our lasers have the power to drive life-saving research, enabling fine-tuned cancer diagnosis and precision medicine development. They support ophthalmic procedures that restore vision and cosmetic procedures like hair removal.
5 months ago
Member of Technical Staff
London - Remote
Full-time
Lead
Member of Technical Staff
📋
Description
- As a Member of Technical Staff in the pretraining evals team, you will play a key role in helping us make modelling decisions based on experimental outcomes for our large language models (LLMs). Your primary focus will be on developing better ways to measure base model progress. This can include implementing new/better evaluations for base model capabilities, finding ways to reduce noise in our current model evaluations, or developing evaluation benchmarks that measure model progress at all model scales, among other directions.
- This role combines expertise in statistics, data science, model evaluation and experience with base model capabilities and how to measure them. If any of these topics sound interesting to you, or if you believe that measuring model performance accurately is a crucial part of advancing artificial intelligence, we encourage you to apply.
- You will deeply understand each evaluation task, suggest improvements, and enhance the statistical understanding of our evals. Strong software engineering skills and proficiency in Python and ML frameworks like PyTorch, TensorFlow, or JAX are essential. The role involves collaboration with cross-functional teams and presenting findings effectively.
🎯
Requirements
- Familiarity with base model evaluations and how they differ from post-trained models.
- Strong statistical skills and experience evaluating scientific experiments related to data collection and model performance.
- Ability to convey statistical information effectively to a broad audience using visualizations and easy-to-understand numbers.
- Extremely strong software engineering skills.
- Proficiency in programming languages such as Python and ML frameworks (e.g., PyTorch, TensorFlow, JAX).
- Excellent communication skills to collaborate effectively with cross-functional teams and present findings.
- One or more papers at top-tier venues (such as NeurIPS, ICML, ICLR, AIStats, MLSys, JMLR, AAAI, Nature, COLING, ACL, EMNLP).
🏖️
Benefits
- Full health and dental benefits, including a separate budget to take care of your mental health
- 100% Parental Leave top-up for up to 6 months
- Weekly lunch stipend, in-office lunches & snacks
- Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement
- Remote-flexible work environment with offices in Toronto, New York, San Francisco, London, and Paris, as well as a co-working stipend
- 6 weeks of vacation (30 working days!)
- An open and inclusive culture and work environment
- Work closely with a team on the cutting edge of AI research