Research Scientist, Web Data Pipeline & AI Evaluation

Applied Intuition Inc.; Greater London; On-site; GBP 70,000 - 90,000; Full time

Job summary

A leading AI research organization is seeking a Research Scientist to enhance the web data pipeline. You will focus on improving data quality through scraping and filtering, evaluate pretrained language models, and collaborate with teams to implement infrastructure improvements. Candidates should have at least 3 years' experience in data processing and proficiency in Python or C++. This role offers the chance to work at the forefront of AI research in a diverse and inclusive environment.

Qualifications

• 3 years of experience as an engineer or researcher, such as in software development or graduate studies.
• Experience in building data processing pipelines handling over 100 million examples.
• Familiarity with evaluating pretrained language model performance.

Responsibilities

• Investigate results to identify areas for improvement based on user feedback.
• Develop measurements to evaluate model performance and pipeline effectiveness.
• Set a medium-term improvement agenda with peer feedback.
• Collaborate with partner teams on technology solutions.
• Execute day-to-day coding, experiments, and reviews.

Skills

Self-directed working

Large-scale data processing

Evaluation of LLM performance

Tools

Python

C++

Job description

A leading AI research organization is seeking a Research Scientist to enhance the web data pipeline. You will focus on improving data quality through scraping and filtering, evaluate pretrained language models, and collaborate with teams to implement infrastructure improvements. Candidates should have at least 3 years' experience in data processing and proficiency in Python or C++. This role offers the chance to work at the forefront of AI research in a diverse and inclusive environment.