Research Scientist, Human Evaluation - Seattle, WA

Technical/Functional Skills

• Strong understanding of machine learning principles, especially in the context of LLMs.
• Knowledgable about LLM evaluation techniques, such as human evaluation and automated benchmarks.
• Can own and pursue a research agenda, including choosing impactful research problems and autonomously carrying out projects.
• Fluent in at least one statistical programming language such as Python (preferred) or R.
• Demonstrated background in collecting data from human participants (e.g., surveys, experiments) with knowledge about data quality, data validity, etc.
• Strong verbal and written communications skills with the ability to work effectively across internal and external organizations and virtual teams.
• PhD or advanced degree in computer science, machine learning, cognitive science, psychology, economics, or similar (preferred).

Education

PhD or advanced degree in computer science, machine learning, cognitive science, psychology, economics, or similar (preferred).