Location: Dublin
Work Model: Hybrid
Job Summary
You are a key member of the Language Experts group closely monitoring and evaluating responses quality for your locale. As a Language Expert, you evaluate the performance of the language model ensuring that it:
1. Correctly understands user requests.
2. Provides relevant and useful responses.
3. Presents the information in a clear and understandable manner.
You also review and evaluate ratings.
Responsibilities
* Collaborating with the cross-locale team of Language Experts to transform task-specific challenges and observations into valuable insights and process improvement suggestions.
* Identifying and calling out what works well.
* LLM Model Improvement and Accountability: Linguists are directly responsible for driving model enhancements specific to their respective language and partner with Subject Matter Experts to ensure that the model delivers high-quality responses.
* Data Analysis and Evaluation: Linguists meticulously analyze evaluation data to identify patterns of success and areas for improvement across various releases.
* Evaluations Trustworthiness: Linguists safeguard the reliability of evaluations by vetting samples and assessing their quality.
* Contextualized Guidance: Linguists create language-specific evaluation guidelines and instructions to provide tailored support and enhance model performance.
* Quality Control: They provide feedback and conduct quality assessments on evaluations and rewrites ensuring that human-generated data aligns with the linguistic nuances and expectations of each language.
Skills and Qualifications
* Bachelor's degree in Linguistics and in-depth knowledge of language structures, phonetics, syntax, semantics, and language analysis methods. Advanced degrees (Master's or Ph.D.) in Linguistics preferred.
* Native-level fluency in the target language is essential with exceptional command of grammar, vocabulary, and cultural nuances.
* Strong analytical abilities to dissect language structures, identify patterns, and draw conclusions about language use.
* Excellent written and verbal communication skills are necessary for presenting research findings and writing reports.
* Meticulous attention to language details including pronunciation, grammar, and subtle language variations.
* Understanding of cultural context, social norms, and non-verbal communication associated with a language.
* Research skills: Ability to conduct research, collect data, and analyze linguistic phenomena is preferred (not required). Programming languages (e.g., Python): Knowledge of programming for computational linguistics, natural language processing, and data analysis tasks is preferred.
#J-18808-Ljbffr