AI Evaluation Specialist at Odixcity Consulting

Join Odixcity Consulting as an AI Evaluation Specialist in a fully remote role. This international HR consulting firm excels in various areas including recruitment and performance management. In this position, you will be responsible for developing systems to assess and enhance generative AI models. Your work will bridge data science, product development, and research, ensuring that our AI systems are accurate, safe, and unbiased. As an AI Evaluation Specialist, your daily tasks will include designing automated evaluation frameworks using Python, leading the creation of annotation rubrics, and managing workflows for human evaluators. You will also conduct adversarial testing to uncover biases and vulnerabilities in model outputs. Additionally, you will analyze evaluation results to identify model weaknesses and provide actionable insights to the product and modeling teams. The ideal candidate will hold a degree in Computer Science, Information Technology, or a related field, with over 5 years of experience in machine learning or AI evaluation. Proficiency in Python and SQL is essential, along with a strong background in designing evaluation strategies for NLP or generative AI products. This is a full-time position, offering a competitive salary of N500,000 monthly. If you are passionate about AI and meet the qualifications, we encourage you to apply for this exciting opportunity at Odixcity Consulting.