Freelancing - Phd Social Sciences

Key Responsibilities:1. Review and Validate AI Responses: a) Evaluators will work via our online platform. b) All decisions of the Evaluators must be guided towards evaluating this central theme: usefulness of the AI response. This is the primary metric for measuring AI response quality: Is the AI response useful in addressing the question posed in the user prompt c) The goal is to assess the quality, safety, and utility of AI-generated content- particularly in use cases like literature summarization, clinical question answering, and decision support. Each AI generated response should be scored across 10 key criteria. d) Evaluators must use a Likert scale (4=Great, 3=Good, 2=Fair, 1=Poor) on the first six criterion, and pass or fail’ on the remaining four. e) A commentary must be provided on the AI response, and flag critical issues (e.g., hallucinations, or, ethical/safety concerns). f) Commentaries must be error-free, concise and consistent with established medical guidelines, evidence-based practices, and current clinical standards. Rewriting the commentary and revisiting the evaluation may also be within scope based on feedback from quality checks. 2. Stay Current with latest in their domain: Stay up-to-date with the latest research, guidelines, and advancements in your area of expertise, ensuring that their validation and feedback are informed by the most current and accurate information. 3.Maintain Confidentiality: Adhere to strict confidentiality of the data received for processing and comply with data protection protocols and other relevant laws and guidelines.Requirements:1. PhD in respective disciplines above. 2. Research Experience: Have a minimum of 2 years of research experience in a reputed institution or laboratory. 3. Strong subject matter expertise. 4. Excellent Communication Skills: Possess excellent written skills, with the ability to clearly articulate complex clinical concepts and provide concise commentaries on shortcomings of AI response. 5. Familiarity with AI and Technology: Have a basic understanding of Generative AI usage pertaining to healthcare information processing.

Apply Now