Remote Assessment Reviewer/Consultant

Summary

Join us and let's shape the AI Economy together! As an Assessment Consultant/Reviewer, you will leverage your expertise to review assessment questions designed to evaluate internal job candidates. These questions cover a variety of topics, including data analysis, financial modeling, and trading algorithms, with a strong focus on mathematical and statistical concepts.

Requirements

• Master’s or higher degree in Mathematics, Statistics, Data Science, or a related field
• Over 3 years of experience in a quantitative research or finance role is preferred, particularly in data-driven environments such as quantitative trading or financial modeling
• Attention to Detail: Strong capability to assess multiple plausible solutions, ensure accuracy, and provide feedback that covers both content and presentation, including grammar and phrasing
• Communication Skills: Strong written and verbal communication skills, essential for delivering high-quality feedback and interacting with team members effectively

Responsibilities

• Expert Question Review and Detailed Feedback: The consultant will deliver quick, in-depth feedback focused on improving assessment questions across several dimensions
• Accuracy: Ensure the question is factually correct and mathematically sound, with no errors in logic, calculations, or assumptions
• Clarity and Readability: Assess whether the question is clear, concise, and easy to understand. Complex questions should be worded in a way that avoids ambiguity and confusion
• Multiple Solution Paths: Identify and evaluate whether the question allows for different valid approaches to solving the problem. They may suggest revisions to encourage creative or alternative methods of problem-solving
• Difficulty Level: Confirm that the difficulty level is appropriate for the intended assessment. Feedback may include how to adjust the complexity to better match the target candidate’s expertise
• Relevance to Job Role: Ensure the question is directly related to the specific skills or knowledge required for the job the assessment is targeting. If the question isn't job-relevant, they may suggest revisions to make it more applicable
• Grammar and Syntax: Check for grammatical errors, awkward phrasing, or misused terminology that could detract from the question’s quality and comprehension
• Answer Choices (for multiple-choice questions): Evaluate whether distractors are plausible yet distinguishable from the correct answer. Distractors should neither be too easy nor irrelevant
• Conceptual Coverage: Ensure the question effectively tests the concepts it aims to assess. Feedback may include suggestions to expand, narrow, or modify the focus of the question to better align with assessment goals
• Assumptions: Confirm that any assumptions inherent in the question are explicitly stated and clear to the candidate. If assumptions are missing or unclear, the consultant may suggest adding them to ensure that candidates have the necessary context
• Definitions: Ensure that key terms, variables, and concepts are clearly defined within the question, particularly if they are not common knowledge. Feedback may include suggestions to clarify or add definitions where needed to avoid ambiguity
• Inclusivity: Suggest improvements to avoid biases and ensure the question is inclusive, offering an equal opportunity for candidates from diverse backgrounds to succeed
• Solution Completeness: Assess whether the step-by-step solution provided is thorough and easy to follow. They might suggest additional explanations or alternative approaches to help candidates understand the problem better
• Iterative Refinement: Collaborate in the continuous improvement of questions by refining them based on feedback cycles, ensuring the highest standards of quality and relevance are maintained throughout the project
• Communication: Maintain consistent communication, providing updates on your progress and ensuring alignment with project goals and deadlines
• Work Independence: Demonstrate the ability to work independently, adhere to project timelines, and meet deadlines without supervision

Benefits

Compensation varies depending on the type and complexity of the question. An estimated flat rate per question is $30-50