Assessment Reviewer/Consultant

Correlation One develops the workforce’s skills for the AI economy

Enterprises and governments work with us to develop talent and close critical data, digital, and technology skills gaps. Our global programs, including Data Skills for All (DS4A) and data competitions, also empower underrepresented communities and accelerate careers.

Our mission is to create equal access to the data-driven jobs of the future. We partner with top employers and government organizations to make that a reality, including Amazon, Coca-Cola, Johnson & Johnson, USAID, U.S. Department of State, and the U.S. Department of Defense.

Our skills training programs are 100% free for learners and are delivered virtually by industry experts to minimize traditional barriers to career advancement. We take pride in fostering supportive, human-led, group learning environments that build technical proficiency and confidence in participants.

Join us and let's shape the AI Economy together!

Program/Contract Specific Information

As an Assessment Consultant/Reviewer, you will leverage your expertise to review assessment questions designed to evaluate internal job candidates. These questions cover a variety of topics, including data analysis, financial modeling, and trading algorithms, with a strong focus on mathematical and statistical concepts. Your role is critical in ensuring the quality, accuracy, and relevance of these assessments, which test candidates' abilities to apply advanced techniques.

You are expected to provide quick, comprehensive feedback on assigned questions. Your ability to identify areas for improvement and suggest multiple refinements ensures questions align with both client needs and Correlation One's content quality principles.

This is a part-time, as-needed contract position. You can expect anywhere from 3-10 hours of work per week during active projects, with some periods of heavier or lighter workloads depending on the project cycle.

Key Responsibilities

• Expert Question Review and Detailed Feedback: The consultant will deliver quick, in-depth feedback focused on improving assessment questions across several dimensions. Here are the key areas they may provide feedback on:

1. Accuracy: Ensure the question is factually correct and mathematically sound, with no errors in logic, calculations, or assumptions.
2. Clarity and Readability: Assess whether the question is clear, concise, and easy to understand. Complex questions should be worded in a way that avoids ambiguity and confusion.
3. Multiple Solution Paths: Identify and evaluate whether the question allows for different valid approaches to solving the problem. They may suggest revisions to encourage creative or alternative methods of problem-solving.
4. Difficulty Level: Confirm that the difficulty level is appropriate for the intended assessment. Feedback may include how to adjust the complexity to better match the target candidate’s expertise.
5. Relevance to Job Role: Ensure the question is directly related to the specific skills or knowledge required for the job the assessment is targeting. If the question isn't job-relevant, they may suggest revisions to make it more applicable.
6. Grammar and Syntax: Check for grammatical errors, awkward phrasing, or misused terminology that could detract from the question’s quality and comprehension.
7. Answer Choices (for multiple-choice questions): Evaluate whether distractors are plausible yet distinguishable from the correct answer. Distractors should neither be too easy nor irrelevant.
8. Conceptual Coverage: Ensure the question effectively tests the concepts it aims to assess. Feedback may include suggestions to expand, narrow, or modify the focus of the question to better align with assessment goals.
9. Assumptions: Confirm that any assumptions inherent in the question are explicitly stated and clear to the candidate. If assumptions are missing or unclear, the consultant may suggest adding them to ensure that candidates have the necessary context.
10. Definitions: Ensure that key terms, variables, and concepts are clearly defined within the question, particularly if they are not common knowledge. Feedback may include suggestions to clarify or add definitions where needed to avoid ambiguity.
11. Inclusivity: Suggest improvements to avoid biases and ensure the question is inclusive, offering an equal opportunity for candidates from diverse backgrounds to succeed.
12. Solution Completeness: Assess whether the step-by-step solution provided is thorough and easy to follow. They might suggest additional explanations or alternative approaches to help candidates understand the problem better.

• Iterative Refinement: Collaborate in the continuous improvement of questions by refining them based on feedback cycles, ensuring the highest standards of quality and relevance are maintained throughout the project.
• Communication: Maintain consistent communication, providing updates on your progress and ensuring alignment with project goals and deadlines.
• Work Independence: Demonstrate the ability to work independently, adhere to project timelines, and meet deadlines without supervision.

Your expertise (qualifications)

• Master’s or higher degree in Mathematics, Statistics, Data Science, or a related field,
• Industry Experience: Over 3 years of experience in a quantitative research or finance role is preferred, particularly in data-driven environments such as quantitative trading or financial modeling.
• Attention to Detail: Strong capability to assess multiple plausible solutions, ensure accuracy, and provide feedback that covers both content and presentation, including grammar and phrasing.

• Communication Skills: Strong written and verbal communication skills, essential for delivering high-quality feedback and interacting with team members effectively.

• Proficiency in one (or both) of the following domains:

  • Mathematics
  • Statistical Processes
  • Statistical Modeling
  • Classical Probability
  • Permutations and Combinations
  • Brain Teasers
  • Number Theory
  • Linear Algebra
  • Data Science
  • Algorithms
  • Machine Learning
  • Artificial Intelligence
  • Data Analysis
  • Information Processing
  • Logical Reasoning
  • Data Engineering

Where you are

• This role is remote and can be located anywhere that is compatible with the EST time zone.

Compensation

• Compensation varies depending on the type and complexity of the question.
• An estimated flat rate per question is $30-50.

The flat rate includes writing and rewrite (based on feedback).

Rate

Type of Complexity

$30

Updated question; Difficulty Level: Easy

$35

Updated question; Difficulty Level: Hard

$40

New Question, Difficulty Level: Easy

$45

New Question, Difficulty Level: Medium

$50

New Question, Difficulty Level: Hard

Note: Our assessments range from 20-50 questions.

Correlation One’s Commitment

Correlation One is proud to be an Equal Opportunity Employer and is committed to providing equal opportunity for all employees and applicants. Correlation One provides a work environment free of discrimination and harassment. Employment decisions at Correlation One are based solely on business needs, job requirements and individual qualifications, without regard to race, color, religion or belief, national, social or ethnic origin, sex (including pregnancy), age, sexual orientation, gender identity and/or expression, marital, civil union or domestic partnership status, past or present military service, or any other status protected by the laws or regulations in the locations where we operate. We encourage applicants to bring their unique skills, experiences, and outlook to our work environment.

Correlation One is committed to the full inclusion of all qualified individuals. In keeping with our commitment, Correlation One strives to provide reasonable accommodations for persons with disabilities to enable them to access the hiring process. If you need an accommodation to access the job application or interview process, please contact [email protected].