Reviewer in Training Program

Program Parameters

Participants in the Mentee role will be assigned up to three applications to review based on their self-declared ability to review. Mentees will also be assigned a Mentor who will be available to provide advice and support throughout the review process. Mentees must submit their reviews to their Mentor at least 2 weeks before the meeting for the Mentor to provide feedback on review quality. Mentees will attend the committee meeting in its entirety, where they will have an opportunity to present one review noting that only the most competitive applications are discussed at a committee meeting. They will not participate in the final scoring of any application, nor in the budget discussion. The meeting participation parameters may vary to fit the committee context while still achieving the principles of the program.

Eligibilty

• Must meet CIHR's definition of an ECR on the application deadline for the Project Grant Competition;
• Must hold a position at an eligible Canadian institution on the application deadline for the Project Grant Competition;
• Must not have previously participated in the RiT Program;
• Must not have previously reviewed for the Project Grant competition; and
• Must not be Full College Members.

Mentorship

The College of Reviewers has developed a guide for Mentees to help facilitate the mentorship process during the RiT Program. This guide will be provided to you prior to the committee meeting.

Roles and Responsibilities

Before the meeting

The Mentee will:

• Complete mandatory learning modules on:
  • Bias in Peer Review;
  • Conducting Quality Reviews; and
  • One of the following modules based on their methodological expertise:
    • Introduction to Sex and Gender Considerations in Basic Science
    • Introduction to Sex and Gender Considerations in Clinical and Epidemiological Research
  • Participants in the Indigenous Health Research (IHR) committee must also complete:
    • Background context on Indigenous Health Research
    • Research Involving First Nations, Inuit and Métis Peoples of Canada (TCPS 2 Chapter 9) – Webinar
• Visit CIHR's Skill Builders webpage for interactive exercises on areas they wish to sharpen their skills for the peer review process. Suggested exercises include:
  • Appropriate Reviews with High Utility;
  • Writing Relevant Reviews;
  • Writing Robust Reviews; and
  • Aligning the Review Scores and Comments.
• Declare any conflict of interest and confirm their ability to review through ResearchNet;
• Complete practice reviews for up to three applications based on their self-declared expertise;
• Submit their practice reviews two weeks in advance of their committee meeting to receive advice and feedback from their mentor;
• Prepare to present their reviews at the meeting, noting that not all applications are discussed at a committee meeting; and
• Familiarize themselves with all other applications to be assessed by their committee to facilitate discussions at the committee meeting.

Important: While a Mentee can ask their Mentor questions about the review process and review quality as it pertains to their practice review, scientific opinions and/or merit of an application should not be the focus.

During the meeting

The Mentee will:

• Attend the committee meeting in its entirety;
• Present their review and preliminary score as scheduled in the meeting agenda and sequence of steps;
• Compare their practice score with the consensus score; and
• Participate in the committee discussions for other applications.

Note: Mentees will not be able to ask their Mentor questions during the meeting as they will be occupied with other tasks (CIHR staff remain available at all times). They will also not participate in the consensus discussion or final scoring of any application, and do not participate in the budget discussion of any application.

After the meeting

The Mentee will:

• Arrange a meeting with their Mentor to debrief on their experience (if schedules allow);
• Be promoted to peer review processes at CIHR and participate when available; and
• Be invited to become an Associate Member if they meet the program's eligibility criteria.

Review Quality Assurance

After participating in the committee meeting, the Chairs, Scientific Officers and CIHR staff will provide feedback on Mentees using a similar approach to CIHR's standardized Reviewer Quality Feedback form. Mentees will receive feedback based on the Review Quality Checklist and their performance during the peer review process. This letter will state one of the following outcomes:

1. Overall, the Mentee exceeded the expectations in all areas of the RiT Program: Review Quality, Participation, and Responsiveness.
2. Overall, the Mentee met the expectations in all areas of the RiT Program: Review Quality, Participation and Responsiveness.
3. The Mentee did not meet the criteria in one or more areas of the RiT Program: Review Quality, Participation, and/or Responsiveness.

The purpose of this feedback is to help Mentees build on their experiences in the RiT Program and apply their learning to future peer review opportunities.

Program Parameters

Participants in the ECR Reviewer role will be assigned up to five applications to review based on their self-declared ability to review. ECR Reviewers must submit their reviews in accordance with committee deadlines. ECR Reviewers will attend the peer review meeting in its entirety, present their reviews, and participate in the committee meeting discussions including final consensus ratings, individual voting, and budget assessment. ECR Reviewers will present their assigned applications later in the meeting, and will have access to all of the supportive resources that CIHR provides to committee members.

Eligibility

• Must meet CIHR’s definition of an ECR on the application deadline for the Project Grant Competition;
• Must hold a position at an eligible Canadian institution on the application deadline for the Project Grant Competition;
• Must have at least one recent federally funded peer reviewed research grant (or equivalent) as a Principal Investigator;
• Must not have previously participated in the RiT Program as an ECR Reviewer;
• Must not have previously reviewed for the Project Grant competition; and
• Must not be Full College Members.

Applicants who have previously participated as a Mentee, and now meet these criteria, are eligible to participate as an ECR Reviewer.

Roles and Responsibilities

ECR Reviewers will follow the same roles and responsibilities as regular reviewers as outlined in the Project Grant manual except where differences are noted below. Briefly:

Before the meeting

The ECR Reviewer will:

• Complete the learning modules on:
  • Bias in Peer Review;
  • Conducting Quality Reviews; and
  • One of following modules based on their methodological expertise:
    • Introduction to Sex and Gender Considerations in Basic Science
    • Introduction to Sex and Gender Considerations in Clinical and Epidemiological Research
  • Participants in the Indigenous Health Research (IHR) committee must also complete:
    • Background context on Indigenous Health Research
    • Research Involving First Nations, Inuit and Métis Peoples of Canada (TCPS 2 Chapter 9) – Webinar
• Visit CIHR's Skill Builders webpage for interactive exercises on areas they wish to sharpen their skills for the peer review process. Suggested exercises include:
  • Appropriate Reviews with High Utility;
  • Writing Relevant Reviews;
  • Writing Robust Reviews; and
  • Aligning the Review Scores and Comments.
• Declare any conflict of interest and confirm their ability to review through ResearchNet;
• Evaluate and provide initial ratings on up to five assigned applications based on their self-declared ability to review;
• Prepare to present their reviews at the meeting, noting that not all applications are discussed at a committee meeting; and
• Familiarize themselves with all other applications to be assessed by their committee to facilitate discussions at the committee meeting.

During the meeting

The ECR Reviewer will:

• Attend the committee meeting date(s) in their entirety;
• Present to the committee their review of their assigned applications (presented later in the meeting);
• Participate in the committee discussions; and
• Vote on all the applications discussed by the committee and for which they are not in conflict.

After the meeting

The ECR Reviewer will:

• Have the option to revise their reviews within 5 business days after the end of the committee meeting;
• Be promoted to peer review processes at CIHR and participate when available; and
• Be invited to become an Associate Member if they meet the program's eligibility criteria.

Review Quality Assurance

After participating in the committee meeting, the Chairs, Scientific Officers and CIHR staff will provide feedback on ECR Reviewers using CIHR's standardized Reviewer Quality Feedback form. ECR Reviewers will receive feedback based on the Review Quality Checklist and their performance during the peer review process. This letter will state one of the following outcomes:

1. Overall, the ECR Reviewer exceeded the expectations in all areas of the RiT Program: Review Quality, Participation, and Responsiveness.
2. Overall, the ECR Reviewer met the expectations in all areas of the RiT Program: Review Quality, Participation and Responsiveness.
3. Overall, the ECR Reviewer did not meet the criteria in one or more areas of the RiT Program: Review Quality, Participation, and/or Responsiveness.

Mentorship

The College of Reviewers has developed a guide for Mentors to help facilitate the mentorship process during the RiT Program. This guide will be provided to you prior to the committee meeting.

Roles and Responsibilites

Before the meeting

The Mentor will:

• Be assigned a Mentee by CIHR staff in collaboration with committee executives;
• Be introduced to the Mentee and will be asked to make themselves available to answer questions through MS Teams;
• Read and assess the review quality of the practice reviews prior to the meeting; and
• Provide Mentee with constructive feedback on review quality in advance of the meeting.

Important: While you can answer questions about the review process, review quality, and provide feedback on the practice reviews, scientific opinions and/or merit of an application should not be the focus.

During the meeting

Formal mentorship stops however, the Chair and Scientific Officer will:

• Explain Mentee's participation parameters at the start of the meeting during the sequence of steps presentation;
• Encourage and make space in the meeting for the Mentee to actively participate;
• Observe the Mentee's participation throughout the committee meeting; and
• Record the Mentee's comments during the discussion as anything they say will have an influence on the final consensus.

After the meeting

The Mentor will:

• Arrange a meeting with their Mentee to debrief on their experience (if schedules allow).

Roles and Responsibilities

CIHR staff will be available to answer questions and support both the Mentees, Mentors, and ECR Reviewers throughout the RiT Program.

Before the meeting

CIHR staff will:

• Introduce the Mentee and Mentor, providing them with an environment to collaborate (MS Teams);
• Assign Mentees up to 3 Project Grant applications for review (up to 5 applications assigned to ECR Reviewers);
• Provide access to appropriate learning materials and webinars; and
• Provide Mentee and Mentor Guide instructions that outline meeting participation parameters.

During the meeting

CIHR staff will:

• Ensure that the Mentee presents their review as scheduled in the agenda and sequence of steps; and
• Ensure that the Mentee follows meeting participation parameters.

After the meeting

CIHR staff will:

• Collect Review Quality Feedback forms from Chairs and Scientific Officers;
• Provide RQA feedback to Mentees and ECR Reviewers; and
• Collect feedback from all participants about their experience with the program.