interviewer training

Interviewer Training: A Programme for Scaling Teams

·6 min read
Interviewer Training: A Programme for Scaling Teams

The short answer

Interviewer training teaches the people who interview candidates to ask structured questions, collect evidence, score it against a shared rubric and stay within the law. A good interviewer training programme has four parts: a short course, shadowing, reverse shadowing and regular calibration, and it signs people off before they interview alone. For a company hiring fast, it is the cheapest way to keep the bar consistent as the number of interviewers grows.

  • Teach the role scorecard, structured questions, note-taking, scoring and the legal basics.
  • Shadow two or three interviews, then be shadowed two or three times, before interviewing alone.
  • Calibrate monthly: score the same answer independently, then discuss the gaps.
  • Train on bias with specific rules (same questions, score before discussing, no protected-characteristic questions) as well as general awareness.
For hiring teams

Cohesyve tests candidates on simulations of the real work before interviews. It is our product.

Interviewer training is the work of teaching the people on your interview panels how to run a fair, structured interview, collect evidence and score it consistently. Most companies skip it while they are small because the founders and early managers do all the interviewing. Then hiring speeds up, dozens of new interviewers join the rota, and the hiring bar quietly becomes whatever each interviewer thinks it is.

This guide sets out an interviewer training programme sized for a fast-growing company: what to teach, how shadowing and calibration work, how to certify interviewers, and how to handle bias in practice.

What is interviewer training?

Interviewer training is a short, structured programme that prepares employees to interview candidates. It covers the role scorecard, question design, how to probe for evidence, note-taking, scoring, the debrief, the candidate experience and the legal limits on what can be asked. It usually ends with sign-off before the person interviews alone.

Why interviewer training matters when you scale

Three things happen when a company starts hiring quickly.

  • The number of interviewers grows faster than the number of experienced interviewers. Many new interviewers have only just been hired themselves.
  • Scoring drifts. One interviewer's "strong" is another's "fine", and debriefs turn into debates about personalities.
  • Legal risk rises. More interviews, run by more people, means more chances for a question that should not be asked.

A training programme fixes all three cheaply. It also improves the candidate experience, because trained interviewers are better prepared, on time and clear about the process.

For hiring teams

Trained interviewers do best with evidence in front of them

Cohesyve sources candidates, tests them on AI simulations of the real work and returns a ranked shortlist, so your interviewers spend their time probing evidence instead of screening.

What should an interviewer training programme cover?

ModuleWhat interviewers learnFormat
The hiring barThe competencies for each role and what evidence shows themShort session with the scorecard
Structured interviewingAsking the same core questions, in order, to every candidate for a roleSession and practice
ProbingFollow-up questions that get to specifics: what exactly did you do, what happened nextRole play
Note-takingWriting down what was said, not impressionsPractice with a sample interview
ScoringScoring each competency against anchors, before reading anyone else's viewCalibration exercise
The debriefPresenting evidence, changing your mind, avoiding groupthinkObserved debrief
Legal basicsWhich questions are off limits where you hireShort session, with counsel's guidance
Candidate experienceOpening, timing, selling the role honestly, closingShort session

Our structured interview guide, interview scoring rubric template and interview scorecard template are good course material.

How does interviewer shadowing work?

Shadowing means a new interviewer sits in on interviews run by an experienced one, then the roles reverse. A common pattern is two or three shadow sessions followed by two or three reverse-shadow sessions, in which the new interviewer leads and the experienced one observes and gives feedback.

During shadowing, ask the new interviewer to take notes and score independently, then compare scores with the lead interviewer afterwards. The differences are the most useful part of the exercise.

A shadowing checklist

  • Before the interview: read the scorecard and the question set together.
  • During: the shadow takes full notes and scores each competency.
  • After: compare scores competency by competency and discuss any gap of more than one point.
  • In reverse shadow: the experienced interviewer watches for leading questions, missed follow-ups and over-talking.
  • Sign-off: the experienced interviewer confirms the new one is ready, or asks for another round.

How to run interview calibration

Calibration is the regular habit of making sure interviewers score the same evidence the same way. Without it, even well-trained interviewers drift apart over time.

A simple monthly session works well:

  1. Pick a written or recorded answer (with the candidate's consent, or a mock answer written for training).
  2. Everyone scores it alone, against the scorecard anchors.
  3. Reveal the scores together.
  4. Discuss the largest gaps: what evidence did each person see?
  5. Update the anchors if they were unclear.

Track each interviewer's scores over time. Someone who rates almost every candidate highly, or almost every candidate poorly, needs a conversation and perhaps more calibration.

What is interviewer certification?

Interviewer certification is a formal sign-off that someone can interview alone for a type of role or a specific competency. It turns training into a clear standard: you are either certified for, say, the system design interview or you are not.

LevelWhat they can doHow to reach it
In trainingShadow onlyComplete the course
CertifiedInterview alone for a specific stageShadow and reverse shadow, signed off
LeadRun debriefs and train othersCalibrated over time, nominated
Bar raiserJoin loops outside their team to protect the standardSelected and trained further

Certify by stage. Someone can be certified for the behavioural interview and still be in training for the technical one.

How to train interviewers on bias

General awareness sessions alone tend to change little. Specific rules built into the process do more. Teach these as part of the course and enforce them through the scorecard.

  • Ask every candidate for a role the same core questions. It makes answers comparable.
  • Score before you discuss. Each interviewer submits scores before the debrief, so the first or loudest voice does not set the result.
  • Score evidence. "Explained how they cut the deploy time and what they would change" is evidence. "Good energy" is not.
  • Do not ask about protected characteristics. In the US, laws enforced by the EEOC protect race, colour, religion, sex (including transgender status, sexual orientation and pregnancy), national origin, age (40 or older), disability and genetic information, and the EEOC says employers may not ask about disability before making a job offer. In the UK, the Equality Act 2010 covers nine protected characteristics, and GOV.UK guidance tells employers not to ask about them, about marital or civil partnership status, or about plans to have children. Health questions are allowed only in limited cases, such as asking whether a candidate needs adjustments for an interview or test.
  • Watch for "culture fit" as a reason. Ask what specific behaviour on the scorecard the concern relates to.

Rules differ by country and change, so have your legal adviser review the legal module. Our guide to unconscious bias in recruitment goes further.

A four-week programme (illustrative)

This is an example schedule for a company adding many new interviewers at once. Adjust it to your volume.

WeekActivity
1Course: the bar, structured questions, notes, scoring, legal basics
2Two or three shadow interviews, with independent scoring and comparison
3Two or three reverse-shadow interviews, with feedback
4Sign-off, first solo interviews, first calibration session

After certification, every interviewer joins a monthly calibration session and gets feedback from debriefs.

Measuring whether interviewer training works

  • Score spread between interviewers on the same candidates. It should narrow.
  • Debrief length and quality. Debriefs should focus on evidence and finish faster.
  • Interview-to-offer rate. A very low rate can mean weak screening before interviews; a very high one can mean a soft bar.
  • Quality of hire by interviewer panel. See quality of hire metrics.
  • Candidate feedback on how prepared and respectful interviewers were. See how to improve candidate experience.

Where Cohesyve fits

Training makes interviewers better at using interview time. Cohesyve helps make sure the time goes to the right people. It sources candidates, tests them on AI simulations of the real work and returns a ranked shortlist before interviews, so trained interviewers can spend their questions probing evidence the candidate has already produced.

Frequently asked questions

How long should interviewer training take?

For most companies, a short course plus a few shadow and reverse-shadow interviews, completed over a few weeks, is enough to certify someone for one stage. Calibration then continues for as long as they interview.

Who should deliver interviewer training?

Usually the talent acquisition team, with experienced interviewers from each function running shadowing. Legal content should be reviewed by counsel.

What is reverse shadowing?

The new interviewer leads the interview while an experienced interviewer observes and gives feedback afterwards.

Do hiring managers need interviewer training?

Yes. Hiring managers interview more than anyone and often run the debrief, so they benefit most from structured questioning and evidence-based scoring.

How often should interviewers calibrate?

Monthly is a good default while hiring is fast, and whenever a new role or scorecard is introduced.

For hiring teams

Trained interviewers do best with evidence in front of them

Cohesyve sources candidates, tests them on AI simulations of the real work and returns a ranked shortlist, so your interviewers spend their time probing evidence instead of screening.

1,500+

assessments completed

50%

faster time-to-hire

5 min

from JD to assessment

14-day free trial · 10 candidates · Not charged until the trial ends

For job seekers

Job hunting yourself? Practise on AI job simulations of the real work. 3-day free trial, cancel anytime.

Practise for interviews with a simulation →

See Cohesyve in action

Free 30-min walkthrough

See it on your role