B-PAD is a highly structured candidate assessment system that improves upon traditional oral boards by using video as the main tool to assess a candidate’s behavioral traits. Professionally produced videos present real world scenarios that accurately represent difficult situations encountered by those employed in public safety positions. The process begins with a candidate viewing a recorded scenario. The video pauses at key decision-making points and the candidate has the opportunity to present to the panel members how he or she would achieve a successful resolution of the presented situation.

Advantages of using video in oral boards

  • Improved standardization, fairness, and reliability over traditional oral boards
  • Standardized, accurate simulation of real-world, on-the-job incidents
  • Consistency - no variations in scenario descriptions
  • Candidate does most of the talking
  • Ethnicity, gender and prior job experience do not affect B-PAD results
  • Saves time and money by efficiently screening large numbers of candidates.

Standardized testing and scoring avoid many shortfalls inherent in traditional oral boards

  • Rater’s tendency to favor a candidate perceived to be most like the rater
  • Rater’s tendency to follow the opinions of the ranking panel member
  • Rater’s tendency to either use exclusively or completely avoid, the middle range of scoring
  • Rater’s tendency to base scoring on other candidate scores
  • Influence of rater’s mood and personal biases

The B-PAD test measures behavioral competence in three key areas:

  • Problem solving
  • Interpersonal skills
  • Ethical decision-making

The B-PAD product design derives from the basic tenet of "behavioral consistency" -- that the best predictor of future, on-the-job performance is performance already observed under similar circumstances.

The B-PAD design contains the following key features:

  • Realistic reenactments of actual on-the-job incidents not only allow for maximum standardization of the test stimulus, but also optimize what is known as the “frame of reference effect” (i.e., the more the candidate is able to place him- or herself in a specific work situation while responding to the test, the more predictably valid the test).
  • Standardized scenarios, questions and scoring criteria for all candidates.
  • After viewing the recorded scenario, a candidate responds to questions from the oral board panel, explaining how best to achieve successful resolution of the situation presented in the video. The rating panel does not provide scenario descriptions - the candidate does most of the talking. This process allows the candidate to demonstrate the key competencies in real-time.
  • Candidates cannot improve scores with exposure, and experienced applicants score no better than entry applicants. The required response is open-ended, minimizing guessing from four choices.

The seminal research of Goldfried and D’Zurilla in the 1960s established that the most desirable method for assessing competency involves posing specific problems and analyzing one’s ability to resolve them. B-PAD applies this, and later research, to effect a significant improvement in overall validity of the candidate evaluation process.

There are two fundamental components to the successful--that is, valid--use of B-PAD as a predictor of on-the-job performance:

  • Proper, standardized administration of the test
  • Proper application of the scoring criteria to the applicant’s responses

The result: a standardized, defensible test, costing far less time and money than traditional oral boards or assessment centers that provides a clear indication of how candidates will handle real-life problems encountered in their everyday work lives. Responses are a highly indicative of a candidate’s judgment, decision-making and interpersonal skills, common sense, and ability to communicate effectively.

B-PAD Test Construction & Validation

B-PAD video tests assess an applicant’s interpersonal skills, judgment and ethical decision-making. Video scenarios present standardized, realistic, job-relevant situations eliciting a rich and wide variety of candidate responses. These responses provide an accurate prediction of future work behavior. Each test consists of three or four scenarios, selected from a larger pool of scenes, to ensure assessment of each applicant’s competence across an appropriate range of situations. In testing parlance, B-PAD is a “high fidelity test” that uses realistic representations of task situations and provides applicants with an opportunity to resolve situations in real time.

Toward the goal of creating a video test that samples an adequate range of job-relevant competence, the construction of each B-PAD video test began with the collection of numerous problematic vignettes, obtained from numerous agencies, departments and experts in the field. Scenarios were gathered from a diverse group of subject matter experts (SMEs) including women, ethnic minorities, and professionals with urban and rural experience, line employees, supervisors and administrators. Additional SMEs were used to rate written scripts based on realism, importance and difficulty. SME input and the need for a representative range of situations were considered in making the final decision about which scenes to produce on video. Each vignette also reflects a job function regarded by the SMEs as essential. Once the scenes were selected, their scripts were refined, storyboards were developed, actors and actresses were chosen, and the scenes were professionally produced.

The validation and reliability-testing procedures used by THE B-PAD GROUP are conducted in accordance with the “Standards for Educational and Psychological Testing” published jointly by the American Educational Research Association, the American Psychological Association, and the National Council on Measurement in Education. In addition, the procedures comply with the “Principles for the Validation and Use of Personnel Selection Procedures” published by the Society for Industrial and Organizational Psychology. Selected research briefs addressing validity, reliability, adverse impact, and other issues are attached. These research briefs [Research Briefs] were conducted using the original BPAD video format and may or may not apply to the new oral board format.




The B-PAD Testing Procedure and Scoring

Applicants taking a B-PAD video test are seated before a video monitor. After receiving instructions orally, they are presented a series of video simulations selected from a larger pool of available scenes. This new process combines video-testing technology presenting real-life situations with traditional oral interviews that can assess a candidate’s spontaneous response to a situation.

B-PAD advantages:

  • Pinpoints candidates who can solve problems and work effectively with the public.
  • Emphasizes action and follow-up questions.
  • Provides standardization, fairness, and reliability.
  • Avoids ethnic or gender bias according to studies on video-testing.
  • Offers easy, real-time scoring and results.

Candidates are observed in action as they respond to a series of “job-related” scenarios supplemented by follow-up questions from the interviewer. Additional questions from your agency may enhance the ones created by B-PAD. In-house personnel numerically rate each candidate utilizing scoring criteria based on an evaluation of core competencies.

Job-relevant video scenarios, rich in visual and auditory information, assess competencies such as problem solving, interpersonal skills, and ethical decision-making.

We are confident that B-PAD will enable you to effectively screen and evaluate law enforcement candidates in order to find the most qualified people for your organization.

The Guidebook has added optional Linkage Forms (Appendix C) so each agency may add or change the questions related to each scenario. Using the Linkage Form to add agency questions provides a dynamic ability to tailor the test process to each agency’s requirements.

The result of the interviews is a clear indication of how candidates will handle real-life problems encountered in their everyday work lives. Responses will highlight candidates’ judgment, common sense, and their ability to communicate effectively.

This all-inclusive, comprehensive Guidebook, along with the videos depicting different scenarios, is all you need to effectively conduct the B-PAD interview; however, the B-PAD staff is available for onsite training of up to 20 raters in one day, if necessary.

Included are:

  • Definitions of three core competencies upon which candidates will be judged: Problem-solving, interpersonal skills and ethical-decision making.
  • B-PAD interview sheets with questions for each scenario.
  • Recommended strong and weak responses to each situation.
  • Optional Linkage Forms to develop additional questions.
  • Proctoring and training instructions for giving and scoring the B-PAD for Oral Boards.