The Science Behind the Assessments

You heard it here first: All assessments are not created equal!

Test Delivery and Administration

Brainbench assessments are all delivered via a state-of-the-art online technology. Completely redesigned and implemented in 2004, this technology allows us to implement the latest test types, including CAT and online simulations, to administer combinations of different tests all in one test event, and to provide reporting tuned to your needs.

Brainbench skill tests use Computer Adaptive Testing (CAT). This innovative technology applies the latest in testing theory to give you the most meaningful and accurate readings of a person's knowledge level possible.

Test Development Process

Brainbench assessments are all developed by qualified professionals in accordance with recognized guidelines published by the American Psychological Association (APA), the Society for Industrial Organizational Psychologists (SIOP), and the US. Department of Labor.

Each test is developed by qualified subject-matter experts according to a carefully defined process. For example, here is a summary diagram of the process we use to develop our knowledge and skills tests:

Ongoing Research and Continuous Optimization

Our in-house psychologists oversee the development, use, and maintenance of all of our products and are responsible for ensuring adherence with professional standards. As more data becomes available on each instrument, we apply this information quickly to refine the instrument. This continuous optimization process ensures that you are always using the best instruments science has to offer in making your most important decisions.

We continuously monitor several key dimensions of each assessment, including the following:

1. Validity — Test validity refers to how effectively an assessment measures what it is supposed to measure. Does a computer programming language test really measure the important aspects of the language? Does a personality test really measure the factors it is supposed to measure. Brainbench continually collects evidence of validity in accordance with APA Standards.
2. Reliability — Test reliability is a sub-component of validity which refers to consistency of scores. Brainbench uses inter-item consistency to ensure that all components of a single assessment support the overall measurement and meet professional standards.
3. Disparate Impact — It's important to ensure that an assessment does not unfairly discriminate against protected groups. While this is always a function of both the instrument and the candidate pool for a specific job, Brainbench constantly collects and analyzes data that we use to assist our clients in interpreting results.
4. Face Validity — This refers to the questions themselves and the impression these questions make on the test taker. While not a direct measure of scientific quality, Brainbench has found that the test taker's opinion of the test and its relevance to the purpose it is used for are very important.
5. Individual Question Performance — For more than 75% of our tests, we use a computer adaptive testing (CAT) algorithm. This testing approach ensures the highest possible validity and reliability and is based on the individual performance of each question, which we monitor regularly. For additional information on our CAT engine, you can download our CAT Technical Manual.

Technical Manuals

Technical manuals for our assessments are available upon request. These manuals clearly describe how each test was constructed and reflect the results of research regarding the use of each test. Each manual is written in clear, concise language. For many assessments, we also have results interpretation guides available.