Dear customer,
We have received recent feedback from customers who have reported concerns with the WISC®–V Coding subtest. This subtest, when administered with digital stimulus and responses (i.e., in digital format), has the potential to produce elevated scores in certain circumstances. In response to this feedback, we have conducted an in-depth review to understand more about these concerns.
WISC–V Coding Analysis in Digital Format
Our analyses have demonstrated that, for the Coding subtest in digital format, the average scaled score is currently slightly inflated (relative to the mean of the nine other primary subtest scaled scores) to varying degrees across countries where it is used. Our review indicates that the level of inflation rose at the end of 2019 in relation to a baseline period in 2018. The data indicate that the average scaled score inflation first appeared in Scandinavian countries, and that at the end of 2019 a discernable pattern of inflation began to emerge in the United States and Canada.
Further analyses showed the common thread connecting elevated scores was administration using newer model iPad® devices. With more quality assurance testing and analysis, it has become clear that newer model iPads and recent operating system (iOS) upgrades have increased the speed that Coding items are presented. For examinees who are progressing quickly, more items can potentially be presented during the Coding subtest administration on newer model iPads. Consequently, the examinee could obtain an inflated scaled score. This is because the normative data were collected on the most recent versions of iPads in 2015 and 2016 and that hardware potentially presented fewer items during the allotted time of the administration than more recent models and operating systems are doing now.
The results observed for the WISC–V Coding in digital format led our team to also review the scores for the Symbol Search subtest. This analysis demonstrated that, in contrast to Coding, Symbol Search in digital format produces scaled scores that are highly consistent with those of the remaining primary WISC–V subtests and are distributed similarly across all countries, including the United States. The Symbol Search task is constructed differently than Coding and appears less vulnerable to the effects of iPad model and iOS
Actions to Address the Issue
New code is being written that removes the influence of the hardware’s processing speed and efficiency of its operating system. This will align the timing and presentation of the items so that the speed and cycle of presentation are consistent across device types and closely align with those present at standardization.
This code will be released as a content update in the near future. Once released, we encourage you to make the content download a priority and update your Q-interactive® Assess App as soon as possible.
Alternate Administration Option on Q-interactive
If you are concerned about potentially higher Coding digital format scores, another option is to complete the Coding subtest in paper format and manually enter the scores into the Assess app. To use this approach, swipe past the Coding cover card at the beginning of the subtest. The Stimulus and Response Options popover will appear for you to make a selection before proceeding with administration. Select Paper response booklet within the popover window. Using this method, you may still administer the other WISC–V subtests via digital format, however, you must administer Coding using a paper response booklet. Once administration is complete, enter the total raw score achieved using the paper response booklet into Q-interactive at the end of the subtest. Q-interactive references the norms derived from Coding administered in paper format to generate a scaled score and all typical composite scores.
To aid this paper administration, customers will be provided with access to a printable PDF of Coding Form A and Form B on the Support Tab in Q-central. Ensure your printer has adequate black ink, and print the file using the highest resolution available to ensure the stimuli are similar to those in the printed response booklet. When printing, ensure that "Actual size" is selected and not "Fit," or the scoring template will not match up.
Customers that do not have access to the scoring template can order one free of charge by following these steps:
Send an email to: clinicalcustomersupport@pearson.com
Use subject line: FREE WISC–V Coding Scoring Template
Include in email: Name, Organization/Residence, Street Address, City, State, Zip Code and
Item number: 0158978560 - WISC-V CODING SCORE TEMPLATE
We appreciate all of the input from our customers who helped discover this issue and apologize for any inconvenience it may have caused. We are all learning to appreciate the benefits and challenges our digital world brings us as technology evolves.
For additional insight and guidance regarding this issue, please read the FAQ paper that will be posted on the Support Tab in Q-central at the time of the content update. The development of valid, reliable tools to aid the understanding of your client’s needs is our priority and we are committed to ensuring their quality for your use.
If you have any additional questions or concerns, please feel free to email us at clinicalcustomersupport@pearson.com and use the Subject Line: WISC–V Coding Question.
Regards,
Your Q-interactive and WISC–V Teams
|