Evaluation of the validity of the Psychology Experiment Building Language tests of vigilance, auditory memory, and decision making

Albright College, Brunswick, United States
Cognitive and Learning Sciences, Michigan Technological University, Houghton, MI, United States
Department of Biology, Husson University, Bangor, ME, United States
School of Pharmacy, Husson University, Bangor, ME, United States
DOI
10.7287/peerj.preprints.1330v1
Subject Areas
Psychiatry and Psychology, Human-Computer Interaction
Keywords
Attention, Decision making, Iowa Gambling Task, Short-term memory
Copyright
© 2015 Piper et al.
Licence
This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, reproduction and adaptation in any medium and for any purpose provided that it is properly attributed. For attribution, the original author(s), title, publication source (PeerJ PrePrints) and either DOI or URL of the article must be cited.
Cite this article
Piper B, Mueller ST, Talebzadeh S, Ki MJ. 2015. Evaluation of the validity of the Psychology Experiment Building Language tests of vigilance, auditory memory, and decision making. PeerJ PrePrints 3:e1330v1

Abstract

Background. The Psychology Experimental Building Language (PEBL) http://pebl.sourceforge.net/ test battery is a popular application for neurobehavioral investigations. This study evaluated the correspondence between the PEBL and the non-PEBL versions of four executive function tests. Methods. In one cohort, young-adults (N = 44) completed both the Conner’s Continuous Performance Test (CCPT) and the PEBL CPT (PCPT) with the order counter-balanced. In a second cohort, participants (N = 47) completed a non-computerized (Wechsler) and a computerized (PEBL) Digit Span (WDS or PDS) both Forward and Backward. Participants also completed the Psychological Assessment Resources or the PEBL versions of the Iowa Gambling Task (PARIGT or PEBLIGT). Results. The between test correlations were moderately high (reaction time r = 0.78, omission errors r = 0.65, commission errors r = 0.66) on the CPT. DS Forward was significantly greater than DS Backward independent of the test modality. The total WDS score was moderately correlated with the PDS (r = 0.56). The PARIGT and the PEBLIGTs showed a very similar pattern for response times across blocks, development of preference for Advantageous over Disadvantageous Decks, and Deck selections. However, the amount of money earned (score – loan) was significantly higher in the PEBLIGT during the last Block. Conclusions. These findings are broadly supportive of the criterion validity of the PEBL measures of sustained attention, short-term memory, and decision making. Select differences between workalike versions of the same test highlight how detailed aspects of implementation may have more important consequences for computerized testing than has been previously acknowledged.

Author Comment

This is a submission to PeerJ for review.

Supplemental Information

Dataset for IGT and Digit Span

DOI: 10.7287/peerj.preprints.1330v1/supp-1

Cohort1 dataset

Spreadsheet with CPT data

DOI: 10.7287/peerj.preprints.1330v1/supp-2