Developing Psychophysical Measurement of Working Memory
Keywords:
Measurement, Psychophysical, Test Construction, Working MemoryAbstract
This experimental research aims to develop a valid and reliable working memory measurement instrument based on psychophysical and computerized characteristics. The authors developed a measuring instrument for working memory capacity, including speed, space or capacity, and energy measurements. We used the Opensesame application from Cogsci.nl to develop a measurement instrument with a paradigm based on the conceptual definition of working memory capacity, such as: speed, space or capacity, and energy. The samples in this study are determined by using the Disproportionate Stratified Random Sampling technique, to obtain a representative sample based on different strata of academic qualification levels. This research involved 93 undergraduate students as the respondents. The Rasch analysis shows the reliability coefficient of the test items is 0.9066 and 0.9295 for the person reliability coefficient, this indicates that the items in the test are reliable. The number of strata as an index of item variation in this measuring instrument also shows a coefficient of 4.4870 at the item level and 5.1743 at the person level, which meets the criteria for a good variation index. On the other hand, Item Response Theory analysis shows the mean value of parameter-a or item discrimination level about 0.210, while the average value of parameter-b or item difficulty level is -1.32 with medium difficulty category.
References
Alloway, T. P., Gathercole, S. E., Kirkwood, H., & Elliott, J. (2008). Evaluating the validity of the Automated Working Memory Assessment. Educational Psychology, 28(7), 725–734. https://doi.org/10.1080/01443410802243828
Andrich, D. (1988). Rasch models for measurement. Sage Publications. http://search.ebscohost.com/login.aspx?direct=true&scope=site&db=nlebk&db=nlabk&AN=24774
Aubry, A., Gonthier, C., & Bourdin, B. (2021). Explaining the high working memory capacity of gifted children: Contributions of processing skills and executive control. Acta Psychologica, 218, 103358. https://doi.org/10.1016/j.actpsy.2021.103358
Baker, F. B. (2004). Item response theory: Parameter estimation techniques (2nd ed., rev.expanded). Marcel Dekker.
Bergman Nutley, S., & Söderqvist, S. (2017). How Is Working Memory Training Likely to Influence Academic Performance? Current Evidence and Methodological Considerations. Frontiers in Psychology, 8. https://doi.org/10.3389/fpsyg.2017.00069
Blankenship, T. L., O’Neill, M., Ross, A., & Bell, M. A. (2015). Working memory and recollection contribute to academic achievement. Learning and Individual Differences, 43, 164–169. https://doi.org/10.1016/j.lindif.2015.08.020
Boag, R. J., Stevenson, N., van Dooren, R., Trutti, A. C., Sjoerds, Z., & Forstmann, B. U. (2021). Cognitive Control of Working Memory: A Model-Based Approach. Brain Sciences, 11(6), 721. https://doi.org/10.3390/brainsci11060721
Chai, W. J., Abd Hamid, A. I., & Abdullah, J. M. (2018). Working Memory From the Psychological and Neurosciences Perspectives: A Review. Frontiers in Psychology, 9, 401. https://doi.org/10.3389/fpsyg.2018.00401
Chalmers, R. P. (2012). Mirt: A Multidimensional Item Response Theory Package for the R Environment. Journal of Statistical Software, 48(6). https://doi.org/10.18637/jss.v048.i06
Conklin, H. M. (2000). Verbal Working Memory Impairment in Schizophrenia Patients and Their First-Degree Relatives: Evidence From the Digit Span Task. American Journal of Psychiatry, 157(2), 275–277. https://doi.org/10.1176/appi.ajp.157.2.275
Cowan, N. (2014). Working Memory Underpins Cognitive Development, Learning, and Education. Educational Psychology Review, 26(2), 197–223. https://doi.org/10.1007/s10648-013-9246-y
Cowan, N., Morey, C. C., Chen, Z., Gilchrist, A. L., & Saults, J. S. (2008). Theory and Measurement of Working Memory Capacity Limits. In Psychology of Learning and Motivation (Vol. 49, pp. 49–104). Elsevier. https://doi.org/10.1016/S0079-7421(08)00002-9
De Beer, M. (2004). Use of differential item functioning (DIF) analysis for bias analysis in test construction. SA Journal of Industrial Psychology, 30(4). https://doi.org/10.4102/sajip.v30i4.175
DeMars, C. (2010). Item response theory. Oxford University Press.
Freeman, E. E., Karayanidis, F., & Chalmers, K. A. (2017). Metacognitive monitoring of working memory performance and its relationship to academic achievement in Grade 4 children. Learning and Individual Differences, 57, 58–64. https://doi.org/10.1016/j.lindif.2017.06.003
Frischkorn, G., von Bastian, C., Souza, A., & Oberauer, K. (2022). Individual Differences in Updating are not related to Reasoning Ability and Working Memory Capacity. Journal of Experimental Psychology General. https://doi.org/10.1037/xge0001141
Friso-van den Bos, I., van der Ven, S. H. G., Kroesbergen, E. H., & van Luit, J. E. H. (2013). Working memory and mathematics in primary school children: A meta-analysis. Educational Research Review, 10, 29–44. https://doi.org/10.1016/j.edurev.2013.05.003
Frost, A., Moussaoui, S., Kaur, J., Aziz, S., Fukuda, K., & Niemeier, M. (2021). Is the n-back task a measure of unstructured working memory capacity? Towards understanding its connection to other working memory tasks. Acta Psychologica, 219, 103398. https://doi.org/10.1016/j.actpsy.2021.103398
Gazzaniga, M. S., Ivry, R. B., & Mangun, G. R. (2019). Cognitive neuroscience: The biology of the mind (Fifth edition). W.W. Norton & Company.
Gkalitsiou, Z., & Byrd, C. T. (2021). Working memory in adults who stutter using a visual N-back task. Journal of Fluency Disorders, 70, 105846. https://doi.org/10.1016/j.jfludis.2021.105846
Jaeggi, S. M., Buschkuehl, M., Perrig, W. J., & Meier, B. (2010). The concurrent validity of the N -back task as a working memory measure. Memory, 18(4), 394–412. https://doi.org/10.1080/09658211003702171
Lee Swanson, H., Arizmendi, G. D., & Li, J.-T. (2021). Working memory growth predicts mathematical problem-solving growth among emergent bilingual children. Journal of Experimental Child Psychology, 201, 104988. https://doi.org/10.1016/j.jecp.2020.104988
Li, C., Ren, X., Schweizer, K., & Wang, T. (2022). Strategy use moderates the relation between working memory capacity and fluid intelligence: A combined approach. Intelligence, 91, 101627. https://doi.org/10.1016/j.intell.2022.101627
Logie, R., Camos, V., & Cowan, N. (Eds.). (2021). Working memory: The state of the science. Oxford University Press.
Lohani, M., Payne, B. R., & Strayer, D. L. (2019). A Review of Psychophysiological Measures to Assess Cognitive States in Real-World Driving. Frontiers in Human Neuroscience, 13. https://www.frontiersin.org/article/10.3389/fnhum.2019.00057
Maehler, C., & Schuchardt, K. (2016). The importance of working memory for school achievement in primary school children with intellectual or learning disabilities. Research in Developmental Disabilities, 58, 1–8. https://doi.org/10.1016/j.ridd.2016.08.007
Mathôt, S., Schreij, D., & Theeuwes, J. (2012). OpenSesame: An open-source, graphical experiment builder for the social sciences. Behavior Research Methods, 44(2), 314–324. https://doi.org/10.3758/s13428-011-0168-7
Mauss, I. B., & Robinson, M. D. (2009). Measures of emotion: A review. Cognition & Emotion, 23(2), 209–237. https://doi.org/10.1080/02699930802204677
Meiran, N., & Shahar, N. (2018). Working memory involvement in reaction time and its contribution to fluid intelligence: An examination of individual differences in reaction-time distributions. Intelligence, 69,176–185. https://doi.org/10.1016/j.intell.2018.06.004
Meyer, J. P. (2014). Applied Measurement with jMetrik (0 ed.). Routledge. https://doi.org/10.4324/9780203115190
Nikolin, S., Tan, Y. Y., Schwaab, A., Moffa, A., Loo, C. K., & Martin, D. (2021). An investigation of working memory deficits in depression using the n-back task: A systematic review and meta-analysis. Journal of Affective Disorders, 284, 1–8. https://doi.org/10.1016/j.jad.2021.01.084
Pelegrina, S., Lechuga, M. T., García-Madruga, J. A., Elosúa, M. R., Macizo, P., Carreiras, M., Fuentes, L. J., & Bajo, M. T. (2015). Normative data on the n-back task for children and young adolescents. Frontiers in Psychology, 6. https://doi.org/10.3389/fpsyg.2015.01544
Rac-Lubashevsky, R., & Kessler, Y. (2016). Decomposing the n-back task: An individual differences study using the reference-back paradigm. Neuropsychologia, 90, 190–199. https://doi.org/10.1016/j.neuropsychologia.2016.07.013
Ren, X., Schweizer, K., Wang, T., Chu, P., & Gong, Q. (2017). On the relationship between executive functions of working memory and components derived from fluid intelligence measures. Acta Psychologica, 180, 79–87. https://doi.org/10.1016/j.actpsy.2017.09.002
Rizopoulos, D. (2006). ltm: An R Package for Latent Variable Modeling and Item Response Theory Analyses. Journal of Statistical Software, 17(5). https://doi.org/10.18637/jss.v017.i05
Schmidt, E. A., Schrauf, M., Simon, M., Fritzsche, M., Buchner, A., & Kincses, W. E. (2009). Drivers’ misjudgement of vigilance state during prolonged monotonous daytime driving. Accident Analysis & Prevention, 41(5), 1087–1093. https://doi.org/10.1016/j.aap.2009.06.007
Schuchardt, K., Maehler, C., & Hasselhorn, M. (2008). Working Memory Deficits in Children With Specific Learning Disorders. Journal of Learning Disabilities, 41(6), 514–523. https://doi.org/10.1177/0022219408317856
Sievert, C. (2020). Interactive Web-Based Data Visualization with R, plotly, and shiny (1st ed.). Chapman and Hall/CRC. https://doi.org/10.1201/9780429447273
Stratta, P., Daneluzzo, E., Prosperini, P., Bustini, M., Mattei, P., & Rossi, A. (1997). Is wisconsin card sorting test performance related to ‘working memory’ capacity? Schizophrenia Research, 27(1), 11–19. https://doi.org/10.1016/S0920-9964(97)00090-X
Strayer, D. L., Turrill, J., Cooper, J. M., Coleman, J. R., Medeiros-Ward, N., & Biondi, F. (2015). Assessing Cognitive Distraction in the Automobile. Human Factors: The Journal of the Human Factors and Ergonomics Society, 57(8), 1300–1324. https://doi.org/10.1177/0018720815575149
Szczygieł, M. (2021). The relationship between math anxiety and math achievement in young children is mediated through working memory, not by number sense, and it is not direct. Contemporary Educational Psychology, 65, 101949. https://doi.org/10.1016/j.cedpsych.2021.101949
Tsigeman, E., Silas, S., Frieler, K., Likhanov, M., Gelding, R., Kovas, Y., & Müllensiefen, D. (2022). The Jack and Jill Adaptive Working Memory Task: Construction, Calibration and Validation. PLOS ONE, 17(1), e0262200. https://doi.org/10.1371/journal.pone.0262200
Wells, E. L., Kofler, M. J., Soto, E. F., Schaefer, H. S., & Sarver, D. E. (2018). Assessing working memory in children with ADHD: Minor administration and scoring changes may improve digit span backward’s construct validity. Research in Developmental Disabilities, 72, 166–178. https://doi.org/10.1016/j.ridd.2017.10.024
Yaple, Z. A., Stevens, W. D., & Arsalidou, M. (2019). Meta-analyses of the n-back working memory task: FMRI evidence of age-related changes in prefrontal cortex involvement across the adult lifespan. NeuroImage, 196, 16–31.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Isman Rahmani Yusron, Anggi Anggraeni, Zulmi Ramdani
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
