Abstract
Introduction: The instruments for screening cognitive functions, applied to subjects in clinical settings and research, are useful for determining if this person has any trouble in cognition or show changes in the time. The usefulness of these instruments is defined with the evaluation of their psychometrics properties.
Objective: This study allows to determine the intra and inter-observer agreement, when the MoCA test and MMSE were applied by a group in training process
Materials and methods: The study group who attended two training sessions, with an interval of 5 months, scored the MoCA test and MMSE, from two patients which were filmed responding the tests, previous informed consent signature. We compared how close were the scores of participants among themselves by concordance correlation coefficient of Lin (rho) and with those given from the others by intra-class correlation coefficients (ICC).
Results: In total, 46 participants were included. Intra-rater reliability was high for MoCA test (ICC = 0.86), but it was poor for MMSE (ICC=0.24). Inter-rater was poor for MoCA test (rho patient 1= 0.012, rho patient 2= 0.152) and MMSE (rho patient 1 = 0.008, rho patient 2 = 0.012). Although the scores between participants and gold standard were different, the diagnoses were similar.
Conclusion:The correct scoring of the test, requires several trainings to clinical and research groups, and although they can be found few differences between scores applied by non-expert personnel, if the scores mistakenly given, are close to the cut-of point proposed for each test, the bias increases.
References
FOLSTEIN MF, FOLSTEIN SE, MCHUGH PR. "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. Journal of psychiatric research. 1975;12(3):189-98.
NASREDDINE ZS, PHILLIPS NA, BEDIRIAN V, CHARBONNEAU S, WHITEHEAD V, COLLIN I, ET AL. The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatric Soc. 2005;53(4):6959.
ROSSETTI HC, LACRITZ LH, CULLUM CM, WEINER MF. Normative data for the Montreal Cognitive Assessment (MoCA) in a population-based sample. Neurology. 2011;77(13):1272-5.
AREVALO-RODRIGUEZ I, SMAILAGIC N, ROQUE IFM, CIAPPONI A, SANCHEZ-PEREZ E, GIANNAKOU A, ET AL. Mini-Mental State Examination (MMSE) for the detection of Alzheimer's disease and other dementias in people with mild cognitive impairment (MCI). The Cochrane database of systematic reviews. 2015;3:CD010783.
ALVES, FREITAS, SIMOE. Montreal Cognitive Assesment (MoCA): Normative study for portuguese population. (2011); 3 (23):37- 41.
GARCÍA-CORPAS JP, ESQUIVEL PRADOS E, PAREJA MARTÍNEZ E. Fiabilidad de los cuestionarios utilizados en ciencias de la salud. Ars Pharm.(2014);55(3): 46-48.
PRICE CC, CUNNINGHAM H, CORONADO N, FREEDLAND A, COSENTINO S, PENNEY DL, ET AL. Clock drawing in the Montreal Cognitive Assessment: recommendations for dementia assessment. Dement GGeriatr Cogn Disord. 2011;31(3):179-87. doi:10.1159/000324639
MIRANDA-NAVA G, SHKUROVICH-BIALIK P, ORTEGA-PONCE F. Variabilidad interobservador en la lectura de EEGs mediante una escala electroencefalografica estandarizada de la Cleveland Clinic Foundation. Rev Mex Neuroci. 2012;13(6):306-313.
ROOS N, ROOS L. Variaciones entre zonas pequeñas, estilo de práctica y calidad asistencial. In: Evans R, Barer M, Marmor T, editors. ¿Por qué alguna gente está sana y otra no? Los determinantes de la salud de las poblaciones. Madrid, España Ediciones Díaz de Santos;1996,Vol. 1 p. 253-75.
SIMÓ-MIÑANA J, RIQUELME-MIRALLES DA. Variabilidad en la interpretación de la radiografía de tórax entre una comunidad médica de atención primaria y sus radiólogos de referencia. Aten Primaria. 1998;21(9):599-606.
LIN LI. A concordance correlation coefficient to evaluate reproducibility. Biometrics. 1989;45(1):255-68.
CAMACHO-SANDOVAL J. Coeficiente de concordancia para variables continuas. Acta Méd Costarric [en línea]. 2008;50(4):211-212.
CORTÉS-REYES É, RUBIO-ROMERO JA, GAITÁN-DUARTE H. Métodos estadísticos de evaluación de la concordancia y la reproducibilidad de pruebas diagnósticas. Rev Colomb Obstet Ginecol. 2010;61(número):247-55.
BLAND MJ, ALTMAN D. Statistical methods for assessing agreement betwen two methods of clinical measurement. The Lancet. 1986;327(8476):307-10.
HALLGREN KA. Computing Inter-Rater Reliability for Observational Data: An Overview and Tutorial. Tutorials in quantitative methods for psychology. 2012;8(1):23-34.
DAVIES M, FLEISS JL. Measuring Agreement for Multinomial Data. Biometrics. 1982;38(4):1047-51.
GAMER M, LEMON J, FELLOWS I, SINGH P. IRR: Various Coefficients of Interrater Reliability and Agreement. R package version 0.84. 2012.
PAWLOWSKI J, SEGABINAZI JD, WAGNER F, BANDEIRA DR. A systematic review of validity procedures used in neuropsychological batteries. Psychology & Neuroscience. 2013;6(número):311-29.
FRIEDMAN L. Evaluating the Montreal Cognitive Assessment (MoCA) and the Mini Mental State Exam (MMSE) for Cognitive Impairment Post Stroke: A Validation Study against the Cognistat [Electronic Thesis and Dissertation Repository]: University of Western Ontario; 2012.
BLACKBURN DJ, WALTERS S, HARKNESS K. Letter by Blackburn et al Regarding Article, 'Is the Montreal Cognitive Assessment Superior to the Mini-Mental State Examination to Detect Poststroke Cognitive Impairment? A study with Neuropsychological Evaluation'. Stroke, 42(11):e582.
DONG Y1, LEE WY, BASRI NA, COLLINSON SL, MERCHANT RA, VENKETASUBRAMANIAN N, CHEN CL. The Montreal Cognitive Assessment is superior to the Mini-Mental State Examination in detecting patients at higher risk of dementia. Int Psychogeriatr. 2012;24 (11):1749-55. doi: 10.1017/S1041610212001068.
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.