Psychometric properties of Clinical Outcomes in Routine Evaluation-Outcome Measure (CORE-OM) in Colombia and Peru

Eliana Ortiz, Alba Lucía Meneses Báez, Adriana Trujillo, César Núñez, Magda Yaneth Acevedo Rodríguez, Ángela Pilar Albarracín Rodríguez, Sergio Dominguez-Lara

Abstract


This study attempts to adapt and validate the Spanish version of The Clinical Outcomes in Routine Evaluation–Outcome Measure CORE-OM questionnaire for Colombian and Peruvian populations. A linguistic and cultural adaptation of the CORE-OM Spanish version was created via cognitive interviews of potential users (Colombians n=28; Peruvians n=8). Then the questionnaire was applied along with the SOS and OQ-45 tests to 270 participants, divided in clinical (n=60), and non-clinical (n=210) samples, from three Colombian cities and one city in Peru. Some students made a retest application (n=26) 15 to 30 days after the first one. The CFA conducted showed a four-factor structure (χ2/df=2.09; RMSEA=0.064; RMR=.069) that included well-being, problems/symptoms, general functioning, and risk. The Spanish version of CORE-OM showed excellent acceptability (96%; omission rate 0.14%), good internal consistency (α >.70 in most of the scales and samples), acceptable test-retest reliability (Spearman rho>0.70; p<.001) and convergent validity (all domains r > .4; p < 0.01, except subjective well-being) in both populations. Significant differences were found in the scores between the clinical and non-clinical sample; although, the clinical sample presented higher scores. These results validate the 1-point cut-off score of between clinical and non-clinical populations.


Keywords


CORE-OM, psychometric properties; outcome measure; Latin-America

Full Text:

PDF

References


Barkham, M., Evans, C., Margison, F., McGrath, G., Mellor-Clark, J. & Milne, D. (1998). The rationale for developing and implementing core batteries in service settings and psychotherapy outcome research. Journal of Mental Health, 7, 35 – 47. https://doi.org/10.1080/09638239818328

Barkham, M., Margison, F., Leach, C., Lucock, M., Mellor-Clark & J., Evans, C. (2001) Service profiling and outcomes benchmarking using the CORE-OM: Toward practice-based evidence in the psychological therapies. Journal of Consulting and Clinical Psychology, 69, 184–196. http://dx.doi.org/10.1037/0022-006X.69.2.184

Barkham, M., Gilbert, N., Connell, J., Marshall, C. & Twigg, E. (2005). Suitability and utility of the CORE-OM and CORE-A for assessing severity of presentig problems in psychological therapy services based in primary and secondary care settings. The British Journal of Psychiatry, 186(3), 239 – 246. https://doi.org/10.1192/bjp.186.3.239

Baumgartner, T. A., & Chung, H. (2001) Confidence limits for intraclass reliability coefficients. Measurement in Physical Education and Exercise Science, 5(3), 179-188. https://doi.org/10.1207/S15327841MPEE0503_4

Biasi, V., Patrizi, N., Mosca, M. & De Vincenzo, C. (2017). The effectiveness of university counselling for improving academic outcomes and well-being. British Journal of Guidance & Counselling, 45(3), 248–257. https://doi.org/10.1080/03069885.2016.1263826

Börjesson, S., & Boström, P. K. (2020). “I want to know what it is used for”: Clients’ perspectives on completing a routine outcome measure (ROM) while undergoing psychotherapy. Psychotherapy Research, 30(3), 337-347. https://doi.org/10.1080/10503307.2019.1630780

Blais, M. A., Lenderking, W. R., Baer, L., de Lorell, A., Peets, K., Leahy, L. & Burns, C. (1999). Development and initial validation of a brief mental health outcome measure. Journal of Personality Assessment, 73(3), 359–373. https://doi.org/10.1207/S15327752JPA7303_5

Brand, C., Ward, F., MacDonagh, N., Cunningham, S., & Timulak, L. (2021). A national evaluation of the Irish public health counselling in primary care service–examination of initial effectiveness data. BMC Psychiatry, 21, 227. https://doi.org/10.1186/s12888-021-03226-x

Bravo, G., & Potvin, L. (1991) Estimating the reliability of continuous measures with Cronbach’s alpha or the intraclass correlation coefficient: Toward the integration of two traditions. Journal of Clinical Epidemiology, 44(4-5), 381-390. https://doi.org/10.1016/0895-4356(91)90076-L

Cantero-Braojos, M. Á., Cabrera-León, A., López-González, M. A., & Saúl, L. A. (2019). Intervención grupal desde un enfoque sensoriomotriz para reducir la intensidad del dolor crónico. Atención Primaria, 51(3), 162-171. https://doi.org/10.1016/j.aprim.2017.07.006

Cattivelli, R., Guerrini Usubini, A., Manzoni, G. M., Vailati Riboni, F., Pietrabissa, G., Musetti, A., Franceschini, C., Varallo, G., Spatola, C. A. M., Giusti, E., Castelnuovo, G. & Molinari, E. (2021). ACTonFood. Acceptance and Commitment Therapy-Based Group Treatment Compared to Cognitive Behavioral Therapy-Based Group Treatment for Weight Loss Maintenance: An Individually Randomized Group Treatment Trial. International Journal of Environmental Research and Public Health, 18(18), 9558. https://doi.org/10.3390/ijerph18189558

Collier, J. E. (2020). Applied structural equation modeling using AMOS. Basic to advanced techniques. Routledge Taylor & Francis Group. https://doi.org/10.4324/9781003018414

Connell, J., Barkham, M., & Mellor-Clark, J. (2007). CORE-OM mental health norms of students attending university counselling services benchmarked against an age-matched primary care sample. British Journal of Guidance & Counselling, 35(1), 41-57. https://doi.org/10.1080/03069880601106781

CORE System Trust (2021, June 02). About CORE and CST. https://www.coresystemtrust.org.uk/home/about-cst/

Diedenhofen, B. & Musch, J. (2016). cocron: A web interface and R package for the statistical comparison of Cronbach’s alpha coefficients. International Journal of Internet Science, 11, 51- 60. https://www.ijis.net/ijis11_1/ijis11_1_diedenhofen_and_musch.pdf

Elfström, M. L, Evans, C., Lundgren, J., Johansson, B., Hakeberg, M., & Carlsson, S. G. (2012). Validation of the Swedish version of the Clinical Outcomes in Routine Evaluation Outcome Measure (CORE‐OM). Clinical Psychology & Psychotherapy, 20(5), 447- 455. https://doi.org/10.1002/cpp.1788

Errázuriz, P., Opazo, S., Behn, A., Silva, O., & Gloger, S. (2017). Spanish Adaptation and Validation of the Outcome Questionnaire OQ-30.2. Frontiers in Psychology, 8, 673. https://doi.org/10.3389/fpsyg.2017.00673

Evans, C., Mellor-Clark, J., Margison, F., Barkham, M., Audin, K., Connell, J. & McGrath, G. (2000). CORE: Clinical outcome measure in routine evaluation. Journal of Mental Health, 9(3), 247-255. https://doi.org/10.1080/jmh.9.3.247.255

Evans, C., Connell, J., Barkham, M., Margison, F., McGrath, G., Mellor-Clark, J., & Audin, K. (2002). Towards a standardized brief outcome measure: Psychometric properties and utility of the CORE-OM. British Journal of Psychiatry, 180(1), 51-60. https://doi.org/10.1192/bjp.180.1.51

Evans, C., Connell, J., Barkham, M., Marshall, C. &, Mellor-Clark, J. (2003). Practice-based evidence: benchmarking NHS primary care counselling services at national and local levels. Clinical Psychology & Psychotherapy, 10, 374 -388. https://doi.org/10.1002/cpp.384

Falkenström, F., Kumar, M., Zahid, A., Kuria, M. & Othieno, C. (2018). Factor analysis of the Clinical Outcomes in Routine Evaluation–Outcome Measures (CORE-OM) in a Kenyan sample. BMC Psychology, 6,48. https://doi.org/10.1186/s40359-018-0260-1

Feixas, G., Evans, C., Trujillo, A., Saúl, L. A., Botella, L., Corbella, S., González, E., Bados, A., García-Grau, E., & López-González, M. A. (2012). La versión española del CORE-OM: Clinical Outcomes in Routine Evaluation - Outcome Measure. Revista de Psicoterapia, 23(89), 109-135. https://doi.org/10.33898/rdp.v23i89.641

Hair, J. F., Black, W. C., & Barry, B. J. (2014). Multivariate Data Analysis (7th ed.) Pearson. https://www.pearson.com/uk/educators/higher-education-educators/program/Hair-Multivariate-Data-Analysis-Pearson-New-International-Edition-7th-Edition/PGM1052102.html

Halacre, M., & Jalil, R. (2017). Holistic therapy with disabled adults from a social and individual perspective: A service evaluation feasibility study. Counselling and Psychotherapy Research, 17(4), 320-329. https://doi.org/10.1002/capr.12137

Honkalampi, K., Laitila, A., Juntunen, H., Lehmus, K., Piiparinen, A., Törmänen, L., Inkinen, M., & Evans, C. (2017). The Finnish Clinical Outcome in Routine Evaluation Outcome Measure: Psychometric exploration in clinical and non‐clinical samples. Nordic Journal Psychiatry, 71(8), 589 - 597. https://doi.org/10.1080/08039488.2017.1365378

Howitt, D., & Cramer, D. (2017). Research methods in psychology (5th ed.). Pearson.

https://www.pearson.com/uk/educators/higher-education-educators/program/Howitt-Research-Methods-in-Psychology-5th-Edition/PGM1240430.html

Iqbal, Z., Airey, N. D., Brown, S. R., Wright, N. M., Miklova, D., Nielsen, V., Webb , K. & Sajjad, A. (2021). Waiting list eradication in secondary care psychology: Addressing a National Health Service blind spot. Clinical Psychology & Psychotherapy. https://doi.org/10.1002/cpp.2551

Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59(1), 12-19. https://doi.org/10.1037/0022-006X.59.1.12

Jenkins, P. E., Smith, L., & Morgan, C. (2021). Can early change in eating disorder psychopathology predict outcome in guided self-help for binge eating?. Eating and Weight Disorders-Studies on Anorexia, Bulimia and Obesity, 26, 2143-2152. https://doi.org/10.1007/s40519-020-01059-3

Jokic,Begic, N., Korajlija, A. L., Jurin, T., & Evans, C. (2014). Faktorska struktura, psihometrijske karakteristike i kritična vrijednost hrvatskoga prijevoda CORE‐OM upitnika. Psihologijske Teme, 23(2), 265–288. https://hrcak.srce.hr/125093.

Juhová, D., Řiháček, T., Cígler, H., Dubovská, E., Saic, M., Černý, M., Dufek, J., & Evans, C. (2018). Česká adaptace dotazníku CORE-OM: vybrané psychometrické charakteristiky. Ceskoslovenska Psychologie, 62(1), 59-74.http://cspsych.psu.cas.cz/result.php?id=1007

Juntunen, H., Piiparinen, A., Honkalampi, K., Inkinen, M. & Laitila, A. (2015). CORE OM mittarin suomalainen validointitutkimus yleisväestössä. Psykologia,50(4), 257–276. http://www.psykologia.fi/arkisto/vanhat-numerot/vanhat-numerot-ghost/351-2015-04/tieteelliset-artikkelit/418-core-om-mittarin-suomalainen-validointitutkimus-yleisvaestossa.

Kiziela, A., Viliūnienė, R., Friborg, O., & Navickas, A. (2019). Distress and resilience associated with workload of medical students. Journal of Mental Health, 28(3), 319-323. https://doi.org/10.1080/09638237.2018.1521922

Kontunen, J., Timonen, M., Muotka, J., & Liukkonen, T. (2016). Is interpersonal counselling (IPC) sufficient treatment for depression in primary care patients? A pilot study comparing IPC and interpersonal psychotherapy (IPT). Journal of Affective Disorders, 189(1), 89-93. https://doi.org/10.1016/j.jad.2015.09.032

Kristjánsdóttir, H., Sigurðsson, B. H., Salkovskis, P., Ólason, D., Sigurdsson, E., Evans, C., Gylfadóttir, E. D., & Sigurðsson, J. F. (2013). Evaluation of the psychometric properties of the Icelandic version of the Clinical Outcomes in Routine Evaluation–Outcome Measure, its transdiagnostic utility and cross‐cultural validation. Clinical Psychology & Psychotherapy, 22(1), 64-74. https://doi.org/10.1002/cpp.1874

Lambert, M. J., Morton, J., Hatfield, D., Harmon, C., Hamilton, S. & Reid, R. C. (2004) Administration and scoring manual for the OQ-45.2 (Outcome Questionnaire) (3rd ed.). American Professional Credentialing Services LLC.

Lambert, M. J. (2015). Outcome Research: methods for improving outcome in routine care. In: O. Gelo, A. Pritz, & B. Rieken (Eds.), Psychotherapy Research: Foundations, process and outcome (pp. 593-610). Springer. https://doi.org/10.1007/978-3-7091-1382-0_29

Londoño, N. H., Agudelo, D., Martínez, E., Anguila, D., Aguirre, D., & Mogollón, C. (2017). Cuestionario de efectividad de la psicoterapia Outcome Questionnaire. Validación en muestra clínica colombiana. Psychologia, 11(1), 97-108. https://doi.org/10.21500/19002386.3105

Lyne, K. J., Barrett, P., Evans, C., & Barkham, M. (2006). Dimensions of variation on the CORE-OM. The British Journal of Clinical Psychology, 45(2), 185-203. https://doi.org/10.1348/014466505x39106

Mækelæ, M. J., Reggev, N., Defelipe, R. P., Dutra, N., Tamayo, R. M., Klevjer, K., & Pfuhl, G. (2021). Identifying resilience factors of distress and paranoia during the COVID-19 outbreak in five countries. Frontiers in Psychology, 12, 2160. https://doi.org/10.3389/fpsyg.2021.661149

Margison, F.R., Barkham, M., Evans, C., McGrath, G., Clark, J.M., & Audin, K. (2000). Measurement and psychotherapy evidence-based practice and practice-based evidence. The British Journal of Clinical Psychology, 177, 123-130. https://doi.org/10.1192/bjp.177.2.123

Medlicott, E., Phillips, A., Crane, C., Hinze, V., Taylor, L., Tickell, A., Montero-Marin, J., & Kuyken, W. (2021). The Mental Health and Wellbeing of University Students: Acceptability, Effectiveness, and Mechanisms of a Mindfulness-Based Course. International Journal of Environmental Research and Public Health, 18(11), 6023. https://doi.org/10.3390/ijerph18116023

Meerding, W. J., Van't Spijker, A., & Van Riessen, M. (2012). Monitoren van behandelresultaat met de CORE‐OM. Tijdschrift Psychotherapie, 38, 355–367. https://doi.org/10.1007/s12485‐012‐0041‐x

Mellor-Clark, J., Connell, J., Barkham, M., & Cummins, P. (2001). Counselling outcomes in primary health care: a CORE system data profile. European Journal of Psychotherapy & Counselling, 4, 65–86. https://doi.org/10.1080/13642530110040118

Murray, A. L., McKenzie, K., Murray, K. R., & Richelieu, M. (2016). An analysis of the effectiveness of university counselling services. British Journal of Guidance & Counselling, 44(1), 130-139. https://doi.org/10.1080/03069885.2015.1043621

Murray, A. L., McKenzie, K., Murray, K. R., & Richelieu, M. (2018). Examining response shifts in the Clinical Outcomes in Routine Evaluation-Outcome Measure (CORE-OM). British Journal of Guidance & Counselling, 48(2), 276-288. https://doi.org/10.1080/03069885.2018.1483007

Palmieri, G., Evans, C., Hansen, V., Brancaleoni, G., Ferrari, S., Porcelli, P., Reitano, F., & Rigatelli, M. (2009). Validation of the Italian version of the clinical outcomes in routine evaluation outcome measure (CORE‐OM). Clinical Psychology & Psychotherapy, 16, 444-449. https://doi.org/10.1002/cpp.646

Paz, C., Adana‐Díaz, L., & Evans, C. (2020). Clients with different problems are different and questionnaires are not blood tests: A template analysis of psychiatric and psychotherapy clients' experiences of the CORE‐OM. Counselling and Psychotherapy Research, 20(2), 274-283. https://doi.org/10.1002/capr.12290

Paz, C., Mascialino, G., & Evans, C. (2020). Exploration of the psychometric properties of the Clinical Outcomes in Routine Evaluation-Outcome Measure in Ecuador. BMC Psychology, 8, 94. https://doi.org/10.1186/s40359-020-00443-z

Paz, C., Mascialino, G., Proaño, K., & Evans, C. (2021). Psychological intervention change measurement in Latin America: Where from? Where to?. Psychotherapy Research, 31(1), 132-141. https://doi.org/10.1080/10503307.2020.1750728

Peak, J., Goranitis, I., Day, E., Copello, A., Freemantle, N., & Frew, E. (2018). Predicting health-related quality of life (EQ-5D-5 L) and capability wellbeing (ICECAP-A) in the context of opiate dependence using routine clinical outcome measures: CORE-OM, LDQ and TOP. Health and quality of life outcomes, 16(106), 1-11. https://doi.org/10.1186/s12955-018-0926-7

Rivas-Vazquez, R.A., Rivas-Vazquez, A., Blais, M.A., Rey, G.J., Rivas-Vazquez, F., Jacobo, M., & Carrazana, E. J. (2001). Development of a Spanish Version of the Schwartz Outcome Scale-10: A Brief Mental Health Outcome Measure. Journal of Personality Assessment, 77(3), 436-446. https://doi.org/10.1207/S15327752JPA7703_05

Ronconi, L., Giannerini, N., Testoni, I., Zulian, M., Guglielmin, MS. A. (2018). A structural model of well-being, spontaneity and self-efficacy: Italian validation between adolescents and young adults. Trends in Psychiatry and Psychotherapy, 40(2), 136-143. http://dx.doi.org/10.1590/2237-6089-2017-0072

Saini, P., Chopra, J., Hanlon, C. A., & Boland, J. (2021). A Case Series Study of Help-Seeking among Younger and Older Men in Suicidal Crisis. International Journal of Environmental Research and Public Health. 18, 14, 7319. https://doi.org/10.3390/ijerph18147319

Sales, C. M. D., Moleiro, C. M. M., Evans, C., & Alves, P. C. G. (2012). Versão Portuguesa do CORE‐OM: tradução, adaptação e estudo preliminar das suas propriedades psicométricas. Revista de Psiquiatria Clínica, 39(2), 54–59. https://doi.org/10.1590/S0101-60832012000200003

Sales, C. M., Neves, I. T., Alves, P. G., & Ashworth, M. (2018). Capturing and missing the patient's story through outcome measures: A thematic comparison of patient‐generated items in PSYCHLOPS with CORE‐OM and PHQ‐9. Health Expectations, 21(3), 615-619. https://doi.org/10.1111/hex.12652

Santana, M. R. M., Silva, M. M. da, Moraes, D. S. de, Fukuda, C. C., Freitas, L. H., Ramos, M. E., Fleury, H. J., & Evans, C. (2015). Brazilian Portuguese version of the CORE-OM: cross-cultural adaptation of an instrument to assess the efficacy and effectiveness of psychotherapy. Trends in Psychiatry and Psychotherapy, 37(4), 227-231. https://doi.org/10.1590/2237-6089-2015-0002

Skre, I., Friborg, O., Elgarøy, S., Evans, C., Myklebust, L. H., Lillevoll, K., Sørgaard, K., & Hansen, V. (2013). The factor structure and psychometric properties of the Clinical Outcome in Routine Evaluation–Outcome Measure (CORE‐OM) in Norwegian clinical and non clinical samples. BMC Psychiatry, 13,99. https://doi.org/10.1186/1471-244X-13-99

Sosa-Torralba, J. E., Romero-Mendoza, M. P., Medina-Mora-Icaza, M. E., Méndez-Ríos, E., & Blum-Grynberg, B. (2020) Estructura dimensional de la Escala Clinical Outcomes in Routine Evaluation-Outcome Measure (CORE-OM) en universitarios mexicanos. Revista Evaluar, 20(1), 49-66. https://revistas.unc.edu.ar/index.php/revaluar

Stiles, W. B., Barkham, M., & Wheeler, S. (2015). Duration of psychological therapy: Relation to recovery and improvement rates in UK routine practice. The British Journal of Clinical Psychology, 207(2), 115-122. https://doi:10.1192/bjp.bp.114.145565

Stroud, J., & Griffiths, C. (2021). An evaluation of compassion‐focused therapy within adult mental health inpatient settings. Psychology and Psychotherapy: Theory, Research and Practice, 94(3), 587–602. https://doi.org/10.1111/papt.12334

Trujillo, A., Feixas, G., Bados, A., García-Grau, E., Salla, M., Medina, J. C., Montesano, A., Soriano, J., Medeiros-Ferreira, L., Cañete, J., Corbella, S., Grau, A., Lana, F., & Evans, C. (2016). Psychometric properties of the Spanish version of the Clinical Outcomes in Routine Evaluation - Outcome Measure. Neuropsychiatric Disease and Treatment, 12, 1457–1466. https://doi.org/10.2147/NDT.S103079

Uji, M., Sakamoto, A., Adachi, K., & Kitamura, T. (2012). Psychometric properties of the Japanese version of the Clinical Outcomes in Routine Evaluation–Outcome Measure. Comprehensive Psychiatry, 53(5), 600-608. https://doi.org/10.1016/j.comppsych.2011.09.006

Viliū nienė, R., Evans, C., Hilbig, J., Pakalniškienė, V., Danilevičiūtė, V., Laurinaitis, E., & Navickas, A. (2013). Translating the Clinical Outcomes in Routine Evaluation Outcome Measure (CORE-OM) into Lithuanian. Nordic Journal of Psychiatry, 67(5), 305-311. https://doi.org/10.3109/08039488.2012.745599

Wickramasekera, N., & Tubeuf, S. (2020). Measuring quality of life for people with common mental health problems. Journal of Mental Health. https://doi.org/10.1080/09638237.2020.1818190

Zeldovich, M., & Alexandrowicz, R. (2019). Comparing outcomes: The Clinical Outcome in Routine Evaluation from an international point of view. International Journal of Methods in Psychiatric Research, 28(3), e1774. https://doi.org/10.1002/mpr.1774

Zibetti, M. R., Serralta, F. B., & Evans, C. (2021). Longitudinal Distress among Brazilian University Workers during Pandemics. International Journal of Environmental Research and Public Health, 18(17), 9072. https://doi.org/10.3390/ijerph18179072




DOI: https://doi.org/10.13129/2282-1619/mjcp-3056

Refbacks

  • There are currently no refbacks.