Initial validation of the Defense Mechanisms Rating Scales Q-sort: A Comparison of Trained and Untrained Raters
Abstract
Objectives: Defense mechanisms underlie a range of healthy and pathological psychological phenomena and are important mechanisms of change in psychotherapy. Thus, the identification of defense mechanisms in clinical work is crucial, however, measures commonly used for their assessment have various limitations. The Defense Mechanisms Rating Scale Q-set (DMRS-Q; Di Giuseppe, 2014) was developed to address these problems, and to provide an easy-to-use, valid, and reliable tool for the assessment of defense mechanisms. The present study aimed to evaluate the reliability of the DMRS-Q when used by trained versus untrained coders, and to examine the criterion validity of the DMRS-Q in relation to its original observer-rated version, the Defense Mechanisms Rating Scale (DMRS; Perry, 1990).
Methods: Collateral sessions (n = 13) with parents of children with externalizing problems were coded with the DMRS-Q by trained and untrained raters, and on the DMRS by an expert rater. Results: We found that both trained and untrained coders were able to assess most defense categories and levels with moderate to excellent reliability on the DMRS-Q, and that untrained coders’ reliability was comparable although slightly lower than untrained coders’ reliability. Moreover, our results indicate the generally good criterion validity of the DMRS-Q when compared to the original DMRS.
Discussion: These findings suggest that the DMRS-Q is a promising measure that can be used by clinicians and researchers at all levels of training and with minimal knowledge of defense mechanisms as a reliable and valid method to assess defense mechanisms in clinical settings.
Keywords
Full Text:
PDFReferences
Aafjes-van Doorn, K., Békés, V., Luo, X., Prout, T. A., & Hoffman, L. (2021). What do therapist defense mechanisms have to do with their experience of professional self-doubt and vicarious trauma during the COVID-19 pandemic? Frontiers in Psychology, 12, 647503. https://doi.org/10.3389/fpsyg.2021.647503
Aafjes-van Doorn, K., Békés, V., Luo, X., Prout, T., A., & Hoffman, L. (in press). Psychotherapists’ Resilience During Covid-19: Professional Self-Doubt and Posttraumatic Growth. Psychological Trauma: Theory, Research, Practice, and Policy.
Albucher, R. C., Abelson, J. L., & Nesse, R. M. (1998). Defense mechanism changes in successfully treated patients with obsessive-compulsive disorder. American Journal of Psychiatry, 4, 558-559. https://doi.org/10.1176/ajp.155.4.558
American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th Ed.). Washington, DC: Author.
Andrews, G., Singh, M., & Bond, M. (1993). The defense style questionnaire. Journal of Nervous and Mental Disease, 181(4), 246–256. https://doi.org/10.1097/00005053-199304000-00006
Babl, A., Holtforth, M. G., Perry, J. C., Schneider, N., Dommann, E., Heer, S., … Caspar, F. (2019). Comparison and change of defense mechanisms over the course of psychotherapy in patients with depression or anxiety disorder: Evidence from a randomized controlled trial. Journal of Affective Disorders, 252, 212–220. https://doi.org/10.1016/j.jad.2019.04.021
Baucom, K. J. W., Baucom, B. R., & Christensen, A. (2012). Do the naïve know best? The predictive power of naïve ratings of couple interactions. Psychological Assessment, 24(4), 983–994. https://doi.org/10.1037/a0028680
Békés, V., Aafjes-van Doorn. K., Talia, A., Spina, D., Starrs., C., & Perry, J. C. (2021). The Relationship Between Defense Mechanisms and Attachment as Measured by Observer-Rated Methods in a Sample of Depressed Patients - A Pilot Study. Frontiers in Psychology, 12, 648503.
Békés, V., Perry, J. C., & Robertson, B. M. (2018). Psychological masochism: A systematic review of the literature on conflicts, defenses, and motives. Psychotherapy Research, 28(3), 470–483. https://doi.org/10.1080/10503307.2016.1189618
Békés, V., Perry, J. C., & Starrs, C. J. (2017). Resilience in Holocaust Survivors: A Study of Defense Mechanisms in Holocaust Narratives. Journal of Aggression, Maltreatment & Trauma, 26(10), 1072.
Boldrini, T., Lo Buglio, G., Giovanardi, G., Lingiardi, V., & Salcuni, S. (2020). Defense mechanisms in adolescents at high risk of developing psychosis: an empirical investigation. Research in Psychotherapy: Psychopathology, Process and Outcome, 23(1), 456. https://doi.org/10.4081/ripppo.2020.456
Bornstein, R. F., Rossner, S. C., Hill, E. L., & Stepanian, M. L. (1994). Face validity and fakability of objective and projective measures of dependency. Journal of personality assessment, 63(2), 363-386. https://doi.org/10.1207/s15327752jpa6302_14
Bowins, B. (2010). Personality disorders: A dimensional defense mechanism approach. American Journal of Psychotherapy, 64(2), 153–169. https://doi.org/10.1176/appi.psychotherapy.2010.64.2.153
Catalano, A., Martino, G., Bellone, F., Papalia, M., Lasco, C., Basile, G., Sardella, A., Nicocia, G., Morabito, N., Lasco A. (2019). Neuropsychological Assessment in Elderly Men with Benign Prostatic Hyperplasia Treated with Dutasteride. Clinical Drug Investigation, 39, 97–102. https://doi.org/10.1007/s40261-018-0720-7
Catalano, A., Sardella, A., Bellone, F., Lasco, C. G., Martino, G., Morabito, N. (2020). Executive functions predict fracture risk in postmenopausal women assessed for osteoporosis. Aging clinical and experimental research, 32(11), 2251–2257. https://doi.org/10.1007/s40520-019-01426-w
Conversano, C. (2021). The psychodynamic approach during COVID-19 emotional crisis. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2021.670196
Conversano, C., Ciacchini, R., Orrù, G., Di Giuseppe, M., Gemignani, A., & Poli, A. (2020). Mindfulness, compassion, and self-compassion among health care professionals: What’s new? A systematic review. Frontiers in Psychology, 11:1683. https://doi.org/10.3389/fpsyg.2020.01683
Conversano, C., & Di Giuseppe, M. (2021). Psychological factors as determinants of chronic conditions: clinical and psychodynamic advances. Frontiers in Psychology, 12, 635708. https://doi.org/10.3389/fpsyg.2021.635708
Cramer, P., & Blatt, S. J. (1990). Use of the TAT to measure change in defense mechanisms following intensive psychotherapy. Journal of Personality Assessment, 54(1/2), 236–251. https://doi.org/10.1207/s15327752jpa5401&2_23
Cramer, P. (1987). The development of defense mechanisms. Journal of Personality, 55(4), 597-614. https://doi.org/10.1111/j.1467-6494.1987.tb00454.x
de Roten, Y., Djillali, S., Crettaz von Roten, F., Despland, J. N., & Ambresin, G. (2021). Defense Mechanisms and Treatment Response in Depressed Inpatients. Frontiers in Psychology, 12, 633939. https://doi.org/10.3389/fpsyg.2021.633939
Di Blasi, M., Giardina, A., Lo Coco, G., Giordano, C., Billieux, J., Schimmenti, A. (2020). A compensatory model to understand dysfunctional personality traits in problematic gaming: The role of vulnerable narcissism. Personality and Individual differences, 160. https://doi.org/10.1016/j.paid.2020.109921
Di Giuseppe, M., Nepa, G., Prout., T. A., Albertini, F., Marcelli, S., Orrù, G., Conversano, C. (2021). Stress, burnout, and resilience among healthcare workers during the COVID-19 emergency: the role of defense mechanisms. International Journal of Environmental Research and Public Health, 18, 5258. https://doi.org/10.3390/ijerph18105258
Di Giuseppe, M., Perry, J. C., Petraglia, J., Janzen, J., Lingiardi, V. (2014). Development of a q-sort version of the defense mechanism rating scales (DMRS-Q) for clinical use. Journal of Clinical Psychology, 70(5), 452–465. https://doi.org/10.1002/jclp.22089
Di Giuseppe, M., Perry, J. C., Conversano, C., Gelo, O. C. G., Gennaro, A. (2020a). Defense mechanisms, gender and adaptiveness in emerging personality disorders in adolescent outpatients. The Journal of Nervous and Mental Disease, in press. https://doi.org/10.1097/NMD.0000000000001230
Di Giuseppe, M., Prout, T. A., Fabiani, M., Kui, T. (2020b). Defensive profile of parents of children with externalizing problems receiving Regulation-Focused Psychotherapy for Children (RFP-C): A pilot study. Mediterranean Journal of Clinical Psychology, 8(2). https://doi.org/10.6092/2282-1619/mjcp-2515
Di Giuseppe, M., Perry, J. C., Lucchesi, M., Michelini, M., Vitiello, S., Piantanida, A., Fabiani, M., Maffei, S., Conversano, C. (2020c). Preliminary reliability and validity of the DMRS-SR-30, a novel self-report based on the Defense Mechanisms Rating Scales. Frontiers in Psychiatry, 11, 870. https://doi.org/10.3389/fpsyt.2020.00870
Di Giuseppe M., Perry, J. C. (2021). The hierarchy of defense mechanisms: assessing defensive functioning with the Defense Mechanisms Rating Scales Q-sort (DMRS-Q). Frontiers in Psychology, 12, 718440
Drapeau, M., Roten, Y. D., Perry, J. C., & Despland, J. (2003). A study of stability and change in defense mechanisms during a brief psychodynamic investigation. The Journal of Nervous and Mental Disease, 191(8), 496-502. https://doi.org/10.1097/01.nmd.0000082210.76762.ec
Eisenstadt, T. H., Eyberg, S., McNeil, C. B., Newcomb, K., & Funderburk, B. (1993). Parent-child interaction therapy with behavior problem children: Relative effectiveness of two stages and overall treatment outcome. Journal of Clinical Child Psychology, 22(1), 42–51. https://doi.org/10.1207/s15374424jccp2201_4
Galli, F., Tanzilli, A., Simonelli, A., Tassorelli, C., Sances, G., Parolin, M., Cristofalo, P., Gualco, I., Lingiardi, V. (2019). Personality and Personality Disorders in Medication-Overuse Headache: A Controlled Study by SWAP-200. Pain research & management, 2019, 1874078. https://doi.org/10.1155/2019/1874078
Giovanardi, G., Mirabella, M., Di Giuseppe, M., Lombardo, F., Speranza, A. M., & Lingiardi, V. (2021). Defensive functioning of individuals diagnosed with gender dysphoria at the beginning of their hormonal treatment. Frontiers in Psychology, 12, 3196. https://doi.org/10.3389/fpsyg.2021.665547
Gugliandolo, M.C., Costa, S., Cuzzocrea, F., Larcan, R., Martino, G. (2020). Adolescents and Body Uneasiness: the Contribution of Supportive Parenting and Trait Emotional Intelligence. Journal of Child and Family Studies, 29, 2453–2462 (2020). https://doi.org/10.1007/s10826-020-01779-1
Hayden, M. C., Müllauer, P. K., Beyer, K., Gaugeler, R., Senft, B., Dehoust, M. C., & Andreas, S. (2021). Increasing Mentalization to Reduce Maladaptive Defense in Patients With Mental Disorders. Frontiers in psychiatry, 12, 637915. https://doi.org/10.3389/fpsyt.2021.637915
Hersoug, A. G., Wærsted, M., & Lau, B. (2021). Defensive Functioning Moderates the Effects of Nondirective Meditation. Frontiers in psychology, 12, 629784. https://doi.org/10.3389/fpsyg.2021.629784
Hill, R., Tasca, G. A., Presniak, M., Francis, K., Palardy, M., Grenon, R., Mcquaid, N., Hayden, G., Gick, M., & Bissada, H. (2015). Changes in Defense Mechanism Functioning During Group Therapy for Binge-Eating Disorder. Psychiatry: Interpersonal & Biological Processes, 78(1), 75–88. https://doi.org/10.1080/00332747.2015.1015897
Høglend, P., & Perry, J. C. (1998). Defensive functioning predicts improvement in major depressive episodes. The Journal of Nervous and Mental Disease, 186(4), 238-243.
Johansen, P. Ø., Krebs, T. S., Svartberg, M., Stiles, T. C., & Holen, A. (2011). Change in defense mechanisms during short-term dynamic and cognitive therapy in patients with cluster C personality disorders. The Journal of Nervous and Mental Disease, 199(9), 712-715. https://doi.org/10.1097/NMD.0b013e318229d6a7
Kipper, L., Blaya, C., Teruchkin, B., Heldt, E., Isolan, L., Mezzomo, K., ... & Manfro, G. G. (2005). Evaluation of defense mechanisms in adult patients with panic disorder: before and after treatment. The Journal of Nervous and Mental Disease, 193(9), 619-624. https://doi.org/10.1097/01.nmd.0000177783.46974.12
Knijnik, D. Z., Salum Jr, G. A., Blanco, C., Moraes, C., Hauck, S., Mombach, C. K., ... & Eizirik, C. L. (2009). Defense style changes with the addition of psychodynamic group therapy to clonazepam in social anxiety disorder. The Journal of Nervous and Mental Disease, 197(7), 547-551.https://doi.org/10.1097/NMD.0b013e3181aac833
Koo, T. K., & Li, M. Y. (2016). A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. Journal of chiropractic medicine, 15(2), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012
Kramer, U., Despland, J., Michel, L., Drapeau, M., & de Roten, Y. (2010). Change in defense mechanisms and coping over the course of short-term dynamic psychotherapy for adjustment disorder. Journal of Clinical Psychology, 66(12), 1232–1241. https://doi.org/10.1002/jclp.20719
Kramer, U., Roten, Y. D., Perry, J. C., & Despland, J. (2013). Change in defense mechanisms and coping patterns during the course of 2-year long psychotherapy and psychoanalysis for recurrent depression. The Journal of Nervous and Mental Disease, 201(7), 614-620. https://doi.org/10.1097/nmd.0b013e3182982982
Kufferath-Lin, T., Aafjes-van Doorn, K., Prout, T. A., & Hoffman, L. (2021). An examination of parent sessions in regulation-focused psychotherapy for children. Psychotherapy, 58(1), 109–120. https://doi.org/10.1037/pst0000314
Lilienfeld, S. O., Wood, J. M., & Garb, H. N. (2000). The scientific status of projective techniques. Psychological Science in the Public Interest: A Journal of the American Psychological Society, 1(2), 27–66. https://doi.org/10.1111/1529-1006.002
Linden, M., Scheel, T., & Rettig, K. (2007). Validation of the factorial structure of the Positive and Negative Syndrome Scale in use by untrained psychiatrists in routine care. International Journal of Psychiatry in Clinical Practice, 11(1), 53–60. https://doi.org/10.1080/13651500600884419
Lundh, A., Kowalski, J., Sundberg, C. J., Gumpert, C., & Landén, M. (2010). Children's Global Assessment Scale (CGAS) in a naturalistic clinical setting: Inter-rater reliability and comparison with expert ratings. Psychiatry Research, 177(1-2), 206–210. https://doi.org/10.1016/j.psychres.2010.02.006
Marchini, F., Langher, V., Napoli, A., Balonan, J. T., Fedele, F., Martino, G., ... & Caputo, A. (2021). Unconscious loss processing in diabetes: associations with medication adherence and quality of care. Psychoanalytic Psychotherapy, 1-19. https://doi.org/10.1080/02668734.2021.1922492
Martino, G., Catalano, A., Agostino, R. M., Bellone, F., Morabito, N., Lasco, C. G., Vicario, C. M., Schwarz, P., & Feldt-Rasmussen, U. (2020a). Quality of life and psychological functioning in postmenopausal women undergoing aromatase inhibitor treatment for early breast cancer. PloS one, 15(3), e0230681. https://doi.org/10.1371/journal.pone.0230681
Martino, G., Caputo, A., Schwarz, P., Bellone, F., Fries, W., Quattropani, M. C., & Vicario, C. M. (2020b). Alexithymia and Inflammatory Bowel Disease: A Systematic Review. Frontiers in psychology, 11, 1763. https://doi.org/10.3389/fpsyg.2020.01763
Martino, G., Caputo, A., Vicario, C. M., Catalano, A., Schwarz, P., & Quattropani, M. C. (2020c). The Relationship Between Alexithymia and Type 2 Diabetes: A Systematic Review. Frontiers in psychology, 11, 2026. https://doi.org/10.3389/fpsyg.2020.02026
Martino, G., Caputo, A., Vicario, C. M., Feldt-Rasmussen, U., Watt, T., Quattropani, M. C., Benvenga, S., & Vita, R. (2021). Alexithymia, Emotional Distress, and Perceived Quality of Life in Patients With Hashimoto's Thyroiditis. Frontiers in psychology, 12, 667237. https://doi.org/10.3389/fpsyg.2021.667237
Metzger, J. A. (2014). Adaptive defense mechanisms: function and transcendence. Journal of Clinical Psychology, 70(5), 478-488.
Merlo, E. M., Sicari, F., Frisone, F., Alibrandi, A., & Settineri, S. (2020a). Personality types and dreaming in future health professionals: Effect of age and gender. International Journal of Dream Research, 13(2), 160–172. https://doi.org/10.11588/ijodr.2020.2.70571
Merlo, E. M., Stoian, A., Motofei, I. G., & Settineri, S. (2020b). Clinical psychological figures in healthcare professionals: Resilience and maladjustment as the “cost of care”. Frontiers in Psychology,11:607783. https://doi.org/10.3389/fpsyg.2020.607783
Merlo, E. M., Stoian, A. P., Motofei, I. G., & Settineri, S. (2021a). The Role of Suppression and the Maintenance of Euthymia in Clinical Settings. Frontiers in psychology, 12, 677811. https://doi.org/10.3389/fpsyg.2021.677811
Merlo, E. M., Sicari, F., Frisone, F., Costa, G., Alibrandi, A., Avena, G., Settineri, S. (2021b). Uncertainty, alexithymia, suppression and vulnerability during the COVID-19 pandemic. Health Psychology Report, 9(2), 169-179. https://doi.org/10.5114/hpr.2021.104078
Nicolas, M., Martinent, G., Drapeau, M., & De Roten, Y. (2017). Development and evaluation of the psychometric properties of the Short Defense Style Questionnaire (DSQ-26) in sport. International Journal of Psychology & Psychological Therapy, 17, 175-187.
Nishimura, R. (1998). Study of measurement of defense style using Bond’s Defense Style Questionnaire. Psychiatry & Clinical Neurosciences, 52(4), 419–424. https://doi.org/10.1046/j.1440-1819.1998.00410.x
Perry, J. C. (1990). Defense mechanism rating scales (5th ed.). Harvard School of Medicine: The Cambridge Hospital.
Perry, J. C. (2014). Anomalies and specific functions in the clinical identification of defense mechanisms. Journal of Clinical Psychology, 70(5), 406-418. https://doi.org/10.1002/jclp.22085
Perry, J. C., & Høglend, P. (1998). Convergent and discriminant validity of overall defensive functioning. Journal of Nervous and Mental Disease, 186(9), 529–535. https://doi.org/10.1097/00005053-199809000-00003
Perry, J. C., & Ianni, F. (1998). Observer-rated measures of defense mechanisms. Journal of Personality, 66, 993–1024. https://doi.org/10.1111/1467-6494.00040
Perry J.C., Kardos M.E., & Pagano C.J. (1993) The study of defenses in psychotherapy using the defense mechanism rating scales (DMRS). In U. Hentschel, G.J.W. Smith, W. Ehlers, J.G. Draguns (Eds.), The Concept of Defense Mechanisms in Contemporary Psychology. Springer.
Perry, J. C., Metzger, J., & Sigal, J. J. (2015). Defensive functioning among women with breast cancer and matched community controls. Psychiatry, 78(2), 156-169.
Perry, J. C., Presniak, M. D., & Olson, T. R. (2013). Defense mechanisms in borderline schizotypal, antisocial and narcissistic personality disorders. Psychiatry: Interpersonal and Biological Processes, 76(1), 32–52. https://doi.org/10.1521/psyc.2013.76.1.32
Pietrabissa, G., Gullo, S., Aimé, A., Mellor, D., McCabe, M., Alcaraz-Ibánez, M., Begin, C., Blackburn, M. E., Caltabiano, M., Sicilia, A., Castelnuovo, G., Dion, J., Granero-Gallegos, A., Hayami-Chisuwa, N., He, Q., Lo Coco, G., Maïano, C., Markey, C., Probst, M., Rodgers, R. F., Strodl, E., Manzoni, G.M., Fuller-Tyszkiewicz, M. (2020). Measuring perfectionism, impulsivity, self-esteem and social anxiety: Cross-national study in emerging adults from eight countries. Body image, 35, 265–278. https://doi.org/10.1016/j.bodyim.2020.09.012
Porcerelli, J. H., Huth-Bocks, A., Huprich, S. K., & Richardson, L. (2016). Defense mechanisms of pregnant mothers predict attachment security, social-emotional competence, and behavior problems in their toddlers. American Journal of Psychiatry, 173(2), 138-146. https://doi.org/10.1176/appi.ajp.2015.15020173
Prout, T. A., Malone, A., Rice, T., & Hoffman, L. (2019). Resilience, defense mechanisms, and implicit emotion regulation in psychodynamic child psychotherapy. Journal of Contemporary Psychotherapy, 49(4), 235-244. https://doi.org/10.1007/s10879-019-09423-w
Rice, T. R., & Hoffman, L. (2014). Defense mechanisms and implicit emotion regulation: a comparison of a psychodynamic construct with one from contemporary neuroscience. Journal of the American Psychoanalytic Association, 62(4), 693-708. https://doi.org/10.117/0003065114546746
Rosa, V., Tomai, M., Lauriola, M., Martino, G., Di Trani, M. (2019). Body mass index, personality traits, and body image in Italian pre-adolescents: An opportunity for overweight prevention.Psihologija, 52 (4).https://doi.org/10.2298/PSI181121009R
Settineri, S., Merlo, E. M., Frisone, F. (2018). Psychothaumatology of images in gender dysphoria. Open Psychology Journal, 11(1), 222-234. https://doi.org/10.2174/1874350101811010222
Settineri, S., Frisone, F., Alibrandi, A., & Merlo, E. M. (2019). Emotional Suppression and Oneiric Expression in Psychosomatic Disorders: Early Manifestations in Emerging Adulthood and Young Patients. Frontiers in Psychology, 10, 1897. https://doi.org/10.3389/fpsyg.2019.01897
Shedler, J., & Westen, D. (2004). Dimensions of Personality Pathology: An Alternative to the Five-Factor Model. The American Journal of Psychiatry, 161(10), 1743–1754. https://doi.org/10.1176/ajp.161.10.1743
Soldz, S., & Vaillant, G. E. (1998). A 50-year longitudinal study of defense use among inner city men: a validation of the DSM-IV defense axis. The Journal of Nervous and Mental Disease, 186(2), 104–111. https://doi.org/10.1097/00005053-199802000-00006
Tanzilli, A., Di Giuseppe, M., Giovanardi, G., Boldrini, T., Caviglia, G., Conversano, C., & Lingiardi, V. (2021). Mentalization, attachment, and defense mechanisms: a Psychodynamic Diagnostic Manual-2-oriented empirical investigation. Research in Psychotherapy: Psychopathology, Process and Outcome, 31-41. https://doi.org/10.4081/ripppo.2021.531
Vaillant, G. E. (1971). Theoretical hierarchy of adaptive ego mechanisms: A 30-year follow-up of 30 men selected for psychological health. Archives of General Psychiatry, 24(2), 107-118. https://doi.org/10.1001/archpsyc.1971.01750080011003
Vicario, C. M., Nitsche, M. A., Salehinejad, M. A., Avanzino, L., Martino, G. (2020). Time Processing, Interoception, and Insula Activation: A Mini-Review on Clinical Disorders. Frontiers in Psychology, 11, 1893. https://doi.org/10.3389/fpsyg.2020.01893
Vita, R.,Caputo, A., Quattropani, M. C., Watt, T., Feldt-Rasmussen, U., Puleio, P., Benvenga, S., Martino, G. (2020). Quality of life in patients with Hyperthyroidism: Where do we stand?. Mediterranean. Journal of Clinical Psychology,8(2). https://doi.org/10.6092/2282-1619/mjcp-2521
Westen, D., & Muderrisoglu, S. (2003). Reliability and validity of personal- ity disorder assessment using a systematic clinical interview: Evaluating an alternative to structured interviews. Journal of Personality Disorders, 17, 350–368. https://doi.org/10.1521/pedi.17.4.351.23967
Westen, D., Muderrisoglu, S., Fowler, C., Shedler, J., & Koren, D. (1997). Affect regulation and affective experience: Individual differences, group differences, and measurement using a Q-sort procedure. Journal of Consulting and Clinical Psychology, 65, 429–439. https://doi.org/10.1037/0022-006X.65.3.429
DOI: https://doi.org/10.13129/2282-1619/mjcp-3107
Refbacks
- There are currently no refbacks.