The Evaluation of Psychotherapies: Implications From the Criteria of the Paradigm of Evidence-Based Psychotherapy
DOI:
https://doi.org/10.5944/rdp.v35i129.41313Keywords:
pshchotherapy, evaluation, research, assessment, humanistic psychotherapiesAbstract
The managers of the public mental health care system argue the need for the benefits provided by public budgets to be effective and efficient, which seems understandable. They rely on the evidence provided by Evidence-Based Medicine or Evidence-Based Psychology. However, the evidence system was initially created to facilitate decision making by psychotherapists in individual cases as a complement to their clinical expertise. Evidence lists in psychotherapy could be misused for the purpose of including or excluding a treatment in public care. It should be remembered that the results of the current evidence list should not be considered as definitive and that they should be used with caution without considering that the techniques that have no evidence for the moment are ineffective or useless.
Downloads
References
Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and policy in mental health, 38(1), 4–23. https://doi.org/10.1007/s10488-010-0327-7
American Psychological Association Task Force on Psychological Intervention Guidelines (1995). Template for developing guidelines: Interventions for mental disorders and psychosocial aspects of physical disorders. American Psychological Association.
American Psychological Association. (2002). Criteria for evaluating treatment guidelines. American Psychologist, 57, 1052–1059.
American Psychological Association. (2004). Guidelines for psychological practice with older adults. American Psychologist, 59, 236–260.
American Psychological Association. (2005). Report of the 2005 Presidential Task Force on Evidence-Based Practice. Ronald F. Levant. https://www.apa.org/practice/resources/evidence/evidence-based-report.pdf
APA Presidential Task Force on Evidence-Based Practice (2006). Evidence-based practice in psychology. The American psychologist, 61(4), 271–285. https://doi.org/10.1037/0003-066X.61.4.271
Reus, V. I., Fochtmann, L. J., Bukstein, O., Eyler, A. E., Hilty, D. M., Horvitz-Lennon, M., Mahoney, J., Pasic, J., Weaver, M., Wills, C. D., McIntyre, J., Kidd, J., Yager, J., & Hong, S. H. (2018). The American Psychiatric Association Practice Guideline for the pharmacological treatment of patients with alcohol use disorder. The American journal of psychiatry, 175(1), 86–90. https://doi.org/10.1176/appi.ajp.2017.1750101
American Psychological Association. (2019). A clinical practice guideline for the treatment of depression across three age cohorts. Washington, DC: American Psychological Association. https://www.apa.org/depression-guideline/guideline.pdf
Andrews, G. & Harvey, R. (1981). Does psychotherapy benefit neurotic patients? A reanalysis of the Smith, Glass, and Miller data. Archives of General Psychiatry, 38(11), 1203-1208.
Barkham, M., Hardy, G.E. & Mellor-Clark, J. (Eds.) (2010). Developing and Delivering Practice-based Evidence. A Guide for the Psychological Therapies. Wiley-Blackwell. https://doi.org/10.1002/9780470687994
Bohart, A.C. y Boyd, G. A (1997). A qualitative analysis and study of outcome in psychotherapy. Paper distributed at the 1997 North American Society for Psychotherapy Research Conference, Tucson. Arizona.
Brown, C. H., Ten Have, T. R., Jo, B., Dagne, G., Wyman, P. A., Muthén, B., & Gibbons, R. D. (2009). Adaptive designs for randomized trials in public health. Annual review of public health, 30, 1–25. https://doi.org/10.1146/annurev.publhealth.031308.100223
Burns, P. B., Rohrich, R. J., & Chung, K. C. (2011). The levels of evidence and their role in evidence-based medicine. Plastic and reconstructive surgery, 128(1), 305–310. https://doi.org/10.1097/PRS.0b013e318219c171
The periodic health examination. Canadian Task Force on the Periodic Health Examination. (1979). Canadian Medical Association journal, 121(9), 1193–1254.
Chambless, D. L., & Hollon, S. D. (1998a). Defining empirically supported therapies. Journal of consulting and clinical psychology, 66(1), 7–18. https://doi.org/10.1037//0022-006x.66.1.7
Chambless, D.L., Baker, M.J., Baucom, D.H. et al. (1998b): Update on empirically validated therapies, II. The Clinical Psychologist, 51, 1-16
Chambless, D. L., & Ollendick, T. H. (2001). Empirically supported psychological interventions: controversies and evidence. Annual review of psychology, 52, 685–716. https://doi.org/10.1146/annurev.psych.52.1.685
Concato, J., Shah, N., & Horwitz, R. I. (2000). Randomized, controlled trials, observational studies, and the hierarchy of research designs. The New England journal of medicine, 342(25), 1887–1892. https://doi.org/10.1056/NEJM200006223422507
Cook, S. C., Schwartz, A. C., & Kaslow, N. J. (2017). Evidence-Based Psychotherapy: Advantages and Challenges. Neurotherapeutics : the journal of the American Society for Experimental NeuroTherapeutics, 14(3), 537–545. https://doi.org/10.1007/s13311-017-0549-4
Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., Petticrew, M., & Medical Research Council Guidance (2008). Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ (Clinical research ed.), 337, a1655. https://doi.org/10.1136/bmj.a1655
Del Barrio, V. (2009). Raíces y evolución del DSM. Revista de historia de la psicología, 30(2–3), 81–90.
Elliott, R. (2001). Hermeneutic single-case efficacy design: An overview. En K. J. Schneider, J. Bugental, & J. F. Pierson (Eds.), The handbook of humanistic psychology: Leading edges in theory, research and practice (pp. 315–326). Sage Publications.
Elliott R. (2002). Hermeneutic single-case efficacy design. Psychotherapy research: journal of the Society for Psychotherapy Research, 12(1), 1–21. https://doi.org/10.1080/713869614
Fishman, D. B. (1999). The case for a pragmatic psychology. New York University Press.
Fishman, D. B., Messer, S. B., Edwards, D.J.A., & Dattilio, F.M. (Eds.). (2017). Case studies within psychotherapy trials: Expanding the gold standard. Oxford University Press.
Frank, J. D. (1973). Persuasion and healing: A comparative study of psychotherapy (Rev. ed.). Schocken.
Greenberg, J. (1994). Psychotherapy research: A clinician's view. En P. F. Talley, H. H. Strupp, & S. F. Butler (Eds.), Psychotherapy research and practice: Bridging the gap (pp. 1–18). Basic Books.
Haynes, R. B., Devereaux, P. J. & Guyatt, G. H. (2002). Clinical expertise in the era of evidence-based medicine and patient choice. Evidence Based Medicine Notebook, 7, 1–3.
Hollon S. D. (1996). The efficacy and effectiveness of psychotherapy relative to medications. The American psychologist, 51(10), 1025–1030. https://doi.org/10.1037//0003-066x.51.10.1025
Institute of Medicine. (2001). Crossing the quality chasm: a new health system for the 21st century. National Academy Press.
Institute of Medicine. (2015). Psychosocial interventions for mental and substance use disorders: a framework for establishing evidence-based standards. National Academies Press.
Landsverk, J., Brown, H., Chamberlain, P., Palinkas, L. A. & Horwitz, S. M. (2012). Design and analysis in dissemination and implementation research. En R. C. Brownson, G. A. Colditz, E. K. Proctor (Eds.), Translating science to practice (pp. 225–260). Oxford University Press.
Lewin, S., Glenton, C., & Oxman, A. D. (2009). Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: Methodological study. British Medical Journal, 339, b3496.
Martínez, J.M. & Pozueta, C. (2019). Análisis Transaccional y Psicoterapia Basada en la Evidencia. Revista de Análisis Transaccional. Órgano de Difusión de APPHAT, 5, 11–35. Retrieved from: https://www.apphat.net/copia-de-el-analisis-transaccional-1
Marzillier, J. (2004). The myth of evidence-based psychotherapy. The Psychologist, Vol. 17(7), 392–395.
McAlister, F. A., Graham, I., Karr, G. W., & Laupacis, A. (1999). Evidence-based medicine and the practicing clinician. Journal of general internal medicine, 14(4), 236–242. https://doi.org/10.1046/j.1525-1497.1999.00323.x
McCann, P. V., & Lubman, D. I. (2014). Qualitative process evaluation of a problem-solving guided self-help manual for family carers of young people with first-episode psychosis. BMC Psychiatry, 14, 168. https://doi.org/10.1186/1471-244X-14-168
McHugh, R. K., & Barlow, D. H. (Eds.). (2012). Dissemination and implementation of evidence-based psychological interventions. Oxford University Press.
McLeod, J. (2010). Case Study Research: In Counselling and Psychotherapy. SAGE Publications. https://dx.doi.org/10.4135/9781446287897
McLeod, J. & Eliott, R. (2011). Systematic case study research: A practice-oriented introduction to building an evidence base for counselling and psychotherapy. Counselling and Psychotherapy Research, 11(1), 1-10. https://doi.org/10.1080/14733145.2011.548954
McLeod, J. (2013). An introduction to research in counselling and psychotherapy. Sage publications.
McLeod, J. (2017). Science and Psychotherapy: Developing research-based knowledge that enhances the effectivenes of practice. Transactional Analysis Journal, 47(2), 82–101. https://doi.org/10.1177/0362153717694885
Morrow-Bradley, C. & Elliott, R. (1986). Utilization of Psychotherapy research by practicing psychologists. American Psychologist, 41, 188-197.
National Institutes of Health. (2004). State implementation of evidence based practices: Bridging science and service (National Institute of Mental Health and Substance Abuse and Mental Health Services Administration Request for Application MH-03–007). Retrieved Novem-ber 19, 2004, from http://grants1.nih.gov/grants/guide/rfa-files/RFAMH- 03–007.html
Nathan, P. E., Stuart, S. P., & Dolan, S. L. (2000). Research on psychotherapy efficacy and effectiveness: between Scylla and Charybdis?. Psychological bulletin, 126(6), 964–981. https://doi.org/10.1037/0033-2909.126.6.964
Oakley, A., Strange, V., Bonell, C., Allen, E., Stephenson, J., & RIPPLE Study Team (2006). Process evaluation in randomised controlled trials of complex interventions. BMJ (Clinical research ed.), 332(7538), 413–416. https://doi.org/10.1136/bmj.332.7538.413
Orlinsky, D. E. & Howard, K. I. (1975). Varieties of psychotherapeutic experience. Teachers College Press.
Palinkas, L. A., Aarons, G. A., Horwitz, S., Chamberlain, P., Hurlburt, M., & Landsverk, J. (2011). Mixed method designs in implementation research. Administration and policy in mental health, 38(1), 44–53. https://doi.org/10.1007/s10488-010-0314-z
Palinkas, L. A., Horwitz, S. M., Green, C. A., Wisdom, J. P., Duan, N., & Hoagwood, K. (2015). Purposeful Sampling for Qualitative Data Collection and Analysis in Mixed Method Implementation Research. Administration and policy in mental health, 42(5), 533–544. https://doi.org/10.1007/s10488-013-0528-y
Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009). Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Administration and policy in mental health, 36(1), 24–34. https://doi.org/10.1007/s10488-008-0197-4
Reed, G. M., & Eisman, J. (2002) Uses and misuses of evidence: Managed care, treatment guidelines, and outcomes measurement in profesional practice. En C. Goodheart, A. F. Kazdin & R. J. Sternberg (Eds.), Evidence Based Psychotherapy: Where practice and research meet (pp. 13-35). American Psychological Association.
Rush A. J & Thase, M. E. (1999). Psychotherapies for depressive disorders. En M. Maj & N. Sartorius (eds.), World Psychiatric Association series: Evidence and practice in psychiatry. (2nd ed, Vol. 1, pp. 161- 206). Wiley.
Rush, A. J., Thase, M. E., & Dubé, S. (2003). Research issues in the study of difficult-to-treat depression. Biological psychiatry, 53(8), 743–753. https://doi.org/10.1016/s0006-3223(03)00088-x
Sackett, D. L., Rosenberg, W. M., Gray, J. A., Haynes, R. B., & Richardson, W. S. (1996). Evidence based medicine: what it is and what it isn't. BMJ (Clinical research ed.), 312(7023), 71–72. https://doi.org/10.1136/bmj.312.7023.71
Seligman M. E. (1995). The effectiveness of psychotherapy. The Consumer Reports study. The American psychologist, 50(12), 965–974. https://doi.org/10.1037//0003-066x.50.12.965
Shorrock, M. P. (2012). The pragmatic case study of Ed - A man who struggled with internet addiction. Counselling Psychology Review, 27(2), 23–35.
Stewart, R. E., Chambless, D. L., & Stirman, S. W. (2018). Decision making and the use of evidence- based practice: Is the three-legged stool balanced?. Practice Innovations, 3, 56-67.
Thase, M. E., Greenhouse, J. B., Frank, E., Reynolds, C. F., 3rd, Pilkonis, P. A., Hurley, K., Grochocinski, V., & Kupfer, D. J. (1997). Treatment of major depression with psychotherapy or psychotherapy-pharmacotherapy combinations. Archives of general psychiatry, 54(11), 1009–1015. https://doi.org/10.1001/archpsyc.1997.01830230043006
Smith, M. L., & Glass, G. V. (1977). Meta-analysis of psychotherapy outcome studies. The American psychologist, 32(9), 752–760. https://doi.org/10.1037//0003-066x.32.9.752
Smith, M.L., Glass, G.V. & Miller, T.I. (1980). The benefits of psychotherapy. The John Hopkins University Press.
Teddlie, C. & Tashakkori, A. (2003). Major issues and controversies in the use of mixed methods in the social and behavioral sciences. En A. Tashakkori & C, Teddlie (Eds). Handbook of mixed methods in the social and behavioral sciences (pp. 3-50). Sage Publications.
Wampold, B.E. (2001). The great pscyhotherapy debate: models, methods, and findings. Lawrence Erlbaum Associates Publishers, p. 128.
Westen, D., Novotny, C. M. & Thompson-Brenner, H. (2004). The empirical status of empirically supported psychotherapies: assumptions, findings, and reporting in controlled clinical trials. Psychological Bulletin, 130(4), 631-633.
Widdowson, M. (2012a). TA treatment of depression: Hermeneutic single-case efficacy design study-‘Paul.’ International Journal of Transactional Analysis Research, 3(1). Retrieved from http://www.ijtar.org/article/view/10026/6888
Widdowson, M. (2012b). TA treatment of depression: Hermeneutic single-case efficacy design study-‘Tom.’ International Journal of Transactional Analysis Research, 3(2). Retrieved from http://www.ijtar.org/article/view/10795/7346
Widdowson, M. (2012c). TA treatment of depression: Hermeneutic single-case efficacy design study-‘Denise.’ International Journal of Transactional Analysis Research, 3(2). Retrieved from http://www.ijtar.org/article/view/10796/7347
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Revista de Psicoterapia

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Authors who publish in this journal accept the following conditions:
-
Authors retain copyright and grant the journal the right of first publication, with the work registered under the Creative Commons CC-BY-NC 4.0 International license. This license allows third parties to cite the text and use it without alteration and for non-commercial purposes, provided they credit the authorship of the work and its first publication in this journal.
-
Authors may enter into other independent and additional contractual agreements for the non-exclusive distribution of the version of the article published in this journal (e.g., including it in an institutional repository or publishing it in a book), provided they clearly indicate that the work was first published in this journal.
-
The views expressed in the articles are solely the responsibility of the authors and in no case do they reflect the opinions or scientific policies of the journal.