Increasing Value and Reducing Waste of Research on Neurofeedback Effects in Post-traumatic Stress Disorder: A State-of-the-Art-Review - Applied Psychophysiology and Biofeedback
- ️Zăgrean, Ana-Maria
- ️Wed Dec 27 2023
References
Al-Shahi Salman, R., Beller, E., Kagan, J., Hemminki, E., Phillips, R. S., Savulescu, J., Macleod, M., Wisely, J., & Chalmers, I. (2014). Increasing value and reducing waste in biomedical research regulation and management. The Lancet, 383(9912), 176–185. https://doi.org/10.1016/S0140-6736(13)62297-7
Altman, D. G. (1994). The scandal of poor medical research. BMJ (clinical Research Ed.), 308(6924), 283–284. https://doi.org/10.1136/bmj.308.6924.283
Amouroux, R. (2017). Beyond indifference and aversion: The critical reception and belated acceptance of behavior therapy in France. History of Psychology, 20(3), 313–329. https://doi.org/10.1037/hop0000064
Antle, A. N., Chesick, L., Levisohn, A., Sridharan, S. K., & Tan, P. (2015). Using neurofeedback to teach self-regulation to children living in poverty. In Proceedings of the 14th International Conference on Interaction Design and Children-IDC ’15, pp. 119–128. https://doi.org/10.1145/2771839.2771852
Antle, A. N., Chesick, L., Sridharan, S. K., & Cramer, E. (2018). East meets west: A mobile brain-computer system that helps children living in poverty learn to self-regulate. Personal and Ubiquitous Computing, 22(4), 839–866. https://doi.org/10.1007/s00779-018-1166-x
Antle, A. N., McLaren, E.-S., Fiedler, H., & Johnson, N. (2019a). Evaluating the impact of a mobile neurofeedback app for young children at school and home. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems-CHI 19, pp. 1–13. https://doi.org/10.1145/3290605.3300266
Antle, A. N., McLaren, E. S., Fiedler, H., & Johnson, N. (2019b). Design for mental health: How socio-technological processes mediate outcome measures in a field study of a wearable anxiety app. Proceedings of the Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction - TEI ’19, pp.87–96. https://doi.org/10.1145/3294109.3295650
Arns, M., Batail, J. M., Bioulac, S., Congedo, M., Daudet, C., Drapier, D., Fovet, T., Jardri, R., Le-Van-Quyen, M., Lotte, F., Mehler, D., Micoulaud-Franchi, J. A., Purper-Ouakil, D., & Vialatte, F., NExT group. (2017). Neurofeedback: One of today’s techniques in psychiatry? L’encephale, 43(2), 135–145. https://doi.org/10.1016/j.encep.2016.11.003
Arns, M., Clark, C. R., Trullinger, M., deBeus, R., Mack, M., & Aniftos, M. (2020). Neurofeedback and attention-deficit/hyperactivity-disorder (ADHD) in children: Rating the evidence and proposed guidelines. Applied Psychophysiology and Biofeedback. https://doi.org/10.1007/s10484-020-09455-2
Askovic, M., Soh, N., Elhindi, J., & Harris, A. W. F. (2023). Neurofeedback for post-traumatic stress disorder: Systematic review and meta-analysis of clinical and neurophysiological outcomes. European Journal of Psychotraumatology, 14(2), 2257435. https://doi.org/10.1080/20008066.2023.2257435
Baldwin, S. A. (2017). Improving the rigor of psychophysiology research. International Journal of Psychophysiology, 111, 5–16. https://doi.org/10.1016/j.ijpsycho.2016.04.006
Batail, J. M., Bioulac, S., Cabestaing, F., Daudet, C., Drapier, D., Fouillen, M., Fovet, T., Hakoun, A., Jardri, R., Jeunet, C., Lotte, F., Maby, E., Mattout, J., Medani, T., Micoulaud-Franchi, J. A., Mladenovic, J., Perronet, L., Pillette, L., Ros, T., NExT group. (2019). EEG neurofeedback research: A fertile ground for psychiatry? L’encephale, 45(3), 245–255. https://doi.org/10.1016/j.encep.2019.02.001
Bell, A., Moss, D., & Kallmeyer, R. (2019). Healing the neurophysiological roots of trauma: A controlled study examining loreta z-score neurofeedback and HRV biofeedback for chronic PTSD. NeuroRegulation, 6(2), 54–70. https://doi.org/10.15540/nr.6.2.54
Berge, E., Al-Shahi Salman, R., van der Worp, H. B., Stapf, C., Sandercock, P., Sprigg, N., Macleod, M. R., Kelly, P. J., Nederkoorn, P. J., Ford, G. A., & Committee, E. S. O. T. N. (2017). Increasing value and reducing waste in stroke research. Lancet Neurology, 16(5), 399–408. https://doi.org/10.1016/S1474-4422(17)30078-9
Bisson, J. I., van Gelderen, M., Roberts, N. P., & Lewis, C. (2020). Non-pharmacological and non-psychological approaches to the treatment of PTSD: Results of a systematic review and meta-analyses. European Journal of Psychotraumatology, 11(1), 1795361. https://doi.org/10.1080/20008198.2020.1795361
Bleijenberg, N., de Man-van Ginkel, J. M., Trappenburg, J. C. A., Ettema, R. G. A., Sino, C. G., Heim, N., Hafsteindóttir, T. B., Richards, D. A., & Schuurmans, M. J. (2018). Increasing value and reducing waste by optimizing the development of complex interventions: Enriching the development phase of the Medical Research Council (MRC) Framework. International Journal of Nursing Studies, 79, 86–93. https://doi.org/10.1016/j.ijnurstu.2017.12.001
Bondjers, K. (2020). Post-traumatic Stress Disorder—Assessment of current diagnostic definitions. Digital Comprehensive Summaries of Uppsala Dissertations from the Faculty of Medicine 1634. 54 pp. Uppsala: Acta Universitatis Upsaliensis. ISBN 978-91-513-0861-6
Border, R., Johnson, E. C., Evans, L. M., Smolen, A., Berley, N., Sullivan, P. F., & Keller, M. C. (2019). No support for historical candidate gene or candidate gene-by-interaction hypotheses for major depression across multiple large samples. The American Journal of Psychiatry, 176(5), 376–387. https://doi.org/10.1176/appi.ajp.2018.18070881
Butt, M., Espinal, E., Aupperle, R. L., Nikulina, V., & Stewart, J. L. (2019). The electrical aftermath: brain signals of posttraumatic stress disorder filtered through a clinical lens. Frontiers in Psychiatry, 10, 368. https://doi.org/10.3389/fpsyt.2019.00368
Carbine, K. A., Lindsey, H. M., Rodeback, R. E., & Larson, M. J. (2019). Quantifying evidential value and selective reporting in recent and 10-year past psychophysiological literature: A pre-registered P-curve analysis. International Journal of Psychophysiology, 142, 33–49. https://doi.org/10.1016/j.ijpsycho.2019.06.004
Carter, E. C., Schönbrodt, F. D., Gervais, W. M., & Hilgard, J. (2019). Correcting for bias in psychology: A comparison of meta-analytic methods. Advances in Methods and Practices in Psychological Science, 2(2), 115–144. https://doi.org/10.1177/2515245919847196
Chalmers, I., Bracken, M. B., Djulbegovic, B., Garattini, S., Grant, J., Gülmezoglu, A. M., Howells, D. W., Ioannidis, J. P. A., & Oliver, S. (2014). How to increase value and reduce waste when research priorities are set. The Lancet, 383(9912), 156–165. https://doi.org/10.1016/S0140-6736(13)62229-1
Chan, A.-W., Song, F., Vickers, A., Jefferson, T., Dickersin, K., Gøtzsche, P. C., Krumholz, H. M., Ghersi, D., & van der Worp, H. B. (2014). Increasing value and reducing waste: Addressing inaccessible research. The Lancet, 383(9913), 257–266. https://doi.org/10.1016/S0140-6736(13)62296-5
Chiba, T., Kanazawa, T., Koizumi, A., Ide, K., Taschereau-Dumouchel, V., Boku, S., Hishimoto, A., Shirakawa, M., Sora, I., Lau, H., Yoneda, H., & Kawato, M. (2019). Current status of neurofeedback for post-traumatic stress disorder: A systematic review and the possibility of decoded neurofeedback. Frontiers in Human Neuroscience, 13, 233. https://doi.org/10.3389/fnhum.2019.00233
Choi, Y.-J., Choi, E.-J., & Ko, E. (2023). Neurofeedback effect on symptoms of posttraumatic stress disorder: A systematic review and meta-analysis. Applied Psychophysiology and Biofeedback. https://doi.org/10.1007/s10484-023-09593-3
Clancy, K. J., Andrzejewski, J. A., Ding, M., Schmidt, N. B., & Li, W. (2019). Posttraumatic stress disorder is associated with alpha dysrhythmia across the visual cortex and the default mode network. MedRxiv. https://doi.org/10.1101/19011841
Clancy, K. J., Andrzejewski, J. A., Simon, J., Ding, M., Schmidt, N. B., & Li, W. (2020). Posttraumatic stress disorder is associated with α dysrhythmia across the visual cortex and the default mode network. Eneuro. https://doi.org/10.1523/ENEURO.0053-20.2020
Cipriani, A., Furukawa, T. A., Salanti, G., Chaimani, A., Atkinson, L. Z., Ogawa, Y., Leucht, S., Ruhe, H. G., Turner, E. H., Higgins, J. P. T., Egger, M., Takeshima, N., Hayasaka, Y., Imai, H., Shinohara, K., Tajika, A., Ioannidis, J. P. A., & Geddes, J. R. (2018). Comparative efficacy and acceptability of 21 antidepressant drugs for the acute treatment of adults with major depressive disorder: A systematic review and network meta-analysis. The Lancet, 391(10128), 1357–1366. https://doi.org/10.1016/S0140-6736(17)32802-7
Clayson, P. E., Carbine, K. A., & Larson, M. J. (2020). A registered report of error-related negativity and reward positivity as biomarkers of depression: P-Curving the evidence. International Journal of Psychophysiology, 150, 50–72. https://doi.org/10.1016/j.ijpsycho.2020.01.005
Cristea, I. A., & Naudet, F. (2019). Increase value and reduce waste in research on psychological therapies. Behaviour Research and Therapy, 123, 103479. https://doi.org/10.1016/j.brat.2019.103479
Cuijpers, P., Cristea, I. A., Karyotaki, E., Reijnders, M., & Hollon, S. D. (2019b). Component studies of psychological treatments of adult depression: A systematic review and meta-analysis. Psychotherapy Research, 29(1), 15–29. https://doi.org/10.1080/10503307.2017.1395922
Cuijpers, P., Karyotaki, E., Reijnders, M., & Ebert, D. D. (2019a). Was Eysenck right after all? A reassessment of the effects of psychotherapy for adult depression. Epidemiology and Psychiatric Sciences, 28(1), 21–30. https://doi.org/10.1017/S2045796018000057
Cuijpers, P., Turner, E. H., Koole, S. L., van Dijke, A., & Smit, F. (2014). What is the threshold for a clinically relevant effect? The case of major depressive disorders. Depression and Anxiety, 31(5), 374–378. https://doi.org/10.1002/da.22249
Di Mauro, J., Carter, S., Folk, J. B., & Kashdan, T. B. (2014). A historical review of trauma-related diagnoses to reconsider the heterogeneity of PTSD. Journal of Anxiety Disorders, 28(8), 774–786. https://doi.org/10.1016/j.janxdis.2014.09.002
Egger, M., Smith, G., Schneider, M., & Minder, C. (1997). Bias in meta-analysis detected by a simple, graphical test. BMJ (clinical Research Ed.), 315(7109), 629–634. https://doi.org/10.1136/bmj.315.7109.629
Ellis, A. (1981). Misrepresentation of behavior therapy by psychoanalysts. American Psychologist, 36(7), 798–799. https://doi.org/10.1037/0003-066X.36.7.798
Fovet, T., Micoulaud-Franchi, J.-A., Vialatte, F.-B., Lotte, F., Daudet, C., Batail, J.-M., Mattout, J., Wood, G., Jardri, R., Enriquez-Geppert, S., & Ros, T. (2017). On assessing neurofeedback effects: Should double-blind replace neurophysiological mechanisms? Brain, 140(10), 63. https://doi.org/10.1093/brain/awx211
Fife, D. A., & Rodgers, J. L. (2022). Understanding the exploratory/confirmatory data analysis continuum: Moving beyond the “replication crisis.” The American Psychologist, 77(3), 453–466. https://doi.org/10.1037/amp0000886
Fried, E. I. (2022). Studying mental health problems as systems, not syndromes. Current Directions in Psychological Science. https://doi.org/10.1177/09637214221114089
Friese, M., & Frankenbach, J. (2020). p-Hacking and publication bias interact to distort meta-analytic effect size estimates. Psychological Methods, 25(4), 456–471. https://doi.org/10.1037/met0000246
Fruchtman-Steinbok, T., Keynan, J. N., Cohen, A., Jaljuli, I., Mermelstein, S., Drori, G., Routledge, E., Krasnoshtein, M., Playle, R., Linden, D. E. J., & Hendler, T. (2021). Amygdala electrical-finger-print (AmygEFP) NeuroFeedback guided by individually-tailored Trauma script for post-traumatic stress disorder: Proof-of-concept. NeuroImage Clinical, 32, 102859. https://doi.org/10.1016/j.nicl.2021.102859
Gapen, M., van der Kolk, B. A., Hamlin, E., Hirshberg, L., Suvak, M., & Spinazzola, J. (2016). A pilot study of neurofeedback for chronic PTSD. Applied Psychophysiology and Biofeedback, 41(3), 251–261. https://doi.org/10.1007/s10484-015-9326-5
Garrett-Ruffin, S., Hindash, A. C., Kaczkurkin, A. N., Mears, R. P., Morales, S., Paul, K., Pavlov, Y. G., & Keil, A. (2021). Open science in psychophysiology: An overview of challenges and emerging solutions. International Journal of Psychophysiology, 162, 69–78. https://doi.org/10.1016/j.ijpsycho.2021.02.005
Gerin, M. I., Fichtenholtz, H., Roy, A., Walsh, C. J., Krystal, J. H., Southwick, S., & Hampson, M. (2016). Real-Time fMRI Neurofeedback with war veterans with chronic PTSD: A feasibility study. Frontiers in Psychiatry, 7, 111. https://doi.org/10.3389/fpsyt.2016.00111
Gilmore, R. O., Diaz, M. T., Wyble, B. A., & Yarkoni, T. (2017). Progress toward openness, transparency, and reproducibility in cognitive neuroscience. Annals of the New York Academy of Sciences, 1396(1), 5–18. https://doi.org/10.1111/nyas.13325
Glasziou, P., Altman, D. G., Bossuyt, P., Boutron, I., Clarke, M., Julious, S., Michie, S., Moher, D., & Wager, E. (2014). Reducing waste from incomplete or unusable reports of biomedical research. The Lancet, 383(9913), 267–276. https://doi.org/10.1016/S0140-6736(13)62228-X
Goldway, N., Jalon, I., Keynan, J. N., Hellrung, L., Horstmann, A., Paret, C., & Hendler, T. (2022). Feasibility and utility of amygdala neurofeedback. Neuroscience and Biobehavioral Reviews, 138, 104694. https://doi.org/10.1016/j.neubiorev.2022.104694
Gruzelier, J., & Egner, T. (2005). Critical validation studies of neurofeedback. Child and Adolescent Psychiatric Clinics of North America, 14(1), 83–104. https://doi.org/10.1016/j.chc.2004.07.002
Hamner, M. B., & Robert, S. (2004). Post-traumatic stress disorder: Differential diagnosis and management. Current Psychosis & Therapeutics Reports, 2(3), 109–115. https://doi.org/10.1007/BF02629430
Harriman, S. L., & Patel, J. (2016). When are clinical trials registered? An analysis of prospective versus retrospective registration. Trials, 17, 187. https://doi.org/10.1186/s13063-016-1310-8
Hengartner, M. P. (2018). Raising awareness for the replication crisis in clinical psychology by focusing on inconsistencies in psychotherapy research: How much can we rely on published findings from efficacy trials? Frontiers in Psychology, 9, 256. https://doi.org/10.3389/fpsyg.2018.00256
Hong, J., & Park, J.-H. (2022). Efficacy of neuro-feedback training for PTSD symptoms: A systematic review and meta-analysis. International Journal of Environmental Research and Public Health. https://doi.org/10.3390/ijerph192013096
Huang-Storms L. (2008). Efficacy of neurofeedback for children with histories of abuse and neglect: Pilot study and meta-analytic comparison to other treatments [Doctoral dissertation, University of North Texas]. APA PsycInfo. https://www.apa.org/pubs/databases/psycinfo
Huang-Storms, L., Bodenhamer-Davis, E., Davis, R., & Dunn, J. (2007). QEEG-guided neurofeedback for children with histories of abuse and neglect: Neurodevelopmental rationale and pilot study. Journal of Neurotherapy, 10(4), 3–16. https://doi.org/10.1300/J184v10n04_02
Ioannidis, J. P. A., Greenland, S., Hlatky, M. A., Khoury, M. J., Macleod, M. R., Moher, D., Schulz, K. F., & Tibshirani, R. (2014). Increasing value and reducing waste in research design, conduct, and analysis. The Lancet, 383(9912), 166–175. https://doi.org/10.1016/S0140-6736(13)62227-8
Ioannidis, J. P. A., & Trikalinos, T. A. (2005). Early extreme contradictory estimates may appear in published research: The Proteus phenomenon in molecular genetics research and randomized trials. Journal of Clinical Epidemiology, 58(6), 543–549. https://doi.org/10.1016/j.jclinepi.2004.10.019
Ioannidis, J. P. A. (2005). Why most published research findings are false. PLoS Medicine, 2(8), e124. https://doi.org/10.1371/journal.pmed.0020124
Im, S., Fitzpatrick, S., Hien, D. A., Lopez-Castro, T., Pawlak, A., & Melara, R. D. (2022). Frontal alpha asymmetry in children with trauma exposure. Clinical EEG and Neuroscience, 53(5), 418–425. https://doi.org/10.1177/15500594221076346
Jannot, A.-S., Agoritsas, T., Gayet-Ageron, A., & Perneger, T. V. (2013). Citation bias favoring statistically significant studies was present in medical research. Journal of Clinical Epidemiology, 66(3), 296–301. https://doi.org/10.1016/j.jclinepi.2012.09.015
Kamiya, J. (2011). The first communications about operant conditioning of the EEG. Journal of Neurotherapy, 15(1), 65–73. https://doi.org/10.1080/10874208.2011.545764
Kelson, Y. C. (2013). The impact of EEG biofeedback on veteran’s symptoms of posttraumatic stress disorder (PTSD). (Doctoral dissertation). Retrieved from ProQuest Dissertations (UMI No. 3603174). ttps://search.proquest.com/docview/1492137060?pq-origsite¼gscholar
Kieser, M., Friede, T., & Gondan, M. (2013). Assessment of statistical significance and clinical relevance. Statistics in Medicine, 32(10), 1707–1719. https://doi.org/10.1002/sim.5634
Kimmelman, J. (2021). Clinical trials to authors: Please pre-register your studies! Clinical Trials, 18(6), 645–646. https://doi.org/10.1177/17407745211057186
Kluetsch, R. C., Ros, T., Théberge, J., Frewen, P. A., Calhoun, V. D., Schmahl, C., Jetly, R., & Lanius, R. A. (2014). Plastic modulation of PTSD resting-state networks and subjective wellbeing by EEG neurofeedback. Acta Psychiatrica Scandinavica, 130(2), 123–136. https://doi.org/10.1111/acps.12229
Kohrt, F., Smaldino, P. E., McElreath, R., & Schönbrodt, F. (2023). Replication of the natural selection of bad science. Royal Society Open Science, 10(2), 221306. https://doi.org/10.1098/rsos.221306
Kühberger, A., Fritz, A., & Scherndl, T. (2014). Publication bias in psychology: A diagnosis based on the correlation between effect size and sample size. PLoS ONE, 9(9), e105825. https://doi.org/10.1371/journal.pone.0105825
Kvarven, A., Strømland, E., & Johannesson, M. (2020). Comparing meta-analyses and preregistered multiple-laboratory replication projects. Nature Human Behaviour, 4(4), 423–434. https://doi.org/10.1038/s41562-019-0787-z
La Vaque, T. J., Hammond, D. C., Trudeau, D., et al. (2002). Template for developing guidelines for the evaluation of the clinical efficacy of psychophysiological interventions. Applied Psychophysiology and Biofeedback, 27, 273–281. https://doi.org/10.1023/A:1021061318355
Larson, M. J., & Carbine, K. A. (2017). Sample size calculations in human electrophysiology (EEG and ERP) studies: A systematic review and recommendations for increased rigor. International Journal of Psychophysiology, 111, 33–41. https://doi.org/10.1016/j.ijpsycho.2016.06.015
Larson, M. J. (2020). Improving the rigor and replicability of applied psychophysiology research: Sample size, standardization, transparency, and preregistration. Biofeedback, 48(1), 2–6. https://doi.org/10.5298/1081-5937-48.1.2
Leem, J., Cheong, M. J., Yoon, S.-H., Kim, H., Jo, H.-G., Lee, H., Kim, J., Kim, H. Y., Kim, G.-W., & Kang, H. W. (2020). Neurofeedback self-regulating training in patients with Post traumatic stress disorder: A randomized controlled trial study protocol. Integrative Medicine Research, 9(4), 100464. https://doi.org/10.1016/j.imr.2020.100464
Leichsenring, F., & Rabung, S. (2011). Long-term psychodynamic psychotherapy in complex mental disorders: Update of a meta-analysis. The British Journal of Psychiatry, 199(1), 15–22. https://doi.org/10.1192/bjp.bp.110.082776
Leichsenring, F., Steinert, C., Rabung, S., & Ioannidis, J. P. A. (2022). The efficacy of psychotherapies and pharmacotherapies for mental disorders in adults: An umbrella review and meta-analytic evaluation of recent meta-analyses. World Psychiatry, 21(1), 133–145. https://doi.org/10.1002/wps.20941
Lorenz, R. C., Matthias, K., Pieper, D., Wegewitz, U., Morche, J., Nocon, M., Rissling, O., Schirm, J., & Jacobs, A. (2019). A psychometric study found AMSTAR 2 to be a valid and moderately reliable appraisal tool. Journal of Clinical Epidemiology, 114, 133–140. https://doi.org/10.1016/j.jclinepi.2019.05.028
Louthrenoo, O., Boonchooduang, N., Likhitweerawong, N., Charoenkwan, K., & Srisurapanont, M. (2022). The effects of neurofeedback on executive functioning in children with ADHD: A meta-analysis. Journal of Attention Disorders, 26(7), 976–984. https://doi.org/10.1177/10870547211045738
Lobo, I., Portugal, L. C., Figueira, I., Volchan, E., David, I., Garcia Pereira, M., & de Oliveira, L. (2015). EEG correlates of the severity of posttraumatic stress symptoms: A systematic review of the dimensional PTSD literature. Journal of Affective Disorders, 183, 210–220. https://doi.org/10.1016/j.jad.2015.05.015
Lin, L., & Aloe, A. M. (2021). Evaluation of various estimators for standardized mean difference in meta-analysis. Statistics in Medicine, 40(2), 403–426. https://doi.org/10.1002/sim.8781
Macleod, M. R., Michie, S., Roberts, I., Dirnagl, U., Chalmers, I., Ioannidis, J. P. A., Al-Shahi Salman, R., Chan, A.-W., & Glasziou, P. (2014). Biomedical research: Increasing value, reducing waste. The Lancet, 383(9912), 101–104. https://doi.org/10.1016/S0140-6736(13)62329-6
Marshall, P. J., Fox, N. A., Bucharest Early Intervention Project Core Group. (2004). A comparison of the electroencephalogram between institutionalized and community children in Romania. Journal of Cognitive Neuroscience, 16(8), 1327–1338. https://doi.org/10.1162/0898929042304723
Meehl, P. E. (1990). Why summaries of research on psychological theories are often uninterpretable. Prävention Und Rehabilitation, 66(1), 195. https://doi.org/10.2466/PR0.66.1.195-244
Miyakawa, T. (2020). No raw data, no science: Another possible source of the reproducibility crisis. Molecular Brain, 13(1), 24. https://doi.org/10.1186/s13041-020-0552-2
Moncrieff, J., & Kirsch, I. (2015). Empirically derived criteria cast doubt on the clinical significance of antidepressant-placebo differences. Contemporary Clinical Trials, 43, 60–62. https://doi.org/10.1016/j.cct.2015.05.005
Micoulaud-Franchi, J.-A., & Fovet, T. (2016). Neurofeedback: time needed for a promising non-pharmacological therapeutic method. The Lancet. Psychiatry, 3(9), e16. https://doi.org/10.1016/S2215-0366(16)30189-4
Misaki, M., Mulyana, B., Zotev, V., Wurfel, B. E., Krueger, F., Feldner, M., & Bodurka, J. (2021). Hippocampal volume recovery with real-time functional MRI amygdala neurofeedback emotional training for posttraumatic stress disorder. Journal of Affective Disorders, 283, 229–235. https://doi.org/10.1016/j.jad.2021.01.058
Misaki, M., Phillips, R., Zotev, V., Wong, C.-K., Wurfel, B. E., Krueger, F., Feldner, M., & Bodurka, J. (2018). Real-time fMRI amygdala neurofeedback positive emotional training normalized resting-state functional connectivity in combat veterans with and without PTSD: a connectome-wide investigation. NeuroImage. Clinical, 20, 543–555. https://doi.org/10.1016/j.nicl.2018.08.025
National Guideline Alliance (UK). (2018). Evidence reviews for psychological, psychosocial and other non-pharmacological interventions for the prevention of PTSD in adults: Post-traumatic stress disorder: Evidence review C. National Institute for Health and Care Excellence (NICE).
Naudet, F., Sakarovitch, C., Janiaud, P., Cristea, I., Fanelli, D., Moher, D., & Ioannidis, J. P. A. (2018). Data sharing and reanalysis of randomized controlled trials in leading biomedical journals with a full data sharing policy: Survey of studies published in The BMJ and PLOS Medicine. BMJ (clinical Research Edition), 360, k400. https://doi.org/10.1136/bmj.k400
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., Contestabile, M., Dafoe, A., Eich, E., Freese, J., Glennerster, R., Goroff, D., Green, D. P., Hesse, B., Humphreys, M., & Yarkoni, T. (2015). Promoting an open research culture. Science, 348(6242), 1422–1425. https://doi.org/10.1126/science.aab2374
Nicholson, A. A., Densmore, M., Frewen, P. A., Neufeld, R. W. J., Théberge, J., Jetly, R., Lanius, R. A., & Ros, T. (2023). Homeostatic normalization of alpha brain rhythms within the default-mode network and reduced symptoms in post-traumatic stress disorder following a randomized controlled trial of electroencephalogram neurofeedback. Brain Communications, 5(2), 068. https://doi.org/10.1093/braincomms/fcad068
Nicholson, A. A., Rabellino, D., Densmore, M., Frewen, P. A., Paret, C., Kluetsch, R., Schmahl, C., Théberge, J., Neufeld, R. W. J., McKinnon, M. C., Reiss, J., Jetly, R., & Lanius, R. A. (2017). The neurobiology of emotion regulation in posttraumatic stress disorder: Amygdala downregulation via real-time fMRI neurofeedback. Human Brain Mapping, 38(1), 541–560. https://doi.org/10.1002/hbm.23402
Nicholson, A. A., Ros, T., Densmore, M., Frewen, P. A., Neufeld, R. W. J., Théberge, J., Jetly, R., & Lanius, R. A. (2020). A randomized, controlled trial of alpha-rhythm EEG neurofeedback in posttraumatic stress disorder: A preliminary investigation showing evidence of decreased PTSD symptoms and restored default mode and salience network connectivity using fMRI. NeuroImage Clinical, 28, 102490. https://doi.org/10.1016/j.nicl.2020.102490
Nicholson, A. A., Ros, T., Frewen, P. A., Densmore, M., Théberge, J., Kluetsch, R. C., Jetly, R., & Lanius, R. A. (2016). Alpha oscillation neurofeedback modulates amygdala complex connectivity and arousal in posttraumatic stress disorder. NeuroImage Clinical, 12, 506–516. https://doi.org/10.1016/j.nicl.2016.07.006
Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349(6251), aac4716. https://doi.org/10.1126/science.aac4716
Othmer, S. (2020). History of neurofeedback. In H. W. Kirk (Ed.), Restoring the brain: neurofeedback as an integrative approach to health (pp. 23–55). Routledge.
Panisch, L. S., & Hai, A. H. (2018). The effectiveness of using neurofeedback in the treatment of post-traumatic stress disorder: A systematic review. Trauma, Violence & Abuse. https://doi.org/10.1177/1524838018781103
Page, M. J., McKenzie, J., Bossuyt, P., Boutron, I., Hoffmann, T., Mulrow, C. D., Shamseer, L., Tetzlaff, J., Akl, E., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E., Mayo-Wilson, E., McDonald, S., & Moher, D. (2020). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. International Journal of Surgery. https://doi.org/10.31222/osf.io/v7gm2
Pfeiffer, T., Bertram, L., & Ioannidis, J. P. A. (2011). Quantifying selective reporting and the Proteus phenomenon for multiple datasets with similar bias. PLoS ONE, 6(3), e18362. https://doi.org/10.1371/journal.pone.0018362
Pigott, H. E., Trullinger, M., Harbin, H., Cammack, J., Harbin, F., & Cannon, R. (2017). Confusion regarding operant conditioning of the EEG. The Lancet. Psychiatry, 4(12), 897. https://doi.org/10.1016/S2215-0366(17)30436-4
Pop-Jordanova, N., & Zorcec, T. (2004). Child trauma, attachment and biofeedback mitigation: Prilozi Contributions. Macedonian Academy of Sciences and Arts, Section of Biological and Medical Sciences, 25(1–2), 103–114.
Reiter, K., Andersen, S. B., & Carlsson, J. (2016). Neurofeedback treatment and posttraumatic stress disorder: Effectiveness of neurofeedback on posttraumatic stress disorder and the optimal choice of protocol. The Journal of Nervous and Mental Disease, 204(2), 69–77. https://doi.org/10.1097/NMD.0000000000000418
Rice, D. B., Raffoul, H., Ioannidis, J. P. A., & Moher, D. (2020). Academic criteria for promotion and tenure in biomedical sciences faculties: Cross sectional analysis of international sample of universities. BMJ (clinical Research Edition), 369, m2081. https://doi.org/10.1136/bmj.m2081
Riesco-Matías, P., Yela-Bernabé, J. R., Crego, A., & Sánchez-Zaballos, E. (2019). What do meta-analyses have to say about the efficacy of neurofeedback applied to children with ADHD? Review of previous meta-analyses and a new meta-analysis. Journal of Attention Disorders. https://doi.org/10.1177/1087054718821731
Rogel, A., Loomis, A. M., Hamlin, E., Hodgdon, H., Spinazzola, J., & van der Kolk, B. (2020). The impact of neurofeedback training on children with developmental trauma: A randomized controlled study. Psychological Trauma, 12(8), 918–929. https://doi.org/10.1037/tra0000648
Rogers, A. (2017). Star neuroscientist Tom Insel leaves the Google-spawned Verily for… a startup? Wired, 5, 11–17.
Ros, T., Frewen, P., Théberge, J., Michela, A., Kluetsch, R., Mueller, A., Candrian, G., Jetly, R., Vuilleumier, P., & Lanius, R. A. (2017). Neurofeedback tunes scale-free dynamics in spontaneous brain activity. Cerebral Cortex, 27(10), 4911–4922. https://doi.org/10.1093/cercor/bhw285
Ros, T., Baars, B. J., Lanius, R. A., & Vuilleumier, P. (2014). Tuning pathological brain oscillations with neurofeedback: A systems neuroscience framework. Frontiers in Human Neuroscience, 8, 1008.
Ros, T., Enriquez-Geppert, S., Zotev, V., Young, K. D., Wood, G., Whitfield-Gabrieli, S., Wan, F., Vuilleumier, P., Vialatte, F., Van De Ville, D., Todder, D., Surmeli, T., Sulzer, J. S., Strehl, U., Sterman, M. B., Steiner, N. J., Sorger, B., Soekadar, S. R., Sitaram, R., & Thibault, R. T. (2020). Consensus on the reporting and experimental design of clinical and cognitive-behavioural neurofeedback studies (CRED-nf checklist). Brain, 143(6), 1674–1685. https://doi.org/10.1093/brain/awaa009
Schutz, C. A., & Herbert, J. (2022). Review of the evidence for neurofeedback training for children and adolescents who have experienced traumatic events. Trauma Violence & Abuse. https://doi.org/10.1177/15248380221134295
Schabus, M. (2017). Reply: On assessing neurofeedback effects: should double-blind replace neurophysiological mechanisms? Brain, 140(10), e64. https://doi.org/10.1093/brain/awx212
Schabus, M. (2018). Reply: Noisy but not placebo: defining metrics for effects of neurofeedback. Brain, 141(5), 41. https://doi.org/10.1093/brain/awy061
Schabus, M., Griessenberger, H., Gnjezda, M.-T., Heib, D. P. J., Wislowska, M., & Hoedlmoser, K. (2017). Better than sham? A double-blind placebo-controlled neurofeedback study in primary insomnia. Brain, 140(4), 1041–1052. https://doi.org/10.1093/brain/awx011
Schönenberg, M., Wiedemann, E., Schneidt, A., Scheeff, J., Logemann, A., Keune, P. M., & Hautzinger, M. (2017a). Confusion regarding operant conditioning of the EEG - Authors’ reply. The Lancet Psychiatry, 4(12), 897–898. https://doi.org/10.1016/S2215-0366(17)30437-6
Schönenberg, M., Wiedemann, E., Schneidt, A., Scheeff, J., Logemann, A., Keune, P. M., & Hautzinger, M. (2017b). Neurofeedback, sham neurofeedback, and cognitive-behavioural group therapy in adults with attention-deficit hyperactivity disorder: a triple-blind, randomised, controlled trial. The Lancet Psychiatry, 4(9), 673–684. https://doi.org/10.1016/S2215-0366(17)30291-2
Schuurmans, A. A. T., Nijhof, K. S., Scholte, R., Popma, A., & Otten, R. (2020). A novel approach to improve stress regulation among traumatized youth in residential care: Feasibility study testing three game-based meditation interventions. Early Intervention in Psychiatry, 14(4), 476–485. https://doi.org/10.1111/eip.12874
Schuurmans, A. A. T., Nijhof, K. S., Scholte, R., Popma, A., & Otten, R. (2021). Effectiveness of game-based meditation therapy on neurobiological stress systems in adolescents with posttraumatic symptoms: a randomized controlled trial. Stress (amsterdam, Netherlands), 24(6), 1042–1049. https://doi.org/10.1080/10253890.2021.1998444
Shea, B. J., Reeves, B. C., Wells, G., Thuku, M., Hamel, C., Moran, J., Moher, D., Tugwell, P., Welch, V., Kristjansson, E., & Henry, D. A. (2017). AMSTAR 2: A critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ (clinical Research Edition), 358, j4008. https://doi.org/10.1136/bmj.j4008
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22(11), 1359–1366. https://doi.org/10.1177/0956797611417632
Smaldino, P. E., & McElreath, R. (2016). The natural selection of bad science. Royal Society Open Science, 3(9), 160384. https://doi.org/10.1098/rsos.160384
Smit, Y., Huibers, M. J. H., Ioannidis, J. P. A., van Dyck, R., van Tilburg, W., & Arntz, A. (2012). The effectiveness of long-term psychoanalytic psychotherapy: a meta-analysis of randomized controlled trials. Clinical Psychology Review, 32(2), 81–92. https://doi.org/10.1016/j.cpr.2011.11.003
Smith, D. B. (2009). The Doctor Is" IN": At 88, Aaron Beck is now revered for an approach to psychotherapy that pushed Freudian analysis aside. The American Scholar, 78(4), 20–31.
Stanley, T. D., Doucouliagos, H., Ioannidis, J. P. A., & Carter, E. C. (2021). Detecting publication selection bias through excess statistical significance. Research Synthesis Methods, 12(6), 776–795. https://doi.org/10.1002/jrsm.1512
Steingrimsson, S., Bilonic, G., Ekelund, A. C., Larson, T., Stadig, I., Svensson, M., Vukovic, I. S., Wartenberg, C., Wrede, O., & Bernhardsson, S. (2020). Electroencephalography-based neurofeedback as treatment for post-traumatic stress disorder: A systematic review and meta-analysis. European Psychiatry, 63(1), e7.
Tackett, J. L., Brandes, C. M., King, K. M., & Markon, K. E. (2019). Psychology’s replication crisis and clinical psychological science. Annual Review of Clinical Psychology, 15, 579–604. https://doi.org/10.1146/annurev-clinpsy-050718-095710
Thibault, R. T., Lifshitz, M., & Raz, A. (2017). Neurofeedback or neuroplacebo? Brain, 140(4), 862–864. https://doi.org/10.1093/brain/awx033
Thibault, R. T., Lifshitz, M., & Raz, A. (2018). The climate of neurofeedback: scientific rigour and the perils of ideology. Brain, 141(2), 11. https://doi.org/10.1093/brain/awx330
Thibault, R. T., & Raz, A. (2016a). Neurofeedback: the power of psychosocial therapeutics. The Lancet Psychiatry, 3(11), e18. https://doi.org/10.1016/S2215-0366(16)30326-1
Thibault, R. T., & Raz, A. (2016b). When can neurofeedback join the clinical armamentarium? The Lancet Psychiatry, 3(6), 497–498. https://doi.org/10.1016/S2215-0366(16)30040-2
Thompson, P. M., Stein, J. L., Medland, S. E., Hibar, D. P., Vasquez, A. A., Renteria, M. E., Toro, R., Jahanshad, N., Schumann, G., Franke, B., Wright, M. J., Martin, N. G., Agartz, I., Alda, M., Alhusaini, S., Almasy, L., Almeida, J., Alpert, K., Andreasen, N. C., et al. (2014). The ENIGMA Consortium: Large-scale collaborative analyses of neuroimaging and genetic data. Brain Imaging and Behavior, 8(2), 153–182. https://doi.org/10.1007/s11682-013-9269-5
Tolin, D. F. (2010). Is cognitive-behavioral therapy more effective than other therapies? A meta-analytic review. Clinical Psychology Review, 30(6), 710–720. https://doi.org/10.1016/j.cpr.2010.05.003
Torrey, E. F., Simmons, W. W., Hancq, E. S., & Snook, J. (2021). The continuing decline of clinical research on serious mental illnesses at NIMH. Psychiatric Services, 72(11), 1342–1344. https://doi.org/10.1176/appi.ps.202000739
Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008). Selective publication of antidepressant trials and its influence on apparent efficacy. The New England Journal of Medicine, 358(3), 252–260. https://doi.org/10.1056/NEJMsa065779
Van Calster, B., Wynants, L., Riley, R. D., van Smeden, M., & Collins, G. S. (2021). Methodology over metrics: Current scientific standards are a disservice to patients and society. Journal of Clinical Epidemiology, 138, 219–226. https://doi.org/10.1016/j.jclinepi.2021.05.018
van der Kolk, B. A., Hodgdon, H., Gapen, M., Musicaro, R., Suvak, M. K., Hamlin, E., & Spinazzola, J. (2016). A randomized controlled study of neurofeedback for chronic PTSD. PLoS ONE, 11(12), e0166752. https://doi.org/10.1371/journal.pone.0166752
Wahbeh, H., & Oken, B. S. (2013). Peak high-frequency HRV and peak alpha frequency higher in PTSD. Applied Psychophysiology and Biofeedback, 38(1), 57–69. https://doi.org/10.1007/s10484-012-9208-z
Wicherts, J. M., Borsboom, D., Kats, J., & Molenaar, D. (2006). The poor availability of psychological research data for reanalysis. The American Psychologist, 61(7), 726–728. https://doi.org/10.1037/0003-066X.61.7.726
Witte, M., Kober, S. E., & Wood, G. (2018). Noisy but not placebo: Defining metrics for effects of neurofeedback. Brain, 141(5), 40. https://doi.org/10.1093/brain/awy060
Zotev, V., Phillips, R., Misaki, M., Wong, C. K., Wurfel, B. E., Krueger, F., Feldner, M., & Bodurka, J. (2018). Real-time fMRI neurofeedback training of the amygdala activity with simultaneous EEG in veterans with combat-related PTSD. NeuroImage Clinical, 19, 106–121. https://doi.org/10.1016/j.nicl.2018.04.010
Zweerings, J., Pflieger, E. M., Mathiak, K. A., Zvyagintsev, M., Kacela, A., Flatten, G., & Mathiak, K. (2018). Impaired voluntary control in PTSD: probing self-regulation of the ACC with real-time fMRI. Frontiers in Psychiatry, 9, 219. https://doi.org/10.3389/fpsyt.2018.00219
Informally published work:
Gelman, A., & Loken, E. (2013). The garden of forking paths: Why multiple comparisons can be a problem, even when there is no “fishing expedition”or “p-hacking”and the research hypothesis was posited ahead of time. http://www.stat.columbia.edu/~gelman/research/unpublished/p_hacking.pdf