Cognitive Behavioral Therapy Using a Mobile Application Synchronizable With Wearable Devices for Insomnia Treatment: A Pilot Study
Abstract
Study Objectives:
The use of telemedicine with a mobile application (MA) and a wearable device (WD) for the management of sleep disorders has recently received considerable attention. We designed an MA synchronizable with a WD for insomnia treatment. Our pilot study determined the efficacy of simplified group cognitive behavioral therapy for insomnia (CBT-I) delivered using our MA and assessed participant adherence to and satisfaction with the device.
Methods:
The efficacy of the CBT-I using MA (CBT-I-MA) was assessed by comparing sleep variables (sleep efficiency [SE], Insomnia Severity Index [ISI], and Pittsburgh Sleep Quality Inventory [PSQI] scores) before and after a 4-week treatment protocol in 19 patients with insomnia disorder patients. SE was assessed using a sleep diary, actigraphy, and the PSQI.
Results:
The intervention significantly improved all three measures of SE (P < .05), and the response rate to treatment was high (94.7%). Total ISI and PSQI scores and sleep latency, as measured by the sleep diary, improved significantly. Participants showed relatively good adherence to our MA, and sleep diary entries were made on 24.3 ± 3.8 of 28 days. Moreover, 94.7% of the participants reported that our MA was effective for treating insomnia.
Conclusions:
Our pilot study suggested the clinical usefulness of a CBT-I-MA. We expect that our findings will lead to further development and replication studies of CBT-I-MA.
Citation:
Kang SG, Kang JM, Cho SJ, Ko KP, Lee YJ, Lee HJ, Kim L, Winkelman JW. Cognitive behavioral therapy using a mobile application synchronizable with wearable devices for insomnia treatment: a pilot study. J Clin Sleep Med. 2017;13(4):633–640.
Keywords: cognitive behavioral therapy, insomnia, mobile application, telemedicine, wearable device
INTRODUCTION
Cognitive behavioral therapy for insomnia (CBT-I) is the first-line treatment for chronic insomnia; however, the intervention requires an experienced therapist and is time consuming and expensive. For these reasons, self-help interventions have been widely investigated, and a recent meta-analysis found that therapist-guided online CBT-I was as effective as face-to-face treatment.1 Although Internet-based self-help CBT-I is more convenient than personal visits, patients tend to experience decreased motivation to participate, attrition, and poor adherence under less interaction or communication with therapists.1,2
The increased use of mobile devices (eg, a smartphone or wearable device [WD]) that monitor activity and sleep, such as Fitbit trackers, is expected to expand the clinical applications of telemedicine for sleep disorders.3 The combined use of a WD with a mobile application (MA) for CBT-I could facilitate objective sleep tracking and maintenance of a subjective sleep diary; it may thereby improve the accuracy and convenience of monitoring sleep quality. Furthermore, the highly portable nature of smartphones may increase adherence to CBT-I and resolve shortcomings of the Internet-based self-help CBT-I.4 Thus, we developed an MA synchronizable with a WD for the treatment of insomnia.
The area of mobile health (mHealth) utilizing a MA has been studied extensively, particularly in the field of non-sleep medical diseases such as pulmonary disease and cardiac disease.5,6 Although a number of such studies made successful cases, the area of sleep medicine has not been sufficiently studied so far. Several MAs have been developed to monitor sleep. For example, the CBT-I Coach,4 Sleepio,7 Win-Win aSleep,8 and SleepRate9 applications were developed to track sleep or facilitate CBT-I. Previous pilot studies found that CBT-I Coach improved sleep in 4 patients with cannabis-use disorder10; when used as an adjunct to CBT-I, the MA improved adherence and sleep outcomes.11 However, to our knowledge, no previous study has investigated the efficacy of CBT-I using MA (CBT-I-MA) for the treatment of chronic insomnia.
Our pilot study aimed to (1) evaluate the efficacy of the simplified group CBT-I-MA in patients with insomnia disorder and (2) determine participant adherence to and satisfaction with our MA. As a subanalysis, we compared the efficacy and adherence/satisfaction between the group using a WD and the group not using a WD.
METHODS
Development of the MA
Our MA was developed by board-certified psychiatrists specializing in sleep medicine in collaboration with an information technology company (EIP, Incheon, Republic of Korea). Because more than 90% of Korean smartphone users used the Android operating system in 2013, which is when we designed our MA, we developed only an Android version. The device was developed for research purposes and has not been released to the public. Our MA was made for an adjunct to face-to-face CBT-I; however, after acquiring a basic understanding of CBT-I and the MA, it can be used as a self-help tool with occasional therapist checkups. Moreover, the MA can be used with or without a WD depending on the user's preference.
The characteristics of our MA are shown in Table 1. The core treatments were sleep restriction therapy (SRT) and stimulus control therapy (SCT).12,13 Our MA used a consensus sleep diary.14 When the sleep diary was completed for the previous night, the total sleep time (TST) and sleep efficiency (SE) were automatically calculated. The sleep prescription menu calculated and displayed the mean sleep values (ie, average TST and SE) of the subjective sleep diary for the previous 7 days and facilitated the calculation of the recommended time in bed (TIB) for SRT. The recommended TIB was calculated according to the mean TST and SE of the previous week and the target SE for SRT. The WD used was the Fitbit Charge HR (Fitbit, San Francisco, California, United States), and the users were able to synchronize their sleep records with the Fitbit MA using Bluetooth connectivity. The sleep records were downloaded from the Fitbit web server and synchronized with our MA. The information from our MA was uploaded to the therapists' web server that was created for this research project.
Table 1.
Major components and contents of our mobile application synchronizable with wearable devices for insomnia treatment.
Participants
The inclusion and exclusion criteria of the research participants are shown in Table 2. All participants met the diagnostic criteria of insomnia disorder based on the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5).15 Board-certified psychiatrists specializing in sleep medicine evaluated the eligibility of participants using a semistructured interview based on the Structured Clinical Interview for DSM-5.15,16 We obtained written informed consent from all participants, and the study was approved by the Gil Medical Center Institutional Review Board.
Table 2.
Inclusion and exclusion criteria of this study.
For the subanalysis, the participants were randomized into two groups (WD users [n = 10] and WD nonusers [n = 9]) to compare the treatment efficacy between two groups. The unblinded simple randomization17 was performed using a Microsoft Excel spreadsheet (Microsoft Corporation, Redmond, Washington, United States).
Procedures
The CBT-I team consisted of a primary therapist, assistant therapist, and a research coordinator. The treatment protocol consisted of simplified group CBT-I using our MA, 3 face-to-face visits (baseline [W0], week 2 [W2], and week 4 [W4]), and 2 telephone sessions (week 1 [W1] and week 3 [W3]; Table 3). The core interventions were SRT and SCT.12,13 SRT limits the TIB (sleep window) to the TST to increase the homeostatic sleep drive and SE.13 The TIB settings and adjustments were based on those of previous studies.13 SCT involves going to bed only when sleepy and getting out of bed when unable to sleep.12
Table 3.
Summary of the protocol of simplified group cognitive behavioral therapy for insomnia using our mobile application.
Participants were required to keep a daily sleep diary in our MA. To compare average SE during the first and fourth weeks, participants were required to continue with their usual sleep cycle during the first week (days 0–6). On W1, W2, and W3, therapists recommended the TIB based on the sleep prescription menu of our MA. However, the sleep window and the TIB were adjusted over at least 4 hours and were slightly compromised according to the physical condition, emotional distress, and working schedule of each patient in certain instances. Participants were required to maintain their current dose of psychotropic medications and frequency of “as needed” hypnotic drugs; however, they were permitted to decrease the dose and frequency of hypnotic drugs upon request.
Measures
Participants were asked to complete the Korean version of Insomnia Severity Index (ISI)18 and Pittsburgh Sleep Quality Inventory (PSQI)19 based their symptoms during the previous week. The Korean version of the Dysfunctional Beliefs and Attitudes about Sleep,20 Beck Depression Inventory,21 and Beck Anxiety Inventory22 were also administered.
All participants were required to wear an Actiwatch 2 monitor (Philips Respironics, Murrysville, Pennsylvania, United States) on their nondominant wrist during the first and fourth week of treatment. There were missing actigraphy data for 1 patient at W1 and in 7 patients at W4 due to device malfunction or charging failures. All actigraphy data in this analysis covered the entire TIB reported by participants. Those in the WD user group were required to wear the Fitbit Charge HR on their nondominant wrist throughout the experimental period to monitor sleep duration, number of awakenings, and SE using a triaxial accelerometer.
The WD user and WD nonuser groups were subjected to the same treatment, with the exception that, at W0, the WD user group received instructions for installing the Fitbit application, using the Fitbit tracker, and checking sleep measurements in our MA.
Outcome Measures
The primary outcome variable was postintervention change in SE as measured by sleep diary, actigraphy, and PSQI data from all participants (ie, WD users and WD nonusers). The secondary outcome variables were total ISI and PSQI scores and the sleep latency (SL) and TST data from the sleep diary. The average sleep values, including SE, as measured by the sleep diary and actigraphy, were compared for each week (ie, W1, days 0–6 versus W4, days 21–27). A treatment response was defined as a change in the PSQI score of ≥ 3 points or a ≥ 10% increase in SE, as measured by the sleep diary.23
Next, we determined participant adherence to and satisfaction with our MA and as a subanalysis, we compared treatment efficacy in the WD user and WD nonuser groups.
Statistical Analysis
The Statistical Package for the Social Sciences version 23.0 (SPSS Inc., Chicago, Illinois, United States) and SAS 9.2 (SAS Institute, Cary, North Carolina, United States) were used to perform the statistical tests. The statistical tests used are shown in each table. Values of P < .05 (two-tailed) were deemed to indicate statistical significance. A post hoc power analysis was conducted with G*Power software (Universität Kiel, Germany) to determine the retrospective power of the key finding of this study.24
RESULTS
Demographic and Clinical Characteristics at Baseline
In total, 19 participants completed the study. The mean age was 45.1 years, and the average duration of insomnia disorder was 60.4 months (Table 4).
Table 4.
Demographic and clinical characteristics of the participants at baseline.
Treatment Outcomes
All measures of SE showed significant improvement (P < .05): SE improved from 68.7% at W1 to 80.9% at W4, as measured by the sleep diary and a post hoc power analysis indicated the power of 0.777; actigraphy showed an increase from 72.1% at W1 to 79.5% at W4; and the SE of PSQI increased from 51.5% at W0 to 77.7% at W4 (Figure 1, Table 5).
Figure 1. Improvement in sleep efficiency after cognitive behavioral therapy for insomnia using a mobile application.
Data are mean and standard error of the mean. The SE when using the sleep logs and actigraphy is the average values during the first, second, and fourth weeks. PSQI = Pittsburgh Sleep Quality Index, SE = sleep efficiency, W0 = baseline, W1 = week 1, W2 = week 2; W4 = week 4.
Table 5.
Treatment outcome of cognitive behavioral therapy for insomnia using our mobile application (comparison between pretreatment and posttreatment).
The total ISI and PSQI scores improved significantly between W0 and W4 (Figure 2, Table 5), and SL improved significantly, from 54.3 minutes at W1 to 32.9 minutes at W4. In total, 18 (94.7%) participants showed a treatment response at W4.
Figure 2. Improvement in Insomnia Severity Index and Pittsburgh Sleep Quality Index total score after the intervention.
Data are mean and standard error of the mean. (A) Improvement in ISI total score after the intervention. (B) Improvement in PSQI total score after the intervention. ISI = Insomnia Severity Index, PSQI = Pittsburgh Sleep Quality Index, W0 = baseline, W2 = week 2, W4 = week 4.
No participants increased the dose or frequency of their hypnotic drugs; however, 2 discontinued hypnotic medication during the study, and 1 participant arbitrarily stopped taking an antidepressant in response to improved sleep.
Adherence and Satisfaction to our MA
The study participants showed relatively good adherence to our MA (Table 6). They made entries in their sleep diary on 24.3 ± 3.8 days each month (28 days). Seventeen participants (89.5%) answered that our MA was convenient to use, 18 (94.7%) answered that they used our MA frequently, 18 (94.7%) answered that our MA was effective for coping with insomnia, and 19 (100%) answered that they would use it again in the future. No meaningful difference was found in the responses between the WD user and WD nonuser groups (Table S1, supplemental material).
Table 6.
Adherence to and satisfaction with the mobile app among all of the participants and in the WD user and WD nonuser groups.
Comparison of WD Users and Nonusers
The average SE recorded in the sleep diary had changed significantly more at W2 relative to W1 in the WD user group than in the WD nonuser group; however, no difference was found between the two groups at W4 (Table S1, supplemental material). No other change of the sleep measurements differed significantly between groups.
DISCUSSION
Our pilot study investigated the efficacy of CBT-I using an MA synchronizable with a WD. The main finding of this study was that CBT-I-MA administered through our MA induced significant improvements, with an intermediate effect size for the sleep diary SE and with a large effect size for the SE from PSQI. The SE from actigraphy also improved significantly, although the effect size was small. In addition to these findings, the response rate of the intervention was good, although the number of participants was small. We believe that these results suggest the clinical usefulness of a simplified and short-term CBT-I-MA, and that it has introduced a new treatment model.
Participants showed relatively good adherence to and overall satisfaction with our MA. Patients can use and enter data in their diary anywhere and more easily than an Internet-based sleep diaries, because no wired Internet connection is required. The alarm option of the MA could increase patients' completion rate of the sleep diary entry and adherence to the MA. Using an MA to keep sleep diaries could reduce the possibility of losing the sleep diary, unlike when using a pen/pencil-and-paper method. Using an MA also could make it easy for therapists and patients to review the diaries and calculate the average TST and SE for the most recent 1-week period. Because our MA enables therapists to review a sleep diary by transferring it via an Internet web server, therapists can understand the sleep condition of patients and provide necessary advice without any face-to-face visit.
There was no significant difference in the treatment efficacy, adherence, and satisfaction with the MA between WD user and WD nonuser groups. This study has several limitations in interpreting this finding: (1) such comparison was not the primary purpose of this study but was made as subanalysis, (2) the sample size was quite small and its randomization was not blinded, (3) two groups received the same treatment, except for the initial education session on how to use Fitbit, (4) certain confounding factors such as difference in age, employment status, and insomnia severity in ISI and PSQI scores at baseline make it even harder to properly interpret the comparison results. In addition, the study design of categorizing patients into two groups for the subanalysis might have produced potential flaws in the study design for the primary research aim, although the two groups received almost the same treatment.
Other major limitations of this pilot study for the primary research aim are the small sample size for determining the efficacy of the CBT-I-MA and the lack of a wait list control group; therefore, we cannot exclude the possibility of type I error. In order to better appreciate the efficacy of a MA or CBT-I-MA, subsequent research needs to occur with a larger sample size and with a wait list control group. For better comparison of groups using a WD and not using a WD, an advanced study design will be also necessary, which satisfies the larger sample size, balanced matched control group for the demographic and clinical characteristics, and a blinded group randomization.
Another consideration necessary here is that, for the reason that this study intended to see the therapeutic effect of simplified group CBT-I-MA, the efficacy of the result here might have been affected by some other elements including, but not limited to, the competence of the therapists, the relatively frequent visits in this CBT-I protocol and the therapist/patient relationship.
In summary, our findings suggest that our CBT-I-MA can be clinically useful for the treatment of insomnia. Patients can use the MA anywhere, and it is more accessible than an Internet-based tool. Furthermore, our MA simplified the review of the sleep diary measurements and the calculations of average TST and SE for the previous week. Using the MA and the WD at the same time, although no meaningful result gained in this study, provides an objective measurement of sleep variables and might help in correcting the underestimation of TST and SE of patients with paradoxical insomnia. We anticipate that our findings will stimulate the further development and replication studies of an MA synchronizable with a WD for the treatment of sleep disorders.
DISCLOSURE STATEMENT
Institution at which the work was performed: Gil Medical Center, Incheon, Republic of Korea. This research was supported by Basic Science Research Program through the National Research Foundation of Korea funded by the Ministry of Education (NRF-2013R1A1A2059105). Dr. Winkelman has consulted for Merck and Xenoport; received research support from Xenoport and Luitpold Pharma; and received royalties from UpToDate. The other authors have indicated no financial conflicts of interest.
EDITOR'S NOTE
The Emerging Technologies section focuses on new tools and techniques of potential utility in the diagnosis and management of any and all sleep disorders. The technologies may not yet be marketed, and indeed may only exist in prototype form. Some preliminary evidence of efficacy must be available, which can consist of small pilot studies or even data from animal studies, but definitive evidence of efficacy will not be required, and the submissions will be reviewed according to this standard. The intent is to alert readers of Journal of Clinical Sleep Medicine of promising technology that is in early stages of development. With this information, the reader may wish to (1) contact the author(s) in order to offer assistance in more definitive studies of the technology; (2) use the ideas underlying the technology to develop novel approaches of their own (with due respect for any patent issues); and (3) focus on subsequent publications involving the technology in order to determine when and if it is suitable for application to their own clinical practice. The Journal of Clinical Sleep Medicine and the American Academy of Sleep Medicine expressly do not endorse or represent that any of the technology described in the Emerging Technologies section has proven efficacy or effectiveness in the treatment of human disease, nor that any required regulatory approval has been obtained.
ACKNOWLEDGMENTS
The authors thank Sara Mariani at Brigham and Women's Hospital and Harvard Medical School for English editing and much helpful advice.
ABBREVIATIONS
-
ANOVA
analysis of variance
BAI
Beck Anxiety Inventory
BDI
Beck Depression Inventory
CBT-I
cognitive behavior therapy for insomnia
CBT-I-MA
CBT-I using a mobile application
DBAS
Dysfunctional Beliefs and Attitudes about Sleep
DSM
Diagnostic and Statistical Manual of Mental Disorders
ESS
Epworth Sleepiness Scale
ISI
Insomnia Severity Index
MA
mobile application
PSQI
Pittsburgh Sleep Quality Index
SCT
stimulus control therapy
SE
sleep efficiency
SL
sleep latency
SRT
sleep restriction therapy
TIB
time in bed
TOB
time out of bed
TST
total sleep time
TTB
time to bed
W0
week 0 (baseline)
W1
week 1
W2
week 2
W3
week 3
W4
week 4
WD
wearable device
REFERENCES
- 1.Ho FY, Chung KF, Yeung WF, et al. Self-help cognitive-behavioral therapy for insomnia: a meta-analysis of randomized controlled trials. Sleep Med Rev. 2015;19:17–28. doi: 10.1016/j.smrv.2014.06.010. [DOI] [PubMed] [Google Scholar]
- 2.Horsch C, Lancee J, Beun RJ, Neerincx MA, Brinkman WP. Adherence to technology-mediated insomnia treatment: a meta-analysis, interviews, and focus groups. J Med Internet Res. 2015;17(9):e214. doi: 10.2196/jmir.4115. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Singh J, Badr MS, Diebert W, et al. American Academy of Sleep Medicine (AASM) position paper for the use of telemedicine for the diagnosis and treatment of sleep disorders. J Clin Sleep Med. 2015;11(10):1187–1198. doi: 10.5664/jcsm.5098. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Kuhn E, Weiss BJ, Taylor KL, et al. CBT-I coach: a description and clinician perceptions of a mobile app for cognitive behavioral therapy for insomnia. J Clin Sleep Med. 2016;12(4):597–606. doi: 10.5664/jcsm.5700. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Masterson Creber RM, Maurer MS, Reading M, Hiraldo G, Hickey KT, Iribarren S. Review and analysis of existing mobile phone apps to support heart failure symptom monitoring and self-care management using the mobile application rating scale (MARS) JMIR Mhealth Uhealth. 2016;4(2):e74. doi: 10.2196/mhealth.5882. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Hui CY, Walton R, McKinstry B, Jackson T, Parker R, Pinnock H. The use of mobile applications to support self-management for people with asthma: a systematic review of controlled studies to identify features associated with clinical effectiveness and adherence. J Am Med Inform Assoc. 2016 Oct 2; doi: 10.1093/jamia/ocw143. [Epub ahead of print] [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Coulson NS, Smedley R, Bostock S, et al. The pros and cons of getting engaged in an online social community embedded within digital cognitive behavioral therapy for insomnia: survey among users. J Med Internet Res. 2016;18(4):e88. doi: 10.2196/jmir.5654. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Chen YX, Hung YP, Chen HC. Mobile Application-assisted cognitive behavioral therapy for insomnia in an older adult. Telemed J E Health. 2016;22(4):332–334. doi: 10.1089/tmj.2015.0064. [DOI] [PubMed] [Google Scholar]
- 9.SleepRate website. [Accessed July 5, 2016]. http://www.sleeprate.com/
- 10.Babson KA, Ramo DE. Mobile app-delivered cognitive behavioral therapy for insomnia: feasibility and initial efficacy among veterans with cannabis use disorders. JMIR Res Protoc. 2015;4(3):e87. doi: 10.2196/resprot.3852. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Koffel E, Kuhn E, Petsoulis N, et al. A randomized controlled pilot study of CBT-I Coach: feasibility, acceptability, and potential impact of a mobile phone application for patients in cognitive behavioral therapy for insomnia. Health Informatics J. 2016 Jun 27; doi: 10.1177/1460458216656472. [Epub ahead of print] [DOI] [PubMed] [Google Scholar]
- 12.Bootzin RR, Epstein D, Wood JM. Stimulus control instructions. In: Hauri PJ, editor. Case Studies in Insomnia. New York, NY: Springer; 1991. pp. 19–28. [Google Scholar]
- 13.Spielman AJ, Saskin P, Thorpy MJ. Treatment of chronic insomnia by restriction of time in bed. Sleep. 1987;10(1):45–56. [PubMed] [Google Scholar]
- 14.Carney CE, Buysse DJ, Ancoli-Israel S, et al. The consensus sleep diary: standardizing prospective sleep self-monitoring. Sleep. 2012;35(2):287–302. doi: 10.5665/sleep.1642. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders. 5th ed. Arlington, VA: American Psychiatric Association Publishing; 2013. [Google Scholar]
- 16.First MB, Williams JBW, Karg RS, Spitzer RL. Structured Clinical Interview for DSM-5 Disorders, Clinician Version (SCID-5-CV) Arlington, VA: American Psychiatric Association; 2015. [Google Scholar]
- 17.Suresh K. An overview of randomization techniques: an unbiased assessment of outcome in clinical research. J Hum Reprod Sci. 2011;4(1):8–11. doi: 10.4103/0974-1208.82352. [DOI] [PMC free article] [PubMed] [Google Scholar] [Retracted]
- 18.Cho YW, Song ML, Morin CM. Validation of a Korean version of the insomnia severity index. J Clin Neurol. 2014;10(3):210–215. doi: 10.3988/jcn.2014.10.3.210. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Sohn SI, Kim DH, Lee MY, Cho YW. The reliability and validity of the Korean version of the Pittsburgh Sleep Quality Index. Sleep Breath. 2012;16(3):803–812. doi: 10.1007/s11325-011-0579-9. [DOI] [PubMed] [Google Scholar]
- 20.Yu E, Ko Y, Sung G, Kwon J. Validation of the Korean Version of Dysfunctional Beliefs and Attitudes About Sleep (K-DBAS-16) Korean Journal of Clinical Psychology. 2009;28(1):309–320. [Google Scholar]
- 21.Hahn H, Yum T, Shin Y, Kim K, Yoon D, Chung K. A standardization study of Beck Depression Inventory in Korea. Journal of Korean Neuropsychiatric Association. 1986;25(3):487–500. [Google Scholar]
- 22.Yook S, Kim Z. A clinical study on the Korean version of Beck Anxiety Inventory. Korean Journal of Clinical Psychology. 1997;16(1):185–197. [Google Scholar]
- 23.Troxel WM, Conrad TS, Germain A, Buysse DJ. Predictors of treatment response to brief behavioral treatment of insomnia (BBTI) in older adults. J Clin Sleep Med. 2013;9(12):1281–1289. doi: 10.5664/jcsm.3270. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Faul F, Erdfelder E, Lang AG, Buchner A. G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods. 2007;39(2):175–191. doi: 10.3758/bf03193146. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.