Managing Traumatic Stress Using a Mental Health Care Mobile App: A Pilot Study

Yun-Jung Choi; Eun-jung Ko; Eun-Joo Choi; Youn-Joo Um

doi:10.32604/IJMHP.2021.015018

1Red Cross College of Nursing, Chung-Ang University, Seoul, 156-756, Korea
2Graduate School of Nursing, Chung-Ang University, Seoul, 156-756, Korea
*Corresponding Authors: Eun-Joo Choi. Email: withlord75@hanmail.net; Youn-Joo Um. Email: digimong8333@gmail.com
#Co-first author
Received: 20 November 2020; Accepted: 23 March 2021

Abstract: This study aims to contribute to improving mental health services and establishing a direction for disaster survivors by verifying the effectiveness of the TLS (Training for Life Skills) app, a mental health management mobile application. Altogether, 22 disaster survivors received access to the app (with guidance) for eight weeks; we analyzed its effectiveness by examining each participant’s electroencephalography data, which were collected while they were utilizing the app. The results of this study show that the use of the TLS app had a significant positive effect on emotional quotient, basic rhythm quotient (left brain, right brain), alpha blocking rate (left brain, right brain), and brain quotient of disaster survivors. The TLS mobile app is expected to not only provide psychological first aid to disaster survivors but also to improve their life skills, which may allow them to gain information about their emotions; hence, it may provide the appropriate conditions needed to enable effective self-control and health management for disaster survivors.

Keywords: Mobile applications; trauma; disasters; mental health

Owing to the recent surge of disasters, the demand for “post-disaster psychological assistance” is growing, and the number of people who need such assistance is increasing. If disaster survivors are given sufficient and effective support systems and show resilience (e.g., are able to endure temporary pain that they may suffer and use appropriate coping strategies), they may be able to, eventually, return to their normal functioning levels, but many will still experience mental health disorders such as post-traumatic stress disorder (PTSD), depression, and anxiety [1]. Although disaster survivors who continuously experience mild or intermittent psychological symptoms (for several weeks or months post-disaster) may not meet the criteria for receiving a mental health disorder diagnosis, most still have to endure a certain degree of pain, which can interfere with their normal functioning in various aspects of their lives and subsequently increase the risk of mental breakdowns among this population group [2].

Recently, whenever a major disaster has occurred, the importance of providing appropriate psychological support for traumas owing to such situations has been raised; nonetheless, in Korea, such importance started being highlighted in particular after the Korean Sewol ferry accident [3]. According to the Jeju Sewol Compensation Center, 17 out of 24 Sewol ferry survivors are experiencing PTSD; reportedly, they complain about sleep disorders, lethargy, depression, nervousness, paranoia, and alcoholism, and many have been unable to return to their daily lives (e.g., some quit their jobs) [4].

One of the most appropriate ways to address the basic medical, mental, and social needs of disaster survivors immediately after the event is through “psychological first aid” (PFA) interventions; these are based on securing the individuals’ safety and bonding after such events and on the provision of information/practical resources to allow them to manage the outcomes of the disaster [5]. The “Skills for Psychological Recovery” (SPR) program was developed for the psychological recovery of children, adolescents, adults, and families exposed to traumatic events owing to disasters; it is technical training that is intended to be provided after the provision of appropriate PFA interventions. It is used to deliver psychological support to disaster victims [6], and it is a crisis counseling service program applicable to various types of disasters (hurricanes, tornadoes, earthquakes, floods, etc.). Various studies have provided education for mental health practitioners on how to utilize this program; notwithstanding, to this date, no research has been conducted on the effects of SPR in Korea [7,8].

Overall, Korea lacks the human and physical infrastructure necessary for the provision of post-disaster psychological assistance; its corresponding field of research is also poor. Additionally, there is no around-the-clock professional manpower—mainly because Korea depends on a volunteer system—and the budget is insufficient for the development of research on manuals and education related to disaster psychology support [9,10]. Therefore, there is an urgent need to develop educational programs and practical manuals suitable for disaster situations to provide practical help to the complex symptoms related to disaster trauma [10].

Recently, the proliferation of smart devices has led to the development of mobile healthcare services that allow for health self-management through people’s smartphones [11]. These services are characterized by the performance of health management through checking the amount of exercise people have performed, electrocardiograms, and heart rates by using a health measuring device linked to a mobile device (such as a smartphone) and/or apps (smartphone applications) within the device [12]. Previous research has shown that mobile-app-based education demonstrated more positive effects on self-directed learning, motivation to learn, state commitment, and interaction between learner interfaces than did computer web-based education [13]. Further, mobile apps aimed at aiding people with alcoholism treatment have been shown to reduce alcohol consumption and promote psychological well-being [14,15]. Therefore, this study aimed to develop a mental health management mobile app, called “Sound of Mind,” for disaster survivors through the use of Training for Life Skills (TLS); we intended to create an effective disaster mental health management strategy for this population group. The app provides relevant information, such as how to cope with disasters, and comprises contents that can help heal the mind and change a mood; thus, it is expected to be useful in emergencies during disasters.

“Brain wave” refers to the number of electrical signals generated during information exchanges between brain cells; these are measured by attaching electrodes to one’s scalp and analyzing the combinations of the changes occurring, in a given moment, in dendrites during neuronal activity of the cerebral cortex [16]. The first electroencephalography (EEG) was performed in 1969 by Hans Berger, who pioneered taking notes on the electrical properties of nerves [17]. Recently, EEGs have been used to provide feedback to practitioners to confirm the outcome after treatment for a variety of patients with cognitive and behavioral problems [18].

Therefore, in this study, to measure the effect of our psychological support service, we used EEG measurements. This study aims to collect basic data on whether the proposed psychological intervention can help improve the mental health of disaster survivors by measuring the brain waves of disaster survivors.

The purpose of this study is as follows. By measuring the participants’ EEG readings after the disaster survivors run the TLS app, we want to determine whether its psychological support service is effective. A further aim is to examine the possibility of using the TLS app for psychological support for disaster survivors. Thus, the following hypotheses are proposed:

Hypothesis 1. Disaster survivors’ use of the TLS app will improvement their emotional quotient.

Hypothesis 2. Disaster survivors’ use of the TLS app will improvement their basic rhythm quotient (left brain, right brain).

Hypothesis 3. Disaster survivors’ use of the TLS app will improvement their alpha blocking rates (left brain, right brain).

Hypothesis 4. Disaster survivors’ use of the TLS app will improvement their brain quotients (BQ).

This pilot study was designed as a single group post-experiment to evaluate the efficacy of the TLS mobile app as a psychological first aid program for disaster survivors.

The TLS app was developed by Choi et al. [19] to support people affected by traumatic experiences. Choi et al. [19] provided the app for free downloads at the ONE store, a Korean mobile app store, as part of their professional obligation to offer their research product to the public, as it was funded by a public foundation. The content of the app, as shown in Fig. 1, is divided into three categories: information, psychological healing, and mood change. The information category consists of self-assessment (PTSD, depression, anxiety, sleep disorder), post-disaster responses, coping mechanisms (anger, sleep disorder, addiction), and guidance on how to utilize information from specialized institutions (consultation centers, medical institutions, administrative support organizations). Psychological healing consists of breathing, butterfly hug, meditation, positive affirmations, healing music, 108 bows, yoga, and writing. Ventilation and diversion (mood change category), find the same picture game, fruit slot machine, bubble shot, coloring book, and Tetris. We informed participants that they can freely select the desired function.

Research participants were first recruited via purposive sampling. Researchers explained the purpose of the study to a disaster support expert and asked for help in recruiting participants. After that, disaster support experts provided the researchers with information on the study participants. Then, snowball sampling was used to recommend additional participants. In this study, we conducted a pilot experiment with 22 participants who self-reported experiencing post-traumatic stress, one year after a natural, social, or artificial disaster.

Before the experiment, all participants were fully informed of the purpose and method of the study; they were informed that they could withdraw at any time without any prejudice. All participants voluntarily provided written informed consent to participate. Before the start of the experiment, participants were informed of the purpose and method of using the TLS mobile app, after which the experiment was initiated. During the experiment period, from June 03 to July 28, 2019, participants were instructed to access the mobile app at least five times a week for eight weeks. Once a week, the researcher would call the participants, check their self-reports, and record the app usage time and functions used. After eight weeks, the researcher conducted a post-test on the participants. EEG measurements were performed on July 29. Since EEG can be sensitive and affected by other external stimuli, it was conducted on participants as they sat unmoving in a quiet place. Participants wore a hairband-type EEG measuring device and looked comfortably at the monitor screen; the measurement time was five minutes.

NeuroHarmony, a handheld EEG measurement instrument, was used; it was developed by BrainTech, a subsidiary of the Korea Institute of Psychiatry [20]. NeuroHarmony uses a mixture of the Monopolar Reference Montage and the Sequential Bipolar Montage based on a 2-channel EEG. It is a portable device that has a 2-channel headband type [20]. It can be connected to a computer via a USB port and uses a dry electrode with a convenient, non-invasive headband method. In addition, participants’ self-reported total app usage time over the eight weeks was digitized. The EEG measurements by NeuroHarmony software were automatically extracted into Excel by requesting the EEG analysis server.

In this study, emotional quotient, basic rhythm quotient (left brain, right brain), alpha blockings rate (left brain, right brain), and BQ were analyzed. The emotional quotient was calculated by subtracting the right alpha wave from the left alpha, and it indicates emotional stability or instability [18]. The basic rhythm quotient was calculated as the ratio of closed eye alpha wave to open eye alpha wave; both, the left and right brains were measured. This factor is often used as a standard for determining brain stability and agility [21]. The alpha blocking rate refers to the rate at which alpha waves disappear when opening the eye; both the left and right brains were measured [18]. Higher alpha blocking rates correspond to clear changes in the EEG during times of open and closed eyes, while lower alpha blocking rates refer to little change [21]. BQ is calculated as ∑w·q (w = weight by index, q = {whole brain index}) and allows for comprehensive judgment of brain function [20].

Collected data were analyzed using the SPSS/WIN 25.0 program. Participants’ general characteristics were analyzed using descriptive statistics, and simple regression analysis was performed to verify the effects of the TLS mobile app on people’s brains.

Researchers informed participants of the purpose, method, and research ethical considerations of the study (e.g., retractable, confidentiality, and anonymity), and the participants provided informed consent. Data were collected for research purposes and were discarded after the time required for the study. Participants were provided their EEG results with an explanation. This research was approved by Chung-Ang University’s Bioethics Committee (IRB No. 1041078-2018060-HR-135-01C).

The study participants consisted of 22 disaster survivors. Results of the investigation of general characteristics, age, gender, marital status, religion, type of disaster, and app usage time are as follows. Twelve participants were under the age of 32, eight were between 32 and 43, and two were over 45. There were three men and 19 women; 11 were married and 11 were unmarried. In terms of religion, four were Christians, six were Catholics, two were Buddhists, and 10 reported “other”. Two of the participants had experienced earthquakes, three had experienced fires, four had been through hazardous chemical disasters, and 11 had been in traffic accidents. Four of the participants used the app for a total of 0–199 min over the eight weeks; nine used it for 200–399 min; three for 400–599 min; two for 600–799 min; one for 800–999 min; and three for 1000–1680 min.

3.2 Effect of TLS Mobile App Usage Time on Emotional Quotients, Basic Rhythm Quotients (Left, Right), Alpha Blocking Rates (Left, Right) and BQ

In this study, the results were obtained by measuring the participants’ EEG (emotional quotient, basic rhythm quotient, alpha blocking rate, BQ) after using the app for eight weeks, to determine the effect of the mobile psychological support service, TLS app, on disaster survivors. The results are presented in Tab. 1.

The effects of the use of TLS apps on disaster survivors are as follows. The use of TLS mobile apps had a significant effect on the emotional quotients (β = 0.550, p < 0.008), and the explanatory power was 30%. It also had a significant positive effect on the basic rhythm quotient (left brain) (β = 0.598, p < 0.003), and the explanatory power was 35%; and on the basic rhythm quotient (right brain) (β = 451, p < 0.035), and the explanatory power was 20%. Furthermore, it had a significant positive effect on the alpha blocking rate (left brain) (β = 0.510, p < 0.015), and the explanatory power was 26%; and on the alpha blocking rate (right brain) (β = 0.463, p < 0.035), and the explanatory power was 21%. In addition, it had a significant positive effect on the BQ (β = 0.451, p < 0.035), and the explanatory power was 20%. In other words, the use of the TLS app had a significant positive effect on the disaster survivors’ emotional quotient, basic rhythm quotient (left brain, right brain), alpha blocking rate (left brain, right brain), and BQ.

This study aimed to develop the TLS mobile app to help disaster survivors deal with the psychological issues evoked by disaster trauma and to determine its effectiveness through an analysis of how the app’s usage time affected participants’ brainwaves. First, disaster survivors’ use of the TLS app was found to have a positive effect on their emotional quotient (left brain, right brain), which judges emotional balance and stability. A higher emotional quotient corresponds to more emotional stability [20]. Another study found that light, low intensity exercise of about 10 minutes can positively change a low emotional index [22]. Furthermore, a horseback riding therapy program for elementary school students resulted in improved emotional quotient [23], suggesting that these interventions affect specific functions of the brain. In the present study, it can be inferred that the TLS app is also involved in influencing functions of the brain. Our findings indicate that the more you use the TLS mobile app, the more stable will be.

Second, it was found that the use of the TLS app by disaster survivors has a positive effect on the basic rhythm quotient (left and right brain), which occurs when the eyes are closed; it is stabilized in a state of awakening, and can indicate brain stability. In addition, the basic rhythm quotient can determine the degree of development and stability of the brain as well as the degree of aging. A high basic rhythm index indicates that the brain’s activity speed is fast and stable. Therefore, from the results of this study, it can be inferred that the more the TLS app is used, the more active the basic rhythm EEG in humans is, and the more it responds to the brain function of the app’s use. Prior studies have shown that a three-month program (mobile or computer-based) for patients with depression improved brain activity and symptoms [24], which is in line with the results of this study.

Third, the use of the TLS app by disaster survivors was also found to have a positive effect on the alpha blocking rate (left and right brain). Alpha waves are the most fundamental waves of the brain, and reflect neurophysiological stability and emotional state; human mental stability is considered most efficient when alpha waves are produced. Alpha waves appear predominantly due to a synchronization phenomenon, in which multiple cells of the cerebral cortex are active almost simultaneously, when they are at rest in a comfortable state, such as relaxation [25]. The better the activity of the alpha wave, the stronger the alpha wave is generated when the eyes are closed; when the eyes are opened, the alpha wave is reliably blocked. This ratio is called the alpha blocking rate. Ekkekakis et al. [26] reported that walking exercise affects the activation of alpha waves by generating a sense of calm and relaxation. In a study on the effect of yoga on brain waves, it was reported that the alpha value increased significantly before and after the program [27]. Alpha wave activity is also found to increase during interactions with animals, as they lead to a feeling of a stable mood, which increases vitality and leads to a positive state of mind [23]. These findings are in line with those of Gabriel et al. [28] who analyzed the image training of athletes and found that it reduced anxiety and activated alpha brain waves. In this study, it is believed that the alpha blocking rate was increased through the use of the app because the vitality, indicating a positive mood state, was increased.

Finally, the use of TLS apps by disaster survivors has been shown to have a positive impact on BQ, a quotient that synthesizes the functions of the brain. In addition, BQ provides accurate and comprehensive information to determine the brain’s response and control capabilities. It is closely related to mental and physical health, and BQ can be developed through one’s own efforts [20]. In a previous study comparing the EEG differences between Baduk players and the general population, the BQ was found to be significantly higher for the players [29]. This suggests that Baduk is involved in a specific function of the brain, and it can be inferred that the TLS mobile app is also involved in this function. Further corroborating our results, a systematic review on the effectiveness of mobile mental health apps suggested that these can be effective and significantly improve treatment accessibility [30].

This is a single group post-test experimental study conducted to provide psychological support services by applying a TLS mobile app to disaster survivors and to confirm the effects. The participants of the study were 22 disaster survivors who used the mobile app for eight weeks and then underwent EEG measurements. The analysis showed that the use of mobile apps had a positive effect on the emotional quotients, basic rhythm quotients (left, right), alpha blocking rates (left, right), and BQ. The conclusions are thus as follows.

First, it is necessary for disaster survivors to increase their security, their adaptive coping skills, and to connect to various community resources to adapt well in society. Therefore, the TLS mobile app is expected to not only provide psychological first aid to disaster survivors but also play a role in improving their life skills, which may allow for this group to know more about themselves and their emotions, subsequently allowing for greater and more efficient health control and self-management.

Second, mobile-app-based psychotherapy for disaster trauma can be a good alternative to traditional therapy because it can compensate for the usual limitations that the latter posit, such as cost burden, distance, and being socially stigmatized as a person that needs in-person psychotherapy. Additionally, through the app, there is the possibility of early diagnosis and prognostic observations before receiving professional treatment. This may, thereby, enable the early observation of symptoms related to disaster trauma and the provision of immediate intervention, whenever necessary. Therefore, this study verified the effectiveness of mobile-app-based psychotherapy, which has the advantages of being user-friendly (performed through a device), having high accessibility, and being cost-effective.

Third, the TLS mobile app was developed through expert consultation and the performance of a pilot experiment, which was based on sufficient clinical experience and evidence of the mental health specialists in charge of this research (and those who contributed to it). Thus, unlike apps developed for commercial uses, our proposed and developed app contains deep and practical content that can be applied for disaster survivors as an alternative to standard therapy. Thus, when the TLS mobile app starts being commercialized, we expect it effectively reduce and prevent symptoms among its target population.

However, this study has some limitations. First, generalization must be done with caution because of the small sample size. Second, we performed only a single group one-time post-test, which is poor validation compared to studies using pre-post tests and experiment-control designs. Third, to increase the desire for users to participate and utilize the app, it will be necessary to develop a practical manual for self-management to increase its applicability. Future research will require a study of mobile application intervention approaches through comparison with controls. In addition, studies on various diagnostic groups and on the effectiveness of adults and the older population, as well as children, are needed. Despite these limitations, this pilot study showed that the TLS mobile app was effective for increasing positive and decreasing negative psychological factors according to app usage time. Therefore, we expect the app to be used to provide psychological stability and to provide the appropriate conditions to enable of effective self-control and management for disaster survivors.

Funding Statement: This research was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea Government (MSIP) (No. NRF-2017R1A2B4004438).

Conflicts of Interest: The authors declare that they have no conflicts of interest to report regarding the present study.

References

North, C. S., & Pfefferbaum, B. (2013). Mental health response to community disasters: A systematic review. JAMA, 310(5), 507-518. [Google Scholar]
Wade, D., Crompton, D., Howard, A., Stevens, N., & Metcalf, O. (2014). Skills for Psychological Recovery: Evaluation of a post-disaster mental health training program. Disaster Health, 2(3–4), 138-145. [Google Scholar] [CrossRef]
Kim, D. H. ( 2015). Development of stabilization program for trauma recovery. Seoul: Seoul National Hospital.
Lim, J. S. (2016). Disaster and psychological trauma-focused on Sewolho. Legislative Policy, 10(1), 65-95. [Google Scholar]
Dieltjens, T., Moonens, I., van Praet, K., De Buck, E., & Vandekerckhove, P. (2014). A systematic literature search on psychological first aid: Lack of evidence to develop guidelines. PLoS One, 9(12), e114714. [Google Scholar]
Berkowitz, S., Bryant, R., Brymer, M., Hamblen, J., Jacobs, A. et al. ( 2017). Skills for Psychological Recovery: Field operations guide, 2010. National Center for PTSD and National Child Traumatic Stress Network. http://www.ptsd.va.gov/professional/materials/manuals/skills_psych_recovery_manual.asp.
Forbes, D., Fletcher, S., Wolfgang, B., Varker, T., & Creamer, M. (2010). Practitioner perceptions of Skills for Psychological Recovery: A training programme for health practitioners in the aftermath of the Victorian bushfires. Australian & New Zealand Journal of Psychiatry, 44(12), 1105-1111. [Google Scholar]
Lee, M. S., Bang, S. Y., Hwang, J. W., Lee, C. S., & Kim, J. Y. (2016). Psychosocial interventions for children and adolescents after a disaster: A systematic literature review (1991–2015). Journal of the Korean Academy of Child & Adolescent Psychiatry, 27(4), 278-294. [Google Scholar]
Choi, Y. K. (2010). Effects of prolonged exposure for PTSD: A pilot study. Cognitive Behavior Therapy in Korea, 10(1), 97-116. [Google Scholar]
Choi, T. S., Kim, J. H., & Lee, D. H. (2014). A systemic approach about psycho-social interventions programs on disasters and post-traumatic stress disorder: On culture perspective. Korean Journal of Culture and Arts Education Studies, 9(5), 99-118. [Google Scholar]
Park, J. J., Choi, G. S., Kim, J. L., Park, I. K., & Kang, J. J. (2014). Development of mobile healthcare app mental health management. Journal of the Institute of Internet, Broadcasting and Communication, 14(6), 13-18. [Google Scholar] [CrossRef]
Jung, E. Y., Kim, J., Chung, K. Y., & Park, D. K. (2014). Mobile healthcare application with EMR interoperability for diabetes patients. Cluster Computing–The Journal of Networks Software Tools and Applications, 17, 871-880. [Google Scholar] [CrossRef]
Lee, M. K. (2015). Effects of mobile phone-based app learning compared to computer-based web learning on nursing students: Pilot randomized controlled trial. Healthcare Informatics Research, 21(2), 125-133. [Google Scholar]
Gustafson, D. H., McTavish, F. M., Chih, M., Atwood, A. K., & Johnson, R. A. (2014). A smartphone application to support recovery from alcoholism: A randomized clinical trial. JAMA Psychiatry, 71(5), 566-572. [Google Scholar] [CrossRef]
Macias, C., Panch, T., Hicks, Y. M., Scolnick, J. S., & Weene, D. L. (2015). Using smartphone apps to promote psychiatric and physical well-being. Psychiatric Quarterly, 86(4), 505-519. [Google Scholar]
Fisch, B. J. ( 1999). Fisch & Spelmann’s EEG primer: Basic principles of digital and analog EEG, 3rd edition. Amsterdam: Elsevier.
Tudor, M., Tudor, L., & Tudor, K. I. (2005). Hans Berger (1873–1941)--The history of electroencephalography. Acta Med Croatica, 59(4), 307-313. [Google Scholar]
Nassar, M. R., Bruckner, R., & Frank, M. J. (2019). Statistical context dictates the relationship between feedback-related EEG signals and learning. eLife Science, 8(1), 1-26. [Google Scholar]
Choi, Y. J., Chung, H. S., Ko, E., Yun, S. M., Kang, J. Y. et al. ( 2019). Development of a Korean disaster mental health mobile app. Korean Research Foundation’s Science and Engineering Basic Research Project Report. Chung-Ang University Industry Academic Cooperation Foundation.
Park, B. W. ( 2005). Neurofeedback instruction. Seoul: Korea Institute of Psychiatry. http://www.brain.re.kr/https://doi.org/10.7554/eLife.46975.
Lee, M. K. (2015). Effects of mobile phone-based app learning compared to computer-based web learning on nursing students: Pilot randomized controlled trial. Healthcare Informatics Research, 21(2), 125-133. [Google Scholar] [CrossRef]
Hansen, C. J., Stevens, L. C., & Coase, J. R. (2001). Exercise duration and mood state: How much is enough to feel better?. Health Psychology, 20(4), 267. [Google Scholar]
Kim, I. ( 2010). The effect of equestrian on elementary students emotional intelligence,(Unpublished Master’s Thesis). Kongju University.
Watts, S., Mackenzie, A., Thomas, C., Griskaitis, A., & Mewton, L. (2013). CBT for depression: A pilot RCT comparing mobile phone . computer. BMC Psychiatry, 13, 49.. [Google Scholar]
Steriade, M., Jones, E. G., Llinas, R. R. ( 1990). Thalamic oscillations and signaling. The Neurosciences Institute Publications Series. John Wiley & Sons.
Ekkekakis, P., Haa, E., Vanlanduyt, L. M., & Petruzzello, S. J. (2000). Walking in (affective) circles: Can short walks enhance affect?. Journal of Behavioral Medicine, 23(3), 245-275. [Google Scholar]
Lim, Y. H., & Kim, M. S. (2007). The effect of yoga exercise program with different exercise intensity on EEG related with attention. Korean Society Leisure & Recreation, 31(3), 101-122. [Google Scholar]
Gabriel, D. A., Kamen, G., & Frost, G. (2006). Neural adaptations to resistive exercise. Sports Medicine, 36(2), 133-149. [Google Scholar]
Back, G. J. ( 2007). A study on the analysis of brain wave differences between the Baduk player group and the general group. 7th Baduk-Conference, pp. 1–19.
Donker, T., Petrie, K., Proudfoot, J., Clarke, J., & Birch, M. R. (2013). Smartphones for smarter delivery of mental health programs: A systematic review. Journal of Medical Internet Research, 15(11), e247. . [Google Scholar]