Optimising mHealth helpdesk responsiveness in South Africa: towards automated message triage.
Repository Usage Stats
In South Africa, a national-level helpdesk was established in August 2014 as a social accountability mechanism for improving governance, allowing recipients of public sector services to send complaints, compliments and questions directly to a team of National Department of Health (NDoH) staff members via text message. As demand increases, mechanisms to streamline and improve the helpdesk must be explored. This work aims to evaluate the need for and feasibility of automated message triage to improve helpdesk responsiveness to high-priority messages. Drawing from 65 768 messages submitted between October 2016 and July 2017, the quality of helpdesk message handling was evaluated via detailed inspection of (1) a random sample of 481 messages and (2) messages reporting mistreatment of women, as identified using expert-curated keywords. Automated triage was explored by training a naïve Bayes classifier to replicate message labels assigned by NDoH staff. Classifier performance was evaluated on 12 526 messages withheld from the training set. 90 of 481 (18.7%) NDoH responses were scored as suboptimal or incorrect, with median response time of 4.0 hours. 32 reports of facility-based mistreatment and 39 of partner and family violence were identified; NDoH response time and appropriateness for these messages were not superior to the random sample (P>0.05). The naïve Bayes classifier had average accuracy of 85.4%, with ≥98% specificity for infrequently appearing (<50%) labels. These results show that helpdesk handling of mistreatment of women could be improved. Keyword matching and naïve Bayes effectively identified uncommon messages of interest and could support automated triage to improve handling of high-priority messages.
Subjecthealth education and promotion
health services research
Published Version (Please cite this version)10.1136/bmjgh-2017-000567
Publication InfoEngelhard, Matthew; Copley, Charles; Watson, Jacqui; Pillay, Yogan; Barron, Peter; & LeFevre, Amnesty Elizabeth (2018). Optimising mHealth helpdesk responsiveness in South Africa: towards automated message triage. BMJ global health, 3(Suppl 2). pp. e000567. 10.1136/bmjgh-2017-000567. Retrieved from https://hdl.handle.net/10161/18141.
This is constructed from limited available data and may be imprecise. To cite this article, please review & use the official citation provided by the journal.
More InfoShow full item record
Showing items related by title, author, creator, and subject.
Stoertz, Aaron (2011)Health system strengthening is now recognized as a pressing global health priority. Motivated and productive health workers are a critical component of health systems. Low and middle-income countries need many more health ...
Economic evaluation of access to musculoskeletal care: the case of waiting for total knee arthroplasty. Bolognesi, Michael Paul; Hug, KT; Koenig, L; Mather, Richard Charles III; Nunley, RM; Orlando, Lori Ann; Watters, TS (BMC Musculoskelet Disord, 2014-01-18)BACKGROUND: The projected demand for total knee arthroplasty is staggering. At its root, the solution involves increasing supply or decreasing demand. Other developed nations have used rationing and wait times to distribute ...
Optimizing linkage and retention to hypertension care in rural Kenya (LARK hypertension study): study protocol for a randomized controlled trial. Akwanalo, CO; Binanay, CA; Bloomfield, Gerald; Delong, AK; Finkelstein, Eric Andrew; Fuster, V; Hogan, JW; ... (16 authors) (Trials, 2014-04-27)BACKGROUND: Hypertension is the leading global risk factor for mortality. Hypertension treatment and control rates are low worldwide, and delays in seeking care are associated with increased mortality. Thus, a critical component ...