A Systematic Method for Evaluating Implementations of Electronic Medical Records Systems in Low- and Medium-Income Countries
MetadataShow full item record
Background: Implementations of Electronic Medical Record systems (EMRs) in healthcare industry in Low- and Middle- Income Countries (LMICs) have been on the rise in recent years driven by the promise of improvements in quality of patient care, patient safety, and cost reduction. Several LMICs, including Kenya, Uganda, and Mozambique have rolled out EMRs within public facilities at a national level. By nature, EMRs implementations are complex, disruptive, costly, and have a potential to restructure workflow processes. Successful EMRs implementation depends on numerous factors, often going beyond a simple consideration of the technology used. While LMICs have embraced national-level EMRs implementations, little evidence exists on how to systematically evaluate success of these implementations. Hence, the aim of this research was to develop and apply a systematic method for evaluating the state of EMRs implementations based on Information Systems (IS) use construct. Methods: This research was anchored on Design Science Research (DSR) methodology. We employed DSR process model by Vaishnavi et al. five steps in the development of the artefact, namely: awareness of problem, suggestion, development, evaluation, and conclusion. The development step comprised of three sub-cycles that included development of EMRs use indicators utilizing Nominal Group Technique (NGT) process, application of the resultant EMRs use indicators to assess the actual state of EMRs implementations in the case study, and qualitative inquiry to identify barriers and facilitators to EMRs use through Focus Group Discussions (FGD) technique. The application of the quantitative and qualitative phases of the study were synthesized to give the overall result of the state of EMRs implementations in real environment settings. Results: A systematic method of evaluating the actual state EMRs implementations comprising of three sub-cycles was developed. The sub-cycles outputs were as follows: a set of fifteen indicators and metrics for monitoring and evaluating actual EMRs use, hinged on four dimensions namely: system use, data quality, interoperability, and reporting (sub-cycle 1); low system usage levels which pointed to salient challenges such as poor management of EMRs user accounts (sub-cycle 2); and EMRs use facilitators such as ease of use, ease of learn, system functionalities, adequate training, timely technical support, and collegial support were identified. However, factors related to infrastructure such as lack of power backup plan and insufficient hardware, as well as EMRs operation mode remain significant barriers to EMRs use (sub-cycle 3). The findings of these sub-cycles were used to validate the proposed methods and framework. Conclusion: Continuous monitoring and evaluation of information systems implementations for successful scale-up and sustainable initiatives remains paramount. The developed method to systematically evaluate the state of EMRs post-implementations can be applied in similar settings in developing countries. The study results provide relevant and actionable information that can benefit EMRs users, ministries of health, EMRs implementing partners, and funding agencies.
Has partsPaper I: Ngugi P, Were MC, Babic A (2018). Facilitators and Barriers of Electronic Medical Records Systems Implementation in Low Resource Settings: A Holistic View. Stud Health Technol Inform. 2018; 251:187-190. The article is not available in BORA due to publisher restrictions. The published version is available at: https://doi.org/10.3233/978-1-61499-880-8-187
Paper II: Ngugi P, Babic A, Kariuki J, Santas X,Naanyu V, Were MC (2021) Development of standard indicators to assess use of electronic health record systems implemented in low-and medium-income countries. PLoS ONE 16(1): e0244917. The article is available at: https://hdl.handle.net/11250/2763612
Paper III: Ngugi P. N., Gesicho MB, Babic A, Were MC (2020). Assessment of HIV Data Reporting Performance by Facilities During EMR Systems Implementations in Kenya. Stud Health Technol Inform. 272:167-170. The article is available at: https://hdl.handle.net/11250/2738824
Paper IV: Ngugi P, Babic A, Were MC (2021). A multivariate statistical evaluation of actual use of electronic health record systems implementations in Kenya. PLoS ONE 16(9): e0256799. The article is available in the thesis file. The article is also available at: https://doi.org/10.1371/journal.pone.0256799
Paper V: Ngugi P, Were MC, Babic A. Users’ Perception on Factors Contributing to Electronic Medical Records Systems Use: A Focus Group Discussion Study in Healthcare Facilities Setting in Kenya. BMC Medical Informatics and Decision Making, in press. The submitted version is available in the thesis file.