Healthc Inform Res Search


Healthc Inform Res > Volume 22(3); 2016 > Article
Kazemi, Rabiei, Moghaddasi, and Deimazar: Pharmacy Information Systems in Teaching Hospitals: A Multi-dimensional Evaluation Study



In hospitals, the pharmacy information system (PIS) is usually a sub-system of the hospital information system (HIS). The PIS supports the distribution and management of drugs, shows drug and medical device inventory, and facilitates preparing needed reports. In this study, pharmacy information systems implemented in general teaching hospitals affiliated to medical universities in Tehran (Iran) were evaluated using a multi-dimensional tool.


This was an evaluation study conducted in 2015. To collect data, a checklist was developed by reviewing the relevant literature; this checklist included both general and specific criteria to evaluate pharmacy information systems. The checklist was then validated by medical informatics experts and pharmacists. The sample of the study included five PIS in general-teaching hospitals affiliated to three medical universities in Tehran (Iran). Data were collected using the checklist and through observing the systems. The findings were presented as tables.


Five PIS were evaluated in the five general-teaching hospitals that had the highest bed numbers. The findings showed that the evaluated pharmacy information systems lacked some important general and specific criteria. Among the general evaluation criteria, it was found that only two of the PIS studied were capable of restricting repeated attempts made for unauthorized access to the systems. With respect to the specific evaluation criteria, no attention was paid to the patient safety aspect.


The PIS studied were mainly designed to support financial tasks; little attention was paid to clinical and patient safety features.

I. Introduction

In countries with advanced and modern healthcare systems, hospital pharmacies and their pharmacists play important roles in patient care [1]. In recent years, with the advancement of health information technology (HIT), there has been increasing attention to the adoption of the pharmacy information system (PIS) to improve the efficiency and effectiveness of services [2]. For example, the PIS has key roles to play in reducing medication errors and improving patient safety [3,4].
The PIS is a system that supports the distribution and management of drugs, identifying the type of intervention, determining the amount of inventory, reporting and managing of costs, and improving the accessibility of information [5]. Furthermore, the PIS helps clinical decision-making by alerting users about clinically important drug-drug interactions, drug allergies [6], and drug doses [7]; it also evaluates patterns of drug use [8] as well as other possible side effects of drugs. The PIS may operate as a separate and individual system or as part of a hospital information system (HIS), paired with the Computerized Physician Order Entry (CPOE) system [7]. Accordingly, to ensure efficiency and effectiveness of these systems, evaluation of the PIS is extremely important; this system could ultimately influence the safety and quality of care [9].
To identify and eliminate technical problems of health care systems, improve the efficiency and effectiveness of services, and minimize costs, careful evaluation of those systems is needed. In other words, the evaluation of information systems, as a key stage in the information system development life cycle [10,11] can help to assure the technical capacity of these systems, determine the effects of using the systems on users practices, and allow application of modifications as required [12,13]. Therefore, this study aimed to evaluate PISs in hospitals affiliated with three universities of medical sciences in Tehran, Iran.

II. Case Description

The study population included the PIS implemented in hospitals affiliated to one of the three medical universities in Tehran, Iran (Tehran, Shahid Beheshti, and Iran Universities of Medical Sciences and Health Services). In Iran, more than 80% of hospital services are provided by the public sector. Medical education is integrated with the health services, which have created universities of medical sciences and health services. Each province has at least one such university. Tehran, which is a huge province with more than 14 million inhabitants, is divided into three zones. The three abovementioned universities provide public health and treatment services to the citizens of Tehran.
Since almost all of the affiliated hospitals implement a PIS from one of the well-known Iranian vendors, the sampling took place by considering two inclusion criteria: (i) there was at least one general teaching hospital for every vendor in which its PIS software was installed and (ii) hospitals were selected based on the number of hospital beds (the hospitals with the highest bed numbers). If a selected hospital was unwilling to take part in the study, the next hospital with the highest bed number was substituted. Selected hospitals provided 24 hr/7 days a week pharmacy services to in- and out-patients. The evaluation tool was a checklist created by reviewing the relevant literature; it was composed of general and specific evaluation criteria related to PIS [3,4,5,14,15,16,17]. There were sub-categories for both general and specific criteria. Categorizing of the criteria and the related aspects was performed according to similarity and relevance. The general evaluation criteria included those aspects that are general to all information systems, such as security, user friendliness, and integration with other systems. The specific criteria evaluated those aspects that were specifically important for PISs. These specific criteria were divided into five categories including prescriptions and medication order management, patient safety management, purchase and sale management, drug stock management, and reports management. The checklist was constructed with 'Yes' and 'No' options and additional space was provided for any possible applicable comments. The content validity of the checklist was examined by five experts in the field of medical informatics and by two pharmacists.
Five PIS supplied by five vendors were evaluated in five general-teaching hospitals. Hospitals are called A (716 beds), B (426 beds), C (139 beds), D (111 beds), and E (379 beds). Similarly, the five software programs used in the hospitals are described as A, B, C, D, and E, respectively.
The findings are presented in sections. Section A reports the findings related to the general criteria, and section B describes the findings based on the specific criteria used to evaluate the PIS.

1. General Criteria in PIS Evaluation

With respect to the security aspects of the PIS, all systems had the ability to report user activities based on IP address or individual user ID. However, the capability of restricting repeated unauthorized access attempts to systems was observed only in 40% of the systems. The password strength was the other security sub-criteria; the findings indicated that the passwords of the systems were not case-sensitive and did not require a combination of letters and numbers (Table 1).
The findings related to 'user friendliness' showed that all systems included some user friendliness features for pharmacy end-users. In this respect, all systems had the capability of displaying patients' drugs and demographic profiles completely and legibly; systems also had flexibility in sorting and selecting of commands from drug profiles, modifying the screen size, using multiple screens simultaneously for various activities, and using defaults to identify commands or a group of commands during order entry.
Regarding the other general criteria, the findings showed that none of the pharmacy systems were connected to the national drug databank. It is notable that, in all five hospitals, the PIS was a sub-system of the integrated HIS and substantially interacted with other HIS sub-systems.

2. Specific Criteria in PIS Evaluation

All of the studied systems had the ability to create reports of drugs and their dosages based on the physicians' name and the prescription date. Furthermore, the systems had the capability to customize the list of medications and to exclude a drug from the list of current medications. However, the systems lacked functions such as showing the history of prescribed medication, prescribing drugs using different units, and renewing current medications without re-entering orders (Table 2).
The findings related to the 'patient safety management' showed that all five systems had the capability of identifying the drug dose and modifying medication orders. However, none of the systems had the functionality to display contraindications, drug interactions, adverse effects, or patient allergy to drugs (Table 3).
With respect to the 'purchase and sale management' function, as can be seen in Table 4, none of the systems included the ability to order drugs electronically. However, all systems had the capability of calculating the prices for drugs and medical devices.
Findings related to 'drug stock management' showed that one of the systems (system D) lacked the stock management function. However, the other four systems had the capability of controlling drug entry to, and exit from, the pharmacy. In addition, these systems had the ability to check the minimum inventory for each drug and to create inventory alerts when a drug reached a minimum stock level.
Regarding 'management reports' function of the systems, the findings indicated that all of the five PISs gave the system administrator the capability to create different reports using dynamic report builders. The reports included but were not limited to the total number of prescribed drugs for both inpatients and outpatients, daily drug distribution according to the delivery location, financial reports, and annual performance reports.

III. Discussion

According to the findings, in terms of the security of the PIS, the users did not use appropriate passwords (a combination of capital and small letters, or a mixture of letters and numbers) to log into the system. This issue is considered a potential risk as unauthorized users could more easily gain access to confidential information stored in the system. According to studies conducted in other countries, the security of information systems will improve if a password is composed of a combination of numbers and letters [14,15]. In addition, in the current study, only two systems had the capability to restrict repeated attempts by unauthorized users to enter the system. Troiano [16] suggest that a powerful security system is one in which the system administrator can determine the activity limit of users on the system and their accessibility. This finding is parallel to that of the current study, in which the administrators of the systems, based on their organizational roles in all five systems, was able to define users' access levels.
In terms of integration of systems, none of the PIS were connected with the national drug data bank, though, based on the law, it is not mandatory to do so. On-line updates through the linkage with the national drug information system may result in better patient safety. For example, the database of the Federal Union of the German Association of Pharmacists, known as ABDA, and the drug database of the United States (First Databank) are two that are connected with the national drug information banks of their countries; their data are updated through these databases [17,18]. These databases include such things as drug interactions, financial information, drug prices, and drug side effects and possible adverse reactions [19]. Therefore, the lack of connection between the pharmacy information systems and the Iranian National Drug Information Bank may result in an increased number of errors, a reduced level of patient safety, and a lack of precise information about drug prices. This issue is considered one of the weaknesses of the existing software systems.
In terms of 'prescriptions management' and 'patient safety management', more attention was apparently paid to prescription order entries and delivery methods than to factors such as drug dose and frequency control, cautions regarding drug usage, prevention of duplication of medication orders, evaluation of drug interactions, and reporting of adverse drug reactions and allergies. This finding indicates that in the design of these systems, the vendors did not consider prescription management or patient safety requirements. This finding is in contrast with the study conducted by Hines et al. [20], who reported that the PIS under study had features such as drug interaction and contraindication alerts. All drug allergies and contraindications can be added as features to the existing PISs. Furthermore, the integration of the HIS system with CPOE and clinical decision support systems can help to improve patient safety [21]. In fact, the CPOE system is a part of clinical information systems (CIS) that is connected with other information systems such as the PIS [19,22]. When the HIS does not provide this feature, many interconnected sub-systems such as PIS would not benefit from the integration. The majority of PISs in Iran are only designed to meet the financial aspects; the clinical aspects that can result in reduction of medication errors have been neglected. This finding is in line with the results of a study conducted by Alkelya [23], in which the limited capability of the PIS in supporting clinical tasks was reported as a key problem of these systems.
In this study, requests to purchase medicines, medical devices, and medical consumer goods from pharmaceutical companies and their distributors in the studied hospitals were made via fax or by sale representatives when they were visiting the hospitals. In other words, none of the studied hospital pharmacies was electronically connected to the producers or their distributors. Therefore, orders of drugs, medical devices, and medical consumer goods were not recorded electronically. This is one of the weaknesses of the majority of pharmacy information systems in Iran. This finding is supported by Asadi et al. [24]'s study, in which it was found that only one of the pharmaceutical companies had semi-computerized communication with the studied hospital pharmacy for marketing and sales purposes. However, in some developed countries, the pharmacy information system communicates electronically with pharmaceutical companies or their distributors, which reduces purchase and deposit process errors [25].
According to these findings, the evaluated systems had the capability of displaying the minimum inventory for each drug, defining different warehouses, and controlling the entry and exit of drugs from the pharmacy. This is in line with El-Mahalli et al. [26]'s study, in which inventory and purchasing management were considered as core functions of PIS systems. For online checking of inventory and distribution of medicines and equipment, Mahoney et al. [27] state that pharmacy software systems need to be integrated with other hospital sub-systems. In the present study, one of the systems did not even have a 'purchase and sale management' function. In the hospital using the mentioned system, a separate system was in use along with the PIS; this separate system controlled the inventory and the expiration date of drugs, and this system had no linkage with the PIS. Therefore, it was impossible to compare minimum inventories for drugs and to alert staff when order limits were reached.
As these findings indicated, all of the studied hospital PISs were equipped with dynamic report builders and were capable of providing customized reports on such topics as the total number of drug deliveries, the financial earnings of the pharmacies, the pharmacies annual performance, and various reports as required by the system administrator. This finding is supported by Isfahani et al. [28]'s study, which reported that the PIS understudy were capable of producing the reports required. This function plays an important role in managerial decision-making. Furthermore, insurance companies increasingly ask pharmacies for various reports, and their information needs are constantly changing. Therefore, dynamic report creation and the ability to customize reports are key requirements of pharmacy systems.


Conflict of Interest: No potential conflict of interest relevant to this article was reported.


1. Colla CH, Lewis VA, Beaulieu-Jones BR, Morden NE. Role of pharmacy services in accountable care organizations. J Manag Care Spec Pharm 2015;21(4):338-344. PMID: 25803767.
crossref pmid pmc
2. Westerling AM, Haikala V, Airaksinen M. The role of information technology in the development of community pharmacy services: visions and strategic views of international experts. Res Social Adm Pharm 2011;7(4):430-437. PMID: 21272534.
crossref pmid
3. Bepko RJ Jr, Moore JR, Coleman JR. Implementation of a pharmacy automation system (robotics) to ensure medication safety at Norwalk hospital. Qual Manag Health Care 2009;18(2):103-114. PMID: 19369853.
crossref pmid
4. Pedersen CA, Schneider PJ, Scheckelhoff DJ. ASHP national survey of pharmacy practice in hospital settings: dispensing and administration: 2014. Am J Health Syst Pharm 2015;72(13):1119-1137. PMID: 26092963.
crossref pmid
5. Mitchell SH, Veltri MA, Kim GR. Dispensing: pharmacy information systems. In: Lehmann CU, Kim GR, Johnson KB, editors. Pediatric informatics. New York (NY): Springer; 2009. p. 345-355.

6. Shortliffe EH, Cimino JJ. Biomedical informatics: computer applications in health care and biomedicine. 3rd ed. New York (NY): Springer; 2006.

7. Wager KA, Lee FW, Glaser JP. Managing health care information systems: a practical approach for health care executives. 2nd ed. San Francisco (CA): Jossey-Bass; 2009.

8. Wolper LF. Health care administration: planning, implementing, and managing organized delivery systems. 4th ed. Boston (MA): Jones & Bartlett Publishers; 2004.

9. Mohamadali NA, Garibaldi JM. A novel evaluation model of user acceptance of software technology in healthcare sector Proceedings of 3rd International Conference on Health Informatics; 2010 Jan 20-23. Valencia, Spain; p. 392-397.

10. Yusof MM, Papazafeiropoulou A, Paul RJ, Stergioulas LK. Investigating evaluation frameworks for health information systems. Int J Med Inform 2008;77(6):377-385. PMID: 17904898.
crossref pmid
11. Bavier K. Evaluation of a pharmacy HIT system. Durham (NC): School of Nursing, Duke University; 2003.

12. Ammenwerth E, Kaiser F, Wilhelmy I, Hofer S. Evaluation of user acceptance of information systems in health care: the value of questionnaires. Stud Health Technol Inform 2003;95:643-648. PMID: 14664060.
13. Pereira IM, Gaidzinski RR, Fugulin FM, Peres HH, Lima AF, Castilho V, et al. Computerized nursing staffing: a software evaluation. Rev Esc Enferm USP 2011;45 Spec No:1600-1605. PMID: 22282068.
14. Certification Commission for Healthcare Information Technology. CCHIT Certified: inpatient EHR 2011 certification. Chicago (IL): Certification Commission for Healthcare Information Technology; 2010.

15. Von Ahn L, Blum M, Hopper NJ, Langford J. CAPTCHA: using hard AI problems for security. In: Biham E, editors. Advances in cryptology—EUROCRYPT 2003. Heidelberg: Springer; 2003. p. 294-311.

16. Troiano D. A primer on pharmacy information systems. J Healthc Inf Manag 1999;13(3):41-52. PMID: 10787600.

17. Pauly A, Wolf C, Busse M, Strauß AC, Krebs S, Dorje F, et al. Evaluation of eight drug interaction databases commonly used in the German healthcare system. Eur J Hosp Pharm 2015;22(3):165-170.
18. Webster L, Spiro RF. Health information technology: a new world for pharmacy. J Am Pharm Assoc (2003) 2010;50(2):e20-e31. PMID: 20199946.
crossref pmid
19. Kazemi A, Ellenius J, Tofighi S, Salehi A, Eghbalian F, Fors UG. CPOE in Iran: a viable prospect? Physicians' opinions on using CPOE in an Iranian teaching hospital. Int J Med Inform 2009;78(3):199-207. PMID: 18760960.
crossref pmid
20. Hines LE, Saverno KR, Warholak TL, Taylor A, Grizzle AJ, Murphy JE, et al. Pharmacists' awareness of clinical decision support in pharmacy information systems: an exploratory evaluation. Res Social Adm Pharm 2011;7(4):359-368. PMID: 21530417.
crossref pmid
21. Saverno KR, Hines LE, Warholak TL, Grizzle AJ, Babits L, Clark C, et al. Ability of pharmacy clinical decision-support software to alert users about clinically important drug-drug interactions. J Am Med Inform Assoc 2011;18(1):32-37. PMID: 21131607.
crossref pmid
22. Colpaert K, Decruyenaere J. Computerized physician order entry in critical care. Best Pract Res Clin Anaesthesiol 2009;23(1):27-38. PMID: 19449614.
crossref pmid
23. Alkelya MA. The influence of the pharmacy information system and pharmacy and therapeutics committee on physician prescribing behavior in the Saudi Ministry of Health: a descriptive cross-sectional comparison study [dissertation]. Madison (WI): University of Wisconsin-Madison; 2006.

24. Asadi F, Hoseini A, Moghadasi H, Maserrat E. Evaluation of pharmacy information systems in the teaching hospitals. HA J 2010;41(13):23-35.

25. Anderson PO, McGuinness SM, Bourne PE. Pharmacy informatics. Boca Raton (FL): CRC Press; 2010.

26. El Mahalli A, El-Khafif SH, Yamani W. Assessment of pharmacy information system performance in three hospitals in Eastern Province, Saudi Arabia. Perspect Health Inf Manag 2016;13:1b.

27. Mahoney CD, Berard-Collins CM, Coleman R, Amaral JF, Cotter CM. Effects of an integrated clinical information system on medication safety in a multi-hospital setting. Am J Health Syst Pharm 2007;64(18):1969-1977. PMID: 17823111.
crossref pmid
28. Isfahani SS, Raeisi AR, Ehteshami A, Janesari H, Feizi A, Mirzaeian R. The role of evaluation pharmacy information system in management of medication related complications. Acta Inform Med 2013;21(1):26-29. PMID: 23572858.
crossref pmid pmc
Table 1

Distribution of sub-criteria related to 'security' among the evaluated pharmacy information system

Table 2

Distribution of sub-criteria related to 'prescriptions and medication order management' among the evaluated pharmacy information system

Table 3

Distribution of sub-criteria related to 'patient safety management' among the studied pharmacy information system

Table 4

Distribution of sub-criteria related to 'purchase and sale management' among the evaluated pharmacy information system

Share :
Facebook Twitter Linked In Google+ Line it
METRICS Graph View
  • 3 Crossref
  • 4   Scopus
  • 2,865 View
  • 41 Download
Related articles in Healthc Inform Res


Browse all articles >

Editorial Office
1618 Kyungheegung Achim Bldg 3, 34, Sajik-ro 8-gil, Jongno-gu, Seoul 03174, Korea
Tel: +82-2-733-7637, +82-2-734-7637    E-mail:                

Copyright © 2022 by Korean Society of Medical Informatics.

Developed in M2community

Close layer
prev next