Journal of Bioinformatics And Diabetes

Journal Of Bioinformatics And Diabetes

Journal of Bioinformatics and Diabetes

Current Issue Volume No: 1 Issue No: 1

Research Article Open Access Available online freely Peer Reviewed Citation

The Pharmacist Knowledge and Computer Skills Towards E-Health. Results of A Survey among Italian Community Pharmacists

Iolanda Grappasonni 1,   Seyed Khosrow Tayebati 1,   Fabio Petrelli 1,   Francesco Amenta 1  

1University of Camerino. School of Pharmacy. Via Madonna delle Carceri,

Abstract

Background:

Health practitioners of different disciplines (physicians, paramedic personnel, pharmacists) should possess adequate ICT (Information and Communication Technology) skills and practical competence on these technologies. Pharmacy practice requires a relevant flow of information, collection and handling of which could be facilitated by ICT. The correct use of ICT requires a proper knowledge by professionals offering a public service. The purpose of this paper was to assess basic informatics background and computer uses in pharmacists practicing in Italy, with the aim to identify educational interventions for increasing their informatics abilities.

Methods:

A questionnaire was proposed to pharmacists working in Italian community pharmacies. The survey was articulated into 35 questions concerning computer basic knowledge, ICT facilities, computer skills, habits, and uses in pharmacy practice.

Results:

The questionnaire was completed by ~45% (No. 224) of responders, the 96.9% of which used computer. Only 7.8% of interviewed people employed e-mail to communicate with health authorities and less than 2% used it to be in contact with physicians or other health professionals. Less than 40% used ICT for training courses. The results revealed a relevant percentage (90.8%) of self-learners to computer use, while only 9.2% was trained by specific courses.

Conclusion:

Basic knowledge of community pharmacists on ICT technological infrastructure is quite low. Although pharmacists play an essential role in health services, they have apparently limited computer skills. This suggests the need of educational and training efforts for enlarging computer and ICT resources competent use in daily pharmacy practice.  

Author Contributions
Received 25 Oct 2013; Accepted 13 May 2014; Published 04 Jun 2014;

Academic Editor: Lijun Zhang, Information Analyst III, Department of Biostatistics & Bioinformatics, Emory University

Checked for plagiarism: Yes

Review by: Single-blind

Copyright ©  2014 lolanda Grappasonni, et al.

License
Creative Commons License     This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Competing interests

The authors disclose any financial and personal relationships with other people or organization that could inappropriately influence this work.

Citation:

Iolanda Grappasonni, Seyed Khosrow Tayebati, Fabio Petrelli, Francesco Amenta (2014) The Pharmacist Knowledge and Computer Skills Towards E-Health. Results of A Survey among Italian Community Pharmacists. Journal Of Bioinformatics And Diabetes - 1(1):50-60. https://doi.org/10.14302/issn.2374-9431.jbd-13-330

Download as RIS, BibTeX, Text (Include abstract )

DOI 10.14302/issn.2374-9431.jbd-13-330

Introduction

Informatics, and more in general information and communication technologies (ICT), are becoming pillars of health activities. National Health Services encourage the development and use of ICT for improving the quality of services for citizens possibly at reduced costs1, 2, 3, 4, 5. Relevant ongoing European experiences in the field are those of United Kingdom (National Strategic Programme for 21st century), and of Italy (e-Gov 2010 programme, and consecutive updating)6, 7, 8. Health practitioners (physicians, paramedic personnel, pharmacists) should possess adequate ICT skills and practical competence on these technologies.

Pharmacy practice requires a relevant flow of information, whose collection and handling may be facilitated by ICT. Pharmacy is a relevant user of ICT to support administrative and operative activities. Today, it is impossible to envision the pharmacy of future without reliance on informatics. It consists in the use and integration of data, information, knowledge, and technology which are involved in drug use processes9, 10, 11. This integration often improves outcomes and services. In general, on entering a pharmacy, the presence of a PC and its common use by pharmacists could be observed. A more advantageous use of ICT facilities/technology requires a proper basic knowledge by professionals offering a public service. In view of this, it is desirable that adequate computer courses become part of university curricula to educate health professionals about computer science and ICT11. In the US, Pharmacy courses programs certified by the Accreditation Council for Pharmacy Education (ACPE) are required to meet ACPE’s Standards and Guidelines for Curriculum12. Guidelines specifically state that pharmacy graduates must be able to “demonstrate expertise in informatics” 11, 12.

The main studies on how pharmacists gained their computer skills and abilities include an investigation promoted by the Royal Pharmaceutical Society of Great Britain assessing the provision of Internet access and medical databases to community pharmacists working in London area and Essex13. More recent studies were conducted in Nigeria and India among health professionals, including pharmacists and revealed an overall good computing knowledge, mainly between doctors and nurses14, 15, 16. Another recent work was based on a survey of computer literacy skills profile of pharmacists in two counties of England, and the results showed that the majority of responding pharmacists used computers both at work and home, where confident in operating computer systems, but identified a training need for particular software applications17. Computer use habits and skills were also investigated in Canada and Greece18, 19. In the first study18 that involved Canadian hospital pharmacists, most pharmacists believed they needed to upgrade their computer skills. Medical database and Internet searching skills were identified as those more critical for improving practice effectiveness. The second study19 was conducted between 92 community pharmacists who are increasingly utilizing information services in their everyday practice. Other surveys focused on different categories of health professionals including pharmacists analyzed the use of PDAs (Personal Digital Assistants), and IBMI (Internet-Based Medicines Information)20, 21. In the US pharmacy, informatics education is assessed analyzing accredited pharmacy programs11.

In Italy data concerning this topic are sparse and limited to the analysis of computer literacy of physicians and nurses. In general, it could be affirmed that the level of ICT skills of health professionals is relatively low22, 23, 24, 25, 26.

The present study was designed to evaluate, through a self-administered survey, basic computer skills and abilities of pharmacists working in Italian community pharmacies with the aim to identify the competencies in informatics education useful to the pharmacists for their own working activities.

In Italy there are 30 Schools of Pharmacy graduating approximately 3,000 professionals per year27. The analysis was performed in collaboration with Registries of Pharmacists operating in the Marche region.

Methods

An anonymous questionnaire to assess community pharmacists’ computer knowledge and skills was designed. It was divided into six sections: a) Demographic data; b) Sources of computer basic knowledge; c) Availability of computer and ICT facilities; d) Computer skills; e) General computer use habits; f) Computer and ICT uses in pharmacy practice. The draft questionnaire was given to a sample of professionals (10 community pharmacists and 5 members of Pharmacists Board of Marche region) to assess the face validity, and participants were asked to fill-in the questionnaire noting any questions unclear or ambiguous, and to provide any suggestions for improvement (ease of completion, legibility, time to fill-in, etc.). The suggestions helped us to review the questionnaire and improve it28, 29. The final questionnaire was articulated into 35 questions. Survey organization included the distribution of 493 questionnaires, delivering one questionnaire per pharmacy.

The time required to fill the questionnaire was evaluated in simulations with the 5 Board Members of Registries of Pharmacists, and 10 community pharmacists involved in questionnaire validity. It was averaged approximately 45 min. In view of the required time and to avoid an excessive loss of time by people interviewed, questionnaire was left to one professional for the pharmacies employing more than one pharmacist. The questionnaire had to be filled-in only by selected professional, without possibility to be replaced. This to avoid that only some ages classes could answer (usually young people are more interested in this topic than older one). This was also one of the reasons why the responder was chosen by a computer-assisted programme starting from the list of people employed in each pharmacy (directors +professional pharmacists). The selected pharmacists did receive a letter with the questionnaire. The cover letter explained the rationale of the survey and provided instructions on how to return the completed questionnaire.

Questionnaire answers were received, collected and transferred in Microsoft Excel sheets. This software was used for data storing and processing. Statistical analysis was performed by the X-Lstat software30. For analysis of the qualitative (gender) and quantitative (age) variables the chi-square test was used and statistical significance was established at p<0.05.

Results

a) Demographic Data

The questionnaire was completed by 224 pharmacists (66. 5% female and 33.5% male), with a response rate of 45.4%. The mean age of the responders was 43.5±11.3 years (range: 25-76). This mean age is consistent with the average age of pharmacists operating in public pharmacies in Italy (data obtained from Italian Federation of Pharmacists Register). In terms of high school graduation of the Marches pharmacists, they mainly followed scientific courses. A small part of them attended humanistic courses. A number of pharmacists taking part to this survey was graduated in pharmacy (85.7 %), whereas 14.3% of them were graduated in Pharmaceutical Chemistry and Technology (Table 1). Although this last degree is designed for training researchers for Pharmaceutical industry, professionals with this degree can also work as pharmacist after one year of internship in a community pharmacy. The 65.6% of responders were graduated in the two universities of Marche region (Camerino and Urbino). The 98.7% of responders had one degree only, whereas the 1.3% of them had 2 degrees. The 9.4% of responders obtained a post-graduate qualification/specialization such as PhD, diplomas of herbalists, cosmetics, homeopathy or nutrition.

Table 1. Demographic data of the participants to the survey
  n. %
Gender    
Male 75 33.5
Female 149 66.5
Total 224 100
Age classes    
< 30 23 10.3
30-39 72 32.1
40-49 55 24.6
50-59 56 25
60-69 16 7.1
≥ 70 2 0.9
Degree    
Pharmacy 192 85.7
CTF* 32 14.3

* (Pharmaceutical Chemistry and Technology)

b) Sources of Computer Basic Knowledge.

The survey showed that the 96.9% of responders commonly used computer. Computer use knowledge was getting by the sources described in Figure 1. Only 9.2% of responders were trained by specific courses followed in high schools or at the university (Figure 1).

Figure 1.Computer basic knowledge source in participants to the survey
Computer basic knowledge source in participants to the survey

c) Availability of Computer and ICT Facilities

ADSL Internet connection was used by the majority of responders familiar with computer use. Although Internet connection mode was apparently well known, concepts such as hardware and software features were not clearly perceived. Awareness of processor features and RAM/REM memories were known by 26.3% and 20.3% of interviewed pharmacists respectively. In terms of other available facilities such as, audio board, speakers and webcam, 58.5% of responders confirmed to have audio board, while 55.8% and 23.5% claimed to have speakers and webcam respectively.

d) Computer Skills

Knowledge of computer terminology was evaluated using multiple choice questions. Despite claims of being aware about the meaning of words such as browser, operative system and HTML, some confusion on the significance of these terms was seen in the majority of questionnaires. Among 104 responders who claimed to know the meaning of browser, only 67.3% of them provided the right answer, 15.4% considered it as a search engine, and for 17.3% pharmacists it was just a network. The 60.7% of responders knew the meaning of an operating system. A lower percentage of responders (~40%) were aware of the HTML meaning.

Males were more informed than females about the meaning of the main computer-related terms (e.g. “browser”) (p <0.05; 40.3% vs 26.5%). Analysis of the responses by age revealed that younger professionals (up to 40 years) had, in general, a better knowledge of terms such as "browser" (p <0.05; 40.0% vs 24.8%),"operative system" (p <0.05; 76,7% vs 44.8%) and "HTML" (p <0.05; 55.6% vs 24.8%) in comparison to older people.

Internet Explorer, Microsoft Word and Outlook Express were, in order, the most used applications. Less than 10% of responders used specific programs for pharmacy management.

e) General Computer use Habits

Many of computer users surfed the web and used e-mail applications. Both Internet surfing and e-mail were primarily used by pharmacists under 40 (p<0.05; 93.8% vs 72.3%, and 89.7% vs 62.2% respectively), with no significant gender differences. Over the 60% of responders used these applications for private purposes. Less than 30% of responders used Internet to find something and/or someone, to communicate (e-mail, chat, etc) or to consult databases for obtaining technical information.

f) Computer and IT uses in Pharmacy Practice

In general, computers are primarily used in pharmacies for pharmacy management. Notwithstanding this data, only 42.4% of responders claimed to use it for this purpose. A software, specifically designed for accounting and organizational purposes, such as Excel, was mainly used by younger pharmacists (less than 40 years) than by older colleagues (p<0.05; 38.2% vs 15.1%). No significant gender-related difference was observed.

The e-mail was apparently more used for personal purposes (64.1%) than for pharmacy business. Only 7.8% of responders used e-mail to communicate with health authorities and less than 2% used it to be in contact with physicians or other health professionals. E-mail was the most used system for placing orders of drugs or other items available in the pharmacy (22.6%). In general, medicinal products were ordered using specific programs provided by wholesalers. ICT was used for training courses by less than 40% of responders. Among this group, only the 30.6% were satisfied with these educational resources.

In terms of recognition of ICT applications relevance in pharmacy practice, Internet was considered to be most important (29.9%) or a quite important (33%) resource. Less popular software packages include statistics applications, web pages construction and electronic data presentation resources. Text entry and basic calculations were in a middle position (Figure 2).

Figure 2.Relevance assigned by respondents to various informatics applications
Relevance assigned by respondents to various informatics applications

Data on knowledge of different computer's applications reflected the same trend above reported for recognition of relevance of ICT applications in pharmacy practice, being text entry and use of Internet applications the better known procedures (data not shown).

Table 2 summarizes data on knowledge and relevance of different computer applications, based on the rank of importance given by responders. Internet and text entry were considered the most important applications.

Table 2. Importance and knowledge of different computer applications
  Importance Knowledge
  Fairly or very important (n.)   % Base or nothing   (n.)   %
Text entry 103 46.0 29 28.2
Archives and calculation 63 28.1 33 52.4
Preparation of slides 41 18.3 21 51.2
Use of statistical applications 43 19.2 31 72.1
Web page construction 25 11.1 19 76.0
Use of Internet applications 141 62.9 37 26.2

Discussion

Since 1988 Internet has generally changed habits and working organization with special reference to health professionals. For instance, until the 80's, search and collection of health/medical information and/or scientific data were a complex and time consuming work. Today thanks to Internet and other on-line databases we can update in real-time information and knowledge on a given topic.

In the pharmacy, computers are used for handling nearly all activities including drug dispensing, service quality improvement and collection of information for patients/customers. This study represents the first survey on informatics skills and literacy of pharmacists in Italy and gives an overview of the levels of computer science and ICT knowledge by community pharmacists working in central Italy (the Marche).

The approximate number of pharmacists working full time in public pharmacies in the Marche region at the time of questionnaire delivery was 2,500. Despite the relatively small size of the sample of professionals who answered the questionnaire (45.4%) (although this percentage is in line with the results of other studies on computer skills/literacy of pharmacists13, 17, 18) this study, could provide, at least, a contribution on the level of computer skills and ICT applications capabilities of a part of Italian pharmacists in their practice.

Analysis of collected data revealed a relevant percentage of self-learners to the use of computer. Moreover, it evidenced that Internet was the most used application. Most of responders who claimed to use Internet and other applications were up to 40, as shown by our results. This is in line with other similar researches conduced in Nigeria and India, where the knowledge and positive attitude towards computing were significantly influenced by respondent’s age14, 15, 16.

A good orientation of responders towards Internet is important to update their knowledge and to be the target of appropriate educational activities (e.g. life-long learning programs or other post-graduate educational activities). Moreover, apart from the reduced costs, the main advantage of Internet use, in this area, may be the potential flexibility of educational programs for professionals, avoiding the loss of working hours. Among Internet involved applications, WEB pages construction was less popular. Responders had little experience/ knowledge about this kind of software that if better known, could be useful to promote services or offers to customers (i.e. to provide commercial electronic services through the website19).

E-mail for its effectiveness (rapidity and low cost) represents the main communication system in institutional and professional interactions. In spite of these advantages, in pharmacy practice, this facility is primarily used for placing drug orders. The limited use of e-mail, mainly among pharmacists over 40, may be an example of inadequate use of ICT in pharmacy practice. These data should stimulate a reflection about needs of educational efforts that could lead to a larger/more correct use of ICT resources in daily pharmacy practice.

A comparison of our results with those of other studies assessing computer and informatics skills of pharmacists, and already mentioned in the introduction14, 15, 17, 18, 19, 20, reveals the differences discussed below. The Canadian and Greek studies involved a small number of pharmacists (106 and 88 respectively)18, 19. In general the results of these studies were consistent with our data (e.g. statistical software use). A British investigation that similarly to the present study was proposed to community pharmacies, involved a larger number of professionals (747) than our survey17. The same study had a higher percentage of responders (n =386, 52%)17. A lower percentage of responders (20.6%) than our survey were reported in the Pharmacist online information literacy study, which involved 208 professionals20. The British study and our survey revealed a quite low percentage of pharmacists properly trained with specific courses for computer skills (24% and 9.2% respectively). This observation indicates the need of educational and professional measures for providing appropriate education on computer science among pharmacists. These measures should include the introduction of appropriate university courses in the pharmacist's curriculum to improve informatics knowledge. The US experience highlights the importance of academic education about informatics knowledge and skills that all graduating pharmacy students should possess31.

A good computer literacy background was reported by two investigations performed in Nigeria14, 15. These studies assessed computing knowledge, attitude, skills and utilization pattern of information technology among health care professionals and medical students. These investigations revealed also a quite high percentage of responders (90.5% and 82% respectively)14, 15. Most healthcare professionals (88.4%) had positive attitude toward computing and this was significantly influenced by responder’s age and previous computer training14. These data, if confirmed by other studies, could bring to the conclusion of a higher sensitivity of emerging economies than industrialized countries, to ICT education.

In terms of technological infrastructure, the widespread broadband availability was quite satisfactory in the Marche territory, but basic knowledge of end-users was not enough for guaranteeing the most profitable use of this facility. Lack of basic knowledge on ICT technological infrastructure was probably due to the self-learning of interviewed pharmacists.

Conclusions

In sum up, Italian community pharmacists are primary health unit. They are also widespread health centers in the Nation. In addition, they are involved in the modernization of the relationships between patients and health system (e.g. by reservation of specialist visits, by home pharmaceutical care for disabled patients, etc).

Therefore, it may be affirm that, although pharmacists play a relevant role in national health services, their computer skills and literacy are limited and probably not satisfactory. The modernization of national health services, including the Italian one, will move towards the replacement of pharmaceutical prescriptions, from paper to digital. This will result in advantages in terms of saving in economic resources and of safety bringing to a reduced number of prescription mistakes. This evolution requires better ICT knowledge and computer skills. Educational efforts (appropriate university courses about informatics knowledge and skills in the pharmacist’s curriculum) should be encouraged for enlarging competencies in ICT of the community pharmacists of the future. Actually, the use of ICT will be useful to support community pharmacists for getting a better coordination with physicians/other health professionals and to help to provide up-to-date information and advice to patients. These professionals should be culturally more advanced for the benefit of patients and other customers of community pharmacy services.

Acknowledgments:

The support and collaboration of the Registries of Pharmacists of the Marches and of their presidents at the time in which the study was made (Drs P.M. Calcatelli, G.C. Cuccù, L. Diomedi and R. Salvi) are gratefully acknowledged.

References

  1. 1.it e-government. (2012) Status of implementation of e-gov plan. [UpdatedApril,2013] http://www.funzionepubblica.gov.it/media/872560/aggiornamento%20piano%20e-gov.pdf
  1. 2.Italian Legislative Decree of October 3, 2009, No 153. Identification of new services provided by pharmacies under the National Health Service, as well as provisions on residence allowances for holders of rural pharmacies. in accordance with Article 11 of Law June18,2009,No69.(Published in the Italian Official Journal,November4,2009,n.257) .
  1. 3.DecreeoftheItalian Ministry of Economy, November2,2011. (2011)Dematerialization of on paper medical prescriptions. , (Published in the Official Journal of Italian Republic204,November12,2011)
  1. 4.Charpiat B, Bedouch P, Conort O, F X Rose, Juste M. (2012) Opportunities for medication errors and pharmacist’s interventions in the context of computerized prescription order entry: a review of data published by French hospital pharmacists. , Ann Pharm Fr 70(2), 62-74.
  1. 5.Lupiáñez-Villanueva F, Hardey M, Lluch M. (2014) The integration of information and communication technology into community pharmacists practice in Barcelona. Health Promot Int. 29(1), 47-59.
  1. 6.RoyalPharmaceuticalSocietyofGreatBritain. (2003) Competencies of the Future of the Pharmacy Workforce. , London, Royal Pharmaceutical Society of Great Britain
  1. 7.Programmicomunitari it European. (2013) Programmes Funded directly from European Commission. Available from: [Updated January,2013] http://programmicomunitari.formez.it/content
  1. 8.Italian Legislative Decree of October 18, 2012, n. 179, " Further urgent measures for the Country’s growth" (Published in the Italian Official Journal,October19,2012,n.194).
  1. 9. (2007) American Society of Health-System Pharmacists. ASHP statement on the pharmacist’s role in informatics. , Am J Health-Syst Pharm 64(2), 200-203.
  1. 10.B D Franklin, Reynolds M, Sadler S, Hibberd R, Avery A J et al. (2014) The effect of the electronic transmission of prescriptions on dispensing errors and prescription enhancements made in English community pharmacies: a naturalistic stepped wedge study. BMJ Qual Saf. Apr 17. [Epub ahead of print]. 10-1136.
  1. 11.B I Fox, R B Karcher, Flynn A, Mitchell S. (2008) Pharmacy informatics syllabi in doctor of pharmacy programs in the US. , Am J Pharm Educ. Aug15; 72(4), 89.
  1. 12. (2006) Accreditation Council for Pharmacy Education. Accreditation Standards and Guidelines For The Professional Program in Pharmacy Leading to the Doctor of Pharmacy Degree (ACPE Standards2007) , Chicago, IL .
  1. 13.Royal Pharmaceutical Society of Great Britain. Millennium Project. London:Royal Pharmaceutical Society of Great Britain (1998) .
  1. 14.Iliyasu Z, I S Abubakar, Kabir M, S M Abbas. (2005) Computing knowledge, attitude and skills among healthcare professionals in Aminu Kano Teaching Hospital. , Nigeria. NigerJMed 14(2), 200-5.
  1. 15.I S Bello, F A Arugundade, Sanusi A A, I T Ezeoma, E A Abioye-Kuteyi. (2004) Knowledge and utilization of Information Technology among health care professionals and students in Ile-Ife, Nigeria: a case study of a university teaching hospital. , J Med Internet Res 6(4), 45.
  1. 16.Gour N, Srivastava D. (2010) Knowledge of computer among healthcare professionals of India: a key toward e-health. , Telemed J E Health 16(9), 957-62.
  1. 17.Thomas P, P M Rutter. (2008) A computer literacy skills profile of pharmacists residing in two counties of England. , Health Info Libr J 25, 288-294.
  1. 18.R M Balen, P J Jewesson. (2004) Pharmacist computer skills and needs assessment survey. , J Med Internet Res 6(1), 11.
  1. 19.Kostagiolas P, V A Aggelopoulou, Niakas D. (2011) A study of the information seeking behaviour of hospital pharmacists: empirical evidence from Greece. Health Info Libr. , J 28, 302-12.
  1. 20.Peterson-Clark G, Aslani P, K A Williams. (2010) Pharmacists online information literacy: an assessment of their use of Internet-based medicines information. , Health Info Libr J, Sep; 27(3), 208-16.
  1. 21.Dasgupta A, Sansgiry S S, J T Sherert, Wallace D, Sikri S. (2009) Pharmacist utilization and interest in usage of personal digital assistants in their professional responsibilities. , Health Info Libr J 27, 37-45.
  1. 22.Gensini G F, Conti A A, Conti A. (2006) Medical education: why and how to innovate it. , Recenti Prog Med 97(10), 540-7.
  1. 23.Buccoliero L, Sala F. (2008) Health in Italy. Collaboration and the Knowledge Economy; issues, Applications, Case Studies.Cunningham P,Cunningham M,Amsterdam,IOSPress. 89-99.
  1. 24.Kumar A, Smith B, D M Pisanelli, Gangemi A, Stefanelli M. (2004) An ontological framework for the implementation of clinical guidelines in health care organizations. , Stud Health Technol Inform 102, 95-107.
  1. 25.Stefanelli M. (2004) Knowledge and process management in health care organizations. , Methods Inf Med 43(5), 525-35.
  1. 26.Rossi Mori A, Consorti F, Ricci F L. (2002) Sharing clinical information. principles and task-oriented solutions. , Stud Health Technol Inform 87, 102-14.
  1. 27.it Federfarma.Italian Federation of Pharmacy Owners [Updated April,2013]. http://www.federfarma.it/Documenti/farmacia_mondo/laureati.aspx
  1. 28.Smith F. (1997) Survey research: (2) Survey instruments, reliability and validity. , Int J of Pharm Practice 5, 216-226.
  1. 29.Vaus D A De. (2002) . Surveys in Social Research. 5th Ed. Allen & Unwin. Crows , Nest, NSW .
  1. 30.Addinsoft SARL XLstat. (2006) Loading Data Analysis and Statistical Solution for Microsoft Excel. Addinsoft SRL.
  1. 31.B I Fox, A J Flynn, C R Fortier, K A Clauson. (2011) Knowledge, skills, and resources for pharmacy informatics education. , Am J Pharm Educ,10; 75(5), 93.

Cited by (3)

  1. 1.Kapp Karmen, Sivén Mia, Laurén Patrick, Virtanen Sonja, Katajavuori Nina, et al, 2022, Design and Usability Testing of an Augmented Reality (AR) Environment in Pharmacy Education—Presenting a Pilot Study on Comparison between AR Smart Glasses and a Mobile Device in a Laboratory Course, Education Sciences, 12(12), 854, 10.3390/educsci12120854
  1. 2.Gumede Lisbeth Cathrine , Helberg Elvera , Bezuidenhout Selente , 2021, Pharmacists’ practices and challenges regarding Continuing Professional Development in Mpumalanga province, South Africa, Pharmacy Education, 21(), 247, 10.46542/pe.2021.211.247254
  1. 3.Hallit Souheil, Tawil Samah, Sacre Hala, Rahme Clara, Hajj Aline, et al, 2020, Lebanese pharmacists’ confidence and self-perceptions of computer literacy: scale validation and correlates, Journal of Pharmaceutical Policy and Practice, 13(1), 10.1186/s40545-020-00246-y