Factors Influencing the Acceptance of Distributed Research Networks in Korea: Data Accessibility and Data Security Risk

Jihwan Park; Mi Jung Rho

doi:10.4258/hir.2023.29.4.334

Healthc Inform Res > Volume 29(4); 2023 > Article

Park and Rho: Factors Influencing the Acceptance of Distributed Research Networks in Korea: Data Accessibility and Data Security Risk

Original Article

Healthcare Informatics Research 2023;29(4):334-342.

Published online: October 31, 2023

DOI: https://doi.org/10.4258/hir.2023.29.4.334

Factors Influencing the Acceptance of Distributed Research Networks in Korea: Data Accessibility and Data Security Risk

Jihwan Park¹

, Mi Jung Rho²

¹College of Liberal Arts, Dankook University, Cheonan, Korea

²College of Health Science, Dankook University, Cheonan, Korea

Corresponding Author: Mi Jung Rho, College of Health Science, Dankook University, 119 Dandae-ro, Dongnam-gu, Cheonan 31116, Korea.
Tel: +82-41-550-1474, E-mail: rhomijung@dankook.ac.kr (https://orcid.org/0000-0002-9862-0122)

Received July 8, 2022 Revised August 3, 2023 Accepted August 5, 2023

This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Objectives

Distributed research networks (DRNs) facilitate multicenter research by enabling the use of multicenter data; therefore, they are increasingly utilized in healthcare fields. Despite the numerous advantages of DRNs, it is crucial to understand researchers’ acceptance of these networks to ensure their effective application in multicenter research. In this study, we sought to identify the factors influencing the adoption of DRNs among researchers in Korea.

Methods

We used snowball sampling to collect data from 149 researchers between July 7 and August 28, 2020. Five factors were used to formulate the hypotheses and research model: data accessibility, usefulness, ease of use, data security risk, and intention to use DRNs. We applied a structural equation model to identify relationships within the research model.

Results

Data accessibility and data security were critical to the acceptance and use of DRNs. The usefulness of DRNs partially mediated the relationship between data accessibility and the intention to use DRNs. Interestingly, ease of use did not influence the intention to use DRNs, but it was affected by data accessibility. Furthermore, ease of use impacted the perceived usefulness of DRNs.

Conclusions

This study highlighted major factors that can promote the broader adoption and utilization of DRNs. Consequently, these findings can contribute to the expansion of active multicenter research using DRNs in the field of healthcare research.

Keywords: Acceptance, Accessibility, DRN, Security, Usefulness

I. Introduction

Efforts to conduct diverse research through multicenter collaborations have increased the capacity for exchanging healthcare-related data, as exemplified by distributed research networks (DRNs) [1]. DRNs are a method that transmits analysis code to each institution, using only the results, without directly providing the original data [2]. Therefore, DRNs have the advantage of yielding research results as though all the data have been gathered and analyzed, but without creating security risks since the original data remain within the organization [3].

For example, DRNs transform medical data, such as Electronic Medical Records (EMR), into a standardized data model using common terms. Subsequently, DRNs offer a data catalog to researchers from other institutions, which can be accessed and utilized in their studies. The DRN administrator then reviews and approves the proposed research, implements the analysis code supplied by the researcher, and sends the results back to the researcher, as depicted in Figure 1 [4].

Security concerns prevent the sharing of EMR data for multicenter research. However, each institution owns the data within DRNs, which can be utilized for research purposes. The primary advantage of DRNs is their ability to facilitate multicenter research by providing access to multicenter data that is typically difficult to obtain [4]. For this reason, DRNs have been used in various healthcare fields [2,5,6].

Korea utilizes government-led DRNs, namely (1) the Health and Medical Big Data Platform of the Ministry of Health and Welfare [7] and (2) Medical Record Observation and Assessment for Drug Safety (MOA Net) of the Korea Institute of Drug Safety & Risk Management [8]. The use of these DRNs supports the need for the acceptance of multi-center research.

Although DRNs have advantages, it is crucial to understand researchers’ acceptance of DRNs to ensure their effective application in multicenter research. Consequently, we sought to identify the key factors influencing the introduction of DRNs in Korea. By examining previous research related to the technology acceptance model (TAM) in healthcare, we aimed to gain deeper insights into the acceptance of DRNs.

1. Hypotheses and Research Model

We formulated our hypotheses and research model based on five key factors: data accessibility, usefulness, ease of use (EOU), data security risk, and the intention to use DRNs. These five factors, which influence the acceptance of DRNs in healthcare, were derived from the TAM [9] and previous related studies [10–14].

1) Data accessibility

In this study, data accessibility refers to the perceived extent to which the use of DRNs can provide accurate and appropriate data from other institutions [10,15]. Data accessibility, particularly in relation to medical records, has been reported to enhance clinical outcomes in telemedicine [10,15]. Similarly, the utilization of diverse data from multiple institutions is crucial for research in the healthcare industry. However, hospital data possess certain characteristics that prevent data from being shared externally. Consequently, these institutions must have access to trustworthy multicenter data. We therefore suggest that increased data accessibility will inevitably result in greater usefulness and ease of use. Furthermore, higher data accessibility is likely to lead to a stronger intention to use DRNs. In accordance with these observations, we propose the following hypotheses:

H1: Data accessibility has a positive relationship with the usefulness of DRNs.
H2: Data accessibility has a positive relationship with the ease of use of DRNs.
H3: Data accessibility has a positive relationship with the intention to use DRNs.

2) Usefulness, ease of use, and intention to use DRNs

Usefulness refers to the degree to which a researcher believes that utilizing DRNs would improve the quality and efficiency of their research [11,15]. EOU denotes the level of ease that a researcher associates with the use of DRNs [11,12]. Intention to use means the degree of a researcher’s behavioral intention to use DRNs [13,14]. Both usefulness and EOU are recognized as significant factors in the acceptance of technology [14]. As a result, these two factors have been applied in various healthcare contexts [11,12]. Moreover, previous literature has emphasized that usefulness and EOU lead to the intention to use DRNs [13,16]. It has also been suggested that EOU can enhance perceived usefulness [15]. Given these established relationships, it is anticipated that researchers will employ DRNs if they perceive them as beneficial to healthcare research and easy to use. Therefore, we propose the following hypothesis:

H4: Usefulness has a positive relationship with the intention to use DRNs.
H5: Ease of use has a positive relationship with the usefulness of DRNs.
H6: Ease of use has a positive relationship with the intention to use DRNs.

3) Data security risk and the intention to use DRNs

In this study, data security risk refers to the extent of a researcher’s concern that the utilization of DRNs could lead to increased data exposure and unauthorized data use [1,4]. Data use in a technological context carries the risk of data exposure [12,17,18]. Specifically, since EMR data involve protected health information, there has always been a dialogue surrounding data exposure and the concerns it raises [1]. Privacy and security policies also pose significant concerns for researchers and providers in terms of accepting DRNs [19]. In other words, given that DRNs handle data, data security risk is viewed as one of the key issues associated with DRNs [1,4]. Therefore, the following hypothesis is proposed:

H7: Data security risk has a negative relationship with the intention to use DRNs.

Based on the above literature and hypotheses, a research model was developed and is presented in Figure 2.

II. Methods

1. Participants

We conducted a survey among individuals in hospitals and universities, including professional researchers, doctors, nurses, pharmacists, and students in both master’s and doctoral healthcare programs, utilizing snowball sampling [20]. This method begins with a small, intentionally or expediently selected sample, which gradually expands to form a larger sample [21]. Snowball sampling is useful when it is difficult to find study subjects belonging to the population being examined. Thus, the online survey link was initially distributed to 10 researchers in the healthcare field who were able to participate. Online surveys were conducted from July 7 to August 28, 2020. Of the 151 completed surveys, two were excluded because they were incomplete. Thus, the final sample included data from 149 respondents.

2. Measures

Table 1 presents the specific items included in the questionnaire. The total questionnaire comprised 23 items: six items on data security risk, five items on usefulness, four items on intention to use DRNs, four items on ease of use, and four items on data accessibility. All questions utilized a 5-point Likert scale.

Each item was first derived from the prior literature [1–4,9–15] and subsequently adapted to suit the subject of DRNs. The questionnaire was further supplemented by a team of four researchers, comprising two experts in medical informatics, one researcher with a master’s degree, and one researcher at the undergraduate level.

3. Statistical Analyses

We identified the factor structure of our research model. Subsequently, we assessed the reliability of all constructs using Cronbach’s alpha. We then carried out a principal component analysis with varimax rotation and performed a confirmatory factor analysis (CFA) to evaluate the validity of each construct. We examined the construct average variance extracted (AVE) and reliability (critical ratio [CR]) scores to establish convergent validity, and also assessed discriminant validity. Finally, we tested the hypotheses of our research model. We utilized R to analyze the descriptive statistics and internal consistency. Additionally, we employed a structural equation model (SEM) to identify the relationships between model parameters, again using R. The R package lavaan (version 0.6–5) was used for the SEMs [22].

4. Ethics

We secured research approval from the Institutional Review Board of the Catholic University (No. MC20QISI0066). All data from respondents was anonymized. Approval for participation was obtained online.

III. Results

1. Participants’ Characteristics

The demographic characteristics of the 149 respondents are presented in Table 2. The sample was nearly evenly split between males and females. The plurality of respondents (38.26%) were in their 30s. In terms of occupation, 37.58% of respondents were researchers, while 23.49% were professors. Furthermore, 39.60% had less than 5 years of experience in their respective fields, and 25.50% had less than 10 years. The respondents were primarily affiliated with universities (44.97%) and hospitals (42.95%). Geographically, 81.88% of respondents were based in the capital region, which includes Gyeonggi Province and Incheon City. In relation to research fields, 42.28% were involved in medicine and pharmacy, while 22.15% were engaged in the field of convergence. Notably, only 11.41% of respondents had experience with DRNs.

2. Reliability and Validity

We conducted a principal component analysis with varimax rotation (Table 3). All variables demonstrated no crossloadings exceeding 0.6. We verified the presence of all variables with eigenvalues above 1.0, which represented 74.091% of the total variance in the model. The communality varied between 0.706 and 0.893, and all variables met the 0.50 threshold. As a result, we confirmed that all constructs were distinct unidimensional scales.

Next, we assessed the reliability of all constructs using Cronbach’s alpha. The internal consistency values for all constructs were significant, and all variables were deemed reliable: α = 0.893 for data security risk, α = 0.846 for usefulness, α = 0.851 for behavioral intention to use DRNs, α = 0.706 for EOU, and α = 0.737 for data accessibility. The internal consistency values for the two constructs exceeding 0.70 suggest that these items demonstrated good internal consistency reliability [23].

The CFA results indicated that all values met the recommended threshold: chi-square/degree of freedom (χ²/df = 1.351), comparative fit index (CFI = 0.970), root-mean-square error of approximation (RMSEA = 0.049), and Tucker-Lewis index (TLI = 0.962). Convergent validity was evaluated for each construct. All variables had an AVE loading above 0.50 (0.679 for data security risk, 0.596 for usefulness, 0.658 for behavioral intention to use DRNs, 0.454 for EOU, and 0.584 for data accessibility) [24]. All variables had a CR score above 0.70 (0.883 for data security risk, 0.912 for usefulness, 0.913 for behavioral intention to use DRNs, 0.738 for EOU, and 0.824 for data accessibility) [25]. Finally, variables that demonstrated validity and reliability in the CFA results were selected for analysis: four out of six items for data security risk, four out of five items for usefulness, three out of four items for behavioral intention to use DRNs, three out of four items for EOU, and two out of four items for data accessibility.

Table 4 displays the results for discriminant validity. To ensure discriminant validity, the square root of the AVE must exceed the correlation with each construct [15]. The square root of the AVE surpassed the corresponding inter-construct correlations, thereby confirming discriminant validity.

3. Hypothesis Testing

We evaluated the fit of the structural model using various goodness-of-fit measures. The results fell within acceptable parameters: χ²/df = 1.387, CFI = 0.967, RMSEA = 0.051, and TLI = 0.958 (Table 5).

Figure 3 presents the structural path diagram, while Table 6 shows the SEM results for the hypotheses. All hypotheses received support, with the exception of H6. There was a positive relationship between data accessibility and usefulness (β = 0.503, p < 0.001), EOU (β = 0.359, p < 0.01), and the intention to use DRNs (β = 0.364, p < 0.01). Usefulness had a positive impact on the intention to use DRNs (β = 0.485, p < 0.001), and EOU positively influenced usefulness (β = 0.323, p < 0.01). Lastly, data security risk was negatively associated with the intention to use DRNs (β = −0.184, p < 0.05).

IV. Discussion

This study aimed to identify the factors that influence the acceptance of DRNs in Korea. To achieve this, we constructed and validated a research model that incorporated five key influencing factors. These factors included data accessibility, usefulness, EOU, data security risk, and the intention to use DRNs. All of our hypotheses were supported, with the exception of H6, which proposed that EOU impacts the behavioral intention to use DRNs.

First, we found that data accessibility was paramount to the use and acceptance of DRNs. That is, the more accessible the data was perceived to be, the more researchers acknowledged the utility of DRNs for their research and the easier they found its use. These findings imply that data accessibility significantly influences the intention to use DRNs. Moreover, DRNs prove to be effective in studies that necessitate extremely large sample sizes or in studies involving rare exposures [3,4]. Researchers intending to use DRNs often aim to access data that is typically hard to obtain or involves a large volume of data. Consequently, it is essential to enhance DRNs to allow researchers to easily comprehend the data they wish to use and to select and utilize it effectively. In the context of DRNs, it appears necessary to simplify data selection when dealing with complex data from other institutions. This is due to the potentially intricate composition and structure of data from each medical institution. Therefore, offering a visualization of the data that researchers can select within the DRN could potentially increase effective data utilization.

Second, we identified the importance of data security in the acceptance of DRNs. While numerous prior studies have addressed policies and procedures for the secure transfer and storage of study results [2,3,26], there appears to be ongoing concern among researchers about the security risks linked to data usage. Consequently, to encourage the active utilization of DRNs, it is necessary to develop a range of security technologies that can alleviate these data security risks.

Third, usefulness was found to play a role as a partial mediator in the relationship between data accessibility and the intention to use DRNs. This reaffirms the importance of usefulness in the acceptance of DRNs, aligning with prior research that indicates a positive correlation between perceived usefulness and the intention to use technology [27–29]. However, EOU did not serve as a mediator between data accessibility and the intention to use. This may suggest that the majority of respondents are experts in their respective fields, and thus, the ease of use was not a significant factor in their acceptance of DRNs. Nevertheless, it is worth noting that as data accessibility improved, so did the ease of use. Therefore, EOU should not be disregarded in the development of DRNs, as it impacts usefulness, which is consistent with the findings of previous studies [15,30].

Despite these significant findings, there are some limitations that should be taken into account. Firstly, while various DRNs are available in Korea, they are not yet widely used as a standard research method. As a result, the number of respondents who had experience with DRNs was limited. Future studies should aim to include more experienced DRN users. Secondly, despite the use of SEM, the volume of data collected was relatively small. This may have been due to the participation of medical field researchers, who might have found it challenging to complete the questionnaire. Even though the sample size was small, the model fit was excellent. Nonetheless, further research with a larger number of respondents is needed to validate these findings.

Despite these limitations, our study highlighted major influencing factors that could contribute to the expansion and utilization of DRNs. Therefore, these findings will aid in promoting active multicenter healthcare research employing DRNs.

Acknowledgments

This research was supported by a grant from the Korea Health Technology R&D Project through the Korea Health Industry Development Institute (KHIDI), funded by the Ministry of Health & Welfare, Republic of Korea (No. HI19C0870). This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT) (No. NRF-2022R1G1A1011635).

Notes

Conflict of Interest

No potential conflict of interest relevant to this article was reported.

Figure 1

Schematic of a simple distributed research network (DRN).

Figure 2

Distributed research networks (DRNs) acceptance model.

Figure 3

Results of hypothesis testing. DRNs: distributed research networks.

Table 1

Detailed items of the questionnaire

Construct	Variables
Data security risk [1,4]	When using the DRNs, data may be leaked to the outside.
	It is likely that data will be collected and utilized without the consent of the researcher or institution.
	Researchers and research information will be exposed.
	There is a concern that patient data may be inappropriately used if the DRNs was used.
	The DRNs will not manage medical data or research information with safety.
	It is likely that unauthorized researchers can access it.

Usefulness [10,12]	Rapid research will be possible through integrated research support.
	Multi-center data-based research will improve research quality.
	A convenient research support service will be helpful for your research.
	It seems that data utilization research can be conducted more effectively.
	DRNs will be useful when conducting multi-center research.

Ease of use [12,13]	It will be easy to apply for research through the DRNs.
	Data from other organizations can be easily used.
	It doesn’t take much time and effort to get good at using data from DRNs.
	The research process using the DRNs will be simple.

Data accessibility [11,17]	Using the DRNs, it is possible to utilize various medical data.
	If you use the DRNs, you will be able to do research using data that is difficult to access.
	Using the DRNs, reliable data can be used for research.
	Using the DRNs, multi-center data utilization research is possible.

Intention to use [14,15]	I am willing to actively recommend the DRNs.
	We will use the DRNs for multi-center research.
	The DRNs will be used for future research.
	If there is an opportunity, I am willing to use the DRNs.

DRNs: distributed research networks.

Table 2

Participants’ characteristics (n = 149)

Characteristic	Freq. (%)
Sex
Male	75 (50.34)
Female	74 (49.66)

Age (yr)
20–29	18 (12.08)
30–39	57 (38.26)
40–49	39 (26.17)
Over 50	35 (23.49)

Position
Professional	35 (23.49)
Researcher	56 (37.58)
Doctor, nurse, and pharmacist	24 (16.11)
Student (including master’s and doctoral programs)	27 (18.12)
Etc.	7 (4.70)

Career (years of experience)
<5	59 (39.60)
5–10	38 (25.50)
Over 11	52 (34.90)

Organization
Hospital	64 (42.95)
University	67 (44.97)
Etc.	18 (12.08)

Location
Capital region (Gyeonggi Province, Incheon City)	122 (81.88)
Outside the capital region and Seoul	27 (18.12)

Research field
Medicine, pharmacy	63 (42.28)
Natural science	23 (15.44)
Science	15 (10.07)
Engineering	15 (10.07)
Convergence	33 (22.15)

Experience of DRNs
Yes	17 (11.41)
No	132 (88.59)

DRNs: distributed research networks.

Table 3

Reliability and validity results for the variables

	DSR	USE	ITU	EOU	DA	Communality	Cronbach’s α	AVE	CR
Data security risk							0.893	0.679	0.883
DSR 3	0.888	−0.041	0.021	0.019	−0.092	0.800
DSR 1	0.869	−0.074	−0.040	−0.105	0.024	0.773
DSR 4	0.861	−0.079	−0.138	−0.114	−0.008	0.779
DSR 2	0.824	−0.059	−0.208	−0.081	0.017	0.733

Usefulness							0.846	0.596	0.912
Use 4	−0.048	0.817	0.213	0.094	0.234	0.779
Use 2	−0.066	0.802	0.262	0.182	0.162	0.776
Use 5	−0.129	0.754	0.205	0.063	0.201	0.671
Use 1	−0.034	0.637	0.214	0.479	−0.013	0.682

Intention to use DRNs							0.851	0.658	0.913
ITU 3	−0.111	0.212	0.835	0.110	0.245	0.828
ITU 4	−0.098	0.311	0.782	−0.062	0.249	0.784
ITU 1	−0.205	0.351	0.731	0.246	0.089	0.769

Ease of use							0.706	0.454	0.738
EOU 3	−0.089	0.006	0.052	0.859	−0.017	0.749
EOU 4	−0.073	0.184	0.056	0.792	0.056	0.673
EOU 1	−0.083	0.229	0.069	0.611	0.287	0.520

Data accessibility							0.737	0.584	0.824
DA 2	−0.035	0.235	0.186	0.091	0.835	0.796
DA 3	0.013	0.195	0.263	0.116	0.789	0.744

Eigenvalue	3.074	2.746	2.226	2.143	1.667	-	-	-	-

% of variance	19.212	17.160	13.909	13.394	10.416	-	-	-	-

Cumulative %	19.212	36.372	50.281	63.675	74.091	-	-	-	-

Number of items included	4/6	4/5	3/4	3/4	2/4	-	-	-	-

DRNs: distributed research networks, AVE: average variance extracted, CR: construct reliability, DSR: data security risk, Use: usefulness, ITU: intention to use, EOU: ease of use, DA: data accessibility.

Bold means the factor loading values.

Table 4

Discriminant validity results

	Data security risk	Usefulness	Intention to use	Ease of use	Data accessibility
Data security risk	0.679	-	-	-	-
Usefulness	0.047	0.596	-	-	-
Intention to use	0.102	0.501	0.658	-	-
Ease of use	0.061	0.254	0.118	0.454	-
Data accessibility	0.010	0.373	0.421	0.122	0.584

^* Average variance extracted (AVE) is on the diagonal; squared correlations are off the diagonal.

Bold means AVE.

Table 5

Research model fit

Model-fit index	Acceptance range	Score
Chi-square/degree of freedom	≤3.00	1.387
Comparative fit index	≥0.90	0.967
Root-mean-square error of approximation	≤0.08	0.051
Tucker-Lewis index	≥0.90	0.958

Table 6

Research model results

	Hypotheses and path	SE	CR (t)	Standardized estimate	p-value	Results
H1	Data accessibility → Usefulness	0.101	4.420	0.503	***	Supported
H2	Data accessibility → Ease of use	0.134	3.054	0.359	0.002	Supported
H3	Data accessibility → Intention to use DRNs	0.118	3.040	0.364	0.002	Supported
H4	Usefulness → Intention to use DRNs	0.139	3.892	0.485	***	Supported
H5	Ease of use → Usefulness	0.082	3.055	0.323	0.002	Supported
H6	Ease of use → Intention to use DRNs	0.084	−0.728	−0.071	0.467	ns
H7	Data security risk → Intention to use DRNs	0.047	−2.535	−0.184	0.011	Supported

DRNs: distributed research networks, SE: standard error, CR: critical ratio, ns: not significant.

^* t_0.05 = 1.960,

^** t_0.01 = 2.576,

^*** t_0.001 = 3.291.

References

1. Bredfeldt CE, Butani A, Padmanabhan S, Hitz P, Pardee R.. Managing protected health information in distributed research network environments: automated review to facilitate collaboration. BMC Med Inform Decis Mak 2013 13:39. https://doi.org/10.1186/1472-6947-13-39

2. Velentgas P, Bohn RL, Brown JS, Chan KA, Gladowski P, Holick CN, et al. A distributed research network model for post-marketing safety studies: the Meningococcal Vaccine Study. Pharmacoepidemiol Drug Saf 2008 17(12):1226-34. https://doi.org/10.1002/pds.1675

3. Toh S, Platt R, Steiner JF, Brown JS.. Comparative-effectiveness research in distributed health data networks. Clin Pharmacol Ther 2011 90(6):883-7. https://doi.org/10.1038/clpt.2011.236

4. Holmes JH, Elliott TE, Brown JS, Raebel MA, Davidson A, Nelson AF, et al. Clinical research data warehouse governance for distributed research networks in the USA: a systematic review of the literature. J Am Med Inform Assoc 2014 21(4):730-6. https://doi.org/10.1136/amiajnl-2013-002370

5. Forrow S, Campion DM, Herrinton LJ, Nair VP, Robb MA, Wilson M, et al. The organizational structure and governing principles of the Food and Drug Administration’s Mini-Sentinel pilot program. Pharmacoepidemiol Drug Saf 2012 21 (Suppl 1):12-7. https://doi.org/10.1002/pds.2242

6. McMurry AJ, Gilbert CA, Reis BY, Chueh HC, Kohane IS, Mandl KD.. A self-scaling, distributed information architecture for public health, research, and clinical care. J Am Med Inform Assoc 2007 14(4):527-33. https://doi.org/10.1197/jamia.M2371

7. Korea Health Information Service. Health and medical big data platform [Internet]. Seoul, Korea: Korea Health Information Service; c2023 [cited at 2023 Sep 30]; Available from: https://hcdl.mohw.go.kr

8. Korea Institute of Drug Safety & Risk Management. MOA project: medical record observation and assessment for drug safety [Internet]. Anyang, Korea: Korea Institute of Drug Safety & Risk Management; c2023 [cited at 2023 Sep 30]. Available from: https://moa.drug-safe.or.kr/main

9. Venkatesh V, Morris MG, Davis GB, Davis FD.. User acceptance of information technology: toward a unified view. MIS Q 2003 27(3):425-78. https://doi.org/10.2307/30036540

10. Sandberg J, Trief PM, Izquierdo R, Goland R, Morin PC, Palmas W, et al. A qualitative study of the experiences and satisfaction of direct telemedicine providers in diabetes case management. Telemed J E Health 2009 15(8):742-50. https://doi.org/10.1089/tmj.2009.0027

11. Dunn HP, Kang CJ, Marks S, Witherow JL, Dunn SM, Healey PR, et al. Perceived usefulness and ease of use of fundoscopy by medical students: a randomised cross-over trial of six technologies (eFOCUS 1). BMC Med Educ 2021 21(1):41. https://doi.org/10.1186/s12909-020-02469-8

12. Schnall R, Higgins T, Brown W, Carballo-Dieguez A, Bakken S.. Trust, perceived risk, perceived ease of use and perceived usefulness as factors related to mHealth technology use. Stud Health Technol Inform 2015;216:467-71.

13. Rho MJ, Kim HS, Chung K, Choi IY.. Factors influencing the acceptance of telemedicine for diabetes management. Cluster Comput 2015 18(1):321-31. https://doi.org/10.1007/s10586-014-0356-1

14. Venkatesh V, Davis FD.. A theoretical extension of the technology acceptance model: four longitudinal field studies. Manag Sci 2000 46(2):186-204. https://doi.org/10.1287/mnsc.46.2.186.11926

15. Rho MJ, Choi IY, Lee J.. Predictive factors of telemedicine service acceptance and behavioral intention of physicians. Int J Med Inform 2014 83(8):559-71. https://doi.org/10.1016/j.ijmedinf.2014.05.005

16. Kamal SA, Shafiq M, Kakria P.. Investigating acceptance of telemedicine services through an extended technology acceptance model (TAM). Technol Soc 2020 60:101212. https://doi.org/10.1016/j.techsoc.2019.101212

17. de Sena Abrahao R, Moriguchi SN, Andrade DF.. Intention of adoption of mobile payment: an analysis in the light of the Unified Theory of Acceptance and Use of Technology (UTAUT). RAI Revista de Administracaoe Inovacao 2016 13(3):221-30. https://doi.org/10.1016/j.rai.2016.06.003

18. Sangroya A, Kumar S, Dhok J, Varma V. Towards analyzing data security risks in cloud computing environments. Prasad SK, Vin HM, Sahni S, Jaiswal MP, Thipakorn B. In: Information systems, technology and management. Heidelberg, Germany: Springer; 2010 255-65. https://doi.org/10.1007/978-3-642-12035-0_25

19. Kim KK, McGraw D, Mamo L, Ohno-Machado L.. Development of a privacy and security policy framework for a multistate comparative effectiveness research network. Med Care 2013 51(8 Suppl 3):S66-72. https://doi.org/10.1097/MLR.0b013e31829b1d9f

20. Goodman LA.. Snowball sampling. Ann Math Stat 1961;32(3):148-70.

21. Parker C, Scott S, Geddes A. Snowball sampling. Thousand Oaks (CA): SAGE Publications Ltd; 2019 https://doi.org/10.4135/9781526421036831710

22. Rosseel Y, Jorgensen TD, Rockwood N, Oberski D, Byrnes J, Vanbrabant L, et al. Package ‘lavaan’: latent variable analysis [Internet]. Vienna, Austria: The R Foundation; 2023 [cited at 2023 Sep 30]. Available from: https://cran.r-project.org/web/packages/lavaan/lavaan.pdf

23. Nunnally JC. Psychometric theory. 2nd ed. New York (NY): McGraw-Hill; 1978.

24. Chin WW. The partial least squares approach to structural equation modeling. In: Marcoulides GA, editors. Modern methods for business research. Mahwah (NJ): Lawrence Erlbaum Associates; 1998. p. 295-336.

25. Hair JF. Multivariate data analysis. 7th ed. Upper Saddle River (NJ): Prentice Hall; 2010.

26. Curtis LH, Weiner MG, Boudreau DM, Cooper WO, Daniel GW, Nair VP, et al. Design considerations, architecture, and use of the Mini-Sentinel distributed data system. Pharmacoepidemiol Drug Saf 2012 21 (Suppl 1):23-31. https://doi.org/10.1002/pds.2336

27. Nadri H, Rahimi B, Lotfnezhad Afshar H, Samadbeik M, Garavand A.. Factors affecting acceptance of hospital information systems based on extended technology acceptance model: a case study in three paraclinical departments. Appl Clin Inform 2018 9(2):238-47. https://doi.org/10.1055/s-0038-1641595

28. Abdekhoda M, Ahmadi M, Gohari M, Noruzi A.. The effects of organizational contextual factors on physicians’ attitude toward adoption of Electronic Medical Records. J Biomed Inform 2015 53:174-9. https://doi.org/10.1016/j.jbi.2014.10.008

29. Hsiao JL, Chang HC, Chen RF.. A study of factors affecting acceptance of hospital information systems: a nursing perspective. J Nurs Res 2011 19(2):150-60. https://doi.org/10.1097/JNR.0b013e31821cbb25

30. Guo XT, Yuan JQ, Cao XF, Chen XD. Understanding the acceptance of mobile health services: a service participants analysis. Proceedings of 2012 International Conference on Management Science & Engineering (ICMSE) 19th Annual Conference; 2012 Sep 2022. Dallas, TX; p. 1868-73. https://doi.org/10.1109/ICMSE.2012.6414426