Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Evaluating Health Information Systems Using Ontologies
Blekinge Tekniska Högskola, Fakulteten för teknikvetenskaper, Institutionen för hälsa. (Applied Health Technology)ORCID-id: 0000-0002-0316-548X
Blekinge Tekniska Högskola, Fakulteten för teknikvetenskaper, Institutionen för hälsa. (Applied Health Technology)ORCID-id: 0000-0001-9870-8477
Blekinge Tekniska Högskola, Fakulteten för teknikvetenskaper, Institutionen för maskinteknik. (Product Development Research Lab)ORCID-id: 0000-0002-9662-4576
Blekinge Tekniska Högskola, Fakulteten för datavetenskaper, Institutionen för programvaruteknik. University of Applied Sciences and Arts Northwestern Switzerland. (Software Engineering Research Laboratory)ORCID-id: 0000-0001-7368-4448
Vise andre og tillknytning
2016 (engelsk)Inngår i: JMIR Medical Informatics, ISSN 2291-9694, Vol. 4, nr 2, artikkel-id e20Artikkel i tidsskrift (Fagfellevurdert) Published
Abstract [en]

Background: There are several frameworks that attempt to address the challenges of evaluation of health information systems by offering models, methods, and guidelines about what to evaluate, how to evaluate, and how to report the evaluation results. Model-based evaluation frameworks usually suggest universally applicable evaluation aspects but do not consider case-specific aspects. On the other hand, evaluation frameworks that are case specific, by eliciting user requirements, limit their output to the evaluation aspects suggested by the users in the early phases of system development. In addition, these case-specific approaches extract different sets of evaluation aspects from each case, making it challenging to collectively compare, unify, or aggregate the evaluation of a set of heterogeneous health information systems.

Objectives: The aim of this paper is to find a method capable of suggesting evaluation aspects for a set of one or more health information systems—whether similar or heterogeneous—by organizing, unifying, and aggregating the quality attributes extracted from those systems and from an external evaluation framework.

Methods: On the basis of the available literature in semantic networks and ontologies, a method (called Unified eValuation using Ontology; UVON) was developed that can organize, unify, and aggregate the quality attributes of several health information systems into a tree-style ontology structure. The method was extended to integrate its generated ontology with the evaluation aspects suggested by model-based evaluation frameworks. An approach was developed to extract evaluation aspects from the ontology that also considers evaluation case practicalities such as the maximum number of evaluation aspects to be measured or their required degree of specificity. The method was applied and tested in Future Internet Social and Technological Alignment Research (FI-STAR), a project of 7 cloud-based eHealth applications that were developed and deployed across European Union countries.

Results: The relevance of the evaluation aspects created by the UVON method for the FI-STAR project was validated by the corresponding stakeholders of each case. These evaluation aspects were extracted from a UVON-generated ontology structure that reflects both the internally declared required quality attributes in the 7 eHealth applications of the FI-STAR project and the evaluation aspects recommended by the Model for ASsessment of Telemedicine applications (MAST) evaluation framework. The extracted evaluation aspects were used to create questionnaires (for the corresponding patients and health professionals) to evaluate each individual case and the whole of the FI-STAR project.

Conclusions: The UVON method can provide a relevant set of evaluation aspects for a heterogeneous set of health information systems by organizing, unifying, and aggregating the quality attributes through ontological structures. Those quality attributes can be either suggested by evaluation models or elicited from the stakeholders of those systems in the form of system requirements. The method continues to be systematic, context sensitive, and relevant across a heterogeneous set of health information systems.

sted, utgiver, år, opplag, sider
JMIR Publications , 2016. Vol. 4, nr 2, artikkel-id e20
Emneord [en]
health information systems; ontologies; evaluation; technology assessment; biomedical
HSV kategori
Identifikatorer
URN: urn:nbn:se:bth-12114DOI: 10.2196/medinform.5185ISI: 000387986800010OAI: oai:DiVA.org:bth-12114DiVA, id: diva2:938404
Forskningsfinansiär
EU, FP7, Seventh Framework Programme, 604691Tilgjengelig fra: 2016-06-16 Laget: 2016-06-16 Sist oppdatert: 2019-10-29bibliografisk kontrollert
Inngår i avhandling
1. Evaluating Success Factors of Health Information Systems
Åpne denne publikasjonen i ny fane eller vindu >>Evaluating Success Factors of Health Information Systems
2019 (engelsk)Doktoravhandling, med artikler (Annet vitenskapelig)
Abstract [en]

Health information systems are our technological response to the growing demand for health care. However, their success in their mission can be challenging due to the complexity of evaluating technological interventions in health care. In the series of studies compiled in this dissertation, we looked at the evaluation of these systems. We focused on the evaluation of factors that lead to success, where success is indicated by user satisfaction and can be induced by both intervention-specific and individual-specific factors.

Study 1 developed a method, called UVON, to elicit and organise the user-demanded qualities in the outcomes of the health information system intervention. Through the application of the UVON method in the FI-STAR project, an EU project which developed and deployed seven e-health applications in seven member countries, ten categories of quality and their subcategories were identified. These qualities formed two questionnaires, specific to the patient and health professional users. Through the questionnaires, the patients and health-professionals users evaluated and graded both the occurrence of those demanded qualities in the project outcomes and their general satisfaction.

Study 2 analysed the survey results to find out which of those ten qualities have the highest impact on satisfaction or can predict it better. Two partial least squares structural equation modelling (PLS-SEM) models were constructed, for the patient and health professionals, based on the Unified eValuation using ONtology (UVON) and survey outputs. The models showed that effectiveness is an important quality in creating satisfaction for both user groups. Besides, affordability for the health professionals and efficiency plus safety for the patients were the most influential. A satisfaction index is also introduced for simple and fast inferring of the changes in the outcome qualities.

Study 5 recruited outputs and learnings from studies 1 and 2 to design a system that partially automates the process of evaluating success factors in health information systems, making it continuous and real-time, and replacing hard-to-run surveys with automatically captured indicators and analytics.

Study 3 focused on individual-specific factors in using health information systems, particularly the technophilia personality trait. A short six-items instrument, called TechPH, was designed to measure technophilia in users, tuned for older users. The study recruited empirical data from the Swedish National Study on Aging and Care (SNAC) project. Two factors, labelled techAnxiety and techEnthusiams, are identified by the factor analysis method. A TechPH score was introduced as a scalar measurement of technophilia.

Study 4 elicited and discussed the ethical challenges of evaluating and researching health information systems. Both a scoping review and a novel systematic postulation approach were recruited to identify twenty ethical challenges. The identified ethical challenges were discussed and mapped into a three-dimensional space of evaluation stages, demanded qualities, and major involving entities (stakeholder and artefacts), which fosters further postulation of ethical challenges.

sted, utgiver, år, opplag, sider
Karlskrona: Blekinge Tekniska Högskola, 2019. s. 340
Serie
Blekinge Institute of Technology Doctoral Dissertation Series, ISSN 1653-2090 ; 14
Emneord
Health Information Systems, Health Information Technology, Health Informatics, eHealth, Digital Health, Evaluation, Information Systems Evaluation, Health Technology Assessment, User Satisfaction, Technophilia, Evaluation and Research Ethics, System Design
HSV kategori
Identifikatorer
urn:nbn:se:bth-18799 (URN)978-91-7295-387-1 (ISBN)
Disputas
2019-12-17, J1640, Campus Gräsvik, Karlskrona, 14:00 (engelsk)
Opponent
Veileder
Tilgjengelig fra: 2019-10-29 Laget: 2019-10-29 Sist oppdatert: 2019-12-12bibliografisk kontrollert

Open Access i DiVA

fulltext(452 kB)694 nedlastinger
Filinformasjon
Fil FULLTEXT01.pdfFilstørrelse 452 kBChecksum SHA-512
8ffd668834ea09499961525c8b3742b03a845825b9b6b97b35dad7a172bf818ea6d51247d8e4376dfee3988e15119897c90e5fc4fe66b7678d88dba05561b01a
Type fulltextMimetype application/pdf

Andre lenker

Forlagets fulltekstJMIR Medical Informatics

Personposter BETA

Eivazzadeh, ShahryarAnderberg, PeterLarsson, TobiasFricker, SamuelBerglund, Johan

Søk i DiVA

Av forfatter/redaktør
Eivazzadeh, ShahryarAnderberg, PeterLarsson, TobiasFricker, SamuelBerglund, Johan
Av organisasjonen

Søk utenfor DiVA

GoogleGoogle Scholar
Totalt: 694 nedlastinger
Antall nedlastinger er summen av alle nedlastinger av alle fulltekster. Det kan for eksempel være tidligere versjoner som er ikke lenger tilgjengelige

doi
urn-nbn

Altmetric

doi
urn-nbn
Totalt: 976 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf