s12962-022-00389-6
s12962-022-00389-6
s12962-022-00389-6
Cost Effectiveness and Resource Allocation (2022) 20:54 Cost Effectiveness and
https://doi.org/10.1186/s12962-022-00389-6 Resource Allocation
Abstract
Background: Health Technology Assessment (HTA) has been widely recognized as informing healthcare decision-
making, and interest in HTA of medical devices has been steadily increasing. How does the assessment of medical
devices differ from that of drug therapies, and what innovations can be adopted to overcome the inherent challenges
in medical device HTA?
Method: HTA Accelerator Database was used to describe the landscape of HTA reports for medical devices from HTA
bodies, and a literature search was conducted to understand the growth trend of relevant HTA publications in four
case studies. Another literature review was conducted for a narrative synthesis of the characteristic differences and
challenges of HTA in medical devices. We further conducted a focused Internet search of guidelines and a narrative
review of methodologies specific to the HTA of medical devices.
Main body: The evidence of HTA reports and journal publications on medical devices around the world has been
growing. The challenges in assessing medical devices include scarcity of well-designed randomized controlled tri-
als, inconsistent real-world evidence data sources and methods, device-user interaction, short product lifecycles,
inexplicit target population, and a lack of direct medical outcomes. Practical solutions in terms of methodological
advancement of HTA for medical devices were also discussed in some HTA guidelines and literature.
Conclusion: To better conduct HTA on medical devices, we recommend considering multi-source evidence
such as real-world evidence; standardizing HTA processes, methodologies, and criteria; and integrating HTA into
decision-making.
Keywords: Health technology assessment, Medical devices, Challenges, Real-world evidence, Review
© The Author(s) 2022. Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which
permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the
original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or
other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line
to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory
regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this
licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativeco
mmons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
Ming et al. Cost Effectiveness and Resource Allocation (2022) 20:54 Page 2 of 9
within medical devices, there are significant differences intend for the case studies to be representative of all med-
between therapeutic, instrumental, and diagnostic prod- ical devices as there is a great deal of diversity in medical
ucts. Moreover, various studies have investigated how devices beyond those four cases, such as diagnostic or
these differences have posed great challenges to the HTA instrumental devices. Instead, through our choice of tar-
of medical devices and have thus called for applying a get devices, we aimed to cover a range of heterogeneous
more innovative approach to medical devices compared cases in terms of disease epidemiology, procedure char-
to drugs. However, few studies have offered practical or acteristics, technology maturity, and demographics. We
actionable solutions. There is still a lack of consensus on used the number of HTA-related publications to measure
the HTA of medical devices with regard to dimensions, the activity level of the current HTA research. We con-
process, criteria, and methods. ducted a literature search and tracked the growth trend
This study aimed to (1) describe the current landscape of relevant HTA publications on PubMed, Embase, and
of HTA activities specific to medical devices; (2) analyze Web of Science. We included HTA studies and economic
the characteristics of medical devices and the resulting evaluations and excluded relevant systematic reviews or
challenges in the HTA of medical devices compared to meta-analyses. The detailed search strategy in each data-
pharmaceuticals; (3) perform a focused search of web- base is listed in Additional file 1: Table S1.
sites of official HTA agencies to identify international In addition, a narrative literature review was conducted
HTA guidelines specific to medical devices, intending to for a synthesis of the characteristic differences and chal-
summarize implementable solutions to the HTA of medi- lenges of HTA in Medical Devices. The literature search
cal devices. In addition, we supplemented the analysis of was performed using PubMed, Embase, and Web of Sci-
HTA guidelines with a narrative review of existing stud- ence. We included relevant empirical studies or reviews
ies discussing the challenges of, and potential suggestions discussing the use of HTA for medical devices. The
for, the HTA of medical devices. detailed search strategy in each database is listed in Addi-
tional file 1: Table S2.
Method Two reviewers (J.M. and Y.H.) independently assessed
To understand the landscape for HTA conducted on the titles and abstracts of all identified study and then
medical devices, we performed a retrospective analysis reviewed full text to determine the potential eligibility
using IQVIA’s HTA Accelerator Database (www.iqvia. for the above narrative literature review. Disagreements
com/landing/hta-accelerator). It contains over 33,000 on whether a specific study should be considered were
HTA publications that cover 100 HTA bodies in 40 coun- resolved by a third investigator (X.Z.).
tries. The primary data source came from the HTA sub- To guide the efficient application of HTAs, we per-
missions that could be tracked by local language. Market formed a gray literature search of official websites of
access experts from IQVIA were responsible for regularly major HTA agencies to identify HTA guidelines with
tracking and translating all newly published HTA reports. respect to medical devices. As guidelines represent a
The database captured over 250 available data elements consensus in the academic community, we believed that
such as the general information in the HTA report, international HTA guidelines have reflected, to some
including publication country, agency, publication date, extent, the current best possible practice. We comple-
disease area, product types, comparators, recommenda- mented the search by reviewing the bibliographies of
tions, etc. In this study, we focused only on HTA reports relevant literature identified through a target literature
specific to medical devices in the HTA Accelerator Data- review of methodological publications on the HTA of
base by selecting the product type as “medical device.” medical devices. Only those (either guidelines or arti-
We limited the assessment type of HTA submissions to cles) that were specific to medical devices and elaborate
health technology assessment or rapid review (includ- economic evaluation, decision-analytic modeling, and/or
ing the assessment of safety, efficacy, cost-effectiveness, HTA were included.
etc.), while other submissions such as clinical guidelines
and public health reviews were excluded. As the earliest Current status of the HTA of medical devices
reports dated back to the year 2000, we extracted HTA Published reports from HTA bodies
reports published from 2000 onwards. In total, around 2300 HTA reports from agencies across
To better demonstrate the current research progress 30 countries or regions were identified. We presents
on the HTA status of medical devices, we examined four the overall trend of HTA report submissions in Fig. 1.
case studies on medical devices, including (1) stents (2) Overall, the body of HTA reports for medical devices
hip and knee arthroplasty, (3) the da Vinci Surgical Sys- increased across the world. Before 2010, the number of
tem, and (4) transcatheter aortic valve implantation HTA reports published for medical devices was limited,
(TAVI) and mitral valve repair (TMVR). We did not ranging from three in 2000 to 20 in 2009. Since 2011, the
Ming et al. Cost Effectiveness and Resource Allocation (2022) 20:54 Page 3 of 9
120 120
100 100
80 80
60 60
40 40
20 20
0 0
2000 2002 2004 2006 2008 2010 2012 2014 2016 2018 2020 2000 2002 2004 2006 2008 2010 2012 2014 2016 2018 2020
(a) (b)
120 120
100 100
80 80
60 60
40
40
20
20
0
0
2000
2001
2002
2003
2004
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2000 2002 2004 2006 2008 2010 2012 2014 2016 2018 2020
(c) (d)
Fig. 2 Summary of HTA-related literature. a Annual number of HTA-related publications on stents; b annual number of HTA-related publications
on hip and knee arthroplasty; c annual number of HTA-related publications on Da Vinci; d annual number of HTA-related publications on TAVI and
TMVR
Ming et al. Cost Effectiveness and Resource Allocation (2022) 20:54 Page 4 of 9
Narrative synthesis of characteristic differences our review after title and abstract screening or full text
and challenges of HTA of medical devices review. The PRISMA flowchart of literature review is
After a literature search on journal publications dis- provided in Additional file 1: Fig. S1.
cussing HTA of medical devices, a total of 1646 records The characteristic differences and challenges of
were identified, and 26 publications were included in HTA in medical devices are summarized in Table 1.
Available clinical evidence The characteristic differences between pharmaceuticals and medical devices [3–23]
may lead to a large gap in terms of the availability of evidence, especially clinical
evidence
• Considerable challenges exist in performing an RCT for medical devices. For
example, a double-blind procedure was usually hard to implement due to differ-
ences in the appearance of medical devices
• Another reason was that implantable medical devices require informed con-
sent from a patient before implantation as they involve an invasive procedure
• There was a lack of infrastructure, e.g., qualified clinical centers and trained
professionals to conduct RCTs for medical devices
Device-user interaction Unlike drugs, the performance of medical devices sometimes depends on their [3–9, 11–27]
users’ experience as well
• The so-called “learning curve”: the launch of a medical device is followed by a
training or initiation period during which healthcare professionals learn how to
handle the technology. As healthcare professionals gain more experience over
time, they were able to grasp the subtle differences that affected the overall
clinical benefits, thus making the best use of the technology
• The learning curve had inevitably interfered with the HTA of medical devices
because the comparative effectiveness between newly-launched and traditional
products was a function of the product itself and operators’ proficiency, which
was hard to quantify
• The clinical adoption of medical devices may also associate with wider impact
of organizational change, for instance, there may be a need for additional train-
ing of physicians or other health professionals, or the introduction of a given
device may require a hospital to reorganize services to accommodate the new
technology or procedure
Short product life cycle and quick upgrade Unlike drugs, the product life cycle of medical devices is usually as short as one [4–9, 11–20, 22, 25–28]
to 3 years
• The key contributing factor was that medical devices undergo continuous
improvement and incremental innovation, which might result in the existence
of various models and specifications within a single product class
• Recognizing the iterative nature of medical devices, regulatory agencies
exempted such variants from rigorous clinical trials as long as the safety of the
new variant was the same as the original. As a result, manufacturers had neither
enough time to collect data for economic evaluations nor an incentive to invest
in clinical research and HTA
• From researchers’ perspective, the short life cycle required the HTA of medical
devices to be done in a timely manner, otherwise the results could become
outdated
• Pricing was typically more dynamic than that of pharmaceuticals, which
increased the complexity of calculating costs
• Rapid product iteration also made it difficult to conduct HTA since the defini-
tion of standard of care was unclear or constantly changing among medical
devices with multiple specifications and models
Inexplicit target population and lack of The economic evaluation of medical devices used in screening or diagnostics [3, 20, 23, 24, 27]
direct clinical outcomes was ever more challenging as most did not have an explicit target population,
nor do they produce clinical outcomes directly
• These devices were used in multiple disease areas or as part of the care
pathway with a group of other devices. For example, the positron emission
tomography-computed tomography (PET/CT) was used in the diagnosis and
follow-up of a number of malignant tumors (e.g., cervical cancer, colorectal
cancer, non-small cell lung cancer, melanoma, and ovarian cancer)
• Since these devices or diagnostics are integrated as a specific part of the clini-
cal pathway. As a result, it is hard to quantitatively observe the direct impact of
these medical devices on patients’ ultimate medical outcomes
Ming et al. Cost Effectiveness and Resource Allocation (2022) 20:54 Page 5 of 9
Overall, there were several key characteristic differ- Available clinical evidence
ences between drugs and medical devices, including Given that RCT evidence for medical devices was gen-
the availability of treatment outcomes and other factors erally limited, an open-minded and flexible attitude
that may impact efficacy. First, the treatment outcome to other forms of evidence e.g., case reports (series),
for medical devices was not as clear and straightfor- cohort studies, case control studies, and real-world
ward as it would be with drugs, because an intervention studies was highly recommended [29, 34, 35]. Both
with device involves the medical devices themselves the UK and EUnetHTA guidelines have pointed out
as well as other subsequent treatments. Furthermore, the high risk of bias in non-randomized controlled tri-
devices usually had multiple applications, making it als [30, 35]. At the same time, several tools have been
hard to assess each application in the same way that developed, although they may not be specific for medi-
traditional drugs were assessed for an individual indi- cal devices. The Cochrane Risk of Bias Assessment Tool
cation. Second, Randomized Controlled Trials (RCTs) for Non-Randomized Studies of Interventions (ACRO-
for medical devices are rare compared to drugs, result- BAT-NRSI) could be used to assess the risk of bias in
ing in a lack of sufficient efficacy/effectiveness data non-randomized controlled studies [36]. In addition,
and making it difficult for economic evaluation. Third, the quality assessment for case reports (series) could
the product life cycle of medical devices was generally refer to the checklist developed by the Canadian Insti-
much shorter than that of drugs, which may result in tute of Health Economics [37].
multiple specifications within a single product class The draft guidance released by the United States
and unclear definition of standard of care. Additionally, Food and Drug Administration (FDA) in 2016 has
the efficacy of medical device treatments depends on spurred a surge in the literature describing how real-
the medical devices themselves and their use. world evidence (RWE) can be used to support regula-
tory approval for medical devices [38]. RWE refers to
any evidence on healthcare generated from multiple
Discussions on practical solutions sources outside clinical trial settings, which is usually
for the challenges of HTA of medical devices in the form of electronic medical records (EMR), elec-
We obtained a total of eight HTA guidelines specific tronic health records (EHR), hospital databases, patient
to medical devices issued by HTA agencies or research registries, claims data, etc. [39]. In addition to market
initiatives across six regions. The National Institute authorization, RWE was also relevant in post-market-
for Health and Care Excellence (NICE) in the United ing surveillance, coverage decisions, outcome-based
Kingdom issued an HTA methods guide for their Medi- contracting, resource use, and treatment compliance
cal Technologies Evaluation Programme in 2011 [29]. [40, 41]. Especially for medical device products for
Following the methods guide, NICE also issued the which the regulatory environment does not require
Diagnostics Assessment Programme manual specifi- RCTs, or in situations where RCTs traditionally have
cally for diagnostic technologies demonstrating higher been lacking such as measuring disease burden and
test accuracy, but at a greater cost compared to those detecting new safety signals, RWE could offer unique
in current use [30]. In Canada, Health Quality Ontario perspectives.
(HQO) released a method and process guide for HTA Unlike randomized clinical trials, most RWE comes
in 2018, with a scope spanning from medical devices, from observational studies and might have many draw-
diagnostics, and surgical procedures to complex health backs. While current medical device-specific HTA guide-
system interventions [31]. In Australia, two HTA guide- lines have underscored the potential bias associated with
lines have been developed separately for therapeutic RWE and several tools may be available for assessment
and diagnostic devices by the Medical Services Advi- of bias for non-randomized studies, few guidelines have
sory Committee (MSAC) [32, 33]. In the Asia–Pacific addressed other common issues including data quality,
region, the Singapore Agency for Care Effectiveness availability, standards, and privacy [29, 30, 32, 33, 35, 42].
(ACE) was the only national HTA organization that has For example, a European study that mapped RWE stud-
released HTA guidelines on medical devices [34]. Apart ies of three medical device products has revealed that
from these official HTA agencies, an international col- the accessibility of data sources for RWE varied greatly
laborative network also contributed to the methodo- across European countries. The study also suggested the
logical advancement of HTA for medical devices. For types and definitions of variables included in each data
example, the European Network for Health Technol- source were not consistent, making a comparison across
ogy Assessment (EUnetHTA), has launched a series of databases impossible [43]. Therefore, there is a need for
research initiatives to develop a methodological frame- RWE guidance on medical devices which would not only
work for HTA of therapeutic medical devices [35]. provide overarching frameworks but also standardize
Ming et al. Cost Effectiveness and Resource Allocation (2022) 20:54 Page 6 of 9
methods and processes ranging from data storage, collec- data of comparator products could be a source for prior
tion, and sharing to analytic approaches. information used in the Bayesian approach.
Funding 14. Ciani O, Wilcher B, Blankart CR, Hatz M, Rupel VP, Erker RS, et al. Health
This work was supported by the National Key Research and Development technology assessment of medical devices: a survey of non-European
Program of China (No. 2018YFC1312900). union agencies. Int J Technol Assess Health Care. 2015;31(3):154–65.
15. Schnell-Inderst P, Mayer J, Lauterberg J, Hunger T, Arvandi M, Conrads-
Availability of data and materials Frank A, et al. Health technology assessment of medical devices: what is
The data used and/or analyzed during the study are available from the cor- different? An overview of three European projects. Z Evid Fortbild Qual
responding author on reasonable request. Gesundhwes. 2015;109(4–5):309–18.
16. Fuchs S, Olberg B, Panteli D, Perleth M, Busse R. HTA of medical devices:
challenges and ideas for the future from a European perspective. Health
Declarations Policy. 2017;121(3):215–29.
17. Tarricone R, Torbica A, Drummond M. Key recommendations from the
Ethics approval and consent to participate medtecHTA project. Health Econ. 2017;26(1):145–52.
Not applicable. 18. Ciani O, Wilcher B, van Giessen A, Taylor RS. Linking the regulatory and
reimbursement processes for medical devices: the need for integrated
Competing interests assessments. Health Econ. 2017;26(Suppl 1):13–29.
The authors declare that they have no competing interests. 19. Ferguson M. Medical devices are different to pharmaceuticals in the
health technology assessment process. J Comp Eff Res. 2014;3(3):217–9.
Author details 20. Daubner-Bendes R, Kovacs S, Niewada M, Huic M, Drummond M, Ciani O,
1
Real World Solutions, IQVIA, Shanghai 200124, China. 2 National Health Com- et al. Quo vadis HTA for medical devices in central and eastern Europe?
mission Key Laboratory of Health Technology Assessment, School of Public Recommendations to address methodological challenges. Front Public
Health, Fudan University, Shanghai 200032, China. Health. 2020;8: 612410.
21. Schnell-Inderst P, Hunger T, Conrads-Frank A, Arvandi M, Siebert U.
Received: 8 March 2022 Accepted: 21 September 2022 Recommendations for primary studies evaluating therapeutic medical
devices were identified and systematically reported through reviewing
existing guidance. J Clin Epidemiol. 2018;94:46–58.
22. Kirisits A, Redekop WK. The economic evaluation of medical devices: chal-
lenges ahead. Appl Health Econ Health Policy. 2013;11(1):15–26.
References 23. Henschke C, Panteli D, Perleth M, Busse R. Taxonomy of medical devices
1. International Joint Task G, O’Rourke B, Oortwijn W, Schuller T. The new in the logic of health technology assessment. Int J Technol Assess Health
definition of health technology assessment: a milestone in international Care. 2015;31(5):324–30.
collaboration. Int J Technol Assess Health Care. 2020;36(3):187–90. 24. Prinja S, Jyani G, Gupta N, Rajsekar K. Adapting health technology assess-
2. Drummond M, Griffin A, Tarricone R. Economic evaluation for devices and ment for drugs, medical devices, and health programs: methodological
drugs—same or different? Value Health. 2009;12(4):402–4. considerations from the Indian experience. Expert Rev Pharmacoecon
3. Craig JA, Carr L, Hutton J, Glanville J, Iglesias CP, Sims AJ. A review of the Outcomes Res. 2021;21(5):859–68.
economic tools for assessing new medical devices. Appl Health Econ 25. Tarricone R, Torbica A, Drummond M. Challenges in the assessment of
Health Policy. 2015;13(1):15–27. medical devices: the medtecHTA project. Health Econ. 2017;26(Suppl
4. Sorenson C, Tarricone R, Siebert M, Drummond M. Applying health 1):5–12.
economics for policy decision making: do devices differ from drugs? 26. Tarricone R, Callea G, Ogorevc M, Prevolnik RV. Improving the meth-
Europace. 2011;13(suppl2):ii54–8. ods for the economic evaluation of medical devices. Health Econ.
5. Chapman AM, Taylor CA, Girling AJ. Are the UK systems of innovation and 2017;26(Suppl 1):70–92.
evaluation of medical devices compatible? The role of NICE’s medical 27. Cookson R, Hutton J. Regulating the economic evaluation of pharma-
technologies evaluation programme (MTEP). Appl Health Econ Health ceuticals and medical devices: a European perspective. Health Policy.
Policy. 2014;12(4):347–57. 2003;63(2):167–78.
6. Bluher M, Saunders SJ, Mittard V, Torrejon Torres R, Davis JA, Saunders R. 28. Kanavos P, Angelis A, Drummond M. An EU-wide approach to HTA: an
Critical review of European health-economic guidelines for the health irrelevant development or an opportunity not to be missed? Eur J Health
technology assessment of medical devices. Front Med (Lausanne). Econ. 2019;20(3):329–32.
2019;6:278. 29. National Institute for Health and Clinical Excellence. Medical technologies
7. Iglesias CP. Does assessing the value for money of therapeutic medical evaluation programme: methods guide [EB/OL]. https://www.nice.org.
devices require a flexible approach? Expert Rev Pharmacoecon Out- uk/Media/Default/About/what-we-do/NICE-guidance/NICE-medical-
comes Res. 2015;15(1):21–32. technologies/Updated-MTEP-methods-guide.pdf. Accessed 8 Mar 2022.
8. Klímová B, Marešová P. Economic methods used in health technology 30. National Institute for Health and Clinical Excellence. Diagnostics assess-
assessment. E+M Ekon Manag. 2018;21(1):116–26. ment programme manual [EB/OL]. https://www.ncbi.nlm.nih.gov/books/
9. Tarricone R, Amatucci F, Armeni P, Banks H, Borsoi L, Callea G, et al. Estab- NBK310367/pdf/Bookshelf_NBK310367.pdf. Accessed 8 Mar 2022.
lishing a national HTA program for medical devices in Italy: overhauling 31. Health Quality Ontario. Health technology assessments methods and
a fragmented system to ensure value and equal access to new medical process guide [EB/OL]. https://www.hqontario.ca/Portals/0/documents/
technologies. Health Policy. 2021;125(5):602–8. evidence/reports/hta-methods-and-process-guide-en.pdf. Accessed 8
10. Kisser A, Tuchler H, Erdos J, Wild C. Factors influencing coverage decisions Mar 2022.
on medical devices: a retrospective analysis of 78 medical device apprais- 32. Australia Government Department of Health. Technical guidelines for
als for the Austrian hospital benefit catalogue 2008–2015. Health Policy. preparing assessment reports for the medical services advisory commit-
2016;120(8):903–12. tee—service type: investigative (version 3.0) [EB/OL]. http://www.msac.
11. Ciani O, Federici C, Tarricone R. Current and future trends in the HTA gov.au/internet/msac/publishing.nsf/Content/0BD63667C984FEEACA25
of medical devices. In: XIV Mediterranean conference on medical and 801000123AD8/$File/InvestigativeTechnicalGuidelines-December-2016-
biological engineering and computing 2016. Cham: Springer; 2016. p. Version-3.0.pdf. Accessed 8 Mar 2022.
1345–8. 33. Australia Government Department of Health. Technical Guidelines for
12. Ferrusi IL, Ames D, Lim ME, Goeree R. Health technology assessment from preparing assessment reports for the medical services advisory commit-
a Canadian device industry perspective. J Am Coll Radiol. 2009;6(5):353–9. tee—medical service type: therapeutic (version 2.0) [EB/OL]. 2021. http://
13. Polisena J, Castaldo R, Ciani O, Federici C, Borsci S, Ritrovato M, et al. www.msac.gov.au/internet/msac/publishing.nsf/Content/9C7DCF1C2D
Health technology assessment methods guidelines for medical devices: D56CBECA25801000123C32/$File/TherapeuticTechnicalGuidelines-Final-
how can we address the gaps? The international federation of medical March2016-Version2.0-accessible.pdf. Accessed 8 Mar 2022.
and biological engineering perspective. Int J Technol Assess Health Care. 34. Agency for Care Effectiveness. Medical technologies evaluation methods
2018;34(3):276–89. and process guide [EB/OL]. https://www.ace-hta.gov.sg/docs/defau
Ming et al. Cost Effectiveness and Resource Allocation (2022) 20:54 Page 9 of 9
lt-source/process-methods/ace-methods-and-process-guide-for-medic
al-technologies-evaluation-(1-oct-2018).pdf. Accessed 8 Mar 2022.
35. European Network for Health Technology Assessment. WP7-SG3 “thera-
peutic medical devices” guideline [EB/OL]. https://eunethta.eu/wp7-sg3-
therapeutic-medical-devices-guideline/. Accessed 8 Mar 2022.
36. Sterne J, Higgins J, Reeves B. A Cochrane risk of bias assessment tool:
for non-randomized studies of interventions (ACROBAT-NRSI). Version.
2014;1:24.
37. Guo B, Moga C, Harstall C, Schopflocher D. A principal component
analysis is conducted for a case series quality appraisal checklist. J Clin
Epidemiol. 2016;69:199-207.e2.
38. The U.S. Food and Drug Administration. Use of real-world evidence to
support regulatory decision-making for medical devices. https://www.
fda.gov/media/99447/download. Accessed 8 Mar 2022.
39. Sherman RE, Anderson SA, Dal Pan GJ, et al. Real-world evidence—what
is it and what can it tell us? N Engl J Med. 2016;375(23):2293–7.
40. Fleurence RL, Shuren J. Advances in the use of real-world evidence for
medical devices: an update from the national evaluation system for
health technology. Clin Pharmacol Ther. 2019;106:30.
41. Li Y, Walter M. The use of real-world evidence for medical device assess-
ments—an environmental scan. Ottawa: CADTH; 2019. p. 91.
42. Government of Canada. A strategy to optimize the use of real-world
evidence across the medical devicelife cycle in Canada. https://www.
canada.ca/en/health-canada/corporate/transparency/regulatory-trans
parency-and-openness/improving-review-drugs-devices/real-world-
evidence-medical-device-strategy.html. Accessed 8 Mar 2022.
43. Drummond M, Pongiglione B, Torbica A, et al. Do existing real-world data
sources generate suitable evidence for the HTA of medical devices in
Europe? Int J Technol Assess Health Care. 2021. https://doi.org/10.1017/
S0266462321000301.
44. Mulier S, Ni Y, Jamart J, Ruers T, Marchal G, Michel L. Local recurrence
after hepatic radiofrequency coagulation: multivariate meta-analysis and
review of contributing factors. Ann Surg. 2005;242(2):158–71.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in pub-
lished maps and institutional affiliations.