Documente Academic
Documente Profesional
Documente Cultură
-Developer-
-Academic partners-
-Partners-
The Dutch Health Outlook is created under the supervision of Prof. dr. Fred van Eenennaam and Ir. Maarten Koomans. It is supported by the International Academic Advisory Council
Acknowledgement
Thanks to all participating hospitals and its data collectors.
Albert Schweitzer ziekenhuis, Dordrecht Amphia Ziekenhuis, Breda 3 Atrium Medisch Centrum, Heerlen 4 Canisius-Wilhelmina Ziekenhuis, Nijmegen 5 Catharina Ziekenhuis, Eindhoven 6 Deventer Ziekenhuis, Deventer 7 Gelre ziekenhuizen, Apeldoorn 8 HagaZiekenhuis, Den Haag 9 Isala klinieken, Zwolle 10 Jeroen Bosch Ziekenhuis, s Hertogenbosch 11 Kennemer Gasthuis, Haarlem 12 Maasstad Ziekenhuis, Rotterdam 13 Martini Ziekenhuis, Groningen 14 Mxima Medisch Centrum, Eindhoven 15 Meander Medisch Centrum, Amersfoort 16 Medisch Centrum Alkmaar 17 Medisch Centrum Haaglanden, Den Haag 18 Medisch Centrum Leeuwarden 19 Medisch Spectrum Twente, Enschede 20 Onze Lieve Vrouwe Gasthuis, Amsterdam 21 Reinier de Graaf Groep, Delft 22 Rijnstate, Arnhem 23 Sint Franciscus Gasthuis, Rotterdam 24 Sint Lucas Andreas Ziekenhuis, Amsterdam 25 Spaarne Ziekenhuis, Hoofddorp 26 St. Antonius Ziekenhuis, Nieuwegein 27 St. Elisabeth Ziekenhuis, Tilburg 28 VieCuri Medisch Centrum, Venlo
1 2
Summary (1/3)
The first Health Outlook aims to attract, and provide insights to applied research and its performance
Aims
Context
Providing affordable and high quality care. Health
Wealth
* From now on, applied research hospitals will be called hospitals. University Medical Centers (UMCs) are not included in t his report. This study was conducted on 16 out of 28 STZ hospitals. In this report the words applied research hospitals and (total) STZ hospitals are used interchangeably. 3 see also www.healthoutlook.nl
Summary (2/3)
by collecting and comparing data of 16 applied research hospitals, in order to build a database for the future which will show progress, be comparable with international clusters
Data
OUTPUT
Key Conclusions
No. of publications: Lead time of clinical trials: No. of new products: new protocols: new guidelines: new treatments :
Applied research hospitals seem to vary heavily in their ability to be relevant in applied research that connects with industry and patients. Size, level of expertise, support and connection with industry and openness seem to matter. Hospitals that outperform collaborate above average with the industry. Outperformance on output: publications, innovation and efficiency.
SIZE Size of clinical trials: Inflow of patients from outside catchment area: 7745 patients* 12 % admissions 10.4 % outpatient visits
INPUT Industry investments: 630 research projects** Hospital R&D investments: 10,8 m**
Publishing and performing applied research are clearly part of the core business of applied research hospitals. In particular clinical trials in phase 3 and medical devices.
*Extrapolation based on number of publication cited. ** Extrapolation based on number of employees. For more chapter For detailed data information please see see chapter 3 4 4 see also www.healthoutlook.nl
Summary (3/3)
and stimulate and improve applied research by sharing (next) best practices in 4 overall themes.
B) Invest in industry
BP 5: Cooperate with industry and other partners, as universities and connect with their experts and professors. BP 12: Create visibility to industry partners, cluster location seems to matter.
The Key (next) Best Practices are based on: 1) best performing hospitals, 2) literature research, 3) advice from experts, 4) International Academic Advisory Council, 5) cluster experiences by researches, 6) other industries. More detailed information about the Key (next) Best Practices can be found in chapter 4.
Key outcomes Dutch Health Outlook 2013 Executive summary Background (Shaping Defining Measuring) Data and conclusions Next best practices Guide to interpret data A roadmap Monitoring Key performance indicators (Definition Measuring Improving) Output Size Input Appendices A. History, development and structure of the Health Outlook B. About the involved partners C. Bibliography D. Consulted experts and organizations Not included in this version but available for download at www.healthoutlook.nl E. Key steering indicators F. Monitoring Methodology extended version
8 9 20 27
2 3
32
38 52 59
67 86 90 97 102 114
The Outlook 2013 has been compiled with the utmost care based upon available data in 2011. Readers are advised to contact the authors of the report to avoid potential misinterpretations of the reported results. Authors welcome suggestions for improvement for the Outlook 2014 (please contact info@thedecisiongroup.nl) .
Applied research
Improving
Source Model Residual Total lw expe expe2 hh dip1 dip3 dip4 dip5 dip6 enf3 enf6 en18 dso1 dso2 dso3 dso4 dso5 dso6 wcj _cons SS df MS Number of obs F( 18, 10870) Prob > F R-squared Adj R-squared Root MSE P>|t| 0.000 0.000 0.000 0.000 0.000 0.000 0.000 0.001 0.111 0.577 0.000 0.843 0.856 0.912 0.391 0.943 0.980 0.098 0.593 = 10889 =25427.59 = 0.0000 = 0.9768 = 0.9768 = .67525
Health Cluster
Outperformance
208692.045 18 11594.0025 4956.30251 10870 .455961593 213648.347 10888 19.6223684 Coef. .0188156 -.000369 .2240197 .1824788 .1814161 .1522206 .0796747 .0779941 .0264903 -.0081408 -.027078 .0771048 .0709971 .043337 .0843082 -.028818 .0098075 5.77e-07 -.2098312 Std. Err. .0041323 .0001039 .0003729 .0320881 .0263996 .0231657 .0175065 .0245033 .01663 .014602 .0071182 .3902956 .3904501 .390496 .0983582 .4020896 .3915849 3.49e-07 .3924445 t 4.55 -3.55 600.79 5.69 6.87 6.57 4.55 3.18 1.59 -0.56 -3.80 0.20 0.18 0.11 0.86 -0.07 0.03 1.66 -0.53
[95% Conf. Interval] .0107154 -.0005726 .2232888 .1195804 .1296682 .1068115 .0453587 .0299632 -.0061076 -.0367635 -.0410309 -.6879458 -.6943563 -.7221063 -.1084917 -.8169869 -.7577703 -1.06e-07 -.979094 .0269157 -.0001654 .2247506 .2453773 .2331641 .1976296 .1139906 .126025 .0590882 .0204818 -.0131251 .8421553 .8363505 .8087804 .2771082 .7593509 .7773853 1.26e-06 .5594315
Measuring
Core business
BACKGROUND
In order to make the Dutch healthcare system sustainable, a shift is needed in its productivity frontier: optimizing value per Euro spent
Health Expenditure is outgrowing, resulting in a pressure to cut costs and in the same time to delivery better value to patients.
Current situation
Sources: Blendon et al. (2004), Christensen et al. (2009), and a The Decision Group analysis (2010)
Based upon: Porter (1996). What is Strategy? Harvard Business Review, November-December 1996: 59-78
BACKGROUND
by improving cooperation between the Life Science cluster and the Health cluster and enhancing at the same time applied research, innovation and valorization.
Applied Research, Innovation and Valorization is the base of the five recognized leverages of Christensen, to increase productivity.
Sources: Blendon et al. (2004), Christensen et al. (2009), and a The Decision Group analysis (2010)
BACKGROUND
On the cross-over of Life Science & Health (product supply market) the four main players each have their own point of view on the current situation of cooperation.
Care & Cure In our hospital patient care is number 1, however a focus on research and creating new treatments and products is also necessary to increase patient value.
Industry We need the hospitals to run clinical trials on our new products; speed, patient size and expertise of researchers are critical success factors in our business. Since we have a commercial point of view, trust is sometimes difficult and hampers co-creation and product development.
11 see also www.healthoutlook.nl
BACKGROUND
The Health Outlook measures and monitors applied research, innovation, valorization and cooperation annually to contribute to a successful and innovative Life Science & Health cluster.
BACKGROUND
The focus of the Dutch Life Sciences & Health Outlook 2013 is the performance of the innovative core of the cluster of both the industry and part of the teaching and specialized care and cure providers.
Suppliers
Bioelectronics, Bioinformatics Analysis Software Medical Equipment Laboratory Equipment Ophthalmic Goods R&D Diagnostic Substances Containers and Packaging Chemical products
Service Providers
Cluster Organizations Niaba, Nefarma, Biofarmind, LSH Regulation CCMO, METCs, FDA, EMA Reimbursement Healthcare Insurance Companies, VWS Specialized Business Services Banking, Accounting, Legal
The cluster map shows both the value chain and the supporting industries in the Dutch LSH cluster. The cluster map is in the process of international recognition Core Value Chain, referred to top-sector plan as innovative core. Monitored with Life Sciences Outlook. 16 out of 28 Top-clinical hospitals are included in the Health Outlook.
Manufacturing
companies Drugs and Medical Device companies (Pharma, Biotech, Medical Engineering)
Translational Research
TiPharma, BMM, CTMM
Fundamental Research
NGI, Hubrechts Institute
Educational Institutions
Universities
The Dutch Life Sciences Outlook 2013 was launched on 8th Feb 2013 The Dutch Health Outlook is launched on 14th June 2013
BACKGROUND
The Care & Cure providers include among others all Top-clinical hospitals of the Netherlands that perform applied research.
Academic hospital
1 2
In 2014, the definition may broaden to: 1. More STZ hospitals 2. Specialty hospitals and UMCs may be included.
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
Albert Schweitzer ziekenhuis, Dordrecht Amphia Ziekenhuis, Breda Atrium Medisch Centrum, Heerlen Canisius-Wilhelmina Ziekenhuis, Nijmegen Catharina Ziekenhuis, Eindhoven Deventer Ziekenhuis, Deventer Gelre ziekenhuizen, Apeldoorn HagaZiekenhuis, Den Haag Isala klinieken, Zwolle Jeroen Bosch Ziekenhuis, s Hertogenbosch Kennemer Gasthuis, Haarlem Maasstad Ziekenhuis, Rotterdam Martini Ziekenhuis, Groningen Mxima Medisch Centrum, Eindhoven Meander Medisch Centrum, Amersfoort Medisch Centrum Alkmaar Medisch Centrum Haaglanden, Den Haag Medisch Centrum Leeuwarden Medisch Spectrum Twente, Enschede Onze Lieve Vrouwe Gasthuis, Amsterdam Reinier de Graaf Groep, Delft Rijnstate, Arnhem Sint Franciscus Gasthuis, Rotterdam Sint Lucas Andreas Ziekenhuis, Amsterdam Spaarne Ziekenhuis, Hoofddorp St. Antonius Ziekenhuis, Nieuwegein St. Elisabeth Ziekenhuis, Tilburg VieCuri Medisch Centrum, Venlo
Quality of care
Specialization
note that a number of top-clinical hospitals provides patient care up to the highest level complexity of care.
The Dutch Healthcare system consists of 91 hospitals (without specialized centers); including 8 University Medical Centers and 28 tertiary medical teaching hospitals engaged in applied research.
note that a schematic representation is given of hospital activities, i.e., general hospitals are not included in the group of top-clinical hospitals
BACKGROUND
The Health Outlook 2013 focuses on the value chain of the health cluster and its related activities to applied research for the top medical teaching hospitals.
Applied research: Scientific publications, presentations
BACKGROUND
Together with experts, we developed a methodology to establish the first Health Outlook, monitoring applied research.
We would like to thank all who made it possible. The help and insights of many (cluster) experts was essential in creating the Dutch Health Outlook 2013. For all experts involved please refer to page(s) 98 and 99.
16 see also www.healthoutlook.nl
BACKGROUND
9 Key Performance Indicators and 7 Key Steering Indicators have been developed to monitor and improve applied research and to share (next) Best Practices.
can be influenced directly by policy makers. Typically, steering indicators are selected so as to have high impact on the success of a cluster or set of organizations.
Number of best practices shared among hospitals Costs of research projects Level of expertise Staff responsiveness Participation of staff in the development, undertaking and use of research Presence of research support offices and transfer facilities in each hospital Cooperation relationships of hospital research
SIZE Size of clinical trials (number of patients in trial) Inflow of patients from outside catchment area
INPUT
Industry investments Hospital R&D investments
Best Practices
* At this moment adoption rate of new products is not measured. Next year we aim to find and determine the right definition and to collect d ata on this specific performance indicator
BACKGROUND
A new database was built to analyze data of the hospitals and based on a survey of which the answers were carefully centralized.
Additional internal and external validity checks performed: Hospital data from 16 individual hospitals More than 500 respondents to survey employed within the 16 STZ hospitals taking part in this years Health Outlook
Monitoring methodology to assess performance: The methodology approach is based on the World Economic Forum approach. The nine key performance indicators are validated by 20+ hospital CEOs and management and medical staff. The methodology is used to create international standards within EU clusters. The methodology has been checked by the International Academic Advisory Council.
nc ti on
ue st
io n
ho sp
it al
1.1
nee
1.2
b
2.1.a
c c c b d c b b b b c c c c c c c b d c c d c b d c c b c d e c a c b c c d b d d d d b c d e b c d c b c b d a c c c
2.1.b
a a a a a a a b b b a a a a a a a a a a a b b b b b b b b a b b a a c a b a a b d b b b b b b b b b b b a b b b b
2.1.c
a a a a a a a a a a a a a a a a a a a a a a a a a a a a a b a a a a c a b a a b c a a a a a a a a b a a b b a a a
2.1.d
a a a a a a a a a a b b b b b b b b b b b b b b b b b b b b c
2.1.e
a a a b c a a a a a a a b b c a a a a a b a a b a c a b a c a a a a b c a b b b b a b a b d b b c a c a b
2.2.a
a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a b b b b b b c c c c c c c c e e e
Fu
neurolog
Rijnstate Rijnstate Rijnstate Rijnstate internist-intensivist Rijnstate kinderarts/medisch manager zorg Rijnstate she arts Rijnstate medish specialist Rijnstate klinisch geriater MC Alkmaar gynaecoloog MC Alkmaar radioloog Rijnstate anesthesioloog Rijnstate SHE Rijnstate chirurg Rijnstate radioloog Rijnstate internist Rijnstate gynaecoloog Rijnstate gynaecollog Zevenaar longarts MC Alkmaar arts onderzoeker MC Alkmaar Ziekenhuisapotheker MC Alkmaar internist Rijnstate patholoog Rijnstate geriater Rijnstate internist Rijnstate anesthesioloog Rijnstate internist-nefroloog MC Alkmaar psycholoog MC Alkmaar Hoofd Ditetiek MC Alkmaar MDL-arts Rijnstate MDL-arts Rijnstate orthopedish chirurg Rijnstate tandarts Rijnstate kinderarts MC Alkmaar arts-onderzoeker MC Alkmaar kinderarts Haga radioloog MC Alkmaar MDL-arts Rijnstate researchvpk Spaarne chirurg Rijnstate anesthesioloog Rijnstate longarts Rijnstate dermatoloog Rijnstate orthopedish chirurg Rijnstate internist Rijnstate chirurg Rijnstate internist-oncloog MC Alkmaar researchverpleekundige MC Alkmaar hoofd expertisecentrum Laboratorium voor MC KCHI Alkmaar MKA-chirurg Rijnstate longarts Haga neurolog Rijnstate locatiemanager MC Alkmaar project leader clinical research Spaarne anesthesioloog Rijnstate neurolog Rijnstate orthopedish chirurg Rijnstate reumatolog Rijnstate orthopedish chirurg Rijnstate kinderarts
nee
ja nee
b b
nee ja nee nee nee nee nee nee ja nee ja nee ja nee nee nee ja nee ja nee
a a a b b a a a b b b b b a a b a c b a a b a a
a c b a
b c
c a a c
nee ja
BACKGROUND
Data collection itself results in building new infrastructures and gaining insight in the processes and procedures. New ideas develop which improve the performance and the efficiency of applied research.
Experiences
Bibi Blijham, Msc. Data collector at 3 hospitals Kwaliteitsmedewerker Wetenschap
Data registration, in general, is insufficient in hospitals, not only at research offices but also at other supporting departments such as Human Resources, Financial management and Health administration. Obtaining comparable data is difficult because the way of registration of research projects differs between hospitals; how data is registered differs between hospitals and which research projects are registered differs as well between hospitals Hospitals have different local procedures, such as the local feasibility procedure of the Board of Directors, with a different focus which leads to different ways of registering data and thus, collecting data. The functionality of research offices is developing in a different way between hospitals. Sharing best practices (such as a uniform way of data collection of research projects) is desirable but there is also a need for standardization.
Health cluster
OUTPUT No. of publications: 3057 publications cited Lead time of clinical trials: 65 days No. of new products: 21 * new protocols: 144 ** new guidelines: 159 ** new treatments : 101 **
INPUT Industry investments: 630 research projects ** Hospital R&D investments: 10,8 m **
*Extrapolation based on number of publication cited ** Extrapolation based on number of employees
INPUT Public investments: 291 m (-2%) Private investments raised: 1887 m (+574%)
For more info please see www.healthoutlook.nl For more info please see www.lifesciencesoutlook.com 20 see also www.healthoutlook.nl
Key conclusions
Hospitals seem to vary heavily in their ability to be relevant in applied research which connects with industry and patients.
Ability depends on size, level of expertise, support and connection with industry and openness.
Publishing and performing applied research is clearly part of the core business of hospitals.
In particular clinical trials in phase 3 and medical devices.
40
35
30
No of research projects
25
20
15
10 5 0
Hospitals
STZ individual hospitals Source: STZ & NFU (Red bars are Academic Medical Centers)
See chapter 3 for detailed information about KPI Industry Investments & Number of publications.
Factors such as size, level of expertise (number of professors, PhDs, GCP-certified), research support capacity, connection with industry and openness to share best practices, seem to matter.
Individual hospitals
Variation is a logic result of various factors. Some of these factors, such as size, are not easy to influence. However, openness to industry and other hospitals are more receptive and can be steered. Researcher
1000
2000
3000 Employees
4000
5000
6000
No. of Professors
Individual hospitals
As for the number of professors I dare to say that this is partly the result of an active policy that we follow in cooperation with academic institutions. Unlike many other hospitals, we focus not only on cooperation with UMC's but also with other academic institutions and disciplines. Employee hospital
2 4 Professors
See chapter 3 for detailed information about KPI Size of clinical trials & Level of expertise. 23 see also www.healthoutlook.nl
Performance of hospitals
The best performing hospitals measured by output: the number of publications, products, protocols, guidelines and treatments (innovation) and lead time of clinical trials (efficiency)
Individual Hospitals
20
40
60
No of days
80
100
120
140
See chapter 3 for detailed information about KPI Lead time of clinical trials 24 see also www.healthoutlook.nl
The graph shows an increasing trend: hospitals with many industry invested research projects have a higher number of publications.
The graph shows a decreasing trend: hospitals with many industry invested research projects have shorter lead times for approval of clinical trials.
*MKB stands for Midden en Klein bedrijven (Small and Medium-sized companies)
7445 3057
Hospitals reported that for the year 2011, 90% of patients participating in clinical trials have been enrolled in Phase 3 (44%) and in Medical Devices trials (46%).
See chapter 3 for detailed information about KPI Number of Publications and Size of Clinical Trials. 26 see also www.healthoutlook.nl
BEST PRACTICES
Support researches
How to deal with rules and regulations How to set up a research line in their own department.
BEST PRACTICES
Industry as a flywheel for research Invest in attracting industry which in turn will fund large projects. It is like a circle, money earned can be reinvested in applied research which is attracting more industry investments which in turn will fund large projects, etc. A large number of specialists and their departments have developed a beautiful structure, in which they have become and remained a loyal partner of the industry, resulting in many clinical trials and investments. Because of these trials, a large part of their own initiated studies can be funded.
BEST PRACTICES
Everything starts with an ambition and a specialist s guts and a norm that will be created. Some departments have developed a mentality with an imbued realization that if you want to ensure specialized care (topreferente zorg) this cannot be realized without the input of scientific research.
Next to patient care, the hospitals have committed themselves to perform applied scientific research and stimulate health
care innovation.
BEST PRACTICES
The outperforming departments also have a specialist who is connected as a professor at a university. As a result, research lines are created with a continuous flow of PhD students and publications.
We cooperate in many networks with universities, IKZ (integral cancer south), and industry research which also made research possible
Red: STZ Hospitals Blue: University Hospitals: Green: Other universities Yellow: Others Source: STZ, Bibliometric analysis of STZ-hospitals
To be determined
Monitoring
Dutch health cluster; Cluster success Measuring performance and progress Dutch health cluster; Key patient value concepts Strategic assessment of progress based on Key Performance Indicators
Improving
Dutch health cluster; Key recommendations Improving success of the health cluster and present its international potential. based on Key Steering Indicators
Extrapolation
The Health Outlook 2013 aims to report the applied research of all hospitals. So far the data has been built using the reports of 16 out of 28 hospitals.
In some cases data is extrapolated across all hospitals. This is based on extrapolation having as proxy, either the number of employees or number of publications cited. Example: there are 13 hospitals reporting the number of research projects with industry. The sum of all reported projects is 301 and the number of employment for those reporting hospitals is 47116. Total employment with STZ hospitals is 93307. By applying the Three Rule: hospitals. equals 628 research projects for the STZ
The number of employees and or the number of publications cited was/were taken as a proxy because the researchers found a correlation* between the implied key performance indicators which had been extrapolated and the number of Health Outlook employees.
Extrapolation based on number of publications cited - No. new products - Size of clinical trials Extrapolation based on number of employees - No. new protocols - No. new guidelines - No. new treatments - Industry investments - Hospital R&D investments Not extrapolated -No. of publication -Lead time of clinical trials -Inflow of patients from catchment area outside
* 61,3% and 43,41%. For detailed information about calculations and statistical tests please check ch. 4 on Monitoring Methodology 34 see also www.healthoutlook.nl
DEFINITION
MEASURING
IMPROVING
The average, median, minimum and maximum value reported by hospitals is depicted, as well as the number of hospitals reporting (n). A separate graph indicates the total numbers for the Health Outlook hospitals and a total (extrapolated number) for all STZ hospitals.
630
N = 15
KPI Information
*The Health Outlook is checked for validity by the International Academic Advisory Council. For more info please refer to page 72.
Totals are obtained by extrapolation. In this edition; totals are based on all applied research hospitals minus the University Medical Centers. 36 see also www.healthoutlook.nl
Monitoring
Key performance indicators (Definition Measuring Improving)
DEFINITION
MEASURING
IMPROVING
OUTPUT
DEFINITION
MEASURING
IMPROVING
A higher number of publications cited indicates that a hospital or member of a hospital is more visible on the international research stage. The Bibliometric analysis of STZ is used in the Health Outlook 2013.
KPI Number of publications cited Number of publications cited from the hospital in one year.
Definition This indicator counts how many times a member hospital has been cited world wide, excluding local citations. Proxy Bibliometric analysis of STZ publications Rationale An higher number of citation indicates that an applied research hospital / or member of an applied research hospital is more visible on the international research stage.
DEFINITION
MEASURING
IMPROVING
On average the number of citations of a hospital is 127 times a year. Compared to 2010, the total number of citations increased by 9.14% (from 2801 to 3057) in 2011.
No of publications cited
400 350 340 3000 3500
2801 2560
1979 2054
No of quotations
300
1022
968 Total STZ hospitals (n=28)
No of citations
659
106
1631
1320 1389
N=16
KPI Number of publications Number of publications cited from the hospital in one year.
The Bibliometric analysis of STZ has been used. See for a detailed explanation Ch 4 Appendices - F. Monitoring Methodology Extended version. 40 see also www.healthoutlook.nl
DEFINITION
MEASURING
IMPROVING
The high scoring hospitals perform more research projects with industry, indicating the importance of cooperation. Steering (Next) Best Practices The number of specialist that are first/main applicant at LTC* (KSI5) and the number of participation to researchevents initiated by MKB (KSI 4) may be associated** with the number of publications cited. 1. Harmonize, discuss and share knowledge on events, to create leverage and enhance innovation. Some departments have developed a mentality with an imbued realization that if you want to ensure specialized care (topreferente zorg) this cannot be realized without the input of scientific research . These departments also have a specialist who is connected as a professor at a university. As a result, research lines are created with a continuous flow of PhD students and publications. 2. Initiate, cooperate and participate in multidisciplinary studies to have access to knowledge.
3. Invest in a relationship with the industry: The best scoring hospitals have more industry invested research projects, showing a positive effect of industry on output (i.e. publications).
*LTC stands for Lokale Toetsingcommissie which reads in English Local Ethics Committee
** The correlation
See for a detailed explanation on correlations Ch. 4 Appendices page 82 and 83. 41 see also www.healthoutlook.nl
DEFINITION
MEASURING
IMPROVING
To get an insight in efficiency, waiting time is measured: number of days from proposal received to local feasibility. KPI Lead time of clinical trials (Phase II and III for drugs and for medical devices) Number of days from Proposal Received (regardless of completeness of proposal) to local feasibility (signature board of directors)
to
The date on which the request for approval of each clinical trial has been registered.
The starting date of a clinical trial, which is considered to be the date that the board signs the proposal.
Proxy A sample of 10 studies within each hospital has been used to determine the lead time of clinical trials. Rationale To get an insight into the waiting time for approving of a clinical trial request by the board and until the first patient is enrolled
DEFINITION
MEASURING
IMPROVING
A large variance in number of days from submission to approval is reported. The best performing hospital had a lead time of 16 days.
Lead time
140 120 100 130
No of days
80
60 40 20 16
64 51
N=15
Minimum
Average
Median
Maximum
KPI Lead time of clinical trials (Phase II and III for drugs and for medical devices) Number of days from Proposal Received (regardless of completeness of proposal) to local feasibility (signature board of directors)
43 see also www.healthoutlook.nl
The figures are based on an average among reporting hospitals. See for a detailed explanation Ch 4 Appendices - F. Monitoring Methodology Extended version.
DEFINITION
MEASURING
IMPROVING
In addition, performing more industry invested research projects has a positive relation on performance, in case of efficiency: lead time of clinical trials.
Steering
The level of expertise (no of professors) (KSI 3) is linked* with the lead time of clinical trials.
4. Stimulate an active policy and support the research committee and LTC (Local Ethics Committee) that enforces guidelines and business plans to optimize research.
5. Cooperate with industry and other partners, as universities and connect with their experts and professors. Optimization of processes as lead time of clinical trials, and in this case approval of proposals should be a logical result of cooperation with partners, especially in case these partners are profit-driven organizations like big pharma. Prof. dr. Fred van Eenennaam cluster expert. As for the number of professors I dare to say that this is partly the result of an active policy that we follow in cooperation with academic institutions. Unlike many other hospitals, we focus not only on cooperation with UMC's but also with other academic institutions and disciplines. Employee hospital
44 see also www.healthoutlook.nl
* The correlation
coefficient with KSI3 Professors is 12,91%. See for a detailed explanation on correlations Ch. 4 Appendices on page 82 and 83.
DEFINITION
MEASURING
IMPROVING
New protocols, treatments and guidelines are the result of applied research and innovation.
KPI Number of new protocols / treatments and guidelines Number of new protocols and treatments
Definition The plan for a course of medical treatment or for a scientific experiment.
Proxy Answers to survey* questions 3.1 to 3.4 are taken as a proxy for the number of new protocols, treatments and guidelines.
Rationale New protocols and treatments are the result of applied research that lead to better patient outcomes.
* For an overview of the question please see Ch4. Appendices on Monitoring Methodology Extended version 45 see also www.healthoutlook.nl
DEFINITION
MEASURING
IMPROVING
The respondents to the survey indicated they implemented a number of 96 protocols, 106 guidelines and 67 treatments.
159
144
100
80 60 40 20 96 106
101
Total STZ hospitals (n=28) Health Outlook Hospitals (n=13)
67
0
Protocols Guidelines Treatments
Number of new protocols and treatments (adopted at a national level, e.g., in guidelines) for which the hospital is the main applicant.
46 see also www.healthoutlook.nl
DEFINITION
MEASURING
IMPROVING
Infrastructure to support research as well as participation in multicenter research studies increases the number of new protocols and treatments.
Steering The cost of research (KSI 2), the number of specialist with application at LTC (KSI 5) and participation to multicenter studies (KSI 7) shows a relationship* with the number of new protocols, treatments and guidelines.
* The correlation
See for a detailed explanation on correlations Ch4. Appendices on page 82 and 83.: 47 see also www.healthoutlook.nl
DEFINITION
MEASURING
IMPROVING
Patents awarded are the confirmation that the research process was found through novel features and support the process of innovation and valorization.
KPI Number of new products # registered patents for which the hospital is main applicant.
Registered patents
Definition A patent is the registered, exclusive right of an inventor to make, use, or sell an invention.
Proxy Answers to survey* question 3.1 of the survey are taken as a proxy for the number of products
Rationale Patents awarded are the confirmation that the research process was found through novel features and support the process of innovation and valorization.
* For an overview of the question please see Ch 4 Appendices - F. Monitoring Methodology Extended version. 48 see also www.healthoutlook.nl
DEFINITION
MEASURING
IMPROVING
In 2011, Health Outlook hospitals reported to have registered 11 new patents. 7 of them were reported by the same hospital. Two other hospitals registered two patents.
16 14
No of patents
12
No of patents
10
11
5 4
8
6
4
2 0 2011
- Source: The Decision Group database -
3
2 1
N=14
0
Individual hospitals
KPI Number of new products # registered patents for which the hospital is main applicant.
*The total no of registered patents is based on question 3.1 of the survey . For detailed info please see Ch 4 Appendices - F. Monitoring Methodology Extended version. 49 see also www.healthoutlook.nl
DEFINITION
MEASURING
IMPROVING
The number of new products might increase by enlarging high skilled labor force and incentivize staff to be more open and cooperative with other hospitals.
Steering
The number of PhDs (KSI 3), participation to industry initiated events (KSI 4) and multicenter investigator initiated researches (KSI 7) are linked* with the number of products.
10. Share best practices internally to increase knowledge: exchange of ideas may help the development of new products. The STZ hospital which outperformed KPIs Number of Products explained:
Our culture is probably the key for success. Collaboration and innovation are stimulated and encouraged. At this moment we are rolling out an internal policy which is based upon sharing best practices. Hopefully, this policy will strengthen our position.
* The correlation
coefficient with KSI 3 (PhD) is 11,14% , KSI 4 (industry initiated) 15,48% and with KSI 7 (multicenter investigator initiated studies) is 19,36%.
. for a detailed explanation on correlations Ch. 4 Appendices on page 82 and 83. See
50 see also www.healthoutlook.nl
DEFINITION
MEASURING
IMPROVING
At this moment adoption rate of new products is not measured. Next year the aim is to find and determine the right definition and to collect data on this specific performance indicator .
At this moment, the said indicator does not provide a significant outcome in this first Health Outlook. The indicator aims at finding the introduction rate and penetration grade primarily of new medicines. The present data search did not turn out enough hits to support broader analysis. We expect that it will be a mere question of time before the indicator will be supported by more adequate data registry. It is probably more significant that present innovation in hospitals focuses mainly on therapy and treatment rather than on product and technology innovation. In an era dominated by an aging population and rising costs of healthcare, one would expect the scope on healthcare innovation to be on medical, technical, process and social innovation. Membership of STZ presupposes a certain size of the institution and number of patients they treat. Under these conditions it seems attractive to realize and sustain local innovations resulting in lower costs of treatment and higher (social) return on investments in terms of clinical outcome, patient satisfaction and quality of life. Admittedly, this will have to be picked up by a whole new set of partners like MKB and HBO organizations in a new variety of business case.
The hospitals that started in this way are confronted by both new and time-honored challenges, the difficult acceptation of foreign (not invented here) concepts being one of them. However, opening up for innovative concepts that will increase the quality of care in feasible business cases will automatically invite other innovators and their innovative concepts to present themselves. Healthcare innovation appears to be in its infancy. Possibly, the current KPI 6 scores most important signal is: Demanding attention. Marc Rinkes & Pieter Kievit
DEFINITION
MEASURING
IMPROVING
Key performance indicators - Size Size of clinical trials (no of patients in trial) Inflow of patients outside catchment area
Size
DEFINITION
MEASURING
IMPROVING
The number of patients are representative for the size of the clinical trials assessed.
DEFINITION
MEASURING
IMPROVING
Hospitals have a focus on phase 3 (2067 patients) and medical devices trials (2300 patients), compared to phase 2 (589 patients). Per total 7445 patients were enrolled in clinical trials.
2489
6000
No of patients
4956
3455
1038 2067
1155 2300
296 589
Ph 2
N=14
Ph 3
N=14
KPI Size of Clinical Trials ( number of patients in trial ) Total Number of target patients to be included in clinical trials, Phase II of III for Drugs or trials for medical devices started during a year.
148 patients were enrolled in average in phase 3 clinical trials. 177 patients were enrolled in average in medical device trials. See for a detailed overview Ch 4 Appendices - F. Monitoring Methodology Extended version. 54 see also www.healthoutlook.nl
DEFINITION
MEASURING
IMPROVING
A larger presence of research support activities will help hospitals to manage the patients in clinical trials.
Steering
Size of clinical trials and the presence of research support offices (KSI 6) are associated*.
11. Stimulate and build research support structures: Outperforming hospitals on size of clinical trials, have more FTEs available to support research than other hospitals. These hospitals have built more structures to manage the large number of patients in trials.
12. Create visibility to industry partners, cluster location seems to matter. A hospital suggested that large phase 3 and medical devices studies are assigned more often to hospitals located in one of the Dutch Life Sciences sub clusters. LS sub cluster
* The correlation
See for a detailed explanation on correlations Ch4. Appendices page 82 and 83. 55 see also www.healthoutlook.nl
DEFINITION
MEASURING
IMPROVING
If there is a high ratio of patients outside catchment area (inpatient and as well outpatient) then the hospital is attractive. KPI Inflow of patients from outside catchment area
Number of unique patients outside hospital catchment area that got care delivered when inpatient (admissions) and outpatient visits (vert.: opnames en 1ste polikliniek bezoeken).
Proxy The patients reported at the hospital living outside the geographic areas than the institution.
Rationale If there is a high ratio of patients outside catchment area then more attractive for the patients is that specific institution.
Rationale To get a good insight in the complexity of pocedure that a patient may undergo.
DEFINITION
MEASURING
IMPROVING
In 2011, the Health Outlook hospitals reported that on average 14.5 % of total admissions and 10,3% of outpatient visits were from patients located outside the catchment area.
First admissions
% of patients outside catchment area
35% 30% 25% 20% 15% 10% 12,0% 11,4% 29,8% 30%
15%
10,4% 10% 5% 0% 3,9% 9,7%
5%
0%
4,5%
N=11
Minimum
Average
Median
Maximum
N=11
Minimum
Average
Median
Maximum
KPI Inflow of patients from outside catchment area Number of unique patients outside hospital catchment area that got care delivered inpatient (admissions) and outpatient visits (vert.: opnames en 1ste polikliniek bezoeken)
57 see also www.healthoutlook.nl
The first position with the maximum number of first admissions and first outpatients visits outside catchment area is hold by the same hospital. See for a detailed explanation Ch 4 Appendices - F. Monitoring Methodology Extended version.
DEFINITION
MEASURING
IMPROVING
Expertise of employees might attract patients from outside catchment area to the hospital.
Steering
The level of expertise (KSI 3) is linked* with the inflow of patients outside catchment area that are admitted for the first time.
13. Attract and invest in the expertise of the core staff members: The expertise of the attractive hospitals, (inflow of patients from outside catchment area) is higher compared to average attractive hospitals.
Next to expertise, data shows a trend on size of clinical trials and inflow of patients outside catchment area. Further research has to validate the hypothesis that inflow of patients with clinical trials may affect the inflow of patients for admissions and outpatient visits.
* The correlation
See for a detailed explanation on correlations Ch. 4 Appendices on page 82 and 83. 58 see also www.healthoutlook.nl
DEFINITION
MEASURING
IMPROVING
Hospital investments
INPUT
DEFINITION
MEASURING
IMPROVING
Industry investments give an approximation of the ability of hospitals to collaborate with industry in common projects.
Number of research projects with industry partners, (including self-initiated healthcare research with industry investment) started in a given year. Core value chain of the Dutch health cluster
Definition of the core value chain The Dutch Health cluster contains all top clinical and research hospital from the Netherlands, including all STZ hospitals that perform applied research.
Proxy The number of research projects commissioned by industry is taken as a proxy for industry investments. Rationale Industry investments give an approximation of the ability of hospitals to collaborate with industry in common projects.
DEFINITION
MEASURING
IMPROVING
In 2011, the industry invested in, on average, 21 research projects per hospital with a maximum of 49 research projects. In total 630 research projects within the hospitals were started.
Industry investments
60 50 49 700 600
No of projects
40 30 21 20 10 1 0 20
No of projects
Minimum
N = 15
KPI Industry Investments Number of research projects with industry partners, (including self-initiated healthcare research with industry investment) started in a given year.
61 see also www.healthoutlook.nl
There is a large variation among the reported industry investments. See for a detailed explanation Appendices on Monitoring Methodology extended version.
DEFINITION
MEASURING
IMPROVING
Hospitals that are participating actively in multi center studies attract more industry investments. Furthermore, ambitious specialists have a large impact on performance.
Steering The participation in multicenter studies (KSI 7) seems to influence* the industry investments.
15. Invest in a research culture. This generates an exciting and vibrant learning community, reinforces the links with industry, and contributes to highquality applied research.
The hospital which outperformed KPI Industry Investments explained: Our specialists are very research minded. They have a lot of ambition, and this influences other specialists. A science-driven culture is growing. The money they receive from the industry is often reinvested in investigator research, which attracts industry, a motor of innovation is created. 16. Coordinate research at a decentralized level too, to stimulate multicenter studies. Another hospital clarified: Our main departments have own research coordinators who facilitate in bringing in multicenter studies.
DEFINITION
MEASURING
IMPROVING
Hospitals that invest in applied research & innovation create a breeding ground for innovation.
Definition Applied research is a form of systematic inquiry involving the practical application of science.
Proxy Hospital budget and a sample of the 3 largest partnerships (maatschappen) for investment in applied research & innovation apart from industry sponsored is taken as a proxy. Rationale Hospitals that invest in applied research & innovation are create a breeding ground for innovation.
DEFINITION
MEASURING
IMPROVING
The hospital investments applied research & innovation vary between the hospitals in 2011. There is a huge gap between the minimum (invested 10k) and the maximum (invested 905k).
Hospital investments
1.000.000 900.000 800.000 904.500
Investments in
Investments in
300.000
200.000 100.000 0 10.000
N=10
Minimum
Average
Median
Maximum
KPI Hospital applied research & innovation Money invested in applied research & innovation by the hospital in a given year.
200000 100000 0
Different reporting sources were considered. See for a detailed explanation Appendices on Monitoring Methodology extended version:
Individual hospitals
DEFINITION
MEASURING
IMPROVING
An explanation for the differences is based on the availability of internal data on investments.
Steering
The steering indicators level of expertise (KSI 3) and participation to industry and health related events (KSI 4) are associated* with Hospital investments.
17. Create insight into costs and investments, to allocate the right resources to the right activities.
* The correlation
coefficient with KSI 3 (CGP) is 56.81% and with KSI 4 (participation to health related events is 60.50%
See for a detailed explanation on correlations Appendices on page 82 and 83. 65 see also www.healthoutlook.nl
Appendices
A. B. C. D. History, development and structure of the Dutch Health Outlook About the involved partners Bibliography Consulted experts and organizations
The Outlook is commissioned by the STZziekenhuizen. STZ stands for the Dutch association of tertiary medical teaching hospitals. STZ members can be seen as high care hospital providers and top referral centers. STZ plays an important role in applied medical research having the aim to provide effective and efficient care with focus on patient value. Contacts: Maarten Rook info@stz-ziekenhuizen.nl www.stz-ziekenhuizen.nl
The Outlook is created in cooperation with the Grenoble School of Management, School of Public Health, part of The George Washington University, Stockholm School of Economics
The Outlook is created in cooperation with consulting firm The Decision Group. The Decision Group helps clients take better strategic decisions, using methods such as strategic dialogue and strategic alignment. The creation of the Outlook is supervised by Prof. dr. Fred van Eenennaam, and ir. Maarten Koomans managing partners of The Decision Group.
Contacts: Prof. dr. Fred van Eenennaam Ir. Maarten Koomans, Kim Bruheim, MSc. Bogdan Toma, BA, BSc +31(0)346-574942 info@thedecisiongroup.nl www.thedecisiongroup.nl
The Nyenrode LSH | Biotech Outlook is created under supervision of prof. dr Fred van Eenennaam and Ir Maarten Koomans.
The Role of Integration into External Informational Environments, John R. Kimberly, Journal of Health and Social Behavior Vol. 19, No. 4 (Dec., 1978),
Determinants of technological innovation and its effect on hospital performance, African Journal of Business Management Vol.5 (11), pp. 4314-4327, 4 June, 2011
WHO Draft Guidelines for adverse event reporting and Learning Systems (2005)
Creating
To make sure the actual needs are addressed The Outlook is created with the hospitals, using: A few sources with each hospital Dialogue sessions Round table discussions
Reporting
To monitor progress systematically on the overall cluster, key business impact areas and key policies The Outlook reports to hospitals & entrepreneurs: Showing progress & performance of hospitals Communicating needs of hospitals to policy makers
Using
To have a dialogue on improvements The Health Outlook is used for monitoring and improving: The key policies have direct impact on the success of the health cluster.
Learning loop
Learning loop
The Outlook uses insights from the strategic dialog , where the key cluster challenges were identified according to the needs of its members.
The Outlook is the starting point for cluster-wide strategic dialogues among entrepreneurs and policy makers.
Improving business knowledge can have large impact on the cluster success.
Learning loop
72 see also www.healthoutlook.nl
Learning loop
Learning loop
Gran Lindqvist Principal Associate at the Center for Strategy and Competitiveness (CSC) at the Stockholm School of Economics and Cluster Observatory project manager. His research focuses on agglomerations, clusters, cluster initiatives, and cluster policy.
Robert E. Burke Professor at the George Washington University Professor Burke is a medical sociologist and a nationally known expert in long-term care, with extensive experience in developing, evaluating and implementing health care policy and managing multidisciplinary professional staff.
Leonard H. Friedman Professor at the George Washington University Dr. Leonard Friedman is an expert on the mechanisms of organizational change and strategic decision-making in health service organizations.
Fred van Eenennaam Professor of Strategy and Dynamics of Strategy Professor Fred van Eenennaam is an expert on corporate governance & strategy. He is also well known for his expertise in the life sciences and healthcare industry.
1The
council meets twice a year with Prof. dr. Fred van Eenennaam as chair and Kim Bruheim, MSc. as secretary of the council. 73 see also www.healthoutlook.nl
CHOICES
DEFINITIONS
MEASURING
The Monitoring methodology of the Outlook consists of: 1) choices, 2) definitions, and 3) measurement of the key performance and steering indicators. MONITORING METHODOLOGY
2013 The Decision Group
3) MEASURING Data collection for the key performance and steering indicators
The data collection methodology is set up to provide accurate measurements:
CHOICES
DEFINITIONS
MEASURING
The main goal of the design was to find a set of indicators that would help to improve the cluster success.
All choices made to select the key performance and steering indicators are based on the added value for the cluster.
Scope Aim
The scope of the Dutch Health Outlook is the Dutch Health cluster. The performance indicators monitor the success of a cluster or set of organizations. Typically, performance indicators cannot be influenced directly by policy. Steering indicators can be influenced directly by policy makers. Steering indicators are selected so as to have high impact on the success of a cluster or set of organizations. The combined set of performance and steering indicators gives insight in the success of the hospitals in the Dutch Health cluster. To ensure that the performance indicators are practical for policy makers, a small controllable set of performance indicators is selected which can be influenced and steered upon. - High social interests in new healthcare products (performance indicator Number of products). - Increased need for personalized medicine and cost reduction. The approach has been validated through a pilot program and the International Academic Advisory Council that meets on a regular basis.
Focus
Use
Health Cluster
Validation
Methodology development
CHOICES
DEFINITIONS
MEASURING
An extensive three-step proces is followed, starting with the analysis of all hospital performance and steering indicators extracted from key sources.
Key Sources
Step 1:
Select Key sources
Key sources: Best practice hospitals, healthcare policy institutes ((e.g., Cleveland Clinic, Centers for Medicare and Medicaid Services etc), healthcare management journals and universities Selection of reports, academic papers, interviews on monitoring and improving hospital performance
All indicators
Step 2
Extract all hospital performance and steering indicators
Selection
Step 3
Select key performance indicators Select key steering indicators
Action
Selection of indicators that monitor and improve the valorization and cooperation of hospitals with the innovative industry
Output
CHOICES
DEFINITIONS
MEASURING
47 key sources are used that report in 85 key documents on monitoring and improving hospital performance.
Key Sources
Best practice hospitals
Karolinska Hospital Sarasota Memorial Hospital Mayo Clinic Cleveland Clinic Johns Hopkins Central Manchester University Hospital Duke University Medical Center Childrens Hospital of Philadelphia National Taiwan University Hospital Nederlandse Vereniging van Ziekenhuizen
Universities
Stanford University University of York Harvard Business School The George Washington University Bocconi University
Dutch hospitals
Vereniging Samenwerkende Topklinische opleidingsZiekenhuizen (STZ) Universitair Medische Centra (UMC's) Nederlandse Federatie Universitair Medische Centra (NFU)
CHOICES
DEFINITIONS
MEASURING
M on
26 27
Monitoring Monitoring
Size
Size
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25
Input by law A-segment MonitoringBudget Size Amount of part-time specialists Input by law B-segment MonitoringBudget Size Amount of publications in top 1% segment Input of Medical faculty of education, MonitoringBudget Size Amount of(ministry topreferent patients culture and science) Input grants/funding research) research MonitoringExternal Size Amount (for of translational Input market competition health caredevelopment budget (insurers) MonitoringFree Size A-segment volume Input care budget (insurers) MonitoringHealth Size A-segment volume development per type of care provider 10 7 10 10
9,11, 13, 14 20
7 13,29
20 20 2 4
Monitoring 43 Monitoring 44 Monitoring 45 Monitoring 46 Monitoring 47 Monitoring 48 Monitoring 49 Monitoring Monitoring 50 Monitoring
Input (Ministryof of multidisciplinary Health, Welfare infrastructure and Sport and health insurers) Including government 27 MonitoringHealthcare Size budget Availability grant for tertiary care and innovation Monitoring Size Availability of data Input Hospital R&D investments Monitoring size Availability of necessary departments Input Industry investments Monitoring Size Availability of necessary supporting specialties Input Research grants 7, 10 7 Monitoring Size Availability of quality, expertise and key opinion leaders in clinical trial research Input Revenues: Ministry of Education, Culture and Science 27 Monitoring Size Average population per hospital Input Rx subsidy % (The percentage of total prescription drug sales paid by subsidy) Monitoring Size Average risk residents w ith pressure ulcers Input Third-party revenues: medical research council, charities, contract research 27 Monitoring Size Avoidance of unnecessary care Size Absentee rate Monitoring Size Brute force indicator (product of the total number of publications in a period, multiplied by the field15 Size Access times for outpatient clinics normalized impact score (CPP/ FCSm) Size Accidental puncture or laceration Monitoring Size Care is offered by (sub)specialized experts in that area (approved by the association narrow (sub)specialties) Size Activeness of medical staff in their field or administrative and/or in the health care Monitoring Size Care is proceeding according to tested protocols Size Amount of adverse events during the length of the research 16 Monitoring Size Central line bundle compliance Size Amount of approved METC projects 9 Monitoring Size Citation score 9,11,13,14, 15 Size Amount of beds Monitoring Size Clinical hospitalizations Size Amount of biomedical research 29 Monitoring size Clinical trial phases covered 3 Size Amount of citations per article 9 Monitoring Size Collaboration of CRO (Contract Research Organization) and pharmaceutical industry w ith hospitals and Size Amount of citations per publication (excl. Self citations) 15 hospital boards (to overcome collaboration bottlenecks) Size of citations per publication (inc. Self citations) 15 MonitoringAmount Size Contribution to the 20/10/5/2/1 % most frequently cited research papers w orldw ide 15 Size Amount of Clinical research 13,29
ea l m t hc an ar B es ag e t em ho pr en sp act tj ita ice o H u ls ea rn lth al H ma ca s ea l na re in thc ge st ar m itu e e n t e po t j s lic ou y rn al s H ea U ni l vein thc rsst ar itiitu e G es t po en es lic er y pe a l rf h or os m p Un an i ta iv c e l er D ut si ch tie G s ho en spp e r a ite arlf l h or os s ..m p an i ta ce l D ut ch ho sp ita ls ..
6
ito ri ng /Im id C at pr eg ov or in y g
in di ca to C r at eg N or am y e of in di ca to r
id pr ov in g
ito ri ng /Im
am
M on
of
6 6
1
2 2
29
18
14
2 3 14 2
2 2 14
6
6 3 29
CHOICES
DEFINITIONS
MEASURING
The key performance and steering indicators have been selected so that they can lie within the focus of the Life Sciences and Health Outlook.
Focus: 1. Including clinical phase II,III and Medical Devices 2. Self-initiated healthcare research 3. Adoption of new products and treatments
Remarks
A few remarks about definitions and measuring should be made :
CHOICES
DEFINITIONS
MEASURING
1. The researchers have opted not to include in the following pages a detailed overview on definitions and measuring of KSIs. For those who might like to read the detailed definitions and measuring are welcome to check the extended version of this Health Outlook available at www.healthoutlook.nl
2. The researchers thought it relevant to offer the definitions of KPIs in Chapter 3, before introducing the results scored for each indicator. The measuring methodology used for each KPI is to be found in the extended version of the Health Outlook.
3. The results of each KSI is provided in a different section called Health Outlook extended.
CHOICES
DEFINITIONS
MEASURING
To measure the key performance indicators 8 & 9 and key steering indicators 1 & 4 a survey was sent. 593 people from 14 hospitals have replied.
STZ & The Decision Group Life Sciences & Health Outlook 2013
Survey onderzoekers en medisch specialisten
Geachte heer, mevrouw, Ons ziekenhuis doet namens de STZ topklinische ziekenhuizen mee aan het ontwikkelen van een Life Sciences & Health Outlook, in samenwerking met The Decision Group Met behulp van de Outlook willen we meten en monitoren hoe we als STZ ziekenhuis presteren op het gebied van onderzoek en innovatie. Graag maken we van uw expertise en knowhow gebruik om een aantal van de indicatoren die we met de STZ leden hebben opgesteld invulling te geven. Momenteel voeren we een pilot uit. Hieruit kan ook blijken dat vragen minder goed aansluiten bij de informatie die we zoeken. Als u suggesties heeft horen we dat graag. Het invullen van de vragen kost naar schatting ongeveer 10 minuten van uw tijd en levert zeer waardevolle input voor de Outlook. We stellen het op prijs als u de ingevulde vragenlijst voor 1 februari zou kunnen toesturen aan Niels van Gorp: n.vangorp@thedecisiongroup.nl Bij voorbaat hartelijk dank voor uw bijdrage. We houden u graag op de hoogte van de ontwikkelingen rond de Life Sciences & Health Outlook.
Wilt u hier uw naam invullen? Wat is uw functie? Voor welk ziekenhuis werkt u?
1.
1.0
1.1
1.2
Heeft u in 2011 medisch wetenschappelijk onderzoek (trials, productontwikkeling of anderszins) uitgevoerd? A) Ja B)Nee (ga door naar vraag 2) Komt het voor dat u onderzoeksprocedures aanpast (bijv beschreven in protocol)? A) Ja B)Nee (ga door naar vraag 2) Hoe vaak deelde u in 2011 naar schatting zulke aanpassingen met collega's in andere ziekenhuizen? A) niet (0 keer) B) 1-2keer C) 3-5 keer D) 6-10 keer E) >10 keer
2.
2.1 a
2.2 a
2.4 a b
Bijeenkomsten en symposia Hoe vaak nam u ongeveer deel aan congressen, symposia, science meets business en gelijksoortige bijeenkomsten in 2011, waarbij de industrie of het bedrijfsleven vertegenwoordigd was? A) niet (0 keer); Ga verder naar vraag 2.2 B) 1-2keer C) 3-5 keer D) 6-10 keer E) meer dan 10 keer Hoeveel van die bijeenkomsten waren door de farmaceutische of medical devices industrie geinitieerd? A) geen enkele B) 1-2 C) 3-5 D) 6-10 E) meer dan 10 Hoeveel van deze bijeenkomsten waren er geinitieerd door het bedrijfsleven/MKB (anders dan farmaceutische of medical devices industrie)? A) geen B) 1-2 C) 3-5 D) 6-10 E) meer dan 10 Hoeveel bijeenkomsten waren door uw eigen ziekenhuis georganiseerd? A) geen B) 1-2 C) 3-5 D) 6-10 E) meer dan 10 Hoeveel van dit soort bijeenkomsten heeft u in 2011 zelf (mede) georganiseerd ? A) geen B) 1 C) 2 D) 3 E) meer dan 3 Contact met industrie en MKB Hoe vaak heeft u in 2011 in het kader van uw onderzoek contacten gelegd met de industrie of de industrie benaderd? (hoeveel verschillende partijen) A) geen enkele keer B) 1 keer C) 2 keer D) 3 keer E) meer dan 3 keer Hoe vaak met het MKB? A) geen enkele keer B) 1 keer C) 2 keer D) 3 keer E) meer dan 3 keer Doelen van contact met bedrijfsleven Wat waren de doelen van uw contacten met industrie? Wat waren de doelen van uw contacten met MKB/overig bedrijfsleven?
3.
3.1 a
b 3.2
Patenten Heeft u in 2011 in het kader van uw onderzoek patent aangevraagd? A) Ja en tevens toegewezen gekregen B) Ja, maar nog niet toegewezen ga naar vraag 3.2 C)Nee, ga door naar vraag 3.2 Hoeveel patenten heeft u geregistreerd? Heeft u nieuwe protocollen opgesteld die in 2011 op (inter)nationaal niveau zijn geimplementeerd? A) Ja (graag ook aantal vermelden) B)Nee Heeft u nieuwe richtlijnen opgesteld die in 2011 op (inter)nationaal niveau zijn gepubliceerd? A) Ja (graag ook aantal vermelden) B)Nee Heeft u nieuwe behandelingen ontwikkeld die in 2011 op (inter)nationaal niveau zijn geimplementeerd? A) Ja (graag ook aantal vermelden) B)Nee
3.3
3.3
Hartelijk dank voor uw deelname aan deze vragenlijst. Mocht u geinteresseerd zijn in de uitkomsten van het onderzoek, vult u dan graag even uw e-mail adres in, dan houden we u op de hoogte. E-mail adres:
* Haga Ziekenhuis sent an own internal survey to measure the Key Performance Indicators: No of products and No of protocols, treatments and guidelines. The numbers of respondents
was 57. 81 see also www.healthoutlook.nl
CHOICES
DEFINITIONS
MEASURING
To compute the correlation between KPIs and KSIs the statistical software package STATA version 11 was used.
The first column ksi3_emp indicates employment and on each row the performance indicator can be found. The intersection between the employment line and a specific key performance indicator gives the correlation coefficient.
For a series of a few KPIs i.e. KPI5, KPI8 and KPI9 the relationship between the above mentioned indicators and KPI7 Number of publications has been considered more appropriate to be used when extrapolating.
ksi3_~mp kpi1_1~j kpi3_1~2 kpi3_1~3 kpi3_1~d kpi4_1~p kpi4_1~1 ~3_part1 ~d_part1 ksi3_11_emp kpi1_11_proj kpi3_11_ph2 kpi3_11_ph3 kpi3_11_md kpi4_11_outp kpi4_11_ou~1 kpi5~3_part1 kpi5_11_md~1 kpi7 kpi9protoc~s kpi9treatm~s 1.0000 0.6130 0.3358 0.1374 0.3057 0.9335 0.5180 0.0631 0.0221 0.3257 0.1217 0.3287
kpi7 kpi9pr~s kp
kpi7 ~d_part1
1.0000 0.5500 0.0117 0.0771 0.6586 0.5615 -0.3014 -0.0340 0.5463 0.1489 0.5441 1.0000 0.4342 0.1621 0.3697 0.7626 -0.1166 0.4747 0.6811 0.0320 0.1891
kpi8 kpi9pr~s
kpi7 1.0000 kpi5_11_md~1 0.2834 1.0000 kpi8 0.1793 0.1017 1.0000 kpi9protoc~s 0.2271 -0.0034 0.3160 1.0000 kpi9guidel~s 0.3983 -0.1787 0.6379 1.00000.0168 kpi9treatm~s 0.4471 0.1258 -0.18300.4341 1.0000 0.2224
0.1530 -0.3999 -0.0216 -0.0534 0.1271 0.3321 0.1670 0.2041 0.3388 0.7233 0.1671 -0.0068 0.1223 -0.0353 0.0361 -0.1402 1.0000 0.2834 -0.0034 0.2224
Source: The Decision Group database STATA print out. 82 see also www.healthoutlook.nl
CHOICES
DEFINITIONS
MEASURING
For a series of KPIs and KSIs presented in chapter 4 the correlation coefficients are given. The table underneath shows an overview of the given coefficients, based on STATA calculations.
Indicators KSI 4 Mkb KSI 4 Health KSI 5 Spec KSI 3 Prof KSI 1 KSI 2 KSI 3 PhD KSI 7 KSI 6 KSI 3 GCP
Source: The Decision Group database .
KPI 5
KPI 9
KPI 4
KPI 1
KPI 2 0,605
KPI 3
CHOICES
DEFINITIONS
MEASURING
Pilot study Before the set up of the Health Outlook 2013 a pilot study was launched. In this way the results could be calibrated and definitions and indicators were adjusted . Communication Along the elaboration of the Health Outlook, there was a permanent and constructive communication between the researchers of The Decision Group and hospital members / employees that participated in this study. The individuals in charge of data-collection have discussed and harmonized data-collection procedures and agreeing on sources for data. Public sources A web search has been performed to check the consistency of data reported for indicator employment. The figures that were available publically corresponded with the ones reported. Cooperation among data collectors In some cases the data collators were the same individuals for multiple hospitals, e.g. the same individuals gathered data from Medisch Centrum Alkmaar, Rijnstate, St. Elisabeth Ziekenhuis and Medisch Centrum Leeuwarden. Hence, a consistency in data collection has been assured. Outlier Check In a few cases, where researchers considered that the reported data may be an outlier, discussions were carried out with the reporting hospital to assure that no reporting mistake had occurred.
CHOICES
DEFINITIONS
MEASURING
STZ Database The figures for number of publications cited are pulled together centrally by STZ and are publicly available through its reports.
Survey For a series of 2 performance indicators and 2 steering indicators a survey was sent.
is commissioned by by thethe Life The Outlook Outlook is commissioned STZ ziekenhuizen . Sciences & Health innovation program.
Driven by the cluster and empowered by the the LSH STZMinistry stands of forEconomic the Dutch Affairs, association of tertiary medical hospitals. STZ program has theteaching objective to improve the members can be seenand as investment high care life sciences innovation hospital in providers and top referral climate the Netherlands. The centers. Outlook STZ plays an important role in applied is part of the four-year work plan.
medical research having the aim to provide effective and efficient care with focus on patient value.
Contact: Willem de Laat, MD, PhD Contacts: Annemiek Verkamman +31(0)71-3322033 Maarten Rook info@lifescienceshealth.com info@stz-ziekenhuizen.nl www.lifescienceshealth.com
www.stz-ziekenhuizen.nl
It is the vision and aim of the Value Based Health Care Center Europe to share key practices, our experiences and knowledge on Value Based Health Care to put Patient Value at the core.
The Outlook is created in cooperation with consulting firm The Decision Group. The Decision Group helps clients take better strategic decisions, using methods such as strategic dialogue and strategic alignment. The creation of the Outlook is supervised by prof. dr. Fred van Eenennaam & ir Maarten Koomans, managing partner of The Decision Group. Contacts: Prof. dr. Fred van Eenennaam, Ir. Maarten Koomans Kim Bruheim, MSc. Bogdan Toma, BA, BSc. +31(0)346-574942 info@thedecisiongroup.nl www.thedecisiongroup.nl
Appendix C Bibliography
4.
5. 6. 7.
Hopkins, J. (n.d.). Johns Hopkins Medicine Clinical Trials. Retrieved 10 06, 2011, from http://www.hopkinsmedicine.org/quality/patients/clinic al_trials
Nederlandse Federatie van Universitair Medische Centra, Acute Zorg: Een beschrijving van het niet te plannen deel van de ziekenhuiszorg (2010), Utrecht, NL. Nederlandse Federatie van Universitair Medische Centra, At a glance: Facts and figures for the Netherlands University Medical Centers (2009), Utrecht, NL. Nederlandse Federatie van Universitair medische Centra, Bibliometric study on Dutch Academic Medical Centers 1998-2008 (2009), Utrecht, NL, p.6.
8.
9.
Nederlandse Federatie van Universitair Medische Centra, In n oogopslag: Feiten en cijfers over de Universitair Medische Centra 2009 (2009), Utrecht, NL.
Nederlandse Federatie van Universitair Medische Centra, Kwaliteitsborging van mensgebonden onderzoek (2010), Utrecht, NL, p.11-14.
10. Nederlandse Federatie van Universitair Medische Centra, Naar een goede waarde: Valorisatie in de Universitair Medische Centra van Nederland- Uitgangspunten voor vorm en regelgeving (2009), Utrecht, NL, p13, p15
11. Nederlandse Federatie van Universitair Medische Centra, Onderzoek onderzocht: een bibliometrische analyse van het onderzoek van de universitair medische centra (2004), Utrecht, NL
12. Nederlandse Federatie van Universitair Medische Centra, OOR-zaak en gevolg:Opleidingen in de zorg NFU-visiedocument (2005), Utrecht, NL, p. 3. 13. Nederlandse Federatie van Universitair Medische Centra, Patintveiligheid,de handen ineen (2006), Utrecht, NL.
14. Nederlandse Federatie van Universitair Medische Centra, Publieke functies van de UMCs in een marktomgeving (2006), Den Haag, NL, p. 39
15. Nederlandse Federatie van Universitair Medische Centra, Report on the research management of the University medical centers in the Netherlands (2005), p .13,15,16,17,23,28. 16. Nederlandse Federatie van Universitair Medische Centra, Tevredenheid gepeild (2005), Utrecht, NL
17. Nederlandse Federatie van Universitair Medische Centra, Trends in tevredenheid (2007/08) De tevredenheid van patinten van de acht Universitair Medische Centra (2008),Utrecht, NL.
18. Nederlandse Federatie van Universitair Medische Centra, Trends in tevredenheid (2003/2009):Samenvatting van het vierde onderzoek naar tevredenheid van patinten in Universitair Medische Centra (2010), Utrecht, NL.
29. Research & Clinical Trials - Cleveland Clinic, Clinical Connection. (n.d.). Retrieved 10 06, 2011, from Cleveland Clinic: www.clinicalconnection.com
30. Shaw C (2003) How can hospital performance be measured and monitored? Copenhagen, WHO Regional Office for Europe (Health Evidence Network report; http://www.euro.who.int/document/e82975.pdf, accessed 29 August 2003) 31. Sibley, C. (2011). Our performance. Retrieved 10 06, 2011, from Central manchester university hospitals: http://www.cmft.nhs.uk/research-and-innovation/ourperformance.aspx 32. Tidd, J., Bessant, J., & Pavitt, K. (2005). Case_studies. Retrieved 11 14, 2011, from Managing innovation: http://www.managinginnovation.com/case_studies/Karolinska%20Hospital.pdf
Universities
33. Daniele Fabbri, Silvana Robone, The geography of hospital admission in a National Health Service with patient choice: evidence from Italy, University of York, HEDG (Dec 2008) 34. Nicholas Bloom, Carol Propper, et al., The Impact of Competition on Management Quality: Evidence from Public Hospitals (Stanford University, Aug 2011)
Dutch hospitals
39. De Vereniging Samenwerkende Topklinische Ziekenhuizen: 15 jaar STZ: Wat STZ-ziekenhuizen verbindt. (2011) Nederland, Utrecht.
40. De Vereniging Samenwerkende Topklinische Ziekenhuizen: Kengetallen Nederlandse Ziekenhuizen. (2009) Nederland, Utrecht. 41. De Vereniging Samenwerkende Topklinische Ziekenhuizen: STZ expertisecentra in beeld. (2011) Nederland, Utrecht. 42. De Vereniging Samenwerkende Topklinische Ziekenhuizen: STZ opnieuw in beeld. (2011) Nederland, Utrecht.
43. De Vereniging Samenwerkende Topklinische Ziekenhuizen: STZ Toelatings- en hervisitatiecriteria. (2011) Nederland, Utrecht.
44. De Vereniging Samenwerkende Topklinische Ziekenhuizen: STZ-ziekenhuizen in het Nederlandse ziekenhuislandschap. (2011) Nederland, Utrecht. 45. Leeuwen, van T. Noyons, E. Medina, C.C. Bibliometric analysis of STZ-hospitals. Leiden, Leiden University 2012 46. Nederlandse vereniging van ziekenhuizen. (2010). Retrieved 10 20, 2011, from ziekenhuis transparant: http://www.ziekenhuizentransparant.nl/toon.php?hm=11006&sm=11979&id=762
62. Australian government, Clinically competitive: boosting the business of clinical trials in Australia (2011)
63. Chief Scientist Office: Scottish Executive Health Department, Scottish exexutive health department research governance framework for health and community care. p. 8/9 64. Ministry of Health Welfare and Sports: Here you work safely or you dont work here at all (2004) Den Haag, Nederland.
65. National Quality Forum: Measurement Framework: Evaluating Efficiency Across Patient-Focused Episodes of Care (2009) Washington, DC, p.8
66. National Quality Forum: National voluntary consensus standards for patient safety measures, first report: a consensus report (2010) Washington, DC 67. National Quality Forum: The ABCs of Measurement, Washington, DC 68. Seow H, Snyder CF, Mularski RA, et al. A framework for assessing quality indicators for cancer care at the end of life. J Pain Symptom Manage 2009 Dec;38(6):903-12.p.13 69. Socialstyrelsen: Open Comparison and Assessment 2009 Cardiac Care, Ordfrrdet AB. 70. Socialstyrelsen: Quality and Efficiency in Swedish Health Care Regional Comparisons (2010), Ordfrrdet AB, p. 300 71. Socialstyrelsen: Quality and Efficiency in Swedish Health Care Regional Comparisons (2008), Ordfrrdet AB.
72. Socialstyrelsen: Quality and Efficiency in Swedish Health Care Regional Comparisons (2009), Ordfrrdet AB.
73. World Health Organization, Measuring hospital performance to improve the quality of care in Europe: a need for clarifying the concepts and defining the main dimensions, Report on a WHO Workshop Barcelona, Spain, 10-11 January 2003 74. World Health Organization, The World Health Report 2000, Health Systems: improving performance (2000) Geneva, Switserland
76. De Centrale Commissie Mensgebonden Onderzoek: Onderzoek met proefpersonen 2006 2010, jaarverslag 2010, Den Haag, Nederland
77. Halbertsma, R. (2008). Kwaliteit van zorg & marktwerking: Een overzicht van de economische literatuur. Utrecht: Nederlandse zorgauthoriteit. 78. Inspectie voor de gezondheidszorg: Kwaliteitsindicatoren 2012 (2011) Utrecht, Nederland 79. Inspectie voor de gezondheidszorg: Veiligheidsindicatoren ziekenhuizen (2010) Utrecht, Nederland 80. Mansley, Mark. Health and safety indicators for institutional investors. United Kingdom: Health and safety executive, 2002. http://www.hse.gov.uk/revitalising/csr.pdf. 81. Ministry of Health Welfare and Sports: Health consumer powerhouse: 2005 EuroHealth Consumer Index (2005) 82. Ministry of Health Welfare and Sports: ICT in Dutch Healthcare: An International Perspective (2006) Den Haag, Nederland.
83. Nederlandse Zorgautoriteit (NZA) : Marktscan Medisch specialistische zorg (2011) Utrecht, Nederland
84. Preventie, Ziekte & Zorg: medische technologie . (sd). Opgeroepen op 10 20, 2011, van Het rijksinstituut voor volksgezondheid en milieu: Http://www.rivm.nl/Thema_s/Preventie_Ziekte_Zorg/Medische_technologie 85. Raad voor de volksgezondheid en zorg: Ruimte voor arbeids-besparende innovaties in de zorg door slimmer werken meer kwaliteit met minder mensen (2010) Den Haag, Nederland. 86. Translating Clinical Trials into Practice, Robert M. Califf, MD, Duke University Medical Center, Duke Clinical Research Institute, Durham, North Carolina (July. 27, 2005) 87. WIP richtlijn handhygiene. (sd). Opgeroepen op 10 20, 2011, van Het Rijksinstituut voor Volksgezondheid en Mileu: http://www.rivm.nl/Bibliotheek/Professioneel_Praktisch/Richtlijnen/Infectieziekten/WIP_Richtlijnen/Actuele_WIP_Richtlijnen/Ziekenhuizen/WIP_richtlijn_Handhygi ne_ZKH 88. WIP-richtlijn Bloedcontact . (sd). Opgeroepen op 10 20, 2011, van het rijksinstituut voor volksgezondheid en milieu : http://www.rivm.nl/Bibliotheek/Professioneel_Praktisch/Richtlijnen/Infectieziekten/WIP_Richtlijnen/Actuele_WIP_Richtlijnen/Ziekenhuizen/WIP_richtlijn_Bloedconta ct_ZKH 89. World Health Organization, WHO Draft Guidelines for adverse event reporting and Learning Systems (2005) Geneva, Switserland
Boxma Brohet Dierick Dille Dijksman Duindam Dusseldorp, van Duin-Outmaijjer, van Geerlings Groenewegen Gorp, van Grimm Groot, de
Position Trial cordinator Voorzitter raad van bestuur Kwaliteitsmedewerker Wetenschap Cordinator medische vervolgopleidingen en wetenschap 1. President, 2. Lid bestuur, 3. MD PhD Research Coordinator Head of Department Scientific Research Implementatiefellow Manager R&D Cordinator wetenschapsbureau, epidemioloog Teamcordinator Dialys Hoofd Kennis- en Informatiecentrum Wetenschapsfunctionaris Voorzitter raad van bestuur Directeur Business Intelligence Business Specialist Cordinator Research Leerhuis Projectmedewerker van de Onderzoeksschool
Organization Rijnstate Ziekenhuis St. Elisabeth Ziekenhuis Medisch Centrum Alkmaar Reinier de Graaf Groep 2. Nederlandse Internisten Vereninging 2. DCTF 3. Rijnstate Ziekenhuis Maasstad Ziekenhuis Spaarne Ziekenhuis, Kennemer Gasthuis Catharina Ziekenhuis Isala Klinieken Onze Lieve Vrouwe Gasthuis St. Antonius Ziekenhuis Nieuwegein Medisch Centrum Leeuwarden Meander Medisch Centrum Medisch Centrum Haaglanden STZ VGZ Atrium Medisch Centrum Sint Lucas Andreas Ziekenhuis
Senior beleidsadviseur Hoofd medische educatie en research support Seniorsenior beleidsadviseur opleiding en onderzoek Science Officer Communicatie Manager Wetenschap en Kennis Voorzitter bestuur Stafbestuurder, hematoloog Directeur 1. Internist-nefroloog 2. Opleidingscoordinator 3. Bestuurslid Spaan Voorzitter raad van bestuur Spronk Intensive care arts Nat, van der Senior Advisor to the Board of Directors Veenhoven 1. Medisch manager 2. Kinderarts Veltman Staffunctionaris wetenschapsbureau Vos Wetenschapscordinator Wermeskerken, van Research Coordinator
Colophon
Developer
The Decision Group
Postbus 54 3620 AB Breukelen - the Netherlands +31(0)346-574942 www.thedecisiongroup.nl www.healthoutlook.nl*
Partner
Bureau STZ
Postbus 9696 3506 GR Utrecht - the Netherlands +31(0)30-2739414 www.stz.nl
Photography
Rebke Klokke, Utrecht www.arebkeoriginal.com
Printer
Reflextra Printing & Design, Utrecht www.reflextradesign.nl
* For extra version of the Dutch Health Outlook 2013 100 see also www.healthoutlook.nl