Documente Academic
Documente Profesional
Documente Cultură
OF THESE DIAGNOSIS IS BY FAR THE MOST IMPORTANT, FOR UPON IT THE SUCCESS OF THE OTHER TWO DEPENDS." The natural history of disease 2nd ed. Oxford University Press, 1948
RYLE J.A.
EBLM Conscientious explicit and judicious use of current best evidence in Laboratory medicine for making well informed decision
COMPONENTS OF EBLM
Individual expertise
EBLM
Increased innovation Greater knowledge Increased workload More spending Patient expectation
New technologies New treatments & Diagnostics More patient visits Salary and other costs More knowledge from internet
Legal aspects
What is particular to laboratory medicine? Limited number and poor quality of studies linking test Results to patients benefits. The poor perception of the value of diagnostic tests. The ever increasing demand for tests. The disconnected approach to resource allocation.
Silo budgeting
How to practice ?
1. Identification of question
2. Track down the best evidence
ASK Acquire
ACT
5. Evaluate
AUDIT
Elements of EBLM
Convert a clinical situation into a searchable, (and hopefully answerable) question using
PICO
PATIENT INTERVENTION COMPARISON OUTCOME
Patient refers to atient or Problem the person presenting with the ntervention problem, or more simply, to the omparison problem itself. Both concepts are utcome important in searching.
atient or Problem
ntervention omparison utcome
Intervention refers to the action taken in response to the problem. This is often a drug or surgical procedure, but it can take many forms
Comparison refers to the benchmark against which the intervention is measured. Often it refers to another treatment, no treatment, or a placebo.
atient or Problem
ntervention omparison utcome
QUESTIONS TO BE ASKED
CARO C: Case A: Assay R: Reference O: Outcome QUESTIONS
What are the patient characteristics, conditions, symptoms, demographics ? Which procedure or strategy is considered ? What is the standard procedure, the comparator ?
What is the interest, the diagnostic validity ? Sensitivity, specificity, predictive values, prognosis ?
Types of question
2. How well does the use of N terminal Pro B type Natriuretic peptide as a guide to therapy.
3. Improve the length of hospital stay and the rate Of subsequent readmission for heart failure ?
An important goal of studies of diagnostics test is to Determine whether the new test adds information to that known from patient observation or other investigations
Original Studies
OR SUMsearch or TRIP
Choosing Resources
Background
Rare
Foreground
Unfiltered Database (e.g. MEDLINE) Filtered/ Pre-appraised Evidence
Common
Textbooks
Where to search ?
It is best to start the search with looking for External evidence based guidelines that can be Adapted. The search for evidence usually starts in databases Such as the Cochrane Library which contains high quality Systematic reviews or meta analysis.
If a search is not successful in the secondary Literature one can look for primary reports in the Medline. Use Pub Med for the search of Medline.
The best single search term for laboratory test Is sensitivity . However the word diagnostic test, Diagnosis Diagnostic use combined with the corresponding Clinical condition ( eg: Chronic renal failure)and Finally the name of the test ( eg: Soluble transferrin Receptor.
Definitions
Review articles A broad overview of a topic, similar to a textbook chapter.
Often covers multiple, background aspects of a disease such as natural history, etiology, epidemiology, signs & symptoms, diagnosis, treatment, and prognosis. The article summarizes the results from many other primary studies. The studies to summarize are chosen at the discretion of the author.
Definitions
Review articles A broad overview of a topic, similar to a textbook chapter. Systematic Review A type of review article that focuses on a focused clinical question
Studies are chosen using a standardized protocol to minimize selection bias.
Definitions
Review articles A broad overview of a topic, similar to a textbook chapter. Systematic Review A type of review article that focuses on a focused clinical question
Meta-analysis A type of systematic review in which the numerical results from individual studies are mathematically combined to give a single, overall estimate of treatment effect.
Definitions
Review articles Systematic Review Meta-analysis
A systematic review can be thought of as a research project done on the medical literature itself. Instead of human beings acting as subjects, the subjects of a systematic review are individual RCTs
Essential Concepts
Three concepts are essential to understanding the critical appraisal of systematic reviews. These are:
Publication bias. Publication bias is one of the factors that systematic reviews attempt to avoid by selecting studies in a systematic way.
Heterogeneity. Heterogeneity is a statistical measure of the difference between the results from different studies. The less heterogeneous results are, the easier it becomes to estimate overall effect.
Forrest Plots
Forest plots. These graphical displays show study data in a way that makes it easy to see similarities and differences between studies.
Look at the title of the forest plot, the intervention, outcome effect measure of the investigation and the scale
The label tells you what the comparison and outcome of interest are
The names on the left are the authors of the primary studies included in the MA
The small squares represent the results of the individual trial results The size of each square represents the weight given to each study in the meta-analysis
Horizontal lines are confidence intervals Diamond shape is pooled effect Horizontal width of diamond is confidence interval
Effect of probiotics on the risk of antibiotic associated diarrhoea
The vertical line represents the line of no effect, i.e. where there is no statistically significant difference between the treatment/intervention
The vertical line in middle is the line of no effect For ratios this is 1, for means this is 0
Effect of probiotics on the risk of antibiotic associated diarrhoea
Pai M, et al. Comparison of diagnostic accuracy of commercial and in-house nucleic acid amplification tests for tuberculous meningitis: a meta-analysis. Poster presented at the American Society for Microbiology, 2003
Funnel plots
A funnel plot is a scatter plot of treatment effect against a measure of study size.
64
Funnel Plots
attempt to detect bias in study selection results of each study plotted against sample size what should we expect?
65
Why Funnel?
precision in the estimation of the true treatment effect increases as the sample size increases. Small studies scatter more widely at the bottom of the graph
In the absence of bias the plot should resemble a symmetrical inverted funnel
66
Funnel Plot
Favors Treatment
Favors Control
Odds Ratio
67
Funnel Plot
Favors Treatment
Favors Control
Odds Ratio
68
Funnel Plot
Favors Treatment
Favors Control
Odds Ratio
69
Funnel Plot
Favors Treatment
Favors Control
Odds Ratio
70
71
72
Publication Bias
Asymmetrical appearance of the funnel plot with a gap in a bottom corner of the graph
73
Inappropriate aggregation of studies A meta-analysis is only as good as the papers included Tend to look at broad questions that may not be immediately applicable to individual patients
1b
II
III
IV
Supported by at least two independent studies of level II Not supported by sufficient studies of level I of II Advices of experts
2. Study design
3.Spectrum of patient and patient setting.
8. Comments on specific issues raised by the study. ( biases) 9.Quality rating and level of evidence of the study.
The extent to which the studys design, conduct, And analysis have minimized selection, measurement and Confounding bias. 2.Quantity of evidence:
The number of studies that have evaluated the given Topic and the sample size of each study. 3. Consistency of the evidence.
Meta-analysis Software
Free RevMan [Review Manager] Meta-Analyst Epi Meta Easy MA Meta-Test Meta-Stat Commercial Comprehensive Metaanalysis Meta-Win WEasy MA General stats packages Stata SAS S-Plus http://www.prw.le.ac.uk/epidemio/personal/ajs22/meta/
Then what is needed ? Critical appraisal skill Competent understanding of the strengths and weakness of systemic Reviews and meta analysis
The laboratory personnel must direct more effect to demonstrate the impact of laboratory tests on a greater variety of clinical outcomes.
DIAGNOSIS WORKSHEET
Can We Apply This Valid, Important Evidence About a Diagnostic Test in Caring for Our Patient?
Is the diagnostic test available, affordable, accurate, and precise in our setting?
Can we generate a clinically sensible estimate of our patients pre-test probability (from personal experience, prevalence statistics, practice databases, or primary studies)? Will the resulting post-test probabilities affect our management and help our patient? *Could it move acrosis a test-treatment threshold? *Would our patient be a willing partner in carrying it out? Would the consequences of the test help our patient?
Introduction Probands
Conclusion
Clinical application
Test
Question
Result
Action
Outcome
Troponin I
Has the patient 7.2g/L Decide to admit, had a MI Intensive care Is this breathless patient suffering from Heart failure 56ng/L Seek alternative diagnostic method
BNP
HbA1C
Promises of EBLM
It ties clinical practices to scientific standards of evidence Able to draw upon the objective experience of many researchers working with accepted scientific standards of evidence EBLM should also promote greater uniformity
Critics
Standard guidelines Disincentives of individual innovation Becomes more like cook book medicine
Recommendation ?
NO
Highest level of evidence may not provide the Strongest recommendations in some local contest. The evidence must be supplemented with considered Judgment of the potential clinical benefits and harms Patients preferences
In patients presenting with complaints with symptoms Of tongue and mouth the prevalence of Vit B12 Deficiency in only 8%. The relatively low cost of Testing for B12 deficiency And availability of effective treatment may counter Balance the low probability of this cause. Might lead to recommendation of B12 testing in One community . But not so in another community because the relative Costs may be different.
An example where patients choices are considered Is the triple test used for antenatal screening of Downs screening. The consequences of positive screening test is Amniocentesis which may harm the fetus. And in positive cases an abortion may be required.
BUT
Good professionals should treat guidelines more as options. As True standards and professional organizations do not enforce adherence. Change in health care is possible with guidelines. Its creation and Implementation reflects the collaborative nature of health care.
Future
Establish a culture of EBLM
How ?
Change the pattern of Journal Club start from the Residents
Crombie I (1996) The Pocket Guide to Critical Appraisal, BMJ Books, London
Greenhalgh T (2001) How to Read a Paper, BMJ Books, London BestBETs CA database
http://www.bestbets.org/cgi-bin/browse.pl?~show=appraisal
Impact of EBLM