Quantitative Research

THE READER'S COMPANION WORKSHEET

Article Title: A Controlled Comparison Study of the Efficacy of Training Medical Students in Evidence-Based Medicine Literature Searching Skills

Author(s): Larry D. Gruppen, PhD, Gurpreet K. Rana, MLIS, and Theresa S. Arndt, MLS

TITLE

Topic of interest: Yes • No o Maybe o

Method of interest: Yes • No o Maybe o

Population of interest: Yes • No o Maybe o

ABSTRACT

Results useful? Yes • No o Maybe o

INTRODUCTION

Why was the study done (i.e., problem, concern, issue)?

Although evidence-based medicine (EBM) is the best method to use in order to resolve patients' healthcare concerns, healthcare students tend to be 'generally

weak' when actually using this method (Gruppen, Rana, and Arndt, 2005). The study was performed to investigate the benefit of training in EBM research

methods.

What is the purpose of the study or what questions is the investigator trying to answer (e.g., literature review)?

The investigator was trying to discover whether or not students' searches improved after they were trained in EMB research methods.

What are the central concepts and variables (e.g., pain level, confidence, exercise activity)?

Information literacy level of students before attending the training

Confidence with databases used to perform searches

The experimental (independent) variable is defined as:

Whether or not students received EBM research training

The outcome (dependent) variable is defined as:

The students' abilities to perform certain searches one month after their completion of the course

Other variables that the researcher has not thought about that might influence the results are:

Whether or not students chose to attend the classes

 Students' abilities to absorb and remember lessons

Note that sometimes there are many factors included in descriptive surveys and not a primary or secondary outcome. If this is the case in the

article that you are reading, provide an overall description.

Are most of the references recent (less than 5 years old)? Yes o No •

If not, is this a classic/groundbreaking reference or one that has reemerged in importance (e.g., research relating to tuberculosis)? No,

the sources include very old systematic reviews, as well as standards of information literacy

Are experts cited? Yes • No o Not sure o

METHODS

Design

What is the research design (e.g., survey, case-control, cohort study)?

Case-control

Sample

What are the characteristics of the participants who were included and excluded from the study (e.g., health status, age, education, gender,

ethnicity, occupation, geographical residence, socioeconomic status)?

Fourth-year medical students, age unspecified

Included: Medical students

Excluded: Non-students

Are the participants similar to those in your setting?

Yes • No o Somewhat o

What are the procedures for choosing participants (e.g., convenience, quota, random selection, volunteers)?

Volunteers

Do you think the methods used to select participants for the study biased the results?

Selection bias: Yes • No o

If yes, how?

Students who chose to participate in the class may have been weak in EBM research skills, and so may have begun with a lower information literacy level.

Were there many refusals, withdrawals, dropouts, or deaths?

No

Participation bias Yes o No •

Research Ethics Concerns

Was informed consent obtained? Yes • No o

Were the participants reasonably able to take part? Yes • No o

Was the study potentially/actually harmful to participants/others? Yes o No •

List any ethical issues that are of concern to you as a reader and potential user of the research (e.g., truthfulness, confidentiality, coercion). All of

the above

Setting

What was the environment in which the data were collected?

Home setting o Private room o Laboratory o Other e

Experiment (if applicable)

What was the special treatment or intervention?

The special treatment was a four-week class that students could take

Did the participants in the study know whether they received the intervention or a placebo? Yes e No o

What methods, if any, were used to "blind" the participants, staff, and data collectors from knowledge about the study that might influence the results?

N/A

Was there any contamination or mixing of treatments across the study groups? Yes o No•

Were there any other factors related to the intervention/treatment that might have influenced the outcomes?

Performance bias: Yes o No •

If yes, what were they?

Data Collection

What was the data collection method/tool used?

Questionnaire o Interview o Chart review o Procedure o

Observation • Other o
Were methods used to ensure that data were reliably collected (e.g., differences between raters, differences between times of measurement)? Yes o

No o Not reported •

If yes, what were they?

Were methods used to ensure the validity of the collected data (e.g., expert review, comparison with other measures)? Yes o

No o Not reported •

If yes, what were they?

Do you think that the measurement methods biased the results?

Measurement bias Yes o No •

If yes, how?

Data Analysis

What statistical methods were used to analyze the data?

RESULTS

Was the response rate satisfactory? Yes • No o Not sure o

What are the main findings of the study?

Intervention and training about how to improve students' EBM research skills ends up improving their research skills.

What information is presented in tables, figures, or graphs? Are these easy to understand or confusing?

The information was presented in tables, which were easy to understand.

Were any of the findings statistically significant? Yes • No o Not sure o

If yes, what were they?

Students who received the training showed that their research results improved by 12%.

Were there clinically meaningful results/trends?

Yes o No o Not applicable o Not sure •

If yes, what were they?

DISCUSSION

Do you agree with the investigator's opinions? Yes • No o Somewhat o

If not, why not?

Are the results consistent with those of past research?

Yes • No o Not applicable o

If not, why not?

Does the interpretation make sense theoretically? Yes • No o Not sure o

If not, why not?

Does the interpretation make sense clinically? Yes o No o Not sure •

If not, why not?

OVERALL IMPRESSIONS

Overall, is the article important or significant for the practice of health care?

Yes o No•

Do the findings resonate (seem correct and familiar) with you and your practice?

Yes o No•

If yes, why?

Major limitations of the study (two or three):

The size of the sample was small

The researchers lost some data due to technical problems

Major strengths of the study (two or three):

The sample group were willing participants The study concluded with an obvious result

Are the results applicable or relevant to other settings, populations, or disciplines?

They are significant, because they show that training in research strategies provides better research results.