|
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
A journal dedicated to
allied health professional practice and education http://ijahsp.nova.edu Vol. 3 No. 4 ISSN 1540-580X |
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
A Peer Reviewed Publication of the College of Allied Health & Nursing at Nova Southeastern University |
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Correspondence:
Citation:
Introduction A number of authors have argued that the profession continues to be in its “infancy” relative to EBP , and that the profession needs to move more quickly toward practice that is more formally based on scientific evidence.2-7 Others have expressed concerns about some aspects EBP as they related to clinical research and practice. For example, in an editorial titled, “The End of Evidence-based practice?” Baxter has argued that “… it would appear that an increasing number of clinicians and researchers have become tired of hearing the message that their work to date has been of variable or poor quality, and that further (better designed) research is urgently needed.”8 Others have argued against the emphasis on the relative strength of randomized controlled trials (RCTs) in physical therapy clinical research.9-11 Therefore despite the high visibility of this issue within the profession, all physical therapists, including clinicians and researchers, are still faced with many questions and uncertainties about the relevance of EBP to clinical practice. The purpose of this paper is to review and synthesize the physical therapy literature in an effort to elucidate issues pertaining to EBP in PT as they have evolved over the past 15 years. In addition, the paper will attempt to identify challenges and barriers that exist relative to EBP in PT practice and begin to articulate some possible solutions to these challenges.
Methods
|
|
Citations |
Category |
Type |
|
Michels, 1969 |
History/Evolution |
Editorial |
|
Basmajian, 1975 |
History/Evolution |
Editorial |
|
Bohannon, 1986 |
Mixed |
Literature Review |
|
Rothstein, 1990 |
History/Evolution |
Editorial |
|
Bohannon, 1990 |
Challenges/Barriers |
Research |
|
Newham, 1994 |
Strategies |
Editorial |
|
Carr, 1994 |
Challenges/Barriers |
Research |
|
Sackett, 1996 |
History/Evolution |
Literature Review |
|
Practice Profile Report, 1996 |
History/Evolution |
Literature Review |
|
Harris, 1996 |
Strategies |
Editorial |
|
Harrison, 1996 |
Mixed/Combination |
Editorial |
|
Bury, 1996 |
Mixed/Combination |
Editorial |
|
Mead, 1996 |
Mixed/Combination |
Editorial |
|
Sumison, 1997 |
Mixed/Combination |
Editorial |
|
Turner, 1997 |
Challenges/Barriers |
Research |
|
Closs, 1998 |
Challenges/Barriers |
Research |
|
Godges, 1998 |
Strategies |
Literature Review |
|
Richardson, 1998 |
Strategies |
Literature Review |
|
Robertson, 1998 |
Strategies |
Research |
|
DiFabio, 1999 |
Challenges/Barriers |
Editorial |
|
Turner, 1999 |
Challenges/Barriers |
Research |
|
Rothstein, 1999 |
Strategies |
Editorial |
|
APTA goals, 1999 |
Strategies |
Literature Review |
|
Vanderkooy, 1999 |
Strategies |
Research |
|
EBMWG, 1999 |
Mixed Combination |
Literature Review |
|
Ritchie, 1999 |
Mixed Combination |
Literature Review |
|
MacIntyre, 1999 |
History/Evolution |
Literature Review |
|
Wakefield, 2000 |
Strategies |
Literature Review |
|
Guyatt, 2000 |
Strategies |
Literature Review |
|
Bithell, 2000 |
Mixed/Combination |
Editorial |
|
Sackett, 2000 |
Mixed/Combination |
Literature Review |
|
Turner, 2001 |
History/Evolution |
Literature Review |
|
Sherrington 2001 |
History/Evolution |
Editorial |
|
Connolly, 2001 |
Challenges/Barriers |
Research |
|
Metcalfe, 2001 |
Challenges/Barriers |
Research |
|
Wade, 2001 |
Challenges/Barriers |
Literature Review |
|
Fritz, 2001 |
Challenges/Barriers |
Editorial |
|
Rothstein, 2001 |
Challenges/Barriers |
Editorial |
|
O’Brien, 2001 |
Strategies |
Literature Review |
|
Ottenbacher, 2001 |
Strategies |
Literature Review |
|
Ritchie, 2001 |
Strategies |
Literature Review |
|
Walker, 2001 |
Strategies |
Literature Review |
|
Cibulka, 2001 |
Strategies |
Literature Review |
|
Walker-Dilks, 2001 |
Strategies |
Literature Review |
|
Maher, 2001 |
Strategies |
Literature Review |
|
Scalzitti, 2001 |
Strategies |
Literature Review |
|
Herbert, 2001 |
Mixed/Combination |
Literature Review |
|
Barnard, 2001 |
Mixed/Combination |
Research |
|
Parker-Taillon, 2002 |
History/Evolution |
Editorial |
|
Cormack, 2002 |
Strategies |
Literature Review |
|
Haynes, 2002 |
Mixed/Combination |
Literature Review |
|
Scherer, 2002 |
Mixed/Combination |
Editorial |
|
Kamwendo, 2002 |
Mixed/Combination |
Research |
|
Pomeroy, 2003 |
Challenges/Barriers |
Research |
|
Miller, 2003 |
Challenges/Barriers |
Research |
|
Rich, 2003 |
Strategies |
Literature Review |
|
Pomeroy, 2003 |
Strategies |
Literature Review |
|
Gibson, 2003 |
Strategies |
Literature Review |
|
Morris, 2003 |
Strategies |
Editorial |
|
Baxter, 2003 |
Mixed/Combination |
Editorial |
|
Jette, 2003 |
Mixed/Combination |
Research |
|
Jette, 2003 |
Mixed/Combination |
Editorial |
|
Rothstein, 2004 |
Strategies |
Editorial |
|
Maher, 2004 |
Mixed/Combination |
Literature Review |
Despite numerous calls for a shift toward the use of research and scientific evidence to guide practice, most physical therapists continued to base practice decisions largely on anecdotal evidence, and utilized treatment techniques with little scientific support.16-21 Studies published in 1997 and 1999 indicated that physical therapists tended to rely more heavily on initial education and training when selecting treatment techniques. In fact, less than five percent of survey respondents indicated that they regularly used scientific evidence to guide practice.17,22 Personal experience and “expert” opinion guided clinical decision making throughout the 1990s.17,22-24
Within the PT profession, the call for a commitment to EBP has gradually became more strident and has corresponded with similar ongoing efforts in other health care professions.2,5,11,25,26 Many PT professional organizations have identified EBP as a priority.1,26-30 Numerous authors have stated that physical therapists have a moral, professional, and ethical obligation as professionals to provide evidence based service and to move away from interventions based solely on anecdotal testimonies, expert opinion, or physiologic rationale.1,2,4,9,17,25,31-33 The ultimate goal of this increased emphasis on using evidence to guide practice is to build a body of knowledge that supports the effectiveness of that practice.5,28 As Harris noted, “It is high time for physical therapists to ensure that the treatments they are endorsing and providing for their clients are based on the strictest rules of experimental design and scientific evidence.”4
The evolution of EBP in PT corresponds with a shift away from traditional models of practice in which uncertainty was seen as a failing. In these traditional models, individual expertise was afforded a high priority and expert clinicians were thought to be those who always “knew what to do,” not those who questioned what they do.5 The early formulations of EBP discouraged clinical decisions based on individual clinical expertise and physiologic rationale. Subsequent iterations have emphasized that research evidence alone is not an adequate guide to action.34 As noted by Sackett et al, clinical expertise must be informed but cannot be replaced by evidence alone.12 Evidence-based practice is not recipe-based. It requires physical therapists to integrate individual clinical experience with an understanding of the rules of evidence and the relevance of these rules to practice.35 Practitioners must also consider the individual values and needs of the patient and the unique circumstances of the clinical environment. Scientific evidence should be used to inform this process, not replace it.2,5,12,25,31,33 Evidence-based practice is now considered to be a process that leads to a specific decision for an individual patient and is predicated on a number of clinical judgments that are directly related to the expertise of the clinician.2,5,25,36,37 Physical therapists should strive to use research evidence in a systematic way, in conjunction with clinical judgment, to make clinical decisions.
The goal of EBP is to use the knowledge created by scientific research in practice.1 This cannot happen without clinicians, as they are the interface. The promotion and development of a clinical “culture” that understands research, values the evidence generated by that research, and demands to be informed is essential. However, clinicians are often unclear as to the definition of EBP and they may not understand the types of research that constitute high quality evidence.31 Therapists often have difficulty applying research findings to individual patients and are unclear as to whether high quality evidence exists to support or refute therapeutic interventions.35 Much of what physical therapists do awaits definitive research to establish its efficacy.33 In many instances there is little evidence to support or refute current practices.33 Clinicians’ negative attitudes about research further compound the difficulties.32 In summary, the transition to EBP will not readily occur if clinicians do not know about the evidence, do not understand it, do not believe in it, or do not know how to apply the findings.33
Challenge #1: Research
Methods
According to Sackett et al, the quality or strength of research evidence is
classified according to a five-level hierarchy that sorts evidence according
to rigor and potential for confounding variables to influence the research
outcomes.38 For example, scientific evidence generated by
systematic reviews of RCTs is at the top of this hierarchy while case
reports and expert opinion are at the bottom.38 Physical
therapists are encouraged to consider a study’s “level of evidence” in the
process of making evidence based clinical decisions. EBP implies that
clinicians use the best available research, based on this hierarchy, to
guide clinical decision making.36 Clinicians have a moral
responsibility to know about the strength of available evidence relating to
assessments and interventions, and to consider this when making decisions
about patient management.6
One challenge for clinicians attempting to utilize this hierarchy has been the application of results from RCTs to physical therapy practice. Some authors have suggested that physical therapists only read and utilize RCTs when seeking out evidence for practice and to disregard lower levels of evidence.39 However, there are inherent difficulties in applying evidence generated by RCTs to a clinical population.9 For example, the array of unique clinical circumstances a therapist treating a child with cerebral palsy must take into consideration is daunting. These include, but are not limited to, the child’s age, type of cerebral palsy, motor ability, cognitive ability, behavior and motivation, family involvement and support, home environment, and educational placement. The results from highly controlled RCTs often are not directly applicable to an individual patient. Thus the practitioner is required to make an interpretative “leap” in determining whether the results from any research, including RCTs, yields the best evidence to support a clinical decision.8,40 As noted by Bithell, “…There is no intrinsic reason why a clinical experiment developed to prove pharmacological efficacy should be the best way to demonstrate effectiveness of therapies which depend so much on human interaction.”9 The concept of a hierarchy of evidence, as derived from medicine and pharmacologic investigations may not always be applicable to the array of factors that influence physical therapy outcomes because of the variability inherent in these types of patients, in patient-therapist interactions, and even in statistically significant results.9,40
Several other limitations related to the perceived “gold standard” of RCTs have been identified.9,10,25,40-42 In physical therapy, RCTs are typically efficacy studies involving distinctly selected patient subgroups in university medical facilities. This information is not always relevant to real-world clinical practice.10,25 In addition, the research procedures of randomly assigning patients to an experimental or control group, using standardized outcome measures that may not have real-world relevance, and the difficulty of blinding investigators and clients to the research procedures all make RCTs difficult for physical therapists to implement, interpret, and utilize.10,41
Along with the methodological limitations, there is often a difference between an optimal and objective research outcome, and an optimal individual clinical outcome. Physical therapy intervention is typically complex, long term, and specifically related to the patient. Translating research results, even those results from high quality RCTs, into specific clinical decisions for an individual patient or client is challenging.1,40,41 Teasing out one aspect of a clinical intervention for study in isolation may lead to what has been termed a Type III error, whereby the interactive effects of an intervention are not considered.43The scientific method focuses on one variable at a time across a given number of identical research subjects to determine a single generalizeable outcome. Clinical practice deals with countless variables at a time with one person in order to generate a range of outcomes intended to satisfy that person’s goals, needs and desires.11 Oftentimes, efficacious research regimens that work under ideal research conditions are not implemented if they do not address relevant clinical issues and cannot be applied to individual patients.1,44,45 A recent review of research and review articles in four national physical therapy journals during a 12-month time period produced a relatively small yield of articles containing scientific evidence that was both clinically useful and of high quality.46 An important and ongoing challenge for researchers is to generate clinically relevant findings that subsequently influence practice.1,47
Challenge #2: Clinicians’
Skills
EBP requires clinicians to read current research literature, understand
research methodology, and incorporate best evidence into practice as
appropriate. However, many clinicians have difficulty accessing and
interpreting the evidence that does exist. Even if research evidence is
available, it may be difficult to use in client-centered practice.48
The research literature may be difficult to access and relevant information
is often not compiled in one place. The evidence that does exist may be
conflicting or have methodological flaws.40,49 Interpreting and
implementing research evidence also requires clinical skill, judgment, and
experience. Deciding what constitutes evidence that justifies a change in
practice is not simple, and the opportunity for bias exists at every stage
of the process.40,45,50 For example, some have suggested that the
nature of scientific inference leads to an inevitable subjectivity in
interpreting and implementing evidence.40,51 Others have
suggested that changing clinical practice to implement therapies that have
not been sufficiently tested across a wide variety of settings in
multi-center RCTs constitutes “evidence-tinged” practice and is
inappropriate.45 Interestingly, no definitive evidence has
accumulated over some 15 years of research and debate on EBP to show that
‘practice by EBP’ is superior to ‘practice as usual,’ or that patients who
receive interventions from evidence based practitioners achieve superior
outcomes when compared to those who do not.52
An often overlooked element of clinicians’ skills in EBP is that
clinicians must critically evaluate their own individual practice.48
Physical therapists should regularly question habituated and traditional
practice and seek evidence to support clinical decision making.53
Subsequently, practitioners must also critically reflect on the application
of evidence-based interventions with each individual patient, and alter
practice accordingly. Failure to consider all aspects of EBP, including
critical self-evaluation, during clinical decision making may lead to a
decrease in effectiveness.53,54
Challenge #3: Logistical
Considerations
A number of other factors present challenges to clinicians who are
attempting to use evidence to guide clinical decision making. Time
constraints are almost universally identified as a primary limiting factor.5,26,31,35,36,55,56
Clinicians refer to pressures of today’s health care environment and
administrators’ emphasis on productivity as factors that directly inhibit
their ability to seek out, gather, read, and integrate scientific
information relevant to daily practice.31,35,49,55-57
Practitioners in settings not affiliated with teaching or research
institutions often face challenges in accessing relevant scientific evidence.31 Clinicians may lack essential skills relative to
using technology to complete literature and database searches.26,35,56
Finally, many practitioners lack the skills that are necessary to understand
statistical analyses and research processes.26,30,31,34,35,46,49,56-58
Clinicians also face difficulties in implementing changes in practice.35,49 This may be due to resistance from other health care providers, including physicians and peers. 30,31,49,57,59 Institutions may be reluctant to support changes, especially when financial considerations are involved.30,31,35,59 EBP is not necessarily less expensive, and therefore changes in practice as a result of EBP may be met with some resistance.14
Strategies for Effective
Evidence-Based Practice
Despite the many challenges, physical therapists have indicated that they
value the integration of scientific research into clinical practice.17,26,31,35,49,56
In a recent survey, 85% of physical therapy respondents indicated a strong
willingness to improve skills relative to EBP.35 However, the
evidence suggests that despite this willingness, most physical
therapists continue to base practice decisions on the information learned
during entry-level education and personal experience rather than on
information gathered from research literature.15,17,22,55,58In
fact, use of journal articles and research literature to guide practice was
virtually absent in a survey of physiotherapists from England and Australia.17
And, in a recent survey, only 58% of physical therapist respondents reported
that they currently possessed sufficient knowledge and skills to read and
evaluate research reports published in scholarly journals.60Students
just entering clinical practice did not sustain beliefs about appropriate
sources of authority for treatment decisions that were established during
entry-level education.30This may indicate that these early
beliefs were not supported by fellow practitioners and administrators in the
clinic.30These results lead to the inevitable suspicion that for
many practitioners, the use of scientific evidence to guide practice may not
be modified following entry-level education.17
Despite these factors, a number of strategies have been suggested as a means of bridging the gap between research evidence and clinical practice.
Strategy #1: Develop,
Implement, and Evaluate Dissemination Techniques Specific to EBP
There is surprisingly little information on determining the best way to get
the results of sound physical therapy research into clinical practice.54
Several strategies have been designed to aid clinicians in identifying
specific clinical problems, fostering collaboration among clinicians,
reinforcing desirable clinical-research practices, and addressing
institutional barriers to change. Many of these programs are aimed at
integrating external clinical evidence from systematic research into
practice within a particular clinic, and have been described in detail.7,36,58,61-63
A critical aspect is to create a change in management culture and a change
in administrators’ and supervisors’ attitudes.17,32,49,54,56,58,62
Implementation strategies that focus on a specific problem, involve
collaboration among clinicians, reinforce desirable practices, and address
barriers to change, such as organizational factors in the practice setting,
are more likely to lead to permanent behavioral change.54,58
There is little evidence to support the use of passive dissemination techniques such as didactic lectures, workshops and handouts in order to effect a positive change in EBP related activities.37,49,58,62,64 However, a variety of strategies that are specific to EBP and focus on a comprehensive implementation plan have been shown to be successful in creating behavioral change relative to EBP. 32,54 These programs have generally included some explicit guidance regarding the process of EBP.7,35,36,47,58,62,63,65 Some have also recommended specific strategies to effectively implement each component of EBP within a particular clinic.36,58,62 Many programs emphasize the importance of minimizing barriers to implementation and promoting factors that enhance implementation, including such aspects as an emphasis on ethics, incentives, motivation, social norms, patient problems and decision support systems.58,62 An important aspect of many of the programs has been to identify EBP as an intellectual challenge and a critical element of individual professional development, not as a management imperative. Some programs focus on the creation of a culture change from the staff level up, engaging managers and administrators in the process as well.56,58 Finally, several other strategies have focused on multi-faceted and interactive educational programming, utilization of small groups of staff to find and report research findings, allocation of specific time for reading and discussing articles, use of hospital clinic audit teams, journal clubs, and providing clinicians with opportunities for experiential learning through collaborative participation in clinical research.1,7,17,46,49,54,56-58
Strategy #2: Re-Think
Traditional Continuing Education Courses
One strategy that continues to be employed by physical therapists to gain
additional skills and to guide practice decisions is attendance at
continuing education conferences.4,54 Recently practitioners have
been urged to request evidence from conference speakers in order to
critically evaluate any claims of effectiveness.4,6,32,66 Others
have suggested that time spent at continuing education conferences may be
better spent by individuals or in small groups answering their own clinical
questions via EBP.5,32 Many clinics have limited continuing
education funds, making travel to conferences difficult for practitioners.
Perhaps the time spent traveling to and attending continuing education
conferences may be better spent on structured and focused EBP activities
within a particular clinic.
Strategy #3: Development,
Implementation, and Evaluation of “User-Friendly” Knowledge Transfer
Activities
Simply publishing results is not enough to change practice.2
Physical therapists are generally eager to use proven and effective
treatments and agree that the use of evidence in practice is necessary.35,44
However, barriers do exist and should be taken into consideration when the
results of a research study are reported.54 Clinicians may
benefit from “hands-on” guidance from academicians and researchers regarding
best clinical evidence and its implementation. Multi-faceted interventions
such as outreach visits, ongoing interactive educational opportunities for
clinicians, and journal clubs involving academics, clinicians and
researchers, should be employed.17,32,49,54,56,58,62 Active and
ongoing interaction and collaboration is especially important given the
prominent role that clinicians play in entry-level education.
Physical therapists have been urged to follow specific guidelines when seeking and utilizing scientific evidence to support a specific intervention.4,42 These guidelines serve to aid clinicians to systematically evaluate the available evidence and determine its usefulness to clinical practice. However, because of the challenge of reading and interpreting a large number and wide variety of primary research articles, some have suggested that it may be more appropriate for clinicians to utilize secondary sources such as clinical guidelines, systematic reviews, journals that publish summaries of information from primary sources, and databases.50
It may be unrealistic to expect clinicians to implement research findings directly into clinical practice without some adaptation and guidance.44,47,54 Some have suggested a re-thinking of the way research results are presented in professional journals.67 One approach has been through the use of “critically appraised topics” or CATS.47 A CAT is a summary of the best available evidence to answer a clinical question and includes a clinical “bottom line” to guide practitioners in interpreting the evidence.47 They are concise, devoted to specific case scenarios, and recommended to be updated every two years.47 CATS and other means of disseminating the evidence should be explored and evaluated for their effectiveness. A similar approach has been undertaken by the American Physical Therapy Association (APTA). Hooked on Evidence is a "grassroots" effort to develop a database containing current research evidence on the effectiveness of physical therapy interventions. The Hooked on Evidence project was motivated by a concern that clinicians lacked access to the knowledge available from current research, thus hindering evidence-based practice. Hooked on Evidence was developed to provide members of the APTA with rapid and easy access to a wide variety of research articles from the peer-reviewed literature. Members of the APTA are able to access and contribute to this database, which consists of a summary of the key points in each article.68
Strategy #4: Highly
Visible Role for Professional Associations
Professional associations need to play a prominent role in fostering EBP and
helping change negative attitudes that exist among physical therapists.31,32,44
Professional associations should work to establish a framework for
implementing EBP, and work to create increased consistency of the process.7,2