- Research article
- Open Open Peer Review
Barriers to the conduct and application of research in complementary and alternative medicine: a systematic review
BMC Complementary and Alternative Medicinevolume 17, Article number: 166 (2017)
The popularity of Complementary and alternative medicine (CAM) has grown considerably over the past few decades. This has been accompanied by increasing public pressure for CAM to be evidence-based. Notwithstanding, the conduct and application of research in CAM faces a number of obstacles. No systematic review has mapped these barriers to date. Therefore, this systematic literature review aimed to explore, identify and map the barriers to the conduct and application of research in CAM.
Systematic searching of MEDLINE, Embase, AMED, CINAHL, The Cochrane library, Google scholar and Google was conducted between February and June 2016 for pertinent publications. Pearling (secondary searching) of retrieved publications was also undertaken. Literature published only in English were included; however, no year limit was placed for searching. Two critical appraisal tools were used to critically appraise descriptive studies and opinion publications.
A total of 21 eligible publications were included in this review; this comprised of eight primary research articles and thirteen opinion publications. A critical appraisal process found two categories of good quality publications while recognising their limitations in terms of descriptive and opinion publications. The synthesised data from the selected publications about the barriers to the conduct and application of research within CAM were captured within two broad components, namely capacity and culture. Capacity encompassed elements such as access, competency, bias, incentives and time. Encompassed within culture were elements relating to the values and complex system of CAM.
Multiple barriers exist for the conduct and application of research in CAM. Given the growing popularity of these therapies, it is essential that the evidence base underpinning CAM also continues to expand. Without overt recognition of these barriers, enabling strategies cannot be applied. By addressing these barriers, CAM professions will be able to develop a critical mass and a well-coordinated research effort to assist the integration of evidence – based practice in CAM.
The use of Complementary and alternative medicine (CAM) has been steadily rising in Western countries where biomedical sciences have typically dominated the healthcare system [1, 2]. According to the World Health Organisation, there are an estimated 100 million users of CAM in Europe [3, 4]. In the United States of America (USA), close to 33.2 million US adults and children use some form of CAM . High prevalence rates of CAM use are also reported in other developed countries, such as Australia , Korea , Canada , Singapore  and Japan .
Despite the growing popularity of CAM, there has been a renewed focus on the evidence-base of CAM [11, 12] with calls for CAM to demonstrate its effectiveness . This focus for evidence in CAM has been increasingly talked about at a national and international level. For example, in the United States of America, The National Institutes of Health has established the National Center for Complementary and Integrative Health to carry out rigourous scientific investigation of CAM interventions . In Australia, the National Health and Medical Research Council (NHMRC) conducted a series of reviews of CAM to determine their efficacy / effectiveness . An important driver of this renewed focus on the effectiveness of CAM is Evidence Based Practice (EBP) .
EBP has been discussed in the medical literature for several decades , yet it is relatively new to CAM. Further, even though CAM has long valued empiricism as the foundation of CAM knowledge and skills [18–20], theoretical, philosophical and cultural differences have resulted in many CAM stakeholders being opposed to the EBP movement . The reluctance to engage with EBP has resulted in ongoing scepticism towards CAM practices from stakeholders who represent mainstream health care [22–24]. Within CAM, while there has been a growing recognition for EBP , this has been constrained by a lack of reliable, trustworthy and diverse sources of research evidence [26, 27]. This can be attributed in part to CAM being a neglected area of research, with only small pockets of CAM research activity dispersed around the world .
Despite the growing popularity of CAM and the increasing need for evidence-based complementary and alternative medicine, the conduct of research (i.e. the systematic investigation of a phenomenon that serves to answer a specific research question) and application of research (i.e. the transference of research findings into clinical practice) in CAM continues to face a number of obstacles. However, no systematic review has mapped these barriers to date. Consequently, the aim of this systematic literature review was to explore, identify and map the barriers to conducting and applying research within CAM.
Systematic review of the literature and narrative synthesis.
This systematic review set out to answer the following question: What are the barriers to the conduct and application of research in Complementary and Alternative medicine?
The search strategy was guided by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines . The search was undertaken between February 2016 and June 2016. Prior to the commencement of a full search, a preliminary scoping search of CINAHL was undertaken to determine the feasibility of the review (i.e. extent of discussion on the topic) and to identify pertinent search terms. Once the search strategy was developed, it was independently checked and validated by an academic librarian at the University of South Australia.
The evidence gathering approach comprised two components: a comprehensive search of relevant databases and a search of references within eligible articles (i.e. pearling). The following databases were systematically searched (from their inception to June 2016) to identify relevant indexed publications: MEDLINE (Ovid), Embase (Ovid), AMED (EBSCO Host), CINAHL (EBSCO Host) and The Cochrane library. To avoid publication bias, a search of Google scholar and the Google search engine was undertaken to identify relevant grey literature. Pearling (secondary searching) was performed also, in which the bibliographies of included publications were screened for eligible articles. The search terms used for this review were as follows:
Complementary medicine OR Alternative medicine OR CAM
Research OR Evidence based practice
1 AND 2
No restriction was placed on the year of publication; however, language (English) and human limits were applied.
The review included any publication(s) that explored barriers to the conduct or the application of CAM research; this was framed using the Population, Interest and Context (PICo) framework . Table 1 provides an overview of the PICo components and the review selection criteria.
With regards to the conduct of research, publications had to focus primarily on CAM researchers; this could include researchers from other health disciplines (such as medicine) who were undertaking CAM research. In terms of the application of research, the core focus of the publication had to be CAM practitioners, from any CAM discipline. Any publications focusing on consumer perspectives were excluded.
The key interest of this review was the barriers to the conduct or application of research in CAM. The focus of this research was not about effectiveness, thus any research testing the effectiveness or efficacy of an intervention were excluded. Also excluded were publications discussing research methodology or cost effectiveness.
The context of the review was complementary and alternative medicine. Any research that focused on describing CAM or CAM use was excluded.
The review included any primary research article (quantitative and qualitative) or opinion publication (commentary, narrative and expert opinion). Secondary research (reviews of the literature), newsletters or opinion publications without references or a publication date were excluded.
Selection of included publications
The title and abstract of each listed publication was screened by YV. Potentially eligible publications were then retrieved as full text to determine if the publication addressed the review question and met the review inclusion criteria. A preliminary list of potentially relevant publications was subsequently generated and reviewed by each author. The authors discussed each publication until consensus was reached on the final list of included articles.
Each included paper was appraised by at least two authors, with the quality of publications assessed using one of two critical appraisal tools. The Narrative, Opinion and Text Assessment and Review Instrument (NOTARI)  was used to appraise opinion publications. This instrument contains seven criteria, which enable judgement of the source of the opinion, expertise of the authors, main focus of the article, logic of the argument, analytical development of the argument, references to literature, and peer support of opinion. Items receiving a ‘yes’ response were assigned one mark, while a ‘no’ response received zero marks. Total scores for NOTARI range from 0 to 7.
The Critical Appraisal of a Survey toolkit  was used to appraise primary research articles reporting on survey research. This toolkit contains twelve criteria, which assess the clarity of the question/issue, appropriateness of the study design, method of subject selection, possibility of sampling bias, representativeness of the study sample, pre-study considerations of sample size, response rate, validity and reliability of the questionnaire, reporting of statistical significance, reporting of confidence intervals, consideration of confounding factors, and the applicability of the results. Each criterion was assessed as either yes (criterion met), can’t tell or no (criterion not met), with a score of 1, 0 and 0 assigned, respectively. Total scores for the toolkit range from 0 to 12, with a score of 9 or more considered excellent qualities .
A customised data extraction tool was developed to extract information relevant to the aim of this review. Data extracted included the author name, year of publication, publication type / study design, country of study, survey tool used (if appropriate), domains of measurement (if appropriate), barriers to the conduct of research, and barriers to the application of research.
Due to the descriptive nature of this review, the analysis of the included studies was undertaken in a narrative manner. Following data extraction, barriers to the conduct and application of research in CAM were reviewed independently by each author to identify subthemes (i.e. low-level themes). The authors then convened to collaboratively refine the subthemes, and to identify overarching themes common across all studies (i.e. high-level themes). The team deliberated until consensus was reached on the themes and sub-themes for the barriers to both the conduct and application of research in CAM.
Figure 1 provides an overview of the literature selection process. The search identified a total of 226 publications. Following the removal of 70 duplicate publications and 108 irrelevant papers, 48 publications remained. Of these, 27 papers were excluded as they did not meet the review selection criteria. This resulted in a total of 21 studies being included in this review.
Overview of included studies
The search identified two categories of publications. The first category comprised eight primary research publications (e.g. cross-sectional studies). The second category encompassed thirteen opinion publications.
The eight primary research articles originated from three countries, including Australia (n = 3), United States of America (USA) (n = 4) and Canada (n = 1). The majority of studies were conducted in the past three years, with three studies conducted in 2015 and three in 2013; the remaining two studies were conducted between 2009-2011. With regards to participants, five studies focused specifically on chiropractors, two studies focused on CAM practitioners more generally, and one involved a combination of CAM and conventional health practitioners. The evidence-based practice attitude and utilization survey (EBASE tool; ) was commonly used across these studies (n = 5), with four studies modifying the tool to suit individual research requirements. Of the eight primary research studies, seven studies used a cross-sectional study design, and one was a descriptive analysis of National Health and Medical Research Council grant data . Table 2 provides an overview of the characteristics of the primary research articles included in this review.
In relation to the thirteen opinion publications, the countries of origin were USA (n = 6), Australia (n = 4) and UK (n = 4). Unlike the primary research studies, opinion publications originated as early as 1999, with the most recent published in 2015. Most of the opinion publications were published in early 2000, which indicates more than a decade of interest in this topic.
Critical appraisal of included studies
The results of the critical appraisal are presented in two distinct sections. The first section focuses on the conduct of research. The second section focuses on the application of research findings.
Critical appraisal of studies reporting barriers to the conduct of research in CAM
Table 3 provides an overview of the critical appraisal scores of the fourteen publications reporting on the barriers to the conduct of research in CAM. The overall methodological quality of all included articles was good, scoring 6/7, with one article having achieved the lowest score of 5/7 . The one criterion that was consistently not met was criterion three, which ascertained if the focus of the article was the patient. Given that the focus of the research was CAM practitioners and researchers, and not patients, all studies did not score for this particular criterion. The Rosner 35 study lost an additional mark because it did not meet the following criterion: ‘argument was developed analytically’ - primarily, because it was a testimonial stating facts about the barriers and obstacles to CAM research.
Critical appraisal of studies reporting barriers to the application of research findings
Table 4 provides an overview of the critical appraisal scores for the seven primary research studies that had a specific focus on the application of research findings in CAM. Overall, the methodological quality of the surveys was good as the lowest score was 9/12 (the highest being 12/12). Generally, three criteria were commonly not addressed across the studies; these related to sampling and selection bias, power calculation and response rate. Sampling and selection bias was often evident when the survey instrument was distributed electronically through email only; this meant those who did not have ready access to internet or email were automatically excluded. This was the case for Alcantara and Leach  and Bussières et al. . Some surveys did not provide evidence of power calculations prior to the start of their research (such as Alcantara & Leach)  or had poor response rates, some as low as 13% (Walker et al.) .
Overview of barriers
The synthesised findings are presented in two parts – barriers that influenced the conduct of research in CAM, and barriers that influenced the application of research findings in CAM. While there were barriers unique to each group, there were also barriers common to both groups.
Barriers to the conduct of research findings
Table 5 provides an overview of the fourteen publications that discussed the barriers to the conduct of research in CAM. Broadly, these barriers were captured within one of two categories: capacity and culture. The category “capacity” encompassed barriers that influenced the conduct of research and could be amenable to change with concerted effort and resources. The category “culture” contained barriers that influenced the conduct of research and were not readily amenable to change.
Within the “capacity” category, three sub-categories of barriers were identified; this included “access”, “competency” and “bias”. “Access” related to barriers such as lack of access to funding, training / skills in research, CAM journals in mainstream databases, quality research and quality researchers in CAM. All the included studies reported on access barriers. Bensoussan and Lewith  stated that since 2001, only 0.085% ($850,000) of about $1 billion of National Health and Medical Research Council research funding was allocated to CAM research in Australia. Ernst  added to this, highlighting that research funding schemes are not designed to support CAM research and the dearth of university researchers interested in CAM does not warrant funding/support . Poor access to funding contributed to a lack of research training , lack of accessibility of well-trained scientists entering CAM , few opportunities for research education and research in CAM  and finally, a paucity of grant applications [25, 39, 41]. Access barriers also extended to the lack of access to well-qualified CAM researchers due to the lack of incentives [41, 43]. Other barriers included poor access to high quality systematic reviews , limited qualitative studies  and lack of access to CAM-centric diagnostic research . Shekelle et al.  also highlighted that the inconsistent keywords, descriptors, subjects and differing indexing procedures across databases pose a challenge in locating CAM research.
Nine articles reported on barriers related to the sub-category “competency”; this referred to the skills, knowledge and competency of the CAM practitioner in the conduct of research. There were a range of different issues that were captured within the included articles, such as insufficient training/literacy in research [25, 42], inadequate research experience, limited ability to interpret results [42, 44], ignorance regarding research methodologies  and lack of awareness of research being undertaken . Some authors indicated that CAM practitioners did not have a strong research background  and thus, were not well qualified to conduct research [35, 39]. Lewith and Holgate  highlighted that few researchers who were investigating CAM topics had explicit CAM experience or knowledge and conversely most CAM therapists did not have a strong background in research.
The sub-category “bias” was an important barrier reported in thirteen publications; this related to the inherent negative perceptions about CAM research. This was well captured by Jonas  who stated, “Another major challenge to CAM research comes from the underlying assumptions of many CAM practices.” These negative perceptions were identified across a range of areas including the medical community, medical institutions, universities, funding agencies and mainstream databases. The mainstream medical community was reported to discredit CAM and CAM research , with collaboration between CAM and mainstream medical scientists/practitioners lacking . This was argued to have resulted in poor engagement between mainstream and CAM researchers with no opportunities for CAM professions to develop a research profile [25, 34]. The publications also pointed to a perceived bias in terms of access to research funding for CAM; this was attributed to non-recognition of CAM as a research priority , limited understanding of CAM research and hence negative attitudes of grant reviewers [34, 39, 48] and insufficient interest in CAM by researchers that deterred CAM research funding . Some authors also highlighted bias in CAM publications due to the lack of specialist CAM reviewers, including a lack of understanding of CAM modalities [35, 46].
Within the “culture” category, two sub-categories of barriers were identified; these were “values” and “complex systems”. The sub-category “values” related to a range of historical and philosophical perspectives, which underpinned CAM as a unique and stand-alone discipline. Some authors reflected that CAM did not fit within the mainstream biomedical model of care  and that CAM practitioners have a different philosophical approach than traditional medicine. This was exemplified by Giordano, Engebretson and Garcia , who stated that complementary medicines “do not fit easily into the mainstream biomedical conceptualization of mechanism, scope/nature of treatment, or the role of the clinician – patient interaction”. This perceived uniqueness of CAM was seen to contribute to a reluctance of CAM to engage with mainstream research [34, 39–41] or to exchange research information .
Another common cultural barrier was the CAM educational model. Much of CAM education was reported as being undertaken in private colleges, and not in university settings, with limited postgraduate research-focused opportunities [25, 44]. As such, CAM education had a predominant focus on clinical practice rather than research. CAM practitioners who were interested in research had to navigate outside their undergraduate training , which posed significant barriers.
The sub-category “complex system” related to the complexity underpinning CAM research, which may not be readily captured in the mainstream research framework. The “complex systems” barriers were reported in eleven articles and were inclusive of the patient-practitioner relationship, the care and treatment model, complex interventions and challenges in research design and execution. Authors highlighted that CAM involves significant and extended patient-practitioner interaction [39, 45]; as such, it was difficult to deconstruct the patient-practitioner relationship . A number of articles reported on CAM having a holistic treatment approach  where patients were treated as individuals, and consequently, a combination of treatments were used both within and between patients [42, 48]. In other words, the CAM health and healing approach was seen to be different from the biomedical model [44, 49], and was generally not well-understood . Given these complexities, several allied barriers to conducting research were identified, including an inability to undertake blinding and provide a true control/placebo group [44, 45], limited generalisability of findings, and associated funding . These issues were best captured by Long and Mercer , who stated that “not only are there important differences between individual CAMs, but there are sometimes further significant divisions within a CAM”.
Barriers to the application of research findings
Table 6 provides an overview of the eight articles (including seven primary research studies and one opinion publication) that identified the barriers to the application of research findings by CAM practitioners within their practices. These barriers could be collapsed into two broad categories: capacity and culture. Similar to the barriers to conducting research, the category “capacity” encompassed barriers that influenced the application of research findings and could be amenable to change with concerted effort and resources. The category “culture” contained barriers that influenced the application of research but were not readily amenable to change.
Within the category “capacity” were five sub-categories. The sub-category “access” related to the accessibility of research. This included access to research training and research skills [36, 37, 50, 51], and lack of training on how to implement research findings into practice . Barriers to access also extended to other concepts such as limited access to resources  and CAM researchers , lack of access to research that supported EBP [36, 41, 53] and lack of access to high quality research evidence that can be readily translated to practice [36, 37, 47, 50, 53].
The subcategory “competency” focused on the competency, skills and knowledge of the CAM practitioner in relation to research. Seven studies identified issues such as the lack of knowledge and skills in locating evidence , critical appraisal of evidence , interpreting results , lack of awareness of practice guidelines and their availability  and presenting evidence to patients .
The sub-category “bias” focused on the (often negative) perceptions of research within CAM. For example, Walker et al.  identified that older chiropractors were less likely to agree to the application of research findings into practice. This may be because their past training might not have had a specific focus on EBP and may have had a considerable focus on the historical/traditional values of CAM. This may have resulted in these chiropractors forming an antithesis viewpoint of EBP.
The two research studies that explored chiropractors’ perspectives of the application of research findings into practice - both of which were undertaken in North American settings – identified the lack of “incentive” (another sub-category) as a critical barrier. Chiropractors in the Bussières et al.  and Schneider et al.  studies reported that there was no financial or tangible incentive for them to undertake EBP in their local settings. Similarly, “time”, another sub-category, was a commonly reported barrier to the application of research findings into practice. Four studies [36, 37, 51, 53] highlighted that due to limited time, chiropractors may focus on clinical priorities during the consultation rather than accessing and applying evidence into practice.
The category “culture” captured a number of barriers related to the general beliefs, attitudes and behaviours of practitioners within the CAM professions. Research by Alcantara et al. , Bussières et al. , Leach and Gillham , Schneider et al. , Tilburt et al.  and Walker et al.  cite entrenched cultural barriers in CAM whereby there was a distinct lack of interest in research, irregular access to the research literature, and infrequent use of databases to inform clinical practice. These barriers could be regarded as profession-wide issues due to the lack of professional and peer support for research, and the over-reliance on anecdotes, expert opinion and traditional evidence. Patient perspectives also contributed to this category in the form of discrepancy between patient expectations and research evidence.
The purpose of this systematic review was to identify the barriers to the conduct and application of research in CAM. While evidence-based practice has been increasingly integrated within the mainstream health professions, within the CAM professions, use of EBP to inform clinical decision making still remains in its infancy. This is particularly concerning as there is widespread and growing use of CAM within the community . Recently, the importance of evidence-based CAM has been highlighted in Australia, with the NHMRC undertaking a review of evidence across a number of CAM disciplines, including homeopathy . Even within CAM, many researchers have called for a greater emphasis on EBP within the CAM professions [42, 50, 53].
While the use of EBP in CAM could be considered as a given, an important problem confronts CAM stakeholders wanting to engage with EBP. An important component of EBP is research evidence and this systematic review has identified numerous barriers to the conduct and application of research evidence in CAM. Findings from this review suggest that there are common and unique barriers to the conduct and application of research in CAM (Fig. 2). Barriers common to both areas were “access” “competency” and bias”.
While this was the first systematic review to map the barriers to the conduct and application of research in CAM, similar findings have been reported in other areas of health [54–56]. In particular, there are a number of research studies in health disciplines such as physiotherapy , occupational therapy , podiatry , speech and language therapy , social work  and nursing [62, 63]. These findings suggest that, irrespective of the discipline, there are some shared common barriers. However, it is poignant to note that one cardinal difference between CAM professions and other health disciplines, is that many of the barriers for other health disciplines have a predominant focus on the application of research findings into practice whereas for CAM, these barriers seem to extend to the conduct as well as the application. One possible explanation for this is that for many health disciplines, over time, the research evidence has been well established. However, for the field of CAM, the development of research evidence is still in its infancy and continues to evolve. Due to this, these barriers extend to the conduct as well as the application of research in CAM.
There are a number of additional factors that may impact the conduct and application of research in CAM, which were not identified in this review. For example, there is disagreement within the CAM research community on what constitutes best research evidence for CAM stakeholders . Historical biases such as the negative perception of CAM, access to funding options, and traditional values held close to CAM practitioner models of care have also been reported in the literature . Poorly reported studies create a lack of accurate and accessible information, which suggests that CAM researchers (and CAM journals) may not be aware of, or adhere to, international research reporting standards . Additionally, there exist multiple factors that create a divide between CAM research and application, the most prominent being the ability of CAM practitioners to translate research evidence into practice . Claims of a culture of ‘anti-science’ anti-medicine’ and ‘anti-establishment’ in CAM have also been suggested as contributing to the research-practice gap in the field .
While there is no one magic bullet to overcome these myriad of factors, a range of strategies could be implemented to facilitate the conduct and application of research within the CAM community. Such tactics might include increasing knowledge through investigator-driven funding, lobbying for unbiased grant review processes, integrating research training into undergraduate CAM programs, and establishing methods for identifying and assessing evidence with ongoing efforts to dispel the myths about CAM. These strategies have been trialled with other professions, such as physiotherapy, with success. Over the course of the past few decades, physiotherapy has moved on to embrace the importance of research to inform its clinical practice . While acknowledging the role of research evidence, physiotherapy continues to recognise the importance of getting the balance right between research evidence, clinical practice and patient morals, values and beliefs .
One of the strategies adopted by physiotherapy has been to embed research within the undergraduate curricula, thereby creating a critical mass of physiotherapists who are familiar with, and have skills to, embed research evidence in clinical practice. Further, there has been the establishment of a dedicated research grant funding body  for which physiotherapists can apply for funding to conduct physiotherapy-related research . Physiotherapists have also successfully tapped in mainstream health and medical research grants, which have historically been accessed by medical disciplines. For example, since 2000, there has been a steady increase in the number of National Health and Medical Research Council funded grants with one or more physiotherapists as chief investigators . These are just a few strategies that have addressed the barriers of access, competency and bias in physiotherapy, which the CAM professions can perhaps learn from if it endeavours to overcome the barriers to conducting and applying research in CAM.
As with any research, this systematic review too has limitations. These limitations include language bias (as only English-language studies and articles were included), use of opinion publications (due to the nature of the review question and lack of research studies) and the inclusion of studies with methodological bias (i.e. the possible presence of sampling and selection bias; inadequate reporting of power calculation; low response rates). Despite these limitations, a comprehensive search strategy, underpinned by a systematic approach, have ensured access to the current best available evidence to answer the review question.
Implications for practice
While it is clear that CAM professions must engage with research, operationalising this in practice continues to face barriers. Without explicit recognition of these barriers, enabling strategies cannot be implemented. These enabling strategies may include dedicated access to research funding for CAM, fellowship opportunities for emerging CAM researchers and clinicians, embedding research as part of undergraduate training in CAM and improved access to ongoing continuous professional development opportunities for clinicians in the areas of EBP and research. By doing so, CAM professions can build a critical mass and a well-coordinated research effort that will assist in integrating EBP in CAM.
Implications for research
Despite the availability of research on the barriers to the conduct and application of research in CAM, much of this research effort is ad hoc and opportunistic. To date there are no structured means of capturing and measuring the barriers to the conduct and application of research in CAM. Future research should focus on systematically mapping these barriers, through the use of psychometrically rigorous instruments and methodologically sound research. Mapping of these barriers could assist in promoting the importance of engaging with research in CAM, develop and trial enabling strategies and identify what strategies works for whom in which contexts.
Complementary and alternative medicine
The narrative, opinion and text assessment and review instrument
Population, interest and context
Frass M, Strassi R, Friehs H, Mullner M, Kundi M, Kaye A. Use and acceptance of complementary and alternative medicine among the general population and medical personnel: a systematic review. Ochsner J. 2012;12:45–56.
Grace S. CAM practitioners in the Australian health workforce: an underutilized resource. BMC Complement Altern Med. 2012; doi:10.1186/1472-6882-12-205.
World Health Organisation. WHO Traditional Medicine Strategy 2014-2023. http://www.who.int/medicines/publications/traditional/trm_strategy14_23/en/. Accessed 12 Aug 2016.
Barnes PM, Bloom B, Nahin R. CDC National Health Statistics Report # 12. Complementary and Alternative Medicine Use Among Adults and Children: United States, 2007, report no. 12. http://nccih.nih.gov/research/statistics/NHIS/2012. Accessed 04 Aug 2016.
Clarke TC, Black LI, Stussman BJ, Barnes PM, Nahin RL. Trends in the use of complementary health approaches among adults: United States. Natl Health Stat Rep. 2015;10:16.
Australian Bureau of Statistics. Australian social trends, 2008: complementary therapies. http://www.abs.gov.au/AUSSTATS/abs@.nsf/Lookup/4102.0Chapter5202008. Accessed 03 Aug 2016.
Kim J, Nam C, Kim M, Lee D. The use of complementary and alternative medicine (CAM) in children: a telephone-based survey in Korea. BMC Complement Altern Med. 2012; doi:10.1186/1472-6882-12-46.
Metcalfe A, Williams J, McChesney J, Patten SB, Jetté N. Use of complementary and alternative medicine by those with a chronic disease and the general population: Results of a national population based survey. BMC Complement Altern Med. 2010;10:58. doi:10.1186/1472-6882-10-58.
Lim MK, Sadarangani P, Chan HL, Heng JY. Complementary and alternative medicine use in multiracial Singapore. Complement Ther Med. 2005; doi:10.1016/j.ctim.2004.11.002.
Hori S, Mihaylov I, Vasconcelos JC. Patterns of complementary and alternative medicine use amongst outpatients in Tokyo, Japan. BMC Complement Altern Med. 2008; doi:10.1186/1472-6882-8-14.
Hisham R, Ng CJ, Liew SM, Hamzah N, Ho G. Why is there variation in the practice of evidence-based medicine in primary care? A qualitative study. BMJ Open. 2016; doi:10.1136/bmjopen-2015-010565.
Leach MJ, Evidence-based practice: a framework for clinical practice and research design. Int J Nurs Pract. 2006; doi:10.1111/j.1440-172X.2006.00587.x.
Fischer FH, Lewith G, Witt CM, Linde K, Von AK, Cardini F, et al. High prevalence but limited evidence in complementary and alternative medicine: guidelines for future research. BMC Complement Altern Med. 2014; doi:10.1186/1472-6882-14-46.
National Institutes of Health. National Center for Complementary and Integrative Health. http://nccih.nih.gov. Accessed 9 Aug 2016.
National Health and Medical Research Council. NHMRC Statement on Homeopathy and NHMRC Information Paper - Evidence on the effectiveness of homeopathy for treating health conditions. http://www.nhmrc.gov.au/guidelines-publications/cam02. Accessed 9 Aug 2016.
Stevens KR. The impact of evidence-based practice in nursing and the next big ideas. Online J Issues Nurs. 2013; doi:10.3912/OJIN.Vol18No02Man04.
Goldberg JM. Lessons learned in 20 years of developing evidence-based medicine. J Paediatr Orthop. 2012;32 Suppl 2:S193–4. doi:10.1097/BPO.0b013e3182595962.
Asante F, Yeboah J, Mensah C. ‘Pulled in or pushed out? Understanding the complexities of motivation for alternative therapies use in Ghana. Int J Qual Stud Health Well-Being. 2016; doi:10.3402/qhw.v11.29667.
Pan SY, Litscher G, Gao SH, Zhou SF, Yu ZL, Chen HQ, et al. Historical perspective of traditional indigenous medical practices: The current renaissance and conservation of herbal resources. Evid Based Complement Alternat Med. 2014; doi:10.1155/2014/525340.
Wardle J. Respecting science, respecting tradition: evidence-based care in the integrative medicine professions. Aust J Herbal Med. 2015;27:47–55.
Gale N. The sociology of traditional, complementary and alternative medicine. Sociol Compass. 2014; doi:10.1111/soc4.12182.
Wardle J, Adams J, Steel AE, Lui C. Current challenges and future directions for naturopathic medicine in Australia: A qualitative examination of perceptions and experiences from grassroots practice. BMC CAM. 2013; doi:10.1186/1472-6882-13-15.
Singh N, Telles S. Awareness about bibliographic databases among students of Ayurveda and qualified Ayurveda practitioners. J Ayurveda and Integr Med. 2012; doi:10.4103/0975-9476.96516.
Power M, Hopayian K. Exposing the evidence gap for complementary and alternative medicine to be integrated into science-based medicine. J R Soc Med. 2011; doi:10.1258/jrsm.2011.100271.
Steel A, McEwen B. The need for higher degrees by research for complementary medicine practitioners. Austr J of Herbal Med. 2014;26:4.
Nissen N, Weidenhammer W, Schunder-Tatzber S, Johannessen H. Public health Ethics for complementary and alternative Medicine. Eu J Integr Med. 2013. doi:http://dx.doi.org/10.1016/j.eujim.2012.11.003.
Fischer FH, Lewith G, Witt CM, Linde K, Von AK, Cardini F, et al. High prevalence but limited evidence in complementary and alternative medicine: guidelines for future research. BMC Complement Alternat Med. 2014; doi:10.1186/1472-6882-14-46.
Final Report Summary – CAMBRELLA. In: Community Research and Development Information Service. European Commission. 2013. http://cordis.europa.eu/result/rcn/57185_en.html. Accessed 25 Aug 2016.
Moher D, Liberati A, Tetzlaff J, Altman DG. The PRISMA Group (2009). Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. Open Med. 2009; doi:10/1136/bmj.b2535.
The Joanna Briggs Institute. Joanna Briggs Institute Reviewer’s Manual: 2014. In: Joanna Briggs Institute.2014. http://joannabriggs.org/assets/docs/sumari/ReviewersManual-2014.pdf. Accessed 19 Aug 2016.
Center for Evidence-Based Management. Critical Appraisal Tools. In: Center for Evidence-Based Management (CEBMa). 2016. https://www.cebma.org/resources-and-tools/what-is-critical-appraisal/. Assessed 09 Aug 2015.
Booth A. Who will appraise the appraisers? The paper, the instrument and the use. Hlth Inf Libr J. 2007. doi:10.1111/j.1471-1842.2007.00703.x.
Leach MJ, Gillham DM. Evaluation of the Evidence-Based Practice Attitude and utilization survEy for complementary and alternative medicine practitioners. J Eval Clin Pract. 2008; doi:0.1111/j.1365-2753.2008.01046. x.
Wardle J, Adams J. Are the CAM professions engaging in high-level health and medical research? Trends in publicly funded complementary medicine research grants in Australia. Complement Ther Med.2013; doi:10.1016/j.ctim.2013.09/003.
Rosner A. Obstacles and barriers to CAM research. Dyn Chiropr. 2000;18:10–30.
Alcantara J, Leach M. Chiropractic attitudes and utilization of evidence-based practice: the use of the EBASE questionnaire. Explore: J Sc Healing. 2015. doi:10.1016/j.explore.2015.06.002.
Bussières A, Terhorst L, Leach M, Stuber K, Evans R, Schneider M. Self-reported attitudes, skills and use of evidence-based practice among Canadian doctors of chiropractic: a national survey. Chiro Manual Therap. 2015;59:332–48.
Walker BF, Stomski NJ, French SD, Hebert JJ. A survey of Australian chiropractors’ attitudes and beliefs about evidence-based practice and their use of research literature and clinical practice guidelines. Chiro Manual Therap, 2013; doi:10.1186/2045-709X-21-44.
Bensoussan A, Lewith GT. Complementary medicine research in Australia: a strategy for the future. Medic J Austral. 2004;181:331–33.
Ernst E. Funding research into complementary medicine: the situation in Britain. Complement Therap Med. 1999; doi:10.1016/S0965-2299(99)80011-9.
Lewith G, Holgate S. CAM research and development. Complement Therap Nurs Midwifery. 2000; doi:10.1054/ctnm.1999.0440.
Jonas WB. Building an evidence house: challenges and solutions to research in complementary and alternative medicine. Forsch Komplementarmed Klass Naturheilkd. 2005;12:159–67.
Ernst E. Obstacles to research in Complementary and alternative medicine. Med J Aust. 2003;179(6):279–80.
Giordano J, Engebretson J, Garcia MK. Challenges to complementary and alternative medical research: focal issues influencing integration into a cancer care model. Integr Cancer Therap. 2005; doi:10.1177/1534735405279179.
Ahn A, Nahin R, Calabrese C, Folkman S, Kimbrough E, Shoham J, et al. Applying principles from complex systems to studying the efficacy of CAM therapies. J Alternat Complement Medic, 2010; doi:10.1089/acm.2009.0593.
Shekelle PG, Morton SC, Suttorp MJ, Buscemi N, Friesen C. Challenges in systematic reviews of complementary and alternative medicine topics. Ann Intern Med. 2005; doi:10.7326/0003-4819-142-12_Part_2-200506211-00003.
Evans A. Complementary and Alternative Medicine (CAM): setting and Australian Research Agenda. Clinical Oncological Society of Australia (COSA). 2007. https://www.cosa.org.au/media/1068/cosa_report_complementary-and-alternative-medicineworkshop_2007.pdf. Accessed 16 Oct 2016.
Nahin R, Straus S. Research into complementary and alternative medicine: problems and potential. Br Medic J. 2001; doi:10.1136/bmj.322.7279.161.
Long AF, Mercer G. Challenges in researching the effectiveness of complementary therapies. J Contemporary Hlth. 1999;8:13–21.
Leach MJ, Gillham D. Are complementary medicine practitioners implementing evidence based practice? Complement Therap Med. 2011. doi:10.1016/j.ctim.2011.04.002.
Schneider MJ, Evans R, Haas M, Leach M, Hawk C, Long C, et al. US chiropractors’ attitudes, skills and use of evidence-based practice: a cross-sectional national survey. Chiropract Manual Therap. 2015. doi:10.1186/s12998-015-0060-0.
Tilburt JC, Curlin FA, Kaptchuk TJ, Clarridge B, Bolcic-Jankovic D, Emanuel EJ, et al. Alternative medicine research in clinical practice - A US national survey. Arch Intern Med. 2009;169:670-77.
Roecker CB, Lawrence DJ, Long CR, Vining RD. Attitudes toward evidence-based clinical practice among doctors of chiropractic with diplomate-level training in orthopaedics. Chiropract Manual Therap. 2013. doi:10.1186/2045-709X-21-43.
Retsas A. Barriers to using research evidence in nursing practice. J Adv Nurs. 2000. doi:10.1046/j.1365-2648.2000.01315.x.
Bishen KA, Chhabra KG, Sagari S, Gupta P. Nationwide survey on barriers for dental research in India. J Pharm Bio Allied Sci. 2015. doi:10.4103/0975-7406.160017.
Bakken S, Lantigua RA, Busacca LV, Bigger J. Barriers, enablers, and incentives for research participation: a report from the ambulatory care research network (ACRN). J Am Board Family Med. 2009. doi:10.3122/jabfm.2009.04.090017.
Kumar S, Young AF, Lekkas P, Grimmer KA, Nyland LJ. Perspectives on research evidence and clinical practice: a survey of Australian physiotherapists. Physiother Res Int. 2007. doi:10.1002/pri.363.
Samuelsson K, Wressle E. Turning evidence into practice: barriers to research use among occupational therapists. Br J Occup Ther. 2015. doi:10.1177/0308022615569511.
Lansdowne N, Brenton-Rule A, Carroll M, Rome K. Perceived barriers to the management of foot health in patients with rheumatic conditions. J Foot Ankle Res. 2015. doi:10.1186/s13047-015-0071-z.
O’Connor S, Pettigrew CM. The barriers perceived to prevent the successful implementation of evidence based practice by speech and language therapists. Int J Lang Commun Disord. 2009. doi:10.1080/13682820802585967.
Gray M, Joy E, Plath D, Webb S. What supports and impedes evidence-based practice implementation? A survey of Australian social workers. Br J Soc Work. 2015;45:667–84. https://doi.org/10.1093/bjsw/bct123.
Dalheim A, Harthug S, Nilsen RM, Nortvedt MW. Factors influencing the development of evidence-based practice among nurses: a self-report survey. BMC Health Serv Res. 2012. doi:10.1186/1472-6963-12-367.
Majid S, Foo S, Luyt B, Zhang X, Theng Y, Chang Y, et al. Adopting evidence-based practice in clinical decision making: nurses’ perceptions, knowledge, and barriers. J Med Libr Assoc. 2011. doi:10.3163/1536-5050.99.3.010.
Broom A, Adams J. Current issues and future directions in complementary and alternative medicine (CAM) research. Complement Ther Med. 2007. doi:10.1016/j.ctim.2006.08.001.
Leach MJ, Tucker B. Current understandings of the research–practice gap from the viewpoint of complementary medicine academics: a mixed-method investigation. Explore: J Sci Healing. 2017. doi:10.1016/j.explore.2016.10.005.
Crosbie J. Physiotherapy research: A retrospective look at the future. Aust J Physiother. 2000. doi10.1016/S0004-9514(14)60325-1.
Kumar S, Roberts P. Bridging the evidence-practice gaps in manual therapy: Getting Balance Right. 2017. doi:10.1016/S0004-9514(14)60325-1.
Australian Physiotherapy Association: Grants. 2017. http://www.physiotherapy.asn.au/APAWCM/Research_and_Publications/PRF/Grants.aspx. Accessed 19 Feb 2017.
Hodges P. Growth of physiotherapy research funding in Australia. J Physiother. 2009. doi:10.1016/S0004-9514(09)70075-3.
The authors would like to thank and acknowledge Ms Adriana Ciccone, Academic Librarian, University of South Australia, for generously providing guidance, feedback and validation of the search strategy used in this systematic review.
This study was not supported by any sources of funding.
Availability of data and materials
All data generated or analysed during this study are included in this published article.
YV conceived the original review. ML and SK assisted YV in refining the review topic and YV, ML and SK co-developed the search strategy. YV and SK undertook independent searching of the literature and the selection of articles were undertaken in collaboration with YV, ML and SK. While YV lead the critical appraisal and data extraction stages, ML and SK also undertook critical appraisal and data extraction, as independent reviewers, in order to ensure rigour in the review process. YV, ML and SK were all involved in the data synthesis stage. All three authors contributed to the development of this manuscript in its current form through various revisions and approved the final manuscript.
1. Yasamin Veziari, RN, AdvDip Naturopathy, BN, Student researcher, University of South Australia, Adelaide
2. Dr. Matthew Leach, RN, BN(hons), ND, PhD, Senior Research Fellow, Department of Rural Health, University of South Australia, Adelaide
3. Dr. Saravana Kumar, B App. Sc (Physiotherapy), MPhty, PhD, Senior Lecturer, School of Health Sciences, University of South Australia, Adelaide
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
- Complementary and alternative medicine
- Evidence-based practice
- Systematic review