- Research article
- Open Access
- Open Peer Review
Placebo design in WHO-registered trials of Chinese herbal medicine need improvements
BMC Complementary and Alternative Medicine volume 19, Article number: 299 (2019)
Physical identical and pharmacological inert are the basic requirements for placebo design, which are essential in clinical trials to evaluate the efficacy of an intervention. However, it is difficult to makeup a placebo of Chinese herbal medicine (CHM) because of special color, taste and smell, etc. Currently, there is no specific requirements and standards for the creation of a CHM-placebo. The purpose of this study is to review the characteristics of the CHM-placebo design and application in registered clinical trials with CHM interventions and identify the common problems, if any.
The World Health Organization (WHO) International Clinical Trials Registry Platform (ICTRP) was systematically searched for CHM interventional trials with placebo-controlled design up to 31 December 2017. Registered information of each included trial was collected from specific registries involved in ICTRP through hyperlinks. Descriptive statistics were used to analyze the characteristics of placebo design in CHM trial registrations.
A total of 889 CHM interventional trials were registered from 1999 to 2017, and 40.8% (363) of them included CHM-placebo control design. The common ways of their design were: placebo as sole control (191, 52.6%); placebo as add-on control with baseline treatment (84, 23.1%); and placebo as double-dummy control (57, 15.7%). Among 363 included trials, 46 (12.7%) reported the compositions of placebos, including CHM ingredients (17 trials), excipients and other agents (29 trials). 2 (0.6%) reported pharmacological inert testing, and 52 (14.3%) descripted their placebos to be physically identical with the CHMs. 14 (3.9%) reported quality control of placebos, and 2 (0.6%) provided blinding assessment of placebos.
The placebos included in most CHM trial registrations is not optimal in terms of placebo design, application, evaluation and reporting. Specific guidelines or standards of CHM-placebo design, including usage requirements, preparation specifications, quality assessments and reporting guidelines should be developed thus to improve their quality.
Although Chinese herbal medicine (CHM) is increasingly popular in the world, its effectiveness continues to be debated. The evidence to support CHM treatment approaches must come from high quality randomized, double-blinded, and placebo-controlled clinical trials . Criticism of the quality of placebos used is unfortunately common. Poor design of the placebo affects the success of blinding and the efficacy of interventions adopted in the trial . In addition, for many CHM clinical trials, creating a quality placebo is extraordinarily difficult because the herbs often have special colors, tastes and smells .
The word “placebo” originates from Latin; it means “I shall please”. It was first used in the 14th century, but did not appear in a documented medical record until the late 18th century . Today, the term “placebo” refers to a harmless pill, medicine, or procedure with no therapeutic effect; it is used in two contexts: (a) prescribed to patients for psychological benefit; or (b) used in clinical trials as a way to test the efficacy of new drugs .
In 1970, the American Food and Drug Administration (FDA) suggested that under the consideration of ethical approval, placebo control design should be used in clinical studies for new drug evaluation . In 2000, the fifth revision of the Declaration of Helsinki addressed the appropriate use of placebos . It requires the application of placebo in clinical studies when there is no established effective intervention; when withholding effective intervention would mostly expose subjects to temporary discomfort or delay in relief of symptoms; when use of effective intervention would not yield scientifically reliable results; and when the use of placebo would not add any serious or irreversible harm to the subjects . For randomized controlled trials (RCTs), a placebo group is designed to control for several factors, including placebo effects, statistical regression to the mean, spontaneous remission, etc. [9, 10]. Thus, if a clinical trial is supported by sound ethical and methodological considerations, a placebo control design is the most rigorous test of treatment efficacy, especially for evaluating a medicinal therapy .
In traditional Chinese medicine (TCM), the first CHM intervention clinical trial with a CHM-placebo control design was published in 1985; it examined the use of Suan-Zao-Ren-Tang in treating insomnia . In 1999, the China Food and Drug Administration (CFDA) issued a document of “Technical Requirements for Clinical Research of New Drugs in Traditional Chinese Medicine”, which encouraged placebo design, as a comparator product, in the phase II of clinical trials, if necessary . Since then, an increasing number of CHM interventional trials with placebo control have been designed and implemented . The first registration of a CHM trial with placebo control was in 2002; the trial was conducted to test the efficacy of a CHM formula (a capsule included 11 herbs) against Crohn’s disease .
A good placebo would be identical to the real CHM intervention in physical form, sensory characteristics, packaging, and labeling, and it would have no pharmaceutical activity . However, few studies have reported these information of a placebo . For example, Wu SP et al. have analyzed 301 CHM placebo-controlled clinical trials published from 1983 to 2013, and have found that only 3 articles (1.0%) reported the testing information on pharmacologically inert and physical similarity of CHM-placebos . A similar study conducted by Qi GD et al., examining 77 CHM placebo-controlled clinical trials from 1999 to 2005, found quite similar results . Besides, some studies have assessed the ethical requirements of placebo application in CHM clinical trials and have found some undesirable results . For instance, Fu JJ et al. have reported that, among 231 CHM placebo-controlled trials published in Chinese journals from 1979 to 2008, 48 (20.78%) did not meet the scientific requirement of placebo usage, 221 (95.67%) did not report ethic approval, and 187 (80.95%) did not report information on informed consent in the publications . Based on literature review, we found that there is no latest study so far to provide the current characteristics of placebo design and its usage in CHM trials, especially in registered CHM clinical trials.
This study aimed to review the overall characteristics of placebo design and application in CHM clinical trial registrations. The objectives were as follows: 1) to summarize the general features of placebo design and application in WHO-registered CHM trials; 2) to identify the common problems of placebo design and application in WHO-registered CHM trials; and 3) to provide suggestions for improving the quality of CHM-placebo design and their use in the future. These results will be the basis for setting up specific guidelines or standards for the CHM-placebo design.
Study design and setting
The WHO ICTRP was searched for registered CHM clinical trials with placebo-controlled design up to 31 December 2017 in this study, and descriptive statistics were used to analyze their characteristics of placebo design.
The database of the WHO ICTRP (http://apps.who.int/trialsearch/) was searched on 15 January 2018 for all TCM trials that had been registered up to 31 December 2017. There are 17 Registries in the ICTRP: Australian New Zealand Clinical Trials Registry (ANZCTR), Chinese Clinical Trial Register (ChiCTR), ClinicalTrials.gov, EU Clinical Trials Register (EU-CTR), International Standard Randomized Controlled Trial Number Register (ISRCTN), the Netherlands National Trial Register (NTR), Brazilian Clinical Trials Registry (ReBec), Clinical Trials Registry-India (CTRI), Clinical Research Information Service-Republic of Korea (CRiS), Cuban Public Registry of Clinical Trials (RPCEC), German Clinical Trials Register (DRKS), Iranian Registry of Clinical Trials (IRCT), Japan Primary Registries Network (JPRN), Pan African Clinical Trial Registry (PACTR), Sri Lanka Clinical Trials Registry (SLCTR), Thai Clinical Trials Register (TCTR), Peruvian Clinical Trials Registry (REPEC).
This study was designed to analyze the overall characteristics of placebo design in CHM clinical trial registrations from the public access way of the ICTRP. All data used in this study are registered information related to trial design and does not involve human subjects.
Standard search, provided by WHO ICTRP (ICTRP Search Portal, http://apps.who.int/trialsearch/) was selected and the search strategy was developed including ‘Chinese medicine OR traditional Chinese medicine OR Chinese materia medica OR Chinese herbal medicine OR acupuncture OR moxibustion OR tuina OR massage OR cupping OR guasha’, without any restrictions.
Inclusion and exclusion criteria
We searched all TCM clinical trials registered up to 31 December 2017 and identified CHM interventional studies according to the ‘study type’ (e.g. interventional, observational, etc.) and ‘intervention’ (e.g. Chinese herbal medicine, acupuncture, cupping, etc.). The CHM interventions included Chinese medicinal substances (e.g. single herbs or extracts from single herbs) and CHM compound formulas (e.g. fixed, individualized or patent proprietary formulas). The dosage forms of CHM interventions included decoctions, capsules, pills, powders, granules, ointments, and injections, etc. However, the CHM interventional trials that included CHM-placebo control design were eligible for inclusion. There were no limitations in the participants and outcomes. We excluded the following registered TCM trials: non-interventional studies (e.g. observational studies); studies with non-CHM interventions, such as acupuncture, moxibustion, massage, cupping, etc.; and CHM interventional studies without placebo of CHM (e.g. CHM vs active control, CHM vs conventional drug vs placebo of conventional drug).
Data extraction and analyses
Using a predefined data extraction form that collected information for this study, two authors (XZ and RT) extracted the data from each trial record independently. Disagreements were resolved by consensus. If needed, a third author (CZ) was consulted. The form of data extraction was composed of two parts: (1) Characteristics of the included trials (e.g. diseases studied, CHM interventions, control group, outcomes, study phase and ethic approval, etc.); and (2) Characteristics of the CHM placebos, including placebo compositions, pharmacological testing for inertness, physical similarity (i.e. should be identical), quality control and manufacturer of the placebo, and successful blinding assessment, etc. All data were collected and recorded in Microsoft Office Excel (Version 2016). Categorical data is presented as number (n) and percent (%).
The initial search identified 3339 records. Screening excluded 384 records that were non-interventional studies. After examination of 2955 interventional studies, 889 trials with CHM interventions were chosen for further screening. A total of 363 trials (40.8%, 363/889) were included because of placebo-controlled design with CHM interventions (Fig. 1). An ID list of all included records is provided in Additional file 1: S1.
Distribution of years and registries
A total of 363 CHM placebo-controlled trials were registered during the period of 2002 to 2017. The number of these trial registrations increased gradually during the first 10 years, and then increased rapidly from 2013 to 2017 (66.4%, 241/363), especially in 2013 (15.4%, 56/363) and 2017 (26.7%, 97/363) (Fig. 2). Among 17 WHO registries, CHM placebo-controlled trial registrations were only found in 7 registries, namely ChiCTR (237), ClinicalTrials.gov (91), ANZCTR (17), ISRCTN (10), CRiS (3), JPRN (3) and IRCT (2). The number of ChiCTR (i.e. China) and ClinicalTrials.gov (i.e. USA) altogether accounted for 90.4% (328/363) of all CHM placebo-controlled trial registrations (Fig. 3).
General characteristics of CHM placebo-controlled trials
The CHM interventions were classified as either CHM formulas (88.4%, 321/363) or single herbs (11.6%, 42/363). Most (95.9%, 348/363) of trials chose the oral route, and the common dosage forms were granule (37.5%, 136/363) and capsule (13.5%, 49/363). The most common conditions studied were the circulatory system diseases (12.4%, 45/363), followed by the digestive system diseases (9.9%, 36/363). Only 29.8% (108/363) of the included trials, however, had adopted TCM syndrome as diagnostic criteria.
Of 363 included trials, 251 (69.1%) provided their ethic approvals to the registration system; 94 (25.9%) reported study phases were II or III. The most common design was solely placebo as control (52.6%, 191/363), followed by placebo as add-on control with baseline treatment (23.1%, 84/363). For placebo-controlled groups, the sample size and administration time were mainly distributed between 1 and 100 (65.8%, 239/363) and half month-3 months (22.9%, 83/363), respectively. For different categories of outcomes, the largest proportion was distributed in both objective and subjective outcomes (63.1%, 229/363). More detailed information is shown in Table 1.
Characteristics (composition, pharmacological effect, physical identity, blinding and quality control) of CHM placebos
As shown in Table 2, 46 trials (12.7%) reported the placebo compositions. Two trials (0.6%) conducted pharmacological inert tests. Fifty-two trials (14.3%) stated that the placebo was physically identical to the experimental CHM, especially in terms of color, smell, and taste; however, no trial reported their testing methods. Information on detailed physical characteristics (e.g. appearance, packaging, etc.) is presented in Additional file 1: S2. Only 2 trials (0.6%) mentioned the evaluation criteria/method for successful blinding of placebo design. Fourteen trials (3.9%) provided the information on quality control of placebo, and 10 reported the name of the company that manufactured the placebo. The relevant information on manufacturers is shown in Additional file 1: S3.
For placebo compositions, of 46 trials, 17 (37%) trials included CHM ingredients and 29 (63%) trials excluded CHM ingredients in their placebos. The placebos including CHM ingredients mainly adopted low dosages of the experimental CHM (13, 28.3%), and 9 (19.6%) reported the specific dosage percentage of CHM ingredients. Except CHM ingredients, the placebos were mainly composed of excipients (28, 60.8%), such as flour, starch, and dextrin, plus flavoring, and/or coloring agents. Only 2 (4.3%) trials provided pharmacological testing for inertness. More detailed information is shown in Table 3.
This study identified 363 CHM interventional trials with placebo-controlled design that were registered from 2002 to 2017; this accounted for 40.8% of the WHO-registered CHM interventional trials. Although the usage of placebo steadily increased each year, reaching a maximum in 2017 with 97 CHM placebo-controlled trial registrations, this review found that some problems had existed in the following aspects of placebos, namely: (1) reporting information about the placebo (i.e. its physical characteristics); (2) ethics of placebo application; (3) placebo preparation and production; and (4) methods of placebo assessment; and (5) PICOS (participant, intervention, comparison, outcome and study type) related with placebo design.
Reporting about the placebo
The placebo design is usually included in the reporting record of a CHM trial registration. Although the WHO Trial Registration Data Set (TRDS) requires the description of control intervention (e.g. placebo) should be appropriately detailed, this study found that the rates of reporting placebo-related information were very low. In descending order, these rates were: dosage form (84.6%), administration time (40.8%), physically identical test (14.3%), placebo composition (12.7%), placebo quality control (3.9%), pharmacologically inert testing (0.6%), and evaluation of successful blinding (0.6%). It’s no surprise that this same situation also appears in the publications of CHM placebo-controlled trials . For example, physically identical and pharmacologically inert are the basic requirements for a placebo , but fewer available published CHM placebo-controlled trials have reported the placebo pharmacologically inert tests or physical similarity results [24, 25].
These findings highlight the need for establishing standard reporting items for placebo-related information. In 2017, a reporting guideline of Consolidated Standards of Reporting Trials (CONSORT) extension for CHM formulas was published, which included five reporting items for CHM-placebo information, namely 1) name and amount of each ingredient of the placebo; 2) description of the similarity of placebo with the intervention (e.g., color, smell, taste, appearance, packaging); 3) quality control and safety assessment, if any; 4) administration route, regimen, and dosage; and 5) production information: where, when, how, and by whom the placebo was produced .
For clinical research, registration is the first important step which adequately reflected the trial design, including the placebo design. Without detailed reporting of placebos, the purposes of any trial registration, including efficient, objective, accurate transfer of trial information and progress in health care, could be undermined . Therefore, it is recommended that a complete description of the placebo in a trial registration record should be appropriately reported the above five items.
Ethics of placebo application
Ethical issues must be considered prior to designing a placebo-controlled trial of CHM. First, the ethical use of placebos should include receiving approval from the ethics committee and obtaining informed written consent from all participants . This study, however, found that except 251 (69.4%) trials had ethics approval,18 (5%) trials reported they did not obtain ethics approval, and 94 (25.9%) trials did not report whether they had such approval or not.
A second ethical consideration is the type of condition appropriate for placebo design and usage. There were many types of conditions involved in this study and the top three were diseases of circulatory system (12.4%), digestive system (9.9%) and infectious and parasitic diseases (9.6%), which included both of organic diseases and functional diseases. In comparison, previous studies have reported that the common types of diseases considered for placebo usage were functional disease and self-limiting disease, such as functional gastrointestinal disease (e.g. Irritable bowel syndrome) [29,30,31]. In addition, some scholars have suggested that the placebo design and application may be acceptable for the following three categories of conditions: self-healing disease (e.g. acute viral hepatitis); diseases without specific treatments (e.g. multiple viral infectious diseases); and chronic conditions with mild symptoms, where no adverse events are expected from delayed treatment (e.g. rheumatoid arthritis) .
Unfortunately, one of the weaknesses of CHM trial registration records is that inadequate details of study diseases were provided (e.g. early or late, mild or severe, etc.), making it difficult to examine the type of condition appropriate for the use of placebo. In that case, the ethics approval of a trial must be required to provide in the registration system.
Placebo preparation and production
The core issue of placebo design is the preparation and production of a placebo, which included three critical elements: (1) selection of dosage form; (2) selection of materials and amount of each ingredient; and (3) quality control of placebo production. However, in practice, it is a challenge to design a perfectly matching placebo that makes blinding easy .
Our results found that except for 56 trials (15.4%) which did not report placebo dosage form, a total of 12 forms of dosage were identified. The most common one was granule (37.5%), followed by capsule (13.5%) and decoction (11.3%). Some scholars have pointed out that it is easier to design physically identical capsules than other dosage forms , but the capsule was not the first choice in this study. The dosage form of a placebo is the primary factor affecting the design of placebo ingredients and dosage. For example, for granule placebo, it is recommended to choose excipients that mimic the color and taste of the testing CHM, and then to spray them with CHM to create identical smell . It is essential that these placebos, even though they have ingredients from the intervention, should be inert. For decoction placebo, the protocol is similar, that is, the placebo contains a low concentration (e.g. 5–10%) of the intervention CHM .
In terms of ingredients of the placebo, two main categories were discovered in this study: (1) with CHM ingredients; and (2) without CHM ingredients. For the first category, there were three common types: (a) all tested CHM formula ingredients were included in the placebo; (b) some of the tested CHM formula ingredients were included in the placebo; and (c) tested CHM formula ingredients plus other agents were included in the placebo. Normally, the dosages of applied CHM ingredients were in low percentage, such as 2, 5% or 10% only. For those without CHM ingredients, the placebo was mainly composed of excipients, such as flour, starch, dextrin, plus coloring agents and flavoring agents. In previous study, Tang XD et al. have suggested that it is better, in general, to choose unbiasedness foodstuffs as excipients for CHM placebos. If there are difficulties in simulating color, taste and smell of CHM, a low dosage of CHM ingredients could be added in the placebo, but the pharmacologically inertness meeting the acceptance of professional experts should be ensured .
It is important to make sure the quality of placebo production should be under rigor control. As with any CHM intervention, quality control of placebo production should follow a strict, systematic procedure, including requirements from selection of raw materials to production of the final products . Unfortunately, this issue has largely been ignored. In this study, among 363 included trials, only 14 trials reported the manufacturer, e.g., Sanjiu Medical & Pharmaceutical Co., Ltd., Jiangyin Tianjiang Pharmaceutical Co., Ltd. Therefore, it is generally recommended that the manufacturer of placebo should have certification of Good Manufacturing Practice (GMP) .
Methods of placebo assessment
Placebo assessment deserves special attention because ensuring that a placebo has two qualities, e.g., physically identical and pharmacologically inertness, is essential. Any activity due to the placebo will affect the relative efficacy of the intervention, whether positively or negatively . According to this study, 52 trials described the similarity of placebo with the CHM intervention in terms of color, smell, taste, appearance, package, shape, size, weight, texture, etc., and 2 trials reported testing for pharmacological inertness. However, no trial had reported any planned testing methods or any objective indicators for placebo assessment. The selection of methods for placebo assessment can also affect the trial’s blinding evaluation.
Previous studies have reported two methods for placebo assessment: (1) artificial scoring (e.g., the placebo score from judgement of different assessors) ; and (2) bionic electronic evaluation (e.g., use of artificial intelligence products to evaluate the smell and taste of placebo) . Given the subjectivity of artificial scoring, some scholars have developed a placebo quality checklist with an improved version for artificial scoring , with the goal of standardizing the artificial evaluation system. By contrast, using bionic electronic nose and electronic tongue to test the smell and taste of the placebo might be a feasible way to collect objective indicators of placebo evaluation [44, 45]. Therefore, using both artificial scoring and electronic evaluation, based on a predefined weight coefficient of each indicator, could help ensure relatively objective assessment of a placebo and its successful rate of blinding.
PICOS (participant, intervention, control, outcome and study type) related with placebo design
A good design of placebo not only depends on the quality of placebo itself, such as placebo preparation, production and so on, it also related to the overall quality of its trial design, particular in the design of participant, intervention, comparison, outcome and study type (PICOS). This study found that the common reporting design of PICOS in the trial included (1) the circulatory system diseases; (2) granule of CHM formula; (3) solely placebo as control; (4) with objective and subjective outcomes; and (5) interventional clinical trial in phase II.
In a CHM placebo-controlled trial, the first consideration could be whether participants/diseases are suitable for use of placebo and under the ethical requirements. This issue has been discussed in the above (e.g., Ethics of placebo application). For the intervention, compared with a single herb or a chemical drug, a CHM formula has more special, more complex features in color, smell and taste, thus increasing the difficulty in placebo simulation. Thus, the placebo design of the CHM formula has been the topic of lively discussion for years. Some scholars have indicated that learning and accumulating experiences related to CHM-placebo creation are considered critical [46, 47]. For the control group, some scholars have believed that the selection of placebo control plus active drug control (e.g., a three-arm study) could be more suitable for clinical trials evaluating new drugs, especially drugs for diseases that are susceptible to psychological impact, such as analgesia, depression, dementia, etc. [48, 49]. Some other scholars have suggested that an add-on design, that is, conducting baseline treatment in both the experimental group and placebo group, could be used in organic diseases with effective treatment and aims to reduce mortality or morbidity of diseases . Thus, an appropriate design of control group could be according to characteristics of the participants/diseases being studied. For the selection of outcomes, placebo effect also needed to be considered [51, 52]. For example, some scholars have recommend using subjective indicators to evaluate efficacy of the CHM intervention compared with the placebo comparator . In this study, a total of 239 (65.8%) trials included the subjective outcomes. For study type, it is generally suggested that placebos are usually used in CHM interventional clinical study phases of II and III [54, 55]. This study, however, found that some trials were not within this scope (e.g., in the phase I or IV). Thus, the placebo design and application needed to be further standardized.
Our study has some limitations. First, this study included CHM trials with placebo control that were registered up to 31 December 2017. Any trials registered in regions which had not yet been included in ICTRP by that time have not been included. Second, this study mainly relied on registration information collected from specific registries, not on study protocols and publications. Third, some CHM placebo-controlled trials were conducted without being registered. This means that our results are not necessarily comprehensive. However, we believe that the general trends indicated by the analysis of the information we did use, even if incomplete, are valid.
To improve the quality of placebo design in CHM clinical trials, we recommend as follows:
The criteria of whether to design or apply a placebo should be strictly followed the scientific and ethical requirements. Ethical approvals must be reported in the trial registration records, which is also required in the trial registration checklist of WHO trial registration data set (TRDS) (e.g., Item 21: Ethics review) .
Physical identical and pharmacological inert are the basic requirements for placebo design. Currently, it is difficult to makeup a perfectly matching placebo of CHM formula because of its special color, taste and smell. Thus, a standardized methodological procedure for designing CHM placebos should be developed.
As blinding assessment is very important to placebo-controlled trials, it is recommended to adopt or design the appropriate method(s) for placebo evaluation, such as the combination of artificial scoring and electronic evaluation.
Factors of PICOS, including the type of participants, CHM intervention and outcome, and the selection of control group design, should be seriously taken into consideration when designing a CHM placebo-controlled clinical trial.
Reporting of placebo characteristics information are encouraged as detailed as applicable, including composition, physical similarity, pharmacologically inert test, quality control, evaluation method(s) and so on.
In summary, currently, the placebo design in WHO-registered CHM trials is not optimal particular in its preparation, application, evaluation and reporting, which undermining their intended value in such trials. The development of a full set of CHM-placebo standards, including usage requirements, preparation specifications, quality assessment and reporting guideline, could alleviate this problem. This could be achieved by combined efforts of health professionals, research scientists and pharmaceutical manufacturers.
Availability of data and materials
The original data used for this study can be freely downloaded from ICTRP search portal at http://apps.who.int/trialsearch/ and through hyperlinks to access the specific registries.
Australian New Zealand Clinical Trials Registry
China Food and Drug Administration
Chinese Clinical Trial Registry
Chinese herbal medicines
Clinical Research Information Service-Republic of Korea
Clinical Trials Registry-India
German Clinical Trials Register
EU Clinical Trials Register
Food and Drug Administration
Good Manufacturing Practice
International Clinical Trials Registry Platform
Iranian Registry of Clinical Trials
International Standard Randomized Controlled Trial Number Register
Japan Primary Registries Network
Netherlands National Trial Register
Pan African Clinical Trial Registry
Participant, Intervention, Control, Outcome and Study Type
Randomized controlled trial
Brazilian Clinical Trials Registry
Peruvian Clinical Trials Registry
Cuban Public Registry of Clinical Trials
Sri Lanka Clinical Trials Registry
Traditional Chinese medicine
Thai Clinical Trials Register
Trial Registration Data Set
World Health Organization
Bian ZX, Moher D, Dagenais S, Li YP, Liu L, Wu TX, et al. Improving the quality of randomized controlled trials in Chinese herbal medicine, part II: control group design. Zhong Xi Yi Jie He Xue Bao. 2006;4(2):130–6.
Xie ZJ, Wen CP, Fan YS. Discussion on quality control of randomized, double-blind and placebo controlled clinical trial of Chinese medicine. Chin J Tradit Chin Med Pharm. 2012;27(6):1479–81 [Article in Chinese].
Dube A, Manthata LN, Syce JA. The design and evaluation of placebo material for crude herbals: Artemisia afra herb as a model. Phytother Res. 2007;21(5):448–51. https://doi.org/10.1002/ptr.2084.
Shapiro AK. A historical and heuristic definition of the placebo. Psychiatry. 1964;27:52–8. https://doi.org/10.1080/00332747.1964.11023375.
Stewart-Williams S, Podd J. The placebo effect: dis-solving the expectancy versus conditioning debate. Psychol Bull. 2004;130(2):324–40. https://doi.org/10.1037/0033-2909.130.2.324.
Food and Drug Administration. Botanical Drug Development Guidance for Industry. https://www.fda.gov/downloads/Drugs/Guidances/UCM458484.pdf (Accessed 13 Sept 2018).
Smoak R Jr. Placebo: its action and place in health research today. Sci Eng Ethics. 2004;10(1):9–13.
The Council for International Organizations of Medical Sciences. International ethical guidelines for biomedical research involving human subjects. Bull Med Ethics. 2002:17–23.
Meissner K, Bingel U, Colloca L, Wager TD, Watson A, Flaten MA. The placebo effect: advances from different methodological approaches. J Neurosci. 2011;31(45):16117–24. https://doi.org/10.1523/JNEUROSCI.4099-11.2011.
Meissner K, Distel H, Mitzdorf U. Evidence for placebo effects on physical but not on biochemical outcome parameters: a review of clinical trials. BMC Med. 2007;5:3. https://doi.org/10.1186/1741-7015-5-3.
Fritze J, Möller HJ. Design of clinical trials of antidepressants: should a placebo control arm be included? CNS Drugs. 2001;15(10):755–64. https://doi.org/10.2165/00023210-200115100-00002.
Chen HC, Hsieh MT. Clinical trial of suanzaorentang in the treatment of insomnia. Clin Ther. 1985;7(3):334–7 [Article in Chinese].
China Food and Drug Administration. Technical Requirements for Clinical Research of New Drugs in Traditional Chinese Medicine. http://www.docx88.com/wkid-27a28e18c281e53a5802fffc-1.html (Accessed 13 Sept 2018).
Gupta U, Verma M. Placebo in clinical trials. Perspect Clin Res. 2013;4(1):49–52.
ISRCTN69696725. Randomised, controlled, double-blind trial of Chinese Herbal Medicine as adjuvant treatment in patients with Crohn's disease. https://doi.org/10.1186/ISRCTN69696725 (Accessed 13 Sept 2018).
Vickers AJ, de Craen AJ. Why use placebos in clinical trials? A narrative review of the methodological literature. J Clin Epidemiol. 2000;53:157–61. https://doi.org/10.1016/S0895-4356(99)00139-0.
Li QS, Cao Y, Ji CH, Liu S, Zhang Y. Thinking on quality evaluation for traditional Chinese medicine placebo. Chin J Tradit Chin Med Pharm. 2017;32(6):2365–8 [Article in Chinese].
Wu SP, Xu LP, Guo Y, Cui YS, Zhao XY, Li Y, et al. Current application of placebo in Chinese clinical studies in past 30 years. Zhongguo Zhong Yao Za Zhi. 2015;40(7):1410–4. [Article in Chinese]. https://doi.org/10.4268/cjcmm20150736.
Qi GD, Wei DA, Chung LP, Fai CK. Placebos used in clinical trials for Chinese herbal medicine. Recent Patents Inflamm Allergy Drug Discov. 2008;2(2):123–7. https://doi.org/10.2174/187221308784543700.
Zhong YQ, Fu JJ, Liu XM, Diao X, Mao B, Fan T, et al. The reporting quality, scientific rigor, and ethics of randomized placebo-controlled trials of traditional Chinese medicine compound formulations and the differences between Chinese and non-Chinese trials. Curr Ther Res Clin Exp. 2010;71(1):30–49. https://doi.org/10.1016/j.curtheres.2010.02.001.
Fu JJ, Wang G, Mao B. The assessment of scientificalness and ethic of placebo-controlled trials in traditional Chinese medicine. Chin J EBM. 2008;8(9):781–5 [Article in Chinese].
Guan DQ, Liang BZ, Zheng JH, An W. Systematic review on placebo used in clinical trials of new drug in traditional Chinese medicine. J Nanjing Tradit Chin Med Univ. 2006;22(3):183–5. [Article in Chinese]. https://doi.org/10.14148/j.issn.1672-0482.2006.03.018.
Wang Q, Wang YR, Qi XF, Liang QQ. Placebo study in the randomized clinical trials of Chinese decoction. World Chin Med. 2016;11(8):1631–9 [Article in Chinese].
Wu J. Placebo control and clinical trial of Chinese medicine. Zhong Xi Yi Jie He Xue Bao. 2010;8(10):906–10. [Article in Chinese]. https://doi.org/10.3736/jcim20101001.
Wang RR, Liu YJ, Yang TJ, He ZX, Wu CJ. Objective and quantitative evaluation for traditional Chinese medicine placebo. Mod of Tradit Chin Med and Mater Med-World Sci Tech. 2014;16(3):485–9. [Article in Chinese]. https://doi.org/10.11842/wst.2014.03.005.
Cheng CW, Wu TX, Shang HC, Li YP, Altman DG, Moher D, et al. CONSORT extension for Chinese herbal medicine formulas 2017: recommendations, explanation and elaboration. Ann Intern Med. 2017;167(2):112–21. https://doi.org/10.7326/M16-2977.
Angelis CD, Drazen JM, Frizelle FA, Haug C, Hoey J, Horton R, et al. Clinical trial registration: a statement from the International Committee of Medical Journal Editors. N Engl J Med. 2004;351:1250–1. https://doi.org/10.1056/NEJMe048225.
Lichtenberg P, Heresco-Levy U, Nitzan U. The ethics of the placebo in clinical practice. J Med Ethics. 2004;30(6):551–4. https://doi.org/10.1136/jme.2002.002832.
Moerman DE. Meaning, medicine, and the “placebo-effect”, vol. 12. Cambridge: Cambridge University Press; 2002.
Pitz M, Cheang M, Bernstein CN. Defining the predictors of the placebo response in irritable bowel syndrome. Clin Gastroenterol Hepatol. 2005;3(3):237–47. https://doi.org/10.1016/S1542-3565(04)00626-3.
Benninga MA, Mayer EA. The power of placebo in pediatric functional gastrointestinal disease. Gastroenterol. 2009;137(4):1207–10. https://doi.org/10.1053/j.gastro.2009.08.023.
Liu JP. Design of control and blinding in clinical trials of traditional Chinese medicine. Zhongguo Zhongxiyi Jiehe Za Zhi. 2003;23(10):789–91 [Article in Chinese].
Wang LQ, Li Q, CX SU, Liu JP. Application and evaluation of blind method in randomize controlled trials of Chinese medicine. J Tradit Chin Med. 2014;55(1):28–33. [Article in Chinese]. https://doi.org/10.13288/j.11-2166/r.2014.01.008.
Podczeck F, Jones BE. Pharmaceutical capsules, vol. 92. London: Pharmaceutical Press; 2004.
Huang QH, Xiao J, Sun YM, Hu XD. Preparation method and quality evaluation of Chinese medicine compound placeboes. J Tradit Chin Med. 2015;56(15):1294–7. [Article in Chinese]. https://doi.org/10.13288/j.11-2166/r.2015.15.010.
Lin M, Tang XD, Wang FY. Pharmacodynamics study on Chang’an I and control placebo containing low concentration original drug. Shenzhen J Integr Med. 2009;19(5):273–8 [Article in Chinese].
Tang XD, Bian LQ, Gao R, Guan SJ. Exploration into the preparation of placebos used in Chinese medicinal clinical trial. Zhongguo Zhong Xi Yi Jie He Za Zhi. 2009;29:656–8 [Article in Chinese].
Leung KSY, Bian ZX, Moher D, Dagenais S, Li YP, Liu L, et al. Improving the quality of randomized controlled trials in Chinese herbal medicine, part III: quality control of Chinese herbal medicine used in randomized controlled trials. Zhong Xi Yi Jie He Xue Bao. 2006;4(3):225–32.
Wu F, Lu ZQ, Hu JL, Wu M, Feng Y, Zhang JQ, et al. Design and quality control of traditional Chinese medicine formula placebo for the clinical trials. Chin J New Drugs. 2018;27(11):1255–61 [Article in Chinese].
Kaptchuk TJ, Miller FG. Placebo effects in medicine. N Engl J Med. 2015;373:8–9. https://doi.org/10.1056/NEJMp1504023.
Wang YF, Ruan XM, Wu HL, Ou AH, Cao BJ, Mu QY, et al. Preparation of Chinese herbal medicine placebos and efficacy evaluation in Large-scale double-blind clinical trials. Tradit Chi Drug Res Clin Pharm. 2011;22(3):255–8. [Article in Chinese]. https://doi.org/10.19378/j.issn.1003-9783.2011.03.007.
Wang RR, Luo D, He ZX, Wu CJ. Objective evaluation of Huoxiang Zhengqi particles placebo. Chin J Exper Tradit Med Form. 2014;20(12):91–5. [Article in Chinese]. https://doi.org/10.13422/j.cnki.syfjx.2014120091.
Brinkhaus B, Pach D, Lüdtke R, Willich SN. Who controls the placebo? Introducing a placebo quality checklist for pharmacological trials. Contemp Clin Trials. 2008;29(2):149–56. https://doi.org/10.1016/j.cct.2007.06.005.
Li S, Li XR, Wang GL, Nie LX, Yang YJ, Wu HZ, et al. Rapid discrimination of Chinese red ginseng and Korean ginseng using an electronic nose coupled with chemometrics. J Pharm Biomed Anal. 2012;70:605–8. https://doi.org/10.1016/j.jpba.2012.06.009.
Li L, Yang SL, Xu M, Zhong L, Wang YW, Ai L. Odor and taste discrimination of Chinese hawthorn based on electronic nose and electronic tongue. Chin J Exper Tradit Med Form. 2015;21(5):99–102. [Article in Chinese]. https://doi.org/10.13422/j.cnki.syfjx.2015050099.
Price DD, Finniss DG, Benedetti F. A comprehensive review of the placebo effect: recent advances and current thought. Annu Rev Psychol. 2008;59(1):565–90. https://doi.org/10.1146/annurev.psych.59.113006.095941.
Jin GQ, Sun L, Xia LH. Preparation and evaluation of placebos for Shenbawei capsules. Chin Pharm. 2014;17(5):734–6 [Article in Chinese].
Temple R, Ellenberg SS. Placebo-controlled trials and active-controlled trials in the evaluation of new treatment. Part I: ethical and scientific issues. Ann Intern Med. 2000;133(6):455–63. https://doi.org/10.7326/0003-4819-133-6-200009190-00014.
Jiang ZJ, Liu JY, Ge FH, Liu JY. Application and consideration of placebo in clinical trial researches of new traditional Chinese medicine. Mod Chin Med. 2013;15(6):463–6. [Article in Chinese]. https://doi.org/10.13313/j.issn.1673-4890.2013.06.022.
Bo QY, Xiong NN, Wu J. International ethical guidelines for the choice of control in clinical trials. Chin J Clin Pharmacol Ther. 2003;8(2):215–8 [Article in Chinese].
Liu WN, Lu Y, Zhong F. Discussion about application of placebo-controlled on syndrome curative efficacy evaluation. Chin J Clin Pharmacol. 2011;27(3):236–40. [Article in Chinese]. https://doi.org/10.13699/j.cnki.10016821.2011.03.003.
Zhang H, Zhu D, Yu QH. Characteristics and problems of the application of placebo in clinical trials of Chinese medicine. Chin J Drug Eval. 2015;32(4):237–40 [Article in Chinese].
Wang HW. Systematic review on placebo used in clinical trials of Chinese herbal medicines in traditional Chinese medicine. Dissertation of Liaoning. Univ Tradit Chin Med. 2014;4:5–6 [Article in Chinese].
Kong KH, Wee SK, Ng CY, Chua K, Chan KF, Venketasubramanian N, et al. A double-blind, placebo-controlled, randomized phase II pilot study to investigate the potential efficacy of the traditional Chinese medicine neuroaid (MLC 601) in enhancing recovery after stroke (TIERS). Cerebrovasc Dis. 2009;28:514–21. https://doi.org/10.1159/000247001.
Mease PJ, Fleischmann R, Deodhar AA, Wollenhaupt J, Khraishi M, Kielar D, et al. Effect of certolizumab pegol on signs and symptoms in patients with psoriatic arthritis: 24-week results of a phase 3 double-blind randomised placebo-controlled study (RAPID-PsA). Ann Rheum Dis. 2014;73(1):48–55. https://doi.org/10.1136/annrheumdis-2013-203696.
World Health Organization International Clinical Trials Registry Platform. WHO trial registration data set (Version 1.3). http://www.who.int/ictrp/network/trds/en/ (accessed 13 Sept 2018).
The authors thank Dr. Martha Dahlen for providing valuable comments of the manuscript.
This study was supported by FunRenHuang Medical Foundation.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Zhang, X., Tian, R., Zhao, C. et al. Placebo design in WHO-registered trials of Chinese herbal medicine need improvements. BMC Complement Altern Med 19, 299 (2019) doi:10.1186/s12906-019-2722-2
- Chinese herbal medicine (CHM)
- Traditional Chinese medicine (TCM)
- Clinical trial registration
- WHO ICTRP