- Research article
- Open Access
- Open Peer Review
A systematic review of the quality of homeopathic clinical trials
© Jonas et al; licensee BioMed Central Ltd. 2001
- Received: 13 July 2001
- Accepted: 31 December 2001
- Published: 31 December 2001
While a number of reviews of homeopathic clinical trials have been done, all have used methods dependent on allopathic diagnostic classifications foreign to homeopathic practice. In addition, no review has used established and validated quality criteria allowing direct comparison of the allopathic and homeopathic literature.
In a systematic review, we compared the quality of clinical-trial research in homeopathy to a sample of research on conventional therapies using a validated and system-neutral approach. All clinical trials on homeopathic treatments with parallel treatment groups published between 1945–1995 in English were selected. All were evaluated with an established set of 33 validity criteria previously validated on a broad range of health interventions across differing medical systems. Criteria covered statistical conclusion, internal, construct and external validity. Reliability of criteria application is greater than 0.95.
59 studies met the inclusion criteria. Of these, 79% were from peer-reviewed journals, 29% used a placebo control, 51% used random assignment, and 86% failed to consider potentially confounding variables. The main validity problems were in measurement where 96% did not report the proportion of subjects screened, and 64% did not report attrition rate. 17% of subjects dropped out in studies where this was reported. There was practically no replication of or overlap in the conditions studied and most studies were relatively small and done at a single-site. Compared to research on conventional therapies the overall quality of studies in homeopathy was worse and only slightly improved in more recent years.
Clinical homeopathic research is clearly in its infancy with most studies using poor sampling and measurement techniques, few subjects, single sites and no replication. Many of these problems are correctable even within a "holistic" paradigm given sufficient research expertise, support and methods.
- Conventional Medicine
- Quality Item
- Conventional Study
- Control Group Design
The popularity of complementary, alternative and unconventional medicine is increasing worldwide. Several surveys have estimated that between 30 and 70% of patients in developed countries use these practices, depending on the population and modality. [1–3] There is, however, a paucity of scientific research on many complementary and alternative medical (CAM) practices. A recent commentary in the Archives of Internal Medicine (vol. 156, pp. 2162–2164) called for more research into one of the most controversial of these practices, homeopathy, to determine its quality and clinical efficacy, putting aside for the moment its implausibility.
Over the past several decades there have been a number of clinical trials on various forms of homeopathic treatment for a host of disorders from stroke and post-operative complications to arthritis and fibromyalgia to influenza and upper respiratory track infections. [4, 5] While the treatment and conditions studied vary, they share the common property of representing clinical outcome research on forms of homeopathic medicine. Several independent systematic reviews published to date on this research have all shown a surprising number of positive results, even among those trials that received high quality ratings for randomization, blinding, sample size and other methodological criteria. [4–6] None of these reviews, however, have looked at a broad spectrum of validity criteria and none have compared the quality of homeopathic research to conventional research using methods that were not derived from a conventional clinical diagnostic framework.
A number of authors have addressed the difficulties encountered in experimental studies of homeopathy. [5, 7–12] While these issues have been extensively discussed in the homeopathic literuature, the issues are not well known in the conventional literature. The main issue relevant to assessment of research quality is that the theoretical and clinical approaches of homeopathy use different diagnostic and therapeutic taxonomies than conventional medicine. Unlike conventional medicine that attempts to isolate cause – effect links between single treatments and specific diseases, homeopathic medicine focuses on the stimulation of broad healing processes that have influences on a variety of conditions and symptom patterns.  Current classical homeopathic practitioners use complex pattern recognition procedures (often computer assisted) to initiate treatment, evaluate patient response and adjust therapy. It is within this so-called "holistic" paradigm that researchers continue to attempt a critical examination of the specific effects of homeopathic therapies as they relate to conventional diagnostic categories. Lack of homeopathic expertise by researchers or difficulties in modification of homeopathic practice goals to fit conventional diagnosis-based research designs can cause confusion in the design and execution of clinical trials and in the evaluation and interpretation of results. For example, a study by Shipley on the treatment of osteoarthritis with the homeopathic remedy Rhus tox reported no difference in outcome compared to placebo.  The method for identifying patients who fit the pattern most likely to respond to Rhus tox was crude, however, reflecting poor homeopathic practice. A follow-up study by Fisher did a detailed evaluation of a set of patients with fibromyalgia who fit the detailed pattern of Rhus tox. using expert homeopathic methods. A randomized controlled trial in this group showed increased effects of Rhus tox over placebo. 
These differing frameworks also complicate our ability to comparatively evaluate these systems. [7–11] The lack of support for homeopathic therapies among Western practitioners stems, in part, from the scarce quantity and perceived poor quality of homeopathic clinical research. However, no studies have directly compared the quality of research in homeopathic to conventional medicine using a quality assessment method that is neutral to their differing diagnostic classifications, treatment and outcome strategies. A meta-analysis of homeopathic clinical trials (on which WJ was the corresponding author) evaluated some specific quality parameters of 89 placebo-controlled trials of homeopathy using commonly used methods for addressing conventional medical studies.  This study reported that homeopathic clinical trials scored about the same as conventional trials on the Jadad scale of quality assessment. The Jadad scale contains only 5 items, however, and measures simple components of internal validity.  No information about external validity, generalizability, statistical validity, effects when compared to conventional treatments, and other important trial quality items were assessed.
When doing this meta-analysis, it became clear to us that using review criteria based on diagnostic classifications developed for assessing conventional medicine did not address the differing classification frameworks between homeopathy and conventional medicine. There were practically no studies that addressed both classification schemes and very few that preselected a uniform set of patients according to homeopathic criteria before testing (as in the Fisher trial described above). This resulted in a heterogeneity problem, that is, we were mixing very different types of conditions and classifications but reviewing them from the perspective of one of these classification systems. This problem was not solvable by using narrow review criteria created for one (conventional) system. What was needed was a set of valid quality criteria that were neutral to these two systems with very different theoretical bases and approaches. We felt that an evaluation system called "Systematic Review" (SR) developed by Light and Pillemer  provided such an approach since the review criteria were not depended on diagnostic homogeneity and so address quite disparate frameworks. SR is comprehensive, objective and validated quality assessment method yet also with broad in applicability. It was originally derived and extensively applied to heterogeneous systems of intervention in the social, educational and behavioral sciences but has since been expanded to the evaluation of medicine – both conventional and complementary. [17–19] It allows for a comprehensive assessment of research quality across a variety of study designs and intervention areas.
In SR, the methodological characteristics critical for attaining reliable and valid research results are evaluated across a variety of studies and study designs. By quantitatively evaluating components of research design, statistical methods, generalizability, bias and related findings, SRs provide an estimate of over 30 quality variables in a study set. Collectively, these criteria are referred to as "threats to validity." In addition to providing a comprehensive assessment of quality the systematic evaluation of scientific methods provides a framework from which future studies can be designed. In addition to its application in the social and behavioral sciences, SRs have been successfully applied to conventional and complementary medical approaches including nursing care , religion and mental health research , abortion , and physiotherapy. Because it provides an approach to the evaluation of disparate systems, we used the SR method to evaluate a sample of homeopathic clinical trials and compare them to the quality of research in conventional studies previously evaluated by the SR method . Our specific aim was to get representative samples of the "best" research in both homeopathy and conventional medicine and objectively evaluate their quality using a "system neutral" approach to research assessment.
A multiple strategy search was undertaken to identify research on homeopathic treatments that used the strategy from the comprehensive review by Linde, et al.  Briefly, this involved 1) the review by Kleijnen, et al. published in 1991,  which used a extensive search strategy for Medline and Embase up to 1990; 2) a direct search of Medline from 1966 to August 1995 using the full text terms homeop*, homoeop*, and the Mesh terms homoeopathy, homoeopathy, and alternative medicine and screening of all citations found; 3) contacts with homeopathic researchers, institutions reporting on homeopathic research, homeopathic manufacturers and follow-up on suggestions from these contacts; 4) searching several extensive homeopathic and complementary medicine registries including those of the Woodward Foundation (USA); CISCOM (RCCM, London); AMED (British Library); HomInform (Glasgow, Scotland); IDAG (Amersfoort, Netherlands); and CCRH (India) as well as several individual collections; 5) attending homeopathic meetings and searching the conference proceedings, abstract ebooklets, and indexes from meetings and homeopathic books; 6) the references of reviews and trials found; 7) and additional on-line searches of Medline and Embase from 1989 to October 1995. We operationally defined homeopathic research as studies involving serially prepared dilutions selected according to commonly used methods, including classical, clinical, and complex approaches including pathological and isopathic and tautapathic remedy selection.
We sought to get representative samples of the best research in homeopathy and conventional medicine. There is a large disparity in the amount of research in conventional and homeopathic medicine. In addition, there are recognized journals in conventional medicine publish the best research, while this is not the case in homeopathy. We therefore used different approaches to identify the best articles in these databases as follows. For homeopathy, articles had to meet the following criteria: (1) use of a homeopathic intervention for a clinical condition in a comparative trial; (2) assessment of the outcome of the intervention using an empirical measure of some type; (3) be prospective and involve a parallel control group for comparison with homeopathic treatment; (4) have sufficient information reported for us to score with SR review criteria; (5) be in English. We included criterion (3 – studies in parallel control groups) because there is a vast literature of case and series outcome reports in homeopathy that are not written for purposes of research and so would not represent the "gold standard" for homeopathic research.
Evaluation of study quality
Each article was reviewed using an established coding form previously used and validated for SRs to assess the characteristics and quality of empirical research. [19–21] In addition, we determined whether the primary study outcome (as determined by the author or, if unclear, selected by the primary reviewer) was improved, unchanged or made worst by homeopathic treatment. All articles were reviewed through a contract by a person specifically trained in the SR method, and has experience in applying it to a variety of study sets. This reviewer had no previous experience or opinion about homeopathy and was hired to apply the SR methods to this data set. In addition, the quality of these reviews were checked for reliability and accuracy on two samples by two other authors who have extensive experience with the SR method and were also neutral about homeopathy (RA and JL). All criterion are scored as either "met" if the quality items was present and adequate or "not met" if the quality item was either missing or inadequately met. The reliability of these review criteria was consistently greater than 0.95 between and among reviewers. Finally, we checked for trends in quality of the homeopathic literature over time by analyzing studies separately in three groups – those published before 1980 (n = 17), and from 1980–89 (n = 29) and 1990–96 (n = 13).
Variables and Definitions Used in Systematic Review
Number of subjects who participated in the research at the initiation of the study
Percent of sample male/female
Average age of sample
Percent of identified racial or ethnic categories
Sample size divided by the total number of people approached for participation
Number of subjects finishing study divided by sample size
How sample was identified–random, systematic, mixed, none, not indicated
Prospective, cross-sectional or retrospective design
Based on highest level used: descriptive, univariate, or multivariate
Who paid for research
Whether or not a control group was used in design
Any indication of the reliability of any measure used.
Use of random assignment to groups
Any measurement or statistical applications that attempt to identify and control for variables that might influence outcomes independent of treatment.
Threats to validity
Threats to Statistical Conclusion Validity
Low statistical power
Rated as any groups < 10 or correlations with fewer than 30 pairs.
Evidence of non-normal distributions with parametric statistics
More than 10 statistical tests without a Bonferroni (or similar) correction.
Reliability of measures
Failure to test, note or reference information on measures
Reliability of treatment
Failure to test or note consistently of the application of treatments
Absence of effort to make measurements reasonably consistent.
Random heterogeneity representative
Absence of effort to ensure that sample is reasonably
Threats to Internal validity
Repeated measures without temporal control
Repeated measures without temporal control on developmentally sensitive outcomes.
Use of measures that are sensitive to the testing process.
Use of poorly or uncalibrated measures.
Study of cases selected from extremes without control group
More than 30% of sample did not complete study
Interaction with selection
Evidence that selection into groups might interact with history, maturation, or testing.
Ambiguity of cause
An association that can be interpreted in either direction vis-à-vis cause and effect.
Diffusion of treatment
Contact between experimental and control subjects.
Compensatory work to Equalization
Evidence that groups are knowledgeable about design and might Equal things out.
Evidence that groups are knowledge about design and might compete with other group members.
Evidence that one group feels disadvantaged through group assignment process.
Threats to Construct Validity
Evidence that choice of measurement operations does not represent the construct.
Use of only one question for central outcome
Use of only one measurement approach (e.g self report) for central outcome
Evidence that subjects might attempt to guess what results should be (absence of appropriate blinding procedures).
Evidence that subjects might become anxious during assessments.
Absence of controls to keep invested parties from participating in the measurement procedures.
Range restriction in measurement
With level of constructs
Threats to External Validity
Interaction of different Treatment
Failure to assess additional treatment received during study.
Interaction of testing And treatment
Evidence that testing might be related to the treatment so that subjects complete tests differently after treatment.
Evidence of a limited measurement approach that may not generalize.
Evidence of a poorly chosen sample that does not represent the population considered.
Interaction of selection And treatment
Evidence that group assignment is influenced by variables related to the likelihood of response to treatment
Interaction of setting And treatment
Evidence that treatment works only in some settings.
Interaction of history And treatment
Evidence that the time during which the study was done may have an impact on findings.
Analysis consisted of descriptive statistics for both sets of studies and a comparison of outcomes in those studies randomized and blinded to those that were not using chi-square method. In addition, we compared the number and percent of "threats-to-validity" in both homeopathic and conventional data sets both individually and in their subgroups.
Characteristics of the Clinical Trials in Homeopathy by Systematic Review
Controlled trials found
Trials included in study
Proceedings or theses
Number of journals
No funding support indicated
Funded by private foundation
Race and ethnicity stated
United States Subjects
Sample size < 100
Sampling frame not stated
Failed to consider confounders
Number screened reported
Drop out rate reported
Average drop out rate
Improvement from treatment
No effect from treatment
Worse from treatment
Across all studies that reported the gender of subjects, 60% of subjects were female and 40% male. Seven studies (11.9%) were entirely female samples while two studies (3.4%) were entirely male samples. Nearly half of all studies (n = 27; 45.8%) failed to report the gender of subjects. No study indicated the race or ethnicity of its sample. Thirty-nine studies (66.1%) indicated the national origins of the sample with only one study comprising subjects from the United States (1.7%) and 38 studies comprising residents of other countries (64.4%). The average sample size was 2,135; however, this high average results from a single study of 18,640. The median sample size was 59, with a range from 10 to 934 (excluding the outlier). Two thirds of studies (n = 40; 67.8%) had a sample size below 100.
Percent of studies with specific threats to validity of homeopathic and conventional interventions.
Statistical Conclusion Validity
Low Statistical Power
Violated Assumptions of Statistical Tests
Fishing/Error Rate Problem
Reliability of Measures
Reliability of Treatment Implementation
Random Irrelevancies in Experimental Setting
Random Heterogeneity of Subjects
Interaction with Selection
Ambiguity of Direction of Causality
Diffusion of Treatment
Compensatory Equalization of Treatments
Inadequate Pre-operational Explication of Constructs
Confounding Constructs with Level of Constructs
Interaction of Testing and Treatments
Restricted Generalizability Across Constructs
Interaction of Selection and Treatment
Interaction of Setting and Treatment
Interaction of History and Treatment
No study reported the reliability of measures. Almost all studies failed to report response rates, that is, the number of patients screened compared to the number who entered the study (n = 57, 96.6%). Of the two studies that reported the proportion of subjects approached who participated, the average response rate was 36.5%. Nearly two thirds of studies (n = 38, 64.4%) did not report the attrition or drop-out rate. For those reporting this item, an average of 16.9% of subjects began the experiment but failed to complete it.
A total of 229 outcome variables were identified, an average of about 4 outcomes per study. Of these, 62 (27%) were only descriptive and no attempt was made to determine how they were affected by the homeopathic treatment. Seventy-three variables (32%) were reported to have statistically significant improvement as a result of the treatment. Ninety outcome variables (39%) were unaffected by the treatment, while four variables (2%) were made significantly worse by the treatment.
The probability of a positive outcome was significantly lower when random assignment was used than when random assignment was not used (chi square= 11.9, p < .001) a finding often found in study series and confirmed by others in homeopathic trials.  However, when the homeopathic treatment was compared to a conventional medical treatment, the probability of a positive outcome was significantly higher than when a placebo control was used (chi square = 15.3, p < .0001).
The overall quality scores in homeopathic trials improved somewhat from 1945 to 1995. Cohort group summary scores went from 30% total validity threats in studies done prior to 1980 (n = 17), to 26% validity threats between 1980–1989 (n = 29) and 24% between 1990 and 1996 (n = 13) (NS).
This review of clinical outcome research in homeopathy has several important implications for the field not revealed in other reviews. Despite the absence of funding, it appears that a number of prospective clinical trials using random assignment and control group designs have been accomplished. The results of these studies suggest that, in general, homeopathic treatments may offer some promise, particularly when compared to conventional medical treatments. As expected, the findings are less impressive when a placebo control and randomization are used. This pattern may reflect the placebo influences common to both conventional and homeopathic therapies and the possibility of selection bias in favor of homeopathy for many studies reported. Both of these factors would falsely elevate the number of positive studies reported in homeopathic research. On the other hand, homeopathic physicians spend considerably more time per visit with patients than conventional physicians.  The comprehensive interview and long-term follow-up undertaken as part of homeopathic case management increases patient-doctor interaction and likely enhances expectancy and placebo effects. This may make it more difficult to detect and isolate any additional effects from homeopathic preparations, if these occur. Combined with small sample size this might falsely increase the number of negative studies reported. Thus, the effect of the homeopathic clinical process needs to be studied separately from the examination of any specific (non-placebo) effects that might occur from homeopathic drugs. The former should be examined in pragmatic randomized trials that compare homeopathic with standard therapy and the later should be examined using simple laboratory or clinical models that can be easily repeated by independent investigators.
This study has several limitations. The samples of homeopathic and conventional studies were not identical. While we took all conditions in both study samples, we examined all the English language studies in homeopathy over five decades as opposed to more recent studies only in the conventional literature. In addition, we selected only studies with parallel control groups in homeopathy but took all intervention studies in conventional medicine. We did this in attempt to select a "gold standard" sample of research in each area. While this difference between samples should only have effected two of our 33 quality criteria we cannot be sure that other validity scoring were not effected. To assess the relevance of these sampling differences we examined only the more recent studies in homeopathy. Unfortunately we were unable to do a subset analysis of only conventional randomized, placebo controlled trials in our conventional subset in order to confirm the independence of validity threat from study design as previously shown. It is likely that this would have further improved the quality scores of the conventional subset, however, which would not affect our main conclusions about the general quality of research and threats to validity in these two systems.
A second limitation is that the Systematic Review method used in this evaluation is derived from the social and behavioral sciences and is not commonly used in medical research evaluation. We selected this system, however, precisely because it was broad enough to examine disparate theoretical systems in a more even handed manner than review criteria developed specifically for use in a biomedical framework. While the SR method has been used in conventional and complementary medicine evaluations in the past we realize that the system can only help make general estimates of comparative quality and that individual or summary scores between the two systems should not be viewed as precise. Since limitations in score precision is a problem with all such scoring methods we have tried to highlight only the general and obvious validity threats found.
How do the quality issues in homeopathic research compare with conventional medical research? Overall, the quality of homeopathic research is not as good as research in conventional medicine. The quality of homeopathic trials has only slightly improved over time. Homeopathic studies scored worse than conventional studies on validity threats in over 60% of the items rated compared to 15% of the items in which convention studies scored worse. Most of these errors were on items that would effect the generalizability of the results to other settings rather than on failure to control for systematic errors within studies (bias). Several quality issues are similar between homeopathic and conventional studies. Notably, both groups of research consistently fail to report on the reliability of measures used. Unreliable outcome measures can markedly distort the accuracy and value of statistical analysis and interpretation of the results. For example, one otherwise very well done study reported on the rates of tonsillectomy under classical homeopathic versus placebo treatment as a main outcome even though the reliability of clinical decisions for obtaining tonsillectomy are extremely poor, thus, making this comparison meaningless. 
Currently, the greatest weaknesses in homeopathic research are the variety of unreplicated studies and the small sample sizes. Although 59 studies were included, there was virtually no replication and practically no overlap in the conditions studied. Two thirds of the studies had total sample sizes below 100 and many did not do power calculations to determine the required subject numbers. In order to build credibility within the medical research field, multiple replications and/or extensions using the same or similar approaches to treat the same or similar medical conditions are necessary. Similarly, multi-site research with larger sample sizes is essential to improve the confidence and generalizability of findings. As in all of medicine, success in a treatment at one site often does not always translate into success at other locations with different practitioners and patients. A second major flaw of homeopathic studies in many have a high "attrition rate." This means that the data analyzed and reported on is often lower than the entry sample size due to all causes, such as dropouts, lost or incorrectly filled out forms, etc. A high attrition rate can be a major threat to validity in a study. In addition, homeopathic studies often demonstrated a interaction of treatment setting and treatment indicating that non-specific effects in the environment more often contributed to the outcome than in conventional research.
Finally, several fairly simple improvements in the reporting of research findings can help to heighten the quality of these studies. Most importantly, an outlined discussion of study limitations and potential confounders is important for a balanced interpretation of results and for the advancement of existing research. Similarly, a detailed description of sample characteristics, including gender, ethnicity, and attrition rates is necessary for determining generalizability. By precisely delineating study and sample characteristics, research findings can be stated more definitively. The absence of an appropriate framework from which to examine homeopathic remedies is one but not the sole challenge to quality research in this alternative practice. Critical systematic review of these studies identifies a number of areas for improvement. Quality guidelines for conducting research in homeopathy are published.  More critical peer review of homeopathic studies that pay attention to these and other guidelines can advance quality research in this area. Such criteria need to be carefully addressed by investigators if the quality, credibility and usefulness of research in homeopathy is to improve.
The authors would like to thank Michelle Shasha for participating in the review of the homeopathic clinical trial articles. This project has been partially supported by a grant, the Standard Homeopathic Foundation and NIH, NCCAM grant, #AT00178-01.
- Eisenberg DM, Davis RB, Ettner S, Appel S, Wilkey S, Van Rompay M, Kessler RC: Trends in alternative medicine use in the United States 1990–1997: Results of a follow-up national survey. JAMA. 1998, 280: 1569-1575. 10.1001/jama.280.18.1569.View ArticlePubMedGoogle Scholar
- MacLennan AH, Wilson DH, Taylor AW: Prevalence and cost of alternative medicine in Austrialia. Lancet. 1996, 347: 569-573.View ArticlePubMedGoogle Scholar
- Fisher P, Ward A: Complementary medicine in Europe. Br Med J. 1994, 309: 107-111.View ArticleGoogle Scholar
- Kleijnen J, Knipschild P, Riet ter G: Clinical trials of homoeopathy. Br Med J. 1991, 302: 316-23.View ArticleGoogle Scholar
- Linde K, Clausius N, Ramirez G, Melchart D, Eitel F, Hedges LV, Jonas WB: Are the clinical effects of homeopathy all placebo effects? A meta-analysis of randomized, placebo controlled trials. Lancet. 1997, 350: 834-843. 10.1016/S0140-6736(97)02293-9.View ArticlePubMedGoogle Scholar
- Cucherat M, Haugh MC, Gooch M, Boissel JP: Evidence of clinical efficacy of homeopathy. Eur J Clin Pharmacol. 2000, 56: 27-33. 10.1007/s002280050716.View ArticlePubMedGoogle Scholar
- Heron J: Critique of conventional research methodology. Comp Med Res. 1986, 1: 10-22.Google Scholar
- Hornung J, Linde K: Guidelines for the exact description of the preparation and mode of application of serial dilutions and potencies on ultra low dose effects and homoeopathic research – a proposal. Berlin Journal of Research in Homoeopathy. 1991, 1,2: 121-123.Google Scholar
- Patel MS: Evaluation of holistic medicine. Soc Sci Med. 1987, 24: 169-75. 10.1016/0277-9536(87)90249-8.View ArticlePubMedGoogle Scholar
- Fisher S, Greenberg R: How sound is the double-blind design for evaluating psychiatric drugs?. J Nerv Mental Dis. 1993, 181: 345-350.View ArticleGoogle Scholar
- Linde K, Jonas WB: Evaluating complementary and alternative medicine: The balance of rigor and relevance. In: Essentials of Complementary and Alternative Medicine (Edited by Jonas WB, Levin JS) Philadelphia, PA: Lipincott Williams & Wilkins;. 1999, 57-71.Google Scholar
- Linde K, Scholz M, Ramirez G, Clausius N, Melchart D, Jonas WB: Impact of study quality on outcome in placebo-controlled trials of homeopathy. J Clin Epidemiol. 1999, 52: 631-636. 10.1016/S0895-4356(99)00048-7.View ArticlePubMedGoogle Scholar
- Shipley M, Berry H, Broster G, Jenkins M, Clover A, Williams I: Controlled trial of homoeopathic treatment of osteoarthtritis. Lancet. 1983, i: 97-98. 10.1016/S0140-6736(83)91743-9.View ArticleGoogle Scholar
- Fisher P, Greenwood A, Huskisson EC, Turner P, Belon P: Effect of homeopathic treatment on fibrositis (primary fibromyalgia). Br Med J. 1989, 299: 365-366.View ArticleGoogle Scholar
- Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJ, Gavaghan DJ, McQuay HJ: Assessing the quality of reports of randomized clinical trials: is blinding necessary?. Controlled din Trials. 1996, 17: 1-12. 10.1016/0197-2456(95)00134-4.View ArticleGoogle Scholar
- Light R, Pillemer D: Summing up: The Science of Reviewing Research. Cambridge, MA: Harvard University Press;. 1984Google Scholar
- Larson D, Sherrill K, Lyons J, Craige FC, Thielman SB, Greenwold MA, Larson SS: Associations between dimensions of religious commitment and mental health found in the American Journal of Psychiatry and the Archives of General Psychiatry: 1978–1989. Amer J Psychiatry. 1992, 149: 557-559.View ArticleGoogle Scholar
- Lyons J, Larson D, Huckeba W, Mueller C: Research on the psychosocial sequelae of abortion. 1966 to 1985. In: Values and Public Policy, Family Research Council (Edited by Reiger G);. 1988Google Scholar
- Larson D, Lyons J, Hohmann A, Beardsley R, Huckeba W, Rabins P, Lebowitz B: A systematic review of nursing home research in three psychiatric journals: 1966 to 1985. Int J Geriatric Psychiatry. 1989, 4: 129-134.View ArticleGoogle Scholar
- Lyons J, Anderson R, Brule P, Ellison S, Walker S: Systematic review of the peer-reviewed scientific literature on family, marital, and community variables across twenty fields of inquiry. Family Health: From Data to Policy. 1993, 43-60.Google Scholar
- Lyons J, Larson D, Bareta J, Liu I, Anderson R, Sparks C: A systematic analysis of the quantity of AIDS publications and the quality of research methods in three general medical journals. Evaluation and Program Planning. 1990, 13: 73-77. 10.1016/0149-7189(90)90011-K.View ArticleGoogle Scholar
- Jacobs J, Chapman EH, Crothers D: Patient characteristics and practice patterns of physicians using homeopathy. Arch Fam Med. 1998, 7: 537-540. 10.1001/archfami.7.6.537.View ArticlePubMedGoogle Scholar
- de Lange de Klerk E, Blommers J, Kuik DJ, Bezemer PD, Feenstra L: Effects of homeopathic medcines on daily burden of symptoms in children with recurrent upper respiratory tract infections. Br Med J. 1994, 309: 1329-1332.View ArticleGoogle Scholar
- Linde K, Melchart D, Jonas WB, Hornung J: Ways to enhance the quality of clinical and laboratory studies in homeopathy. Br Homoeopath J. 1994, 83: 3-7.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6882/1/12/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article: verbatim copying and redistribution of this article are permitted in all media for any purpose, provided this notice is preserved along with the article's original URL.