Open Access
Open Peer Review

This article has Open Peer Review reports available.

How does Open Peer Review work?

A new prognostic scale for the early prediction of ischemic stroke recovery mainly based on traditional Chinese medicine symptoms and NIHSS score: a retrospective cohort study

  • Ke-Gang Cao1,
  • Cai-Hong Fu1,
  • Huan-Qin Li2,
  • Xi-Yan Xin3 and
  • Ying Gao1Email author
Contributed equally
BMC Complementary and Alternative MedicineThe official journal of the International Society for Complementary Medicine Research (ISCMR)201515:407

https://doi.org/10.1186/s12906-015-0903-1

Received: 28 February 2015

Accepted: 7 October 2015

Published: 16 November 2015

Abstract

Background

Ischemic stroke (IS) is a common disease, often resulting in death or disability. Previous studies on prognosis of stroke mainly focused on the baseline condition or modern expensive tests. However, the change of clinical symptoms during acute stage is considerably neglected. In our study, we aim to develop a new prognostic scale to predict the 90-day outcome of IS patients.

Methods

In this retrospective cohort study, a secondary data analysis was performed on 489 patients extracted from 1046 patients of 4 hospitals. A new prognostic scale was constructed to predict the recovery of IS mainly based on the National Institutes of Health Stroke Scale (NIHSS) score, traditional Chinese Medicine (TCM) symptoms & signs and the changes during the first 3 days of patients in the 3 TCM hospitals. Receiver Operating Characteristic (ROC) curve was used to determine the cutoff point for prediction. In the end, the scale was used to test the outcome of IS patients in Xuanwu hospital.

Results

The new prognostic scale was composed of 8 items including age degree (OR = 3.32; 95 % CI: 1.72–6.42), history of diabetes mellitus (DM) (OR = 2.20; 95 % CI: 1.19–4.08), NIHSS score (OR = 3.08; 95 % CI: 2.16–4.40), anxiety (OR = 3.17; 95 % CI: 1.90–5.29) and irritability (OR = 4.61; 95 % CI: 1.36–15.63) on the 1st day of illness onset, change in NIHSS score (OR = 2.49; 95 % CI: 1.31–4.73), and circumrotating (OR = 7.80; 95 % CI: 1.98–30.64) and tinnitus (OR = 13.25; 95 % CI: 1.55–113.34) during the first 3 days of stroke onset. The total score of the scale was 16.5 and the cutoff point was 9.5, which means patients would have poor outcome at 90 days of stroke onset if the score was higher than 9.5. The new scale was validated on the data of Xuanwu hospital, and the value of its sensitivity, specificity and overall accuracy were 69.6 %, 83.3 % and 75.0 % respectively.

Conclusions

The 8-item scale, mainly based on TCM symptoms, NIHSS score and their changes during the first 3 days, can predict the 90-day outcome for IS patients while it still needs to be further validated and optimized clinically.

Background

Ischemic stroke (IS) is a common disease with the characteristics of high incidence, high mortality, severe morbidity, high recurrence rate and serious complications, and it imposes a huge economic burden on the family and the society [17]. Stroke has been listed as the third leading cause of death following heart diseases and cancer in the world [3, 4, 6]. Ischemic stroke accounts for approximately 80 % of the total cerebrovascular diseases [8]. Therefore, the prevention and treatment of ischemic stroke has attracted a great attention from the medical profession domestically and internationally in recent years [9, 10]. Meanwhile the judgment of stroke prognosis plays an important role in the formulation of health and economic policy and the choice of treatment programs.

Prognosis, affecting both initial therapy and rehabilitation plans of ischemic stroke patients, has been studied for several decades [11]. Previous studies on prognosis of ischemic stroke was mainly focused on the baseline condition or some modern expensive tests like Magnetic Resonance diffusion-weighted Imaging (MR DWI) [12], as well as static signs, such as obviously unconscious [13]. Recently, some researchers have attached importance to the change of signs, such as blood pressure (BP) during the acute stage [14]. However, the change of clinical symptoms during acute stage is consistently neglected. A comprehensive and precise prognosis scale of ischemic stroke still needs to be further developed [15].

The National Institutes of Health Stroke Scale (NIHSS) is widely used to evaluate the severity of neurological deficit of stroke patients [16, 17]. Barthel Index (BI) is the most commonly used tool to evaluate the physical disability and functional recovery after stroke [18, 19]. Modern medical studies also show that these factors such as age, gender, hypertension, diabetes, smoking, and drinking alcohol, have a close relationship with the prognosis of stroke [6, 20, 21].

In Traditional Chinese Medicine (TCM), symptoms or syndromes can influence the diagnosis and treatment of the disease greatly. Many researchers analyse and induce TCM Symptoms or syndrome by means of modern algorithms to be convenient in clinical application [2224]. Several early symptoms such as anxiety, irritability and circumrotating related to stroke outcomes were not only mentioned in ancient literature [25], but also reported by TCM doctors nowadays [26, 27]. It is important for clinical doctors to decide the treatment plan based on these symptoms & signs within the first few hours after stroke onset and predict the likely outcome of patients. Knowing the prognosis of stroke is also very important for stroke patients and their families [12, 28].

However, TCM symptoms have not been applied as the early predictive indicators of stroke outcome in the prognostic scale of stroke. Based on NIHSS score, TCM symptoms and their changes during the first 3 days of stroke onset, we developed a new scale to predict the 90-day outcome in the current study.

Methods

Study design

In the retrospective cohort study, a secondary data analysis was performed on a Microsoft ACCESS database among ischemic stroke patients based on the project of Major State Basic Research Development Program of China (973 Program NO.2003CB517102) (Fig. 1).
Fig. 1

Flowchart of the study recruitment

Ethics

The study protocol was conformed to the Helsinki Declaration [29] and the research regulations for Chinese clinical trials, which was approved by the Ethics Committee of Dongzhimen Hospital affiliated to Beijing University of Chinese Medicine.

Study subjects

1046 cases of ischemic stroke patients were recruited between January, 2004 to December, 2009 from inpatient, outpatient, and emergency department settings in 4 hospitals including three TCM hospitals and one western medicine hospital: Dongzhimen Hospital affiliated to Beijing University of Chinese Medicine, Second Affiliated Hospital of Tianjin University of TCM, Guangdong Provincial Chinese Medicine Hospital and Xuanwu Hospital affiliated to Capital Medical University. All ischemic stroke patients received the standard treatment according to World Health Organization (WHO) criteria [30].

Diagnostic criteria

(1) Western Medicine diagnostic criteria of ischemic stroke referred to WHO criteria and intracranial hemorrhage was further excluded by Computed Tomography (CT) or Magnetic Resonance Imaging (MRI) scan in the hospital [30]. (2) TCM diagnostic criteria with reference to the “Standards of TCM Syndrome-differentiated Diagnosis of Apoplexy” were regulated by the Encephalopathy Accident and Emergency Collaborative Group of State Administration of Traditional Chinese Medicine in 1995 [31].

Inclusion criteria

(1) All patients should conform to the diagnostic criteria of ischemic stroke in Western medicine and apoplexy; (2) Ischemic stroke can be definitely diagnosed by CT or MRI scan; (3) Patients arriving in hospital within 24 h of stroke onset were included. (4) NIHSS scores, TCM symptoms & signs of the first 3 days after stroke onset and data of BI on 90th day were completely recorded.

Exclusion criteria

The exclusion criteria were including: (1) patients with cerebral transient ischemic attacks (TIA); (2) cerebral apoplexy caused by blood diseases, cancer or other causes; (3) accompanying some serious illnesses, such as gastrointestinal hemorrhage, heart or kidney failure, cancer, osteoarthritis and so on; (4) patients with mental disorder or severe dementia; (5) patients with obvious sequel of apoplexy.

Data collection

The observed data including patients’ demographics (age, gender, medical history, etc.), auxiliary examination, stroke onset time and admission time, and TCM clinical symptoms & signs were recorded on the case report form (CRF) by neurologists. TCM symptoms & signs were recorded for the 1st, 2nd, 3rd day and 90th day after stroke onset. The NIHSS was performed by researchers with NIHSS certificate on the 1st, 3rd, 7th, 14th, 28th, and 90th day in the hospital, and the score were recorded. BI on the 90th day of patients was also recorded. For the accuracy and consistence of the data in collecting and testing, a monitoring system for the collection of information and standardized abstraction forms was applied to guide the data collection in case of ambiguous, conflicting, and missing information.

Measurements

Outcome measurement

The BI as a reliable and valid assessment scale can be used to assess the function of ten activities in daily life [32, 33]. The maximum score of 100 indicates a full independence. Good stroke recovery was defined as BI score of 90 or higher, indicating a near full functional independence on the 90th day [34, 35].

Predictors

The NIHSS is widely used to measure the neurological function and predict the outcome of stroke in the clinical practice. It consists eleven graded items including level of consciousness, language function, visual fields, eye movements, facial symmetry, motor strength, sensation, coordination and so on, which has undergone extensive validation and reliable assessments [36]. Clinical nerve function defect could change dramatically during the first 48 to 72 h after stroke onset [37]. In this study, the change in NIHSS scores would be recorded from the difference of scores between the 3rd day and the 1st day of stroke onset [14].

TCM symptoms & signs with appearance rate ≥ 5 % were selected from the database in the actual data analysis. The changes in TCM symptoms & signs during the first 3 days were expressed as disappearance of symptom (disappear), no change (keep) and new appearance (appear) respectively.

In addition, the demographic and clinical factors were assessed, such as age, sex, history of stroke, hypertension, coronary heart disease (CHD), atrial fibrillation (AF), and diabetes mellitus (DM), which were defined as patients with medical treatment history.

Statistical analysis

The data were analyzed by SPSS statistical software version 12.0 (SPSS, Chicago, USA). The measurement data such as age, NIHSS score, BI score and course of disease were expressed as mean ± standard deviation and the enumeration data such as gender and medical history were expressed as counts (percentage). Frequency comparisons were made with the method of Chi-square test. Two-group comparisons of normally distributed data were performed with the independent samples t-test. Mann–Whitney U test was used to analyze the difference of two groups for these unmatched normally distributed data. Correlation between the TCM symptoms & signs and NIHSS score was analyzed by Spearman ranked correlation coefficient. The method of logistic regression was used to further screen prognostic factors and recursive partitioning and classification tree for optimum discrimination of variables classification between good and poor recovery. The cutoff point for the prognostic model of ischemic stroke recovery was determined by Receiver Operating Characteristic (ROC) curve with maximum Youden’s index value. A probability of P < 0.05 was considered to be statistically significant.

Results

Participants

From the total 1046 subjects in the database, 489 ischemic stroke patients were finally enrolled into the study according to the diagnostic criteria and inclusive criteria, which included 413 cases from 3 TCM hospitals and 76 cases from Xuanwu hospital (Fig. 1).

Baseline characteristics of the patients

Table 1 showed the demographics and the baseline characteristics of the 489 patients based on the outcome details with good recovery (good recovery was defined as a score of 90 or higher on the 90-day) (n = 278) and poor recovery (n = 211) measured by BI. The average age of all the patients was 65.8 years old and 63.0 % (n = 308) were men. The average score of NIHSS and BI of all the stroke patients were 6.2 and 77.9 respectively. There were no statistical differences (P > 0.05) between the 3 TCM hospitals and Xuanwu hospital in these demographics and the baseline characteristics including the history of hypertension, stroke, CHD, DM, AF, course of disease, NIHSS scores, and BI score. And the data of these hospitals were comparable.
Table 1

The demographic and baseline characteristics of patients

 

Total

3TCM Hospital

XW Hospital

 

Overall (n=489)

Good (n=278)

Poor (n=211)

Overall (n=413)

Good (n=232)

Poor (n=181)

Overall (n=76)

Good (n=46)

Poor (n=30)

Age,yearsa

65.8 ±11.05

63.6 ± 10.95

68.6 ± 10.55

66.4 ± 10.80

64.0 ±10.89b

69.6 ± 9.82

62.0 ± 11.68

61.8 ± 11.18

62.2 ± 12.60

Male, n (%)

308 (63.0)

185 (66.5)

123 (58.3)

254 (61.5)

151 (65.1)

103 (56.9)

54 (71.1)

34 (73.9)

20 (66.7)

Female, n (%)

181 (37.0)

93 (33.5)

88 (41.7)

159 (38.5)

81 (34.9)

78 (43.1)

22 (28.9)

12 (26.1)

10 (33.3)

Hypertension,n (%)

304 (62.2)

174 (62.6)

130 (61.6)

251 (60.8)

143 (61.6)

108 (59.7)

53 (69.7)

31 (67.4)

22 (73.3)

Stroke History, n (%)

158 (32.3)

79 (28.4)

79 (37.4)

135 (32.7)

68 (29.3)

67 (37.0)

23 (30.3)

11 (23.9)

12 (40.0)

CHD,n (%)

115 (23.5)

62 (22.3)

53 (25.1)

101 (24.5)

51 (22.0)

50 (27.6)

14 (18.4)

11 (23.9)

3 (10.0)

DM,n (%)

99 (20.2)

44 (15.8)

55 (26.1)

82 (19.9)

37 (15.9)b

45 (24.9)

17 (22.4)

7 (15.2)

10 (33.3)

AF,n (%)

28 (5.7)

15 (5.4)

13 (6.2)

24 (5.8)

13 (5.6)

11 (6.1)

4 (5.3)

2 (4.3)

2 (6.7)

Onset-admission,

         

hoursa

10.3 ± 7.11

10.7 ± 7.23

9.7 ± 6.94

10.0 ± 7.17

10.2 ± 7.22

9.7 ± 7.12

11.6 ± 6.68

13.0 ± 6.90

9.38 ± 5.80

NIHSS, day 1a

6.2 ± 4.77

4.4 ± 3.41

8.6 ± 5.24

6.3 ± 4.60

4.5 ± 3.17b

8.5 ± 5.15

6.1 ± 5.67

3.9 ± 4.41

9.5 ± 5.76

BI,day90a

77.9 ±24.26

94.4 ± 1.60

56.0 ± 22.84

77.7 ± 24.13

94.5 ± 1.55

56.4 ± 22.59

78.3 ± 25.12

94.2 ± 1.82

53.8 ± 24.59

TCM traditional Chinese medicine, XW Xuanwu, CHD coronary heart disease, DM Diabetes Mellitus, AF Atrial Fibrillation, NIHSS National Institutes of Health Stroke Scale, BI Barthel Index. Good good recovery, Poor bad recovery

a Data presented as mean ± SD. b There were statistical differences (P < 0.05) between the good and poor recovery

The relationship between TCM symptoms and NIHSS score

In practical analysis, 57 TCM symptoms [see Additional file 1: Table S1] were selected with the appearance rate ≥ 5 % from 157 TCM symptoms & signs except tongue and pulse. Then, the relationship between these TCM symptoms & signs and NIHSS score on the 1st day of stroke onset were analysed with Pearson Correlation, and the results demonstrated that 16 of them were related to NIHSS score closely (P < 0.05). Moreover, the highest correlation coefficient (r2) was 0.451 (Table 2).
Table 2

The relationship between TCM symptoms & signs and NIHSS score

TCM symptom & signs

Correlation coefficient (r2)

P value

Limb flaccid paralysis

0.451

0.000

Incontinence of urinary

0.325

0.000

Cough due to drinking

0.308

0.000

Respiratory rude

0.272

0.000

Irritability

0.255

0.000

Anxiety

0.249

0.000

Analeptic

0.186

0.000

Stiffness and tension in the limbs

0.132

0.003

Purple lips

0.108

0.017

Salivation

0.090

0.047

Tinnitus

−0.099

0.028

Thirst with desire to hot drink

−0.104

0.022

Frequent micturition

−0.107

0.018

Dry mouth

−0.117

0.009

Circumrotating

−0.141

0.002

Dizziness

−0.193

0.000

TCM traditional Chinese medicine. Significant difference, P < 0.05

Construction of the new scale

Screening of the prognostic factors

The new scale was developed based on the data of 3 TCM hospitals. From the general information of patients on the 1st day on admission, age, history of DM and NIHSS score were screened out as the significant prognostic indicators of ischemic stroke (Table 1).

Table 3 showed there were statistical differences (P < 0.05) in 14 TCM symptoms & signs on the 1st day, which were screened from 57 TCM symptoms & signs, between the good and poor recovery measured by BI from the data of 3 TCM hospitals. And the changes of NIHSS score, irritability, circumrotating, tinnitus and difficult to cough sputum during the first 3 days were also related to the outcome (Tables 3 and 4).
Table 3

Comparison of TCM symptoms & signs between good and poor recovery for 3 TCM hospitals

Factors

Good (n = 232)

Poor (n = 181)

P value*

Spiritlessness, day 1,n (%)

107 (46.1)

105 (58.0)

0.016

Anxiety day 1,n (%)

49 (21.1)

94 (51.9)

0.000

Cough due to drinking, day 1,n (%)

48 (20.7)

69 (38.1)

0.000

Anorexia,day 1,n (%)

27 (11.6)

39 (21.5)

0.006

Salivation, day 1,n (%)

22 (9.5)

31 (17.1)

0.021

Analeptic, day 1,n (%)

17 (7.3)

27 (14.9)

0.013

Limb flaccid paralysis, day 1,n (%)

11 (4.7)

28 (15.5)

0.000

Thirst with desire to hot drink, day 1,n (%)

25 (10.8)

9 (5.0)

0.033

Circumrotating, day 1,n (%)

25 (10.8)

8 (4.4)

0.018

Emaciation,n (%)

9 (3.9)

24 (13.3)

0.000

Stiffness and tension in the limbs, day 1,n (%)

12 (5.2)

22 (12.2)

0.010

Tinnitus, day 1,n (%)

23 (9.9)

5 (2.8)

0.004

Irritability, day 1,n (%)

5 (2.2)

18 (9.9)

0.001

Incontinence of urinary, day 1,n (%)

10 (4.3)

19 (10.5)

0.015

Significant difference, P < 0.05

Good: good recovery; Poor: bad recovery

*P values based on Chi-square test

Table 4

The changes of NIHSS and TCM symptoms between good and poor recovery for 3 TCM hospitals

Factors

Total (n =413) Change status

Good (n = 232)

Poor (n = 181)

P value

NIHSS

-

0.54 ± 1.80

−0.45 ± 2.74

0.000a

TCM symptoms & signs

    

Irritability

appear,n (%)

0 (0.0)

3 (1.7)

0.037

 

keep,n (%)

230 (99. 1)

166 (91.7)

 
 

disappear,n (%)

2 (0.9)

12 (6.6)

 

Circumrotating

appear,n (%)

0 (0.0)

4 (2.2)

0.007

 

keep,n (%)

220 (94.8)

174 (96.1)

 
 

disappear,n (%)

12 (5.2)

3 (1.7)

 

Tinnitus

appear,n (%)

1 (0.4)

2 (1.1)

0.002

 

keep,n (%)

219 (94.4)

179 (98.9)

 
 

disappear,n (%)

12 (5.2)

0 (0.0)

 

Difficult to cough sputum

appear,n (%)

4 (1.7)

7 (3.9)

0.031

 

keep,n (%)

221 (95.3)

173 (95.6)

 
 

disappear,n (%)

7 (3.0)

1 (0.6)

 

TCM traditional Chinese medicine. NIHSS National Institutes of Health Stroke Scale

aMann–Whitney U test; Good: good recovery; Poor: bad recovery

Among the selecting factors above, the age, NIHSS score on the 1st day and the change of NIHSS score during the first 3 days were dealt with as continuous variables for optimum discrimination between good and poor recovery by the method of classification tree [12]. The analysis results showed that the two categories of age degree were assigned ≤ 56.44 or > 56.44, the three categories of NIHSS score (on the 1st day) ≤ 2, 3–6, or > 7, the two categories of change in NIHSS score (during the first 3 days) ≤ −1, or > −1 (Fig. 2).
Fig. 2

The optimum discrimination of some independent prognosis variables by the method of Classification Tree

The method of logistic regression was used to further screen prognostic factors from all variables in Tables 1, 3 and 4. On statistical analysis, there were 8 independent prognosis variables were included in the prognosis model: age [Odds ratio (OR) 3.32, P < 0.05], history of DM (OR 2.20, P < 0.05), anxiety (OR 3.17, P < 0.05), NIHSS score (OR 3.08, P < 0.05), irritability on the 1st day (OR 4.61, P < 0.05), and the changes in NIHSS score (OR 2.49, P < 0.05), circumrotating (OR 7.80, P < 0.05) and tinnitus (OR 13.25, P < 0.05) during the first 3 days (Table 5).
Table 5

Screening prognostic fators by the method of logistical regression model in 3 TCM hospitals

Factor

Coefficient (S.E.)

OR (95 % CI)

P value

Age degree

1.20 (0.34)

3.32 (1.72–6.42)

0.000

History of DM

0.79 (0.32)

2.20 (1.19–4.08)

0.012

Anxiety, day 1

1.15 (0.26)

3.17 (1.90–5.29)

0.000

NIHSS score degree, day 1

1.12 (0.18)

3.08 (2.16–4.40)

0.000

Irritability, day 1

1.53 (0.62)

4.61 (1.36–15.63)

0.014

Change in NIHSS score during 3 days

0.91 (0.33)

2.49 (1.31–4.73)

0.006

Change in circumrotating during 3 days

2.05 (0.70)

7.80 (1.98–30.64)

0.003

Change in tinnitus during 3 days

2.58 (1.10)

13.25 (1.55–113.34)

0.018

NIHSS National Institutes of Health Stroke Scale, SE standard error, CI confidence interval, OR odds ratio

Adding weight value for each prognostic factors

In order to use the prognostic model conveniently and effectively in clinic, different points were assigned for the categories of the 8 factors by a simple weighting scheme according to the value of findings and analysis. The results of categories obtained were as follows: age degree [0 (≤56.44); 1 (>56.44)], history of DM [0 (no); 1 (yes)], anxiety on the 1st day [0 (no); 1 (yes)], NIHSS score degree on the 1st day [0 (≤2); 1 (3–6); 2 (>7)], irritability on the 1st day [0 (no); 1.5 (yes)], change in NIHSS score during the first 3 days [0 (≤ − 1), 1 (> − 1)], change in circumrotating during the first 3 days [0 (disappear); 2 (keep); 4 (appear)], change in tinnitus during the first 3 days [0 (disappear); 2.5 (keep); 5 (appear)]. The total score was calculated by adding up all factor scores. The maximum score was 16.5, and the range of score was from 0 to 16.5 points (Table 6).
Table 6

A 8-item scale for the prediction of stroke recovery

Item

Weight

Assigned points

Age

1

0 (≤56.44); 1 (>56.44)

History of DM

1

0 (no); 1 (yes)

Anxiety, day 1

1

0 (no); 1 (yes)

NIHSS score degree, day 1

1

0 (≤2),1 (3–6), 2 (>7)

Irritability,day 1

1.5

0 (no); 1.5 (yes)

Change in NIHSS score during 3 days

1

0 (≤ − 1),1 (> − 1)

Change in circumrotating during 3 days

2

0 (disappear); 2 (keep); 4 (appear)

Change in tinnitus during 3 days

2.5

0 (disappear); 2.5 (keep); 5 (appear)

Total score (sum of assigned points)

-

0–16.5

NIHSS National Institutes of Health Stroke Scale

Then a new 8-item scale for the early prediction of ischemic stroke recovery was developed to be used for clinical assessment. It means that the older patients, with a history of DM, high NIHSS score, anxiety, irritability on the 1st day, and with an increased NIHSS score, appearance of circumrotating and tinnitus during the first 3 days, were inclined to get poor recovery.

Selection of cutoff value

Receiver operating characteristic (ROC) curve analysis was performed to determine the cutoff value for the prognostic model of ischemic stroke recovery by using these 8 independent factors. The new scale was applied to estimate the prognosis of 413 ischemic stroke patients in 3 TCM hospitals by ROC curve analysis. And with prognostic assessment of ischemic stroke recovery measured by BI as the standard, the ROC curve indicated that at the cutoff point of 9.5 score, it had the greatest prognostic ability (maximum sensitivity and specificity) (Fig. 3).
Fig. 3

The cutoff value for predicted probability of the stroke prognosis

The results of 310 cases (good =159, poor = 151) in the 3 TCM hospitals were predicted correctly, while the other 103 cases (good =30, poor = 73) were wrong classified. The sensitivity of this model for prediction of good recovery was 68.5 % and the specificity was 83.4 %. The overall probability of accurate prediction was 75.1 %. Therefore, the score of 9.5 was chosen as the cutoff value for prediction good and poor stroke recovery (Table 7).
Table 7

An 8-item scale for the prediction of stroke recovery in TCM hospitals and Xuanwu hospital

Hospital

Good, n

Poor, n

Sensitivity (%)

Specificity (%)

Accuracy (%)

TG

FP

FG

TP

3TCM Hospitals

159

73

68.5

83.4

75.1

30

151

XW Hospital

32

14

69.6

83.3

75.0

5

25

TG ture good recovery, FG false good recovery, TP ture poor recovery, FP false poor recovery

Sensitivity = TG/ (TG + FP); Specificity = TP/ (TP + FG); Accuracy = (TG + TP)/ (TG + FG + TP + FP)

Validation of the scale for patients in Xuanwu hospital

The validation result of the new scale showed that 57 cases (good = 32, poor = 25) were predicted correctly, while the other 19 cases (good = 5, poor = 14) were wrong classified in Xuanwu hospital. The sensitivity and specificity of the scale for prediction of good recovery were 69.6 and 83.3 %, and the overall percentage of correct prediction was 75.0 % (Table 7).

Discussion

Summary of main findings

The study showed that NIHSS score had a relationship with some TCM symptoms & signs (P < 0.05), such as limb flaccid paralysis, anxiety, dizziness and so on. NIHSS is one of the most common assessment methods to predict the outcome of ischemic stroke. It found that there was some relationship between NIHSS and certain TCM symptoms which indicates TCM symptoms may have a predictive value for the outcome of ischemic stroke. Many studies have shown that age is an independent factor in predicting patients’ outcome [38, 39]. Consistent with previous researches, the result showed that patients aged 56.44 years old or younger were more likely to recover than those over 56.44 years old (OR =3.32, 95 % CI 1.72–6.42). Several studies have reported that NIHSS score had a significant effect on ischemic stroke outcome [16, 17]. The study showed that the scale could make a more accurate prognosis using the change in NIHSS scores. The patients with an increased NIHSS score more than 1 during the first 3 days were 2.49 times (OR = 2.49, 95 % CI 1.31–4.73) more likely to get poor recovery. Some TCM symptoms and signs play an important role in prognosis. For example, the patients with anxiety on the 1st day were more likely to get poor recovery than those without it (OR =3.17, 95 % CI 1.90–5.29). The disappearance of some TCM symptoms & signs such as circumrotating and tinnitus during the first 3 days can also indicate good recovery.

Finally the new scale was composed of age degree, history of DM, NIHSS score, anxiety and irritability on the 1st day, and change in NIHSS score, circumrotating and tinnitus during the first 3 days (Table 8). The total score of the scale was 16.5 and the cutoff point was 9.5 by the ROC curve, which means patients would have poor recovery outcome on the 90th day if the score >9.5. The new scale was validated on Xuanwu hospital patients, and the sensitivity of the scale for the prediction of good recovery was 69.6 % and the specificity was 83.3 % with an overall accuracy 75.0 %.
Table 8

The new prognosis scale for the prediction of ischemic stroke recovery

Item

Weight

Classify

Assigned point

Age degree

1.0

  

 ≤56.44

 

0

0

 >56.44

 

1

1.0

History of Diabetes

1.0

  

 No

 

0

0

 Yes

 

1

1.0

Anxiety, day 1

1.0

  

 No

 

0

0

 Yes

 

1

1.0

NIHSS score, day 1

1.0

  

 ≤2

 

0

0

 2 < NIHSS score ≤ 6

 

1

1.0

 >6

 

2

2.0

Irritability, day 1

1.5

  

 No

 

0

0

 Yes

 

1

1.5

NIHSS score change during 3 days

1.0

  

 ≤ − 1

 

0

0

 > − 1

 

1

1.0

Change in circumrotating during 3 days

1.0

  

 Disappear

 

0

0

 Keep

 

1

2.0

 Appear

 

2

4.0

Change in tinnitus during 3 days

2.5

  

 Disappear

 

0

0

 Keep

 

1

2.5

 Appear

 

2

5.0

Total score (sum of assigned points)a

  

16.5

aThe range of score from 0 to 16.5 points; the cutoff point was 9.5

Strengths of the study

To construct the scale by the TCM symptoms and NHISS

The four diagnostic methods in TCM include observation, listening and smelling, inquiry and pulse feeling diagnosis. These methods are not only the principal methods for collecting case information comprehensively, but also an important evidence for TCM differential syndrome and treatment, as well as a solid foundation for TCM clinical research and TCM clinical application [40]. Upholding TCM holism concepts as our guide, it can be of great significance to test the prognosis and recurrence of disease and guide the clinical practice by use of the comprehensive information. NIHSS scores can be used to measure the severity of stroke, which is highly predictive to excellent or devastating outcomes in ischemic stroke patients [17, 41]. It also emphatically reflects the disease outcome at objective injury level, which has been considered a close association with prognosis [42]. The study combined the TCM diagnostic information with the evaluation tool of dysfunction in modern medicine to develop the scale, so as to be both comprehensive and focused. The 8-item scale for stroke outcome can comprehensively evaluate the prognosis from physical and psychological aspects without high cost. The study would provide a relatively comprehensive evaluation tool for clinical practice.

In addition, one previous study has shown that the prognostic model based on age and NIHSS score has correctly predicted survival and functional recovery after 3 months, which provided the basis for our research [11]. The modified Rankin Scale (mRS) is the most comprehensive and most widely used scale for measuring clinical outcome of stroke patients. However, substantial inter observer variability in mRS scoring has been reported in a recent study, and the Rankin Focused Assessment (RFA) is suggested to be used in clinical trials as a short and practicable structured assessment tool [43]. Barthel index (BI) is a kind of activities of daily living (ADL) assessment tool with high reliability and sensitivity, commonly used in rehabilitation institutions of the United States. So BI was chosen as the prognostic assessment index in this study.

The scale reflects the dynamic change in prognosis of ischemic stroke

Stroke is a kind of disease with the characteristics of obvious stage change of symptoms and syndrome (acute phase/recovery/sequel period), which is manifested by acute onset and quick change [42]. The wind, fire, phlegm, blood stasis, and deficiency are the main syndrome factors of stroke. While NIHSS is mainly used for evaluating the degree of nerve function defect of acute ischemic stroke patients [17, 41], TCM symptoms and NIHSS reflect the development of stroke from different angles. Therefore, correlation researches on dynamic evolution of stroke syndrome elements and neurological function deficit have been conducted [44, 45]. Some researchers believe that there are certain and complex nonlinear relations between the two, while others have found they have correlations among them by use of the analysis method of Bayesian network, and the related degree would dynamic change over time [42]. Moreover, the result of the study was identical with the above conclusions. As a result, the new scale conforms to the characteristics of the dynamic development of the disease, and would more accurately evaluate the prognosis of stroke.

Limitation of the study

The study has three limitations. Firstly, the patients are relatively milder in ordinary ward because the patients died or with incomplete record without BI data on the 90th day are not included in our study. Secondly, based on the second data analysis, the new scale needs to be further tested by prospective and lager sample size studies. Thirdly, further sensitivity tests and specificity by expert questionnaire and clinical verification is required.

Conclusions

The 8-item scale can be used to predict the 90-day outcome for ischemic stroke patients shortly after admission to hospital, but further clinical verification researches should be conducted to make the prediction rule more dependable for clinical use.

Notes

Declarations

Acknowledgements

This study was supported by the Major State Basic Research Development Program of China (973 Program NO. 2003CB517102). The work was partially supported by National Key Technology R&D Program during the“Twelfth Five-year”Plan (No.2012BAI25B01) and the Innovative Team Project of Beijing University of Traditional Chinese Medicine (No.2011-CXTD-22). The authors are grateful to professor Dimple Rajgor, Jatin Shah, and Ricardo Pietrobon of Duke-National University of Singapore Graduate Medical School for helpful statistical analysis.

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Authors’ Affiliations

(1)
Department of Neurology, Dongzhimen Hospital affiliated to Beijing University of Chinese Medicine
(2)
Department of Acupuncture and Moxibustion, Beijing Hospital of Traditional Chinese Medicine affiliated to Capital Medical University
(3)
Traditional Chinese Medicine Department, Peking University Third Hospital

References

  1. Lee JS, Hong JM, Moon GJ, Lee PH, Ahn YH, Bang OY, et al. A long-term follow-up study of intravenous autologous mesenchymal stem cell transplantation in patients with ischemic stroke. Stem Cells. 2010;28:1099–106.View ArticlePubMedGoogle Scholar
  2. Yu CY, Ng G, Liao P. Therapeutic antibodies in stroke. Transl Stroke Res. 2013;4:477–83.View ArticlePubMedPubMed CentralGoogle Scholar
  3. Rothwell PM, Coull AJ, Silver LE, Fairhead JF, Giles MF, Lovelock CE, et al. Population-based study of event-rate, incidence, case fatality, and mortality for all acute vascular events in all arterial territories (Oxford Vascular Study). Lancet. 2005;366:1773–83.View ArticlePubMedGoogle Scholar
  4. Liu HL, Zhang DS, Tan XG, Yang DQ, Wang GL, Zhao Y, et al. The effect of acupuncture on stroke recovery: study protocol for a randomized controlled trial. BMC Complement Altern Med. 2012;12:216.View ArticlePubMedPubMed CentralGoogle Scholar
  5. Go AS, Mozaffarian D, Roger VL, Benjamin EJ, Berry JD, Blaha MJ, et al. Heart disease and stroke statistics–2014 update: a report from the American Heart Association. Circulation. 2014;129:e28–292.View ArticlePubMedGoogle Scholar
  6. Suljic E, Mehicevic A, Gavranovic A. Stroke emergency medical care: initial assessment, risk factors, triage and hospitalization outcome. Mater Sociomed. 2013;25:83–7.View ArticlePubMedPubMed CentralGoogle Scholar
  7. Johnston SC, Mendis S, Mathers CD. Global variation in stroke burden and mortality: estimates from monitoring, surveillance, and modeling. Lancet Neurol. 2009;8:345–54.View ArticlePubMedGoogle Scholar
  8. Kim HJ, Kim SK, Park HJ, Chung JH, Chun J, Yun DH, et al. Polymorphisms of IGFI contribute to the development of ischemic stroke. Exp Ther Med. 2012;3:93–8.PubMedGoogle Scholar
  9. Park JH, Ovbiagele B. Optimal combination treatment and vascular outcomes in recent ischemic stroke patients by premorbid risk level. J Neurol Sci. 2015;355:90–3.View ArticlePubMedPubMed CentralGoogle Scholar
  10. Larsson SC, Åkesson A, Wolk A. Primary prevention of stroke by a healthy lifestyle in a high-risk group. Neurology. 2015;84:2224–8.View ArticlePubMedPubMed CentralGoogle Scholar
  11. König IR, Ziegler A, Bluhmki E, Hacke W, Bath PM, Sacco RL, et al. Predicting long-term outcome after acute ischemic stroke: a simple index works in patients from controlled clinical trials. Stroke. 2008;39:1821–6.View ArticlePubMedGoogle Scholar
  12. Hand PJ, Wardlaw JM, Rivers CS, Armitage PA, Bastin ME, Lindley RI, et al. MR diffusion-weighted imaging and outcome prediction after ischemic stroke. Neurology. 2006;66:1159–63.View ArticlePubMedGoogle Scholar
  13. Park CH, Chang WH, Ohn SH, Kim ST, Bang OY, Pascual-Leone A, et al. Longitudinal changes of resting-state functional connectivity during motor recovery after stroke. Stroke. 2011;42:1357–62.View ArticlePubMedPubMed CentralGoogle Scholar
  14. Sare GM, Ali M, Shuaib A, Bath PM, VISTA Collaboration. Relationship between hyperacute blood pressure and outcome after ischemic stroke: data from the VISTA collaboration. Stroke. 2009;40:2098–103.View ArticlePubMedGoogle Scholar
  15. Heldner MR, Zubler C, Mattle HP, Schroth G, Weck A, Mono ML, et al. National Institutes of Health stroke scale score and vessel occlusion in 2152 patients with acute ischemic stroke. Stroke. 2013;44:1153–7.View ArticlePubMedGoogle Scholar
  16. Kasner SE, Chalela JA, Luciano JM, Cucchiara BL, Raps EC, McGarvey ML, et al. Reliability and validity of estimating the NIH Stroke Scale score from medical records. Stroke. 1999;30:1534–7.View ArticlePubMedGoogle Scholar
  17. Boone M, Chillon JM, Garcia PY, Canaple S, Lamy C, Godefroy O, et al. NIHSS and acute complications after anterior and posterior circulation strokes. Ther Clin Risk Manag. 2012;8:87–93.PubMedPubMed CentralGoogle Scholar
  18. Ghandehari K, Ghandehari K, Saffarian-Toosi G, Masoudinezhad S, Yazdani S, Nooraddin A, et al. Comparative interrater reliability of Asian Stroke Disability Scale, modified Rankin Scale and Barthel Index in patients with brain infarction. ARYA Atheroscler. 2012;8:153–7.PubMedPubMed CentralGoogle Scholar
  19. Dionyssiotis Y, Kiourtidis D, Karvouni A, Kaliontzoglou A, Kliafas I. Consequences of neurologic lesions assessed by Barthel Index after Botox (®) injection may be underestimated. Ther Clin Risk Manag. 2012;8:385–91.View ArticlePubMedPubMed CentralGoogle Scholar
  20. Djelilovic-Vranic J, Alajbegovic A, Zelija-Asimi V, Niksic M, Tiric-Campara M, Salcic S, et al. Predilection role diabetes mellitus and dyslipidemia in the onset of ischemic stroke. Med Arh. 2013;67:120–3.View ArticleGoogle Scholar
  21. Meschia JF, Bushnell C, Boden-Albala B, Braun LT, Bravata DM, American Heart Association Stroke Council; Council on Cardiovascular and Stroke Nursing; Councilon Clinical Cardiology; Council on Functional Genomics and Translational Biology; Council on Hypertension, et al. Guidelines for the primary prevention of stroke: a statement for healthcare professionals from the American Heart Association/ American Stroke Association. Stroke. 2014;45:3754–832.View ArticlePubMedPubMed CentralGoogle Scholar
  22. Liu GP, Li GZ, Wang YL, Wang YQ. Modelling of inquiry diagnosis for coronary heart disease in traditional Chinese medicine by using multi-label learning. BMC Complement Altern Med. 2010;10:37.View ArticlePubMedPubMed CentralGoogle Scholar
  23. Li GZ, Sun S, You MY, Wang YL, Liu GP. Inquiry diagnosis of coronary heart disease in Chinese medicine based on symptom-syndrome interactions. Chin Med. 2012;7:9.View ArticlePubMedPubMed CentralGoogle Scholar
  24. Li GZ, Yan SX, You MY, Sun S, Ou AH. Intelligent ZHENG classification of hypertension depending on ML-kNN and feature fusion. Evid Based Complement Alternat Med. 2012;2012:837245.PubMedPubMed CentralGoogle Scholar
  25. Hua T. Zhong Zang Jing. Hua T. Zhong Zang Jing. Jiangsu Science and Technology Press 1985:14-16.Google Scholar
  26. Gao Y, Zhong HZ, Ma B, Huang Y. Randomized, double-blind, parallel-controlled clinical trial on correspondence of prescriptions and traditional Chinese medicine syndrome of ischemic stroke. J Tradit Chin Med. 2012;32:335–42.View ArticlePubMedGoogle Scholar
  27. Liu L, Gao Y. Study on the correlation between traditional Chinese medicine syndrome and short-term prognosis of ischemic stroke using logistic regression model and repeated-measures analysis of variance. Zhong Xi Yi Jie He Xue Bao. 2012;10:983–90.View ArticlePubMedGoogle Scholar
  28. Gialanella B, Santoro R, Ferlucci C. Predicting outcome after stroke: the role of basic activities of daily living predicting outcome after stroke. Eur J Phys Rehabil Med. 2013;49:629–37.PubMedGoogle Scholar
  29. World Medical Association. World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. JAMA. 2013;310:2191–4.View ArticleGoogle Scholar
  30. Stroke-1989. Recommendations on stroke prevention, diagnosis, and therapy. Report of the WHO task force on stroke and other cerebrovascular disorders. Stroke. 1989;20:1407–31.View ArticleGoogle Scholar
  31. The Encephalopathy Accident and Emergency Collaborative Group of State Administration of Traditional Chinese Medicine. Criteria of diagnosis and therapeutic effect evaluation for apoplexy (trial version). Beijing Zhong Yi Yao Da Xue Xue Bao. 1996;19:55–6.Google Scholar
  32. Cioncoloni D, Piu P, Tassi R, Acampa M, Guideri F, Taddei S, et al. Relationship between the modified Rankin scale and the Barthel index in the process of functional recovery after stroke. Neuro Rehabilitation. 2012;30:315–22.PubMedGoogle Scholar
  33. Mahoney FI, Barthel DW. Functional evaluation: the Barthel Index. Md State Med J. 1965;14:61–5.PubMedGoogle Scholar
  34. Houlden H, Edwards M, McNeil J, Greenwood R. Use of the Barthel index and the functional independence measure during early inpatient rehabilitation after single incident brain injury. Clin Rehabil. 2006;20:153–9.View ArticlePubMedGoogle Scholar
  35. Kauranen T, Laari S, Turunen K, Melkas M, Mustanoja S, Baumann P, et al. Use of stroke-related income supplements and predictors of Use in a working-aged Finnish ischemic stroke cohort. J Stroke Cerebrovasc Dis. 2015;24:1715–23.View ArticlePubMedGoogle Scholar
  36. Prasad K, Dash D, Kumar A. Validation of the Hindi version of National Institute of Health Stroke Scale. Neurol India. 2012;60:40–4.View ArticlePubMedGoogle Scholar
  37. Middleton S, Grimley R, Alexandrov AW. Triage, treatment, and transfer: evidence-based clinical practice recommendations and models of nursing care for the first 72 h of admission to hospital for acute stroke. Stroke. 2015;46:e18–25.View ArticlePubMedGoogle Scholar
  38. Lin PH, Yeh WT, Svetkey LP, Chuang SY, Chang YC, Wang C, et al. Dietary intakes consistent with the DASH dietary pattern reduce blood pressure increase with age and risk for stroke in a Chinese population. Asia Pac J Clin Nutr. 2013;22:482–91.PubMedGoogle Scholar
  39. Hanson E, Nilsson S, Jood K, Norrving B, Engström G, Blomstrand C, et al. Genetic variants of coagulation factor XI show association with ischemic stroke Up to 70 years of Age. PLoS One. 2013;8:e75286.View ArticlePubMedPubMed CentralGoogle Scholar
  40. Shi Q, Zhao H, Chen J, Ma X, Yang Y, Zheng C, et al. Study on TCM syndrome identification modes of coronary heart disease based on data mining. Evid Based Complement Alternat Med. 2012;2012:697028. 10.1155 /2012/697028.View ArticlePubMedPubMed CentralGoogle Scholar
  41. Tan F, Wang X, Li HQ, Lu L, Li M, Li JH, et al. A randomized controlled pilot study of the triple stimulation technique in the assessment of electroacupuncture for motor function recovery in patients with acute ischemic stroke. Evid Based Complement Alternat Med. 2013;2013:431986.PubMedPubMed CentralGoogle Scholar
  42. Jiang LJ, Hu JQ, Yi DH, Chen Q, Liu BY. Bay esian network analysis of correlation between TCM syndrome dynamic changes and NIHSS scores of ischemia stroke. World Chinese Medicine. 2013;8:613–7.Google Scholar
  43. Saver JL, Filip B, Hamilton S, Yanes A, Craig S, Cho M, et al. Improving the reliability of stroke disability grading in clinical trials and clinical practice: the Rankin Focused Assessment (RFA). Stroke. 2010;41:992–5.View ArticlePubMedPubMed CentralGoogle Scholar
  44. Zhang H, Gao Y. Correlation between syndrome changes and neurological parafunction of ischemia stroke. J Beijing University Traditional Chin Med. 2007;30:274–8.Google Scholar
  45. Wang ZH, Liu C, Xu JF, Li XY, Zhang YX, Gao Y, et al. Study of relationship of NIHSS and TCM standardized sheet of apoplexy syndromes diagnosis base on LVQ neural networks. Liaoning J TCM. 2009;36:2020–2.Google Scholar

Copyright

© Cao et al. 2015

Advertisement