- Research article
- Open Access
- Open Peer Review
A modified score to identify and discriminate neuropathic pain: a study on the German version of the neuropathic pain symptom inventory (NPSI)
- Claudia Sommer†1Email author,
- Helmut Richter†2,
- Jan P Rogausch1,
- Jule Frettlöh2,
- Margitta Lungenhausen2 and
- Christoph Maier2
© Sommer et al.; licensee BioMed Central Ltd. 2011
- Received: 18 April 2011
- Accepted: 23 August 2011
- Published: 23 August 2011
Neuropathic pain must be correctly diagnosed for optimal treatment. The questionnaire named Neuropathic Pain Symptom Inventory (NPSI) was developed in its original French version to evaluate the different symptoms of neuropathic pain. We hypothesized that the NPSI might also be used to differentiate neuropathic from non-neuropathic pain.
We translated the NPSI into German using a standard forward-backward translation and administered it in a case-control design to patients with neuropathic (n = 68) and non-neuropathic pain (headache and osteoarthritis, n = 169) to validate it and to analyze its discriminant properties, its sensitivity to change, and to detect neuropathic pain subgroups with distinct profiles.
Using a sum score (the NPSI-G score), we found sensitivity to change (r between 0.37 and 0.5 for pain items of the graded chronic pain scale) and could distinguish between neuropathic and other pain on a group basis, but not for individual patients. Post hoc development of a discriminant score with optimized diagnostic properties to distinguish neuropathic pain from non-neuropathic pain resulted in an instrument with high sensitivity (91%) and acceptable specificity (70%). We detected six different pain profiles in the patient group with neuropathic pain; three profiles were found to be distinct.
The NPSI-G potentially combines the properties of a diagnostic tool and an instrument to identify subtypes of neuropathic pain.
- Neuropathic Pain
- Pain Intensity
- Diagnostic Group
- Divergent Validity
- Discriminant Score
Neuropathic pain must be correctly diagnosed for optimal treatment. Several screening tools have been developed to differentiate neuropathic from non-neuropathic pain . These include the Leeds Assessment of Neuropathic Symptoms and Signs (LANSS ), the Neuropathic Pain Questionnaire , the DN4 , the painDETECT questionnaire , and the ID pain . Another goal of pain questionnaires is the use of effective pain descriptors to identify subgroups of patients that may benefit from specific therapies. Such questionnaires are the Neuropathic Pain Scale (NPS)  and the Neuropathic Pain Symptom Inventory (NPSI) . The NPSI has psychometric properties which suggest that it may be used to characterize subgroups of neuropathic pain patients and verify whether they respond differentially to treatment . It has good construct validity, high test-retest reliability, and is sensitive to change. It has been translated into several languages and used in clinical trials [9, 10]; see additional file 1 for its (non-validated) English translation by the original authors. Given the good psychometric properties of the NPSI, we constructed and validated a German version, the NPSI-G with the aims to analyze its sensitivity to change and to identify distinct subgroups among patients with neuropathic pain. We hypothesized that the NPSI might also be used to differentiate neuropathic from non-neuropathic pain, a distinction which was not tested in the original study. We collected data from 237 participants with confirmed neuropathic pain, and with two frequently encountered non-neuropathic chronic pain syndromes, osteoarthritis, or headache. To enhance the separation qualities of the NPSI-G for neuropathic and non-neuropathic pain, we used discriminant analysis to construct a weighted sum score of the variables.
Patients with neuropathic pain and headache were recruited from the Department of Neurology, University of Würzburg and the Department of Pain Management (Bergmannsheil), Ruhr University, Bochum. Patients with osteoarthritis related pain were recruited from the Department of Orthopedics (König-Ludwig-Haus), University of Würzburg and the Department of Orthopedics (St. Josefs Klinikum), Ruhr University, Bochum. A diagnosis of neuropathic pain was confirmed when associated with a definite neurological cause as determined during routine in- or outpatient management of the patient. In addition, it was required that the pattern of pain distribution was characteristic of the respective diagnosis. Headache was diagnosed using the International Headache Society criteria for tension type headache and migraine . Only patients with a headache present at the time of visit were included. Headache was chosen in order to have a pain condition with a very different distribution from that in most patients with neuropathic pain. Osteoarthritis was diagnosed based on criteria provided by the American College of Rheumatology (http://www.rheumatology.org). Osteoarthritis was chosen to include a condition that (like in most patients with neuropathic pain in our sample) entails pain in the extremities. Exclusion criteria were coexistence of several conditions possibly causing pain, severe depression, chronic alcoholism or substance abuse, and an inability to understand the questionnaire. Patients with neuropathic pain received current symptomatic treatment, including analgesic drugs, when admitted or seen as outpatients.
NPSI Translation into German and adaptation of the NPSI for patients with headache and osteoarthritis
Using the original French NPSI, we used a standard forward-back translation to develop the German equivalent. First, two translators who were native French speakers and fluent in German (one with, one without medical knowledge) translated the questionnaire into German. A reconciled language version was developed using these two forward translations. A third professional translator (a native German speaker fluent in French) produced the back-translation. The final version was evaluated by three independent medical professionals fluent in both French and German usage. Discrepancies in wording were analyzed and when required, resolutions were obtained by consensus. A diagram depicting pain attacks and episodes of continuous pain was inserted to facilitate patient comprehension. For quality control, patients were instructed to indicate areas of pain on an additional diagram (see additional file 2 for a full version of the NPSI-G). Patients with headache or osteoarthritis related pain were additionally required to complete a short questionnaire that addressed aspects of their headache (questions were designed to differentiate between tension headaches and migraines) or, their joint pain (location of pain sites including potentially related sites).
The study was approved by the Ethics Committees of the Universities of Bochum and Würzburg. After providing informed consent, the patients were required to complete four questionnaires: the NPSI-G, the German version of the NPS (NPS-D), the graded chronic pain scale (GCPS, ), and the German version of the Center for Epidemiologic Studies Depression Scale (CES-D) . Patients diagnosed with neuropathic pain were instructed to complete a 2nd NPSI-G as well as the patient global impression of change (PGIC) scale  24 hours later. The entire set of questionnaires was repeated at 4 weeks. Since most of these patients were inpatients, their 24 hour questionnaire was readily distributed and collected. Outpatients with neuropathic pain were given both the 24 hour and 4 week questionnaires with dates for completion clearly marked and prepaid postal envelopes addressed to the investigators. Patients who did not return the questionnaires at the specified time intervals received telephone reminders. During the 4-week period, patients underwent medical treatment as required. Patients with headache (mostly outpatients) or osteoarthritis pain (mostly inpatients) received all of the above questionnaires only once and were instructed to complete their questionnaires while at the hospital.
Depressive symptoms were assessed using the CES-D questionnaire. Scores above 23 points were considered indicative of depressive states. Pain intensities were graded using the 11-point numerical scales (0 - 10) of the GCPS.
Sample description and comparison of the diagnostic groups
Sample description included diagnostic data, age, gender, depression score (CES-D) and general pain characteristics (GCPS scores) for each diagnostic group.
Construction of a score for assessing neuropathic pain
A sum score (NPSI-G score) for assessing the severity of neuropathic pain was calculated using the sum score methodology of our reference study . A possible positive contribution of the categorical items Q4 (frequency of spontaneous pain) and Q7 (number of pain attacks) to the score was examined by transforming them into dichotomous variables and post hoc adding weighted variable scores to the sum score. Then we looked for improvement by comparing the validity measures of the original and the expanded score. Optimized transformation rules and weight-coefficients were generated from an algorithm which tested possible improvements of the correlations in the validity calculations.
Reliability and validity of the NPSI-D
For the group of patients with neuropathic pain, we assessed the test-retest reliability of the NPSI-G and the NPSIG score and analyzed its convergent and divergent validities. The test-retest reliability of the interval-scaled items and the NPSI-G score was assessed by calculating intra-class correlations (ICC, two way random model) for all items included in the initial measurements and the 24-hour follow-up. Since there are no validated instruments available in German comparable to the NPSI, we used two widely employed comparators for convergent validity; the German version of the NPS  (NPS-D) and those items from the GCPS that examine intensity of pain (current, average and maximal pain assessments over the 4 week interval). Divergent validity was measured by calculating the Pearson correlations with the CES-D scores. We then compared the reliability of the NPSI-G items and the NPSI-G score with the French reference study.
Sensitivity to change
The Pearson correlations between the 4-week change of the NPSI-G score and the changes of current, average, and maximum pain in the GCPS, the PGIC-score, and the change of the CES-D-score were calculated in patients with neuropathic pain, whereby the CES-D was used as a control measure for divergent characteristics. Correlations were considered low, medium or high as they reached levels of r = 0.1, r = 0.3, or r = 0.5 respectively . To conclude that there was sensitivity to change, we would expect at least medium correlations with the changes of pain intensity in the CGPS (r ≥ 0.3). As the PGIC score is a gross estimate of changes in pain intensity, it was only considered as an additional control instrument. A low to medium correlation (r ≥ 0.2) was judged sufficient to support the hypothesis that the NPSI-G score is sensitive to change. Low correlations with the ASD-score (r < 0.3) would support divergent validity.
Evaluation of the discriminant properties of the NPSI-G and the NPSI-G score
Responses to the NPSI-G items were compared between the diagnostic groups by analyzing the mean values and the frequencies of positive item responses (values > 0), indicating the occurrence of the different qualities of pain for the 10 interval scaled items Q1 - Q3, Q5 - Q6, Q8 - Q12. Mean values of items and sum score were calculated and compared between diagnostic groups. The distribution of the NPSI-G score within the groups was analyzed using box plots. The correlation of the NPSI-G score with age, sex, pain intensity in the CGPS, and the CES-D score was calculated by Pearson correlations to control for a possible bias caused by between-group differences of these parameters. We then examined the diagnostic power of the NPSI-G score using a receiver operating characteristic (ROC) diagram . The ROC diagram shows the possible combinations of sensitivity and specificity that can be achieved for a given score. The non-neuropathic group was formed by combining the osteoarthritis and the headache patients.
Development and analysis of a diagnostic tool based on the NPSI-G
To develop a tool that would separate patients with neuropathic pain from the other groups, we calculated a discriminant score (NPSI-G-dis) using discriminant analysis. This weighted sum score of the variables was constructed using specific coefficients for each variable to allow optimal separation of the different diagnostic groups. We used all variables from the NPSI-G including the two categorical variables Q4 and Q7, which were transformed into dichotomous variables similar to the construction described in the definition of the NPSI-G score, but without weight coefficients which were dispensable in this context. In this case an optimal ROC-diagram was the criterion for an appropriate transformation.
Analysis of different pain profiles in patients with neuropathic pain
Using a cluster analysis (hierarchical Ward analysis  with follow up k-means analysis) based on the ten interval items of the NPSI-G, we looked for subgroups with different pain profiles within the neuropathic pain group. Profiles were compared by multivariate variance analysis (MANOVA; Wilks-Lambda used as test statistic) and differences between the item scores within each cluster by variance analysis for dependent measures. An analysis of current and maximal pain levels from the GCPS was done to evaluate whether clusters were based on pain severity only. The distribution of pain intensities was examined by box plots; mean values for different clusters were compared by t-tests.
Test statistics and measurements of coherence
In addition to the already described methods, we used the following statistical tests: Frequencies of item responses were compared using Chi-square tests. Comparison of group means (of the different diagnostic groups or of groups defined by the results of the cluster analysis) was done by t-tests in the case of two groups and by ANOVAs with post hoc tests (Sidak resp. Dunnett T-3 adjustments for multiple testing) when more than two independent groups were involved [18, 19]. To analyze coherence of item responses, we calculated Pearson correlations. Compensation for multiple comparisons was done by Bonferroni adjustments .
Sample description and comparison of the diagnostic groups
Demographic and clinical data of the study participants
Clinical and demographic data
59.1 ± 13.0
60.5 ± 12.4
49.7 ± 14.7
56.6 ± 14.1
mean pain intensity on a numeric 0-10 - pain scale (SD)
maximal pain intensity in the past 4 weeks
average pain intensity in the past 4 weeks
nerve injury pain
The NPSI-G score
Intraclass correlation coefficients (ICC) for each item and for the NPSI sum scores based on baseline and second measurement (after 24 h in the current study and after 3 h in the reference study)
Evoked by brushing
Evoked by pressure
Evoked by cold stimuli
Pins and needles
Reliability and validity
Convergent and divergent validities (Pearson correlations) for patients with neuropathic pain
correlation with NPSI-D score
maximal pain (past 4 weeks)
average pain (past 4 weeks)
Construct validity information is given in Table 3. The correlation of the NPSI-G score with the NPS-D score was high. As expected, the correlation with current pain intensity in the GCPS was also high in contrast to medium correlations with maximum pain and average pain in the past 4 weeks. The correlation with the depression-score was low and supported divergent validity.
Sensitivity to change
Correlation of changes in a 4-week period in patients with neuropathic pain (Pearson correlations)
maximal pain (past 4 weeks)
average pain (past 4 weeks)
Evaluation of the discriminant properties of the NPSI-G
Frequency of positive NPSI item responses
(NP vs. OA)
(NP vs. H)
Evoked by brushing
Evoked by pressure
Evoked by cold
Pins and needles
Means for item and sum
(NP vs. OA)
(NP vs. H)
Evoked by brushing
Evoked by pressure
Evoked by cold
Pins and needles
Construction and analysis of a diagnostic tool based on the NPSI-G
Since the separation quality of the NPSI-G score for neuropathic versus non-neuropathic pain was not satisfactory, we used discriminant analysis to construct an improved score for the separation of neuropathic and non-neuropathic pain. The optimal transformations of the categorical items 4 and 7 into dichotomous scores are: Q4_d = 0/1 if Q 4 ≥ 4/<4; Q7_d = 0/1 if Q7 ≥2/<2 (allocation of higher scores to lower class numbers corresponds to the order of classes in the questionnaire, smaller numbers indicate higher numbers of complaints).
Discrimination-coefficients for the discrimination score
spontaneous pain (dichot.)*
pain attacks (dichot.)*
evoked by brushing
evoked by pressure
evoked by cold stimuli
pins and needles
Pain profiles of neuropathic pain patients
Reliability and validity of the NPSI and comparison of the item characteristics to the French original and to transnational results
The NPSI-G score demonstrated a high test-retest reliability and convergent as well as divergent construct validity when applied to neuropathic pain patients. This allows us to conclude that the NPSI-G is a useful and reliable instrument for assessing the severity of neuropathic pain. However, since our patient population was biased toward neuropathic pain of peripheral origin, the NPSI-G will have to be validated in a separate sample including also patients with other neuropathic pain syndromes, e.g. with central pain. Nearly all properties of the NPSI-G score were comparable to the original French results. In contrast to the reference study, test-retest-reliability on a per item basis did not reach acceptable values in all cases. This might possibly be attributed to the different time lags, which were 24 h in the current as opposed to 3 h in the reference study. The possibility of different connotations of some items in the respective languages as another possibility for divergent results has recently been discussed for several non-validated translations of the NPSI . For neuropathic pain patients, the responder rates for individual items were more variable than in the French study (see Table 5). Ranking the items according to responder rates of neuropathic pain patients resulted in pins and needles as the most frequently endorsed item, followed by burning, stabbing and pressure/evoked by pressure. The other items clearly achieved lower percentages. The differences in item ranking between the German and the French study may be caused by the composition of the neuropathic pain group. While our group consisted of a majority of patients with peripheral neuropathy, there were more patients with nerve trauma and with central pain in the French study which may explain the higher prevalence of brush evoked and electric shock like pain in their sample. A recent multinational study  found that across different cultures and languages (German not included), the ranking was the same for the items with the highest frequency of positive answers: "pins and needles", "burning" and "electric shock like". This is similar to our results, except for the third item which was "stabbing" in our study. However, the diagnostic composition within groups from the participating countries varied greatly, and numbers of participants from each country were small such that direct comparisons with the German and the French cohort are difficult, not excluding further limitations inherent in cross-cultural comparisons .
The correlation with data from the CGPS for current pain was high, for pain in the last 4 weeks it was only medium high (see Table 3). This result was predictable because the NPSI-G asks for current pain symptoms only. In the reference study, there was a correlation of ρ = 0.6 for the NPSI with general pain, comparable to our result for current pain (see Table 3). The low correlation with a depression scale was equivalent to the French study (ρ = 0.32).
Sensitivity to change
The NPSI-G score is sensitive to change and thus allows measurement of treatment efficacy. As expected, there was only a weak correlation between the patients' assessment of change using the PGIC at 4 weeks and the NPSI-G score at 4 weeks. In this analysis, the patients' assessment of change over a relatively long period of time was compared with the difference between two assessments of current symptoms 4 weeks apart. From a psychological point of view, this analysis would not be expected to demonstrate strongly correlated results .
Discriminant properties of the NPSI-G
The group of patients with neuropathic pain had a typical profile of pain descriptors that differed significantly from the control groups with osteoarthritis and headache (see Table 5). Similar group differences were achieved using the NPSI-G score. The NPSI-G score however, lacks discriminant power when used for individual patients, as demonstrated in Figure 1 and in the ROC diagram (Figure 2).
The NPSI-G as a tool for diagnosing neuropathic pain
The post hoc construction of a discriminant score based on the algorithm of discriminant analysis led to clearly enhanced separation qualities. For example, a high sensitivity of 91% combined with a tolerable specificity of 70% or a combination of 72% sensitivity and 90% specificity were possible. The quality of this diagnostic instrument is slightly inferior to the diagnostic tool based on the French DN4 questionnaire (sensitivity 82.9%, specificity 89.9%) , which was constructed with a selection of items from the NPSI and some additional items.
The NPSI-G as a tool for analyzing distinct neuropathic pain profiles
The cluster analysis revealed six clusters with different patterns. Three of them (clusters 1, 2, and 5 in Figure 4) showed differences in pairwise comparisons that were statistically significant in multivariate testing. Comparable patterns but different levels of pain intensity were found in two clusters (clusters 1 and 5), whereas cluster 2 demonstrated a different shape mainly caused by the dysesthesia items. Overall, the clusters do not merely represent distinctive pain intensities as shown by the box plots in Figure 5, and the different profiles cannot be explained by different pain levels alone. For example, clusters 3 to 6 are very similar in pain levels yet show very different profiles. Most of these differences are statistically significant in simple comparisons. Whether the clusters have a clinical meaning regarding pathophysiology or response to treatment cannot be answered by our study. Additional studies with larger numbers of participants are required to confirm our results. Furthermore, we will need to examine whether the clusters represent different underlying pain mechanisms.
Limitations of the study
There are several limitations to our study. Limitations in assessing test-retest reliability must be considered as even a latency period of 24 h may be too short to guarantee independent measurements.
It was difficult to assess reliability because other procedures (for example parallel measuring) were not possible, and with any latency longer than 24 h, influences of treatment or spontaneous fluctuations in pain characteristics that would disturb identical conditions for the responses to the items would have to be expected. Given the high number of statistical tests, some spuriously random results cannot be excluded with certainty. The discriminant function was optimized for the given data, and we did not crossvalidate the results. Crossvalidation was not possible because of the relatively small sample size. Our results indicate that a follow-up study to achieve this aim might be worthwhile. Differences in group parameters (depressiveness, age, gender, pain intensity) may have caused some biases when analyzing group differences. This mainly concerns responses to single items or the NPSI-G score. The correlations of this score (calculated for the whole sample) with age and gender are low, but are considerable for the pain variables (about 0.5) and for depressiveness (> 0.3). The discriminant score NPSI-G-dis was only marginally influenced by these parameters, with only low correlations.
The NPSI-G is the first questionnaire that is capable of discriminating subtypes of neuropathic pain and provides additional information as a diagnostic tool. Using specifically constructed scores, the NPSI-G can distinguish neuropathic from non-neuropathic pain with high sensitivity and acceptable specificity. This combination of properties suggests that it may be ideally suited for use in clinical trials. Further studies with larger numbers of participants are required to confirm our findings.
The authors' work was supported by Bundesministerium für Bildung und Forschung (BMBF), Grants 01EM0107 (CM) and 01EM0509 (CS) (German Research Network on Neuropathic Pain, DFNS) and by an unrestricted grant of Schwarz-Pharma (Monheim, Germany) to CM. We thank Didier Bouhassira for valuable discussion, Anette Warkentin for help with patient recruitment, and Barbara Zochodne for language editing. We are grateful to F. Gohlke of the Orthopedic Hospital König-Ludwig-Haus Würzburg, J. Krämer of the Orthopedic Department of Sankt Josef Hospital Bochum, and to O. Russe of Bergmannsheil-Klinik Bochum for access to their patients. This publication was funded by the German Research Foundation (DFG) and the University of Würzburg in the funding program Open Access Publishing.
- Bennett MI, Attal N, Backonja MM, Baron R, Bouhassira D, Freynhagen R, Scholz J, Tölle TR, Wittchen HU, Jensen TS: Using screening tools to identify neuropathic pain. Pain. 2007, 127: 199-203. 10.1016/j.pain.2006.10.034.View ArticlePubMedGoogle Scholar
- Bennett M: The LANSS Pain Scale: the Leeds assessment of neuropathic symptoms and signs. Pain. 2001, 92: 147-157. 10.1016/S0304-3959(00)00482-6.View ArticlePubMedGoogle Scholar
- Krause SJ, Backonja MM: Development of a neuropathic pain questionnaire. Clin J Pain. 2003, 19: 306-314. 10.1097/00002508-200309000-00004.View ArticlePubMedGoogle Scholar
- Bouhassira D, Attal N, Alchaar H, Boureau F, Brochet B, Bruxelle J, Cunin G, Fermanian J, Ginies P, Grun-Overdyking A, et al: Comparison of pain syndromes associated with nervous or somatic lesions and development of a new neuropathic pain diagnostic questionnaire (DN4). Pain. 2005, 114: 29-36. 10.1016/j.pain.2004.12.010.View ArticlePubMedGoogle Scholar
- Freynhagen R, Baron R, Gockel U, Tölle TR: painDETECT: a new screening questionnaire to identify neuropathic components in patients with back pain. Curr Med Res Opin. 2006, 22: 1911-1920. 10.1185/030079906X132488.View ArticlePubMedGoogle Scholar
- Portenoy R: Development and testing of a neuropathic pain screening questionnaire: ID Pain. Curr Med Res Opin. 2006, 22: 1555-1565. 10.1185/030079906X115702.View ArticlePubMedGoogle Scholar
- Galer BS, Jensen MP: Development and preliminary validation of a pain measure specific to neuropathic pain: the Neuropathic Pain Scale. Neurology. 1997, 48: 332-338.View ArticlePubMedGoogle Scholar
- Bouhassira D, Attal N, Fermanian J, Alchaar H, Gautron M, Masquelier E, Rostaing S, Lanteri-Minet M, Collin E, Grisart J, Boureau F: Development and validation of the Neuropathic Pain Symptom Inventory. Pain. 2004, 108: 248-257. 10.1016/j.pain.2003.12.024.View ArticlePubMedGoogle Scholar
- Crawford B, Bouhassira D, Wong A, Dukes E: Conceptual adequacy of the neuropathic pain symptom inventory in six countries. Health Qual Life Outcomes. 2008, 6: 62-10.1186/1477-7525-6-62.View ArticlePubMedPubMed CentralGoogle Scholar
- Padua L, Briani C, Jann S, Nobile-Orazio E, Pazzaglia C, Morini A, Mondelli M, Ciaramitaro P, Cavaletti G, Cocito D, et al: Validation of the Italian version of the Neuropathic Pain Symptom Inventory in peripheral nervous system diseases. Neurol Sci. 2009, 30: 99-106. 10.1007/s10072-009-0025-y.View ArticlePubMedGoogle Scholar
- The International Classification of Headache Disorders: 2nd edition. Cephalalgia. 2004, 24 (Suppl 1): 9-160.Google Scholar
- Von Korff M, Ormel J, Keefe FJ, Dworkin SF: Grading the severity of chronic pain. Pain. 1992, 50: 133-149. 10.1016/0304-3959(92)90154-4.View ArticlePubMedGoogle Scholar
- Hautzinger M, Bailer M: Allgemeine Depressions Skala, Manual. 1993, Göttingen: Beltz Test GmbHGoogle Scholar
- Dworkin RH, Turk DC, Farrar JT, Haythornthwaite JA, Jensen MP, Katz NP, Kerns RD, Stucki G, Allen RR, Bellamy N, et al: Core outcome measures for chronic pain clinical trials: IMMPACT recommendations. Pain. 2005, 113: 9-19. 10.1016/j.pain.2004.09.012.View ArticlePubMedGoogle Scholar
- Cohen J: Statistical Power Analysis for the Behavioral Sciences. 1988, Hillsdale, New Jersey: Lawrence Erlbaum Associates, Inc, 2Google Scholar
- Hosmer DW, Lemeshow S: Applied Logistic Regression. 2000, New York: Wiley, 2View ArticleGoogle Scholar
- Ward JH: Hierarchical Grouping to Optimize an Objective Function. J Amer Statistical Assoc. 1963, 58: 236-244. 10.2307/2282967.View ArticleGoogle Scholar
- Abdi H: The Bonferonni and Sidak corrections for multiple comparisons. Encyclopedia of Measurement and Statistics. Edited by: Salkid N. 2007, Thousand Oaks SAGE Publications Inc, 103-107.Google Scholar
- Dunnett C: Pairwise multiple comparisons in the unequal variance case. J Am Stat Assoc. 1980, 75: 796-800. 10.2307/2287161.View ArticleGoogle Scholar
- Bender R, Lange S: Adjusting for multiple testing--when and how?. J Clin Epidemiol. 2001, 54: 343-349. 10.1016/S0895-4356(00)00314-0.View ArticlePubMedGoogle Scholar
- Helmstadter GC: Principals of psychological measurement. 1964, New Yoerk: Apple Century- CroftsGoogle Scholar
- Beaton DE, Bombardier C, Guillemin F, Ferraz MB: Guidelines for the process of crosscultural adaptation of self-report measures. Spine. 2000, 25: 3186-3191. 10.1097/00007632-200012150-00014.View ArticlePubMedGoogle Scholar
- Kastner S, Basler HD: [Do questionnaires for the assessment of change really assess change?]. Schmerz. 1997, 11: 254-262. 10.1007/s004820050094.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://0-www.biomedcentral.com.brum.beds.ac.uk/1471-2377/11/104/prepub
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.