Indian Journal of Palliative Care
Open access journal 
  Print this page Email this page   Small font sizeDefault font sizeIncrease font size Users online: 393  
     Home | About | Feedback | Login 
  Current Issue Back Issues Editorial Board Authors and Reviewers How to Subscribe Advertise with us Contact Us Analgesic Prescription  
  Navigate Here 
 Search
 
  
 Resource Links
  »  Similar in PUBMED
 »  Search Pubmed for
 »  Search in Google Scholar for
 »Related articles
  »  Article in PDF (305 KB)
  »  Citation Manager
  »  Access Statistics
  »  Reader Comments
  »  Email Alert *
  »  Add to My List *
* Registration required (free)  

 
  In this Article
 »  Abstract
 » Introduction
 » Methods
 » Results
 » Discussion
 » Conclusion
 »  References
 »  Article Tables

 Article Access Statistics
    Viewed78    
    Printed0    
    Emailed0    
    PDF Downloaded13    
    Comments [Add]    

Recommend this journal

 


 
Table of Contents 
ORIGINAL ARTICLE
Year : 2019  |  Volume : 25  |  Issue : 3  |  Page : 374-378

Validation of the comprehensive needs assessment tool in patients with advanced cancer


1 Division of Supportive and Palliative Care, National Cancer Centre; Lien Centre for Palliative Care, Duke-NUS Medical School, Singapore
2 Division of Supportive and Palliative Care, National Cancer Centre, Singapore
3 Department of Social Work, Faculty of Arts and Social Sciences, National University of Singapore, Singapore
4 Department of Quality, Assisi Hospice, Singapore
5 Centre for Quantitative Medicine, Duke-NUS Medical School, Singapore; Centre for Child Health Research, University of Tampere and Tampere University Hospital, Tampere, Finland

Date of Web Publication17-Jul-2019

Correspondence Address:
Dr. Grace Meijuan Yang
Division of Supportive and Palliative Care, National Cancer Centre, 11 Hospital Drive, Singapore 169610
Singapore
Login to access the Email id

Source of Support: None, Conflict of Interest: None


DOI: 10.4103/IJPC.IJPC_38_19

Rights and Permissions

 » Abstract 


Aims: The 59-item Comprehensive Needs Assessment Tool (CNAT) for cancer patients is an English language survey developed in South Korea. The objective of this study was to validate the English version of CNAT in advanced cancer patients in Singapore. Methods: This was a cross-sectional survey where advanced cancer patients completed the CNAT in English. Confirmatory factor analysis was used to assess construct validity. For known groups validity, independent samples t-test was used to compare CNAT scores based on the Karnofsky performance status and outpatient versus inpatient setting. Cronbach's alpha was used to measure internal consistency. Results: A total of 328 advanced cancer patients were recruited. The mean age was 59.6 years and 49.1% were male. Majority (68.0%) were Chinese, 20.4% were Malay, 7.9% were Indian, and 3.7% were of other ethnicities. The 7-factor model previously established in Korea showed sufficient construct validity with root mean square error of approximation 0.037 and comparative fit index 0.944. All 59 items had a factor loading ≥0.5. Group invariance test showed no difference in the pattern of factor loadings between ethnic Chinese and other ethnic groups (P = 0.155). For known groups validity, there were significant differences in CNAT scores by performance status and outpatient versus inpatient setting. The CNAT total and factor scores showed good internal consistency with Cronbach's alpha of between 0.80 and 0.937. Conclusions: The CNAT showed construct and known-group validity and internal consistency in this study sample and can be used to assess the unmet needs of advanced cancer patients in the Singapore context.


Keywords: Advanced cancer, measurement properties, needs, patients


How to cite this article:
Yang GM, Pang GS, Lee GL, Neo PS, Wong YY, Qu DL, Cheung YB. Validation of the comprehensive needs assessment tool in patients with advanced cancer. Indian J Palliat Care 2019;25:374-8

How to cite this URL:
Yang GM, Pang GS, Lee GL, Neo PS, Wong YY, Qu DL, Cheung YB. Validation of the comprehensive needs assessment tool in patients with advanced cancer. Indian J Palliat Care [serial online] 2019 [cited 2019 Aug 19];25:374-8. Available from: http://www.jpalliativecare.com/text.asp?2019/25/3/374/262856





 » Introduction Top


Cancer is a leading cause of death and a highly burdensome disease for patients, their families, and the health-care system.[1] Previous studies indicate that patients with advanced cancer have high levels of unmet need that significantly contribute to the health-care burden at the end of life.[2] Therefore, needs assessment in these patients is important so as to identify patients requiring greater input from as well as aid service planning by health-care organizations.

The assessment of patients' need for care is a vital step in achieving patient-centered care. However, these needs can be significantly affected by factors related to the socioeconomic-cultural setting and health-care system.[3],[4],[5],[6],[7] Therefore, tools related to patient-reported outcomes developed in one setting may not be entirely or readily usable in another, giving rise to the need to validate assessment tools for the appropriate setting.[8]

The 59-item Comprehensive Needs Assessment Tool in Cancer (CNAT) is an English language survey for needs assessment developed and validated in South Korean cancer patients.[9] It has been used as the tool to describe the prevalence of needs in cancer patients but has not be specifically validated elsewhere.[10],[11] There is also a corresponding version of CNAT for caregivers and the potential for both the patient and caregiver versions to be used concurrently make the CNAT attractive.[12],[13] The aim of this study was to validate the CNAT in advanced cancer patients in Singapore.


 » Methods Top


Study setting and participants

Singapore is a multiethnic society in Southeast Asia, where English is the working language and medium of instruction in schools. Most Singaporeans are bilingual in English and a mother tongue. According to the census in 2010, 74.1% of the residents are of Chinese descent.

This was a cross-sectional study. English-speaking participants were recruited from specialist outpatient clinics in the National Cancer Center of Singapore or inpatient oncology wards in Singapore General Hospital. The patient inclusion criteria were those aged 21 years or older, intact cognition as deemed by the attending physician at study entry, able to read or understand English, diagnosed with metastatic or locally advanced solid cancer that was not receiving curative treatment, Karnofsky Performance Status (KPS) >20, and able to give informed consent. This study was approved by the SingHealth Centralized Institutional Review Board (reference number 2013-082-A). Written informed consent was obtained before research participation.

Study instruments

The CNAT is a 59-item questionnaire with seven factors as follows: (1) information and education, (2) psychological problems, (3) healthcare staff, (4) physical symptoms, (5) hospital facilities and services, (6) social and religious/spiritual support, and (7) practical support. These seven factors were established by exploratory factor analysis (principal component analysis with varimax rotation).[9] Items are scored on a 4-point scale of severity according to the level of need. The original questionnaire was found to be reliable, valid, and acceptable in South Korean cancer patients.[9]

In this study, the CNAT was modified (with written permission from the CNAT developers) to replace the word “cancer” with the word “illness.” This modification was important, as it is not uncommon for patients to be unaware of their diagnosis in the Singapore context.[14],[15] Similar modifications have been previously reported for the adaptation and validation of the Functional Living Index-Cancer questionnaire in Singapore.[16]

Demographic and clinical data were obtained from eligible consented patients as well as medical records at the study entry. The CNAT was administered once to eligible participants by trained interviewers.

Statistical analysis

Participants rated each CNAT item according to their level of need for help – 0, (no need for help), 1 (a little), 2 (moderately), and 3 (a lot). Higher scores indicated higher levels of unmet need.[9] The factor scores were obtained by computing the mean score of items in each factor. The total CNAT score was obtained similarly by computing the mean score of all 59 items. The factor and total scores then rescaled to a 0–100 scale.

The percentage of respondents who obtained the minimum (floor) and maximum score (ceiling) were tabulated. Less than 30% of participants on the floor or ceiling were considered acceptable levels of floor or ceiling effects.[17]

To assess construct validity, we conducted confirmatory factor analysis (CFA) of the 7-factor model for the 59 items previously proposed by Shim et al.[9] We used the robust-weighted least squares method for the CFA.[18] The root mean square error of approximation (RMSEA) and Comparative Fit Index (CFI) were used for model selection and assessment of goodness-of-fit.[19],[20] While there is no golden rule to determine what cutoff values are optimal, we consider RMSEA 0.05 and CFI 0.95 as approximate reference values, which are often discussed in the literature.[18],[19] We tested group invariance in factor loadings between ethnic Chinese (n = 223) and non-Chinese (n = 105) participants.[18]

Known-groups validity was assessed based on the KPS and study setting. Independent samples t-test was used to compare CNAT factor and total scores for those with KPS 0–60 (requires assistance) versus KPS 70–100 (able to care for self), and those in the outpatient setting versus in the inpatient setting.

Internal consistency was measured using Cronbach's α. Test–retest reliability was not planned, as there may be rapid changes in functional status and psychosocial well-being due to complications from cancer progression resulting in different responses unrelated to the measurement properties of the CNAT questionnaire. Cronbach's α values of ≥0.7 were considered acceptable.[21]

Sample size considerations

For validity assessment by known-group comparison using the independent samples t-test, with group size that may vary by up to a 2:3 ratio, a total sample size of at least 275 gives 90% power, at 5% two-sided Type 1 error rate, to detect an effect size of 0.4 standard deviation (SD) in the mean difference between the two groups. Furthermore, the recommendation of Comrey and Lee[22] is that, for factor analysis, a sample size of 300 is “good.” The study sample size satisfied both criteria.


 » Results Top


A total of 328 patients were recruited. The mean age was 59.6 years, 49.1% were male, and most (74.1%) were married with living with their spouse. Majority (68.0%) were Chinese, 20.4% were Malay, 7.9% were Indian, and 3.7% were of other ethnicities [Table 1].
Table 1: Demographic and clinical characteristics (n=328)

Click here to view


On a 0–100 scale, the mean CNAT total score was 14.1 [Table 2]. Less than 2% of participants reached the ceiling for any of the domains. Substantial (>30%) floor effect was observed in 5 of 7 factors; the highest floor effect was seen in factor 6 “social and religious/spiritual support” (58.2%).
Table 2: Distribution of comprehensive needs assessment tool factor and total scores

Click here to view


CFA of the 7-factor model gave RMSEA 0.037 and CFI 0.944, indicating approximately sufficient fit. All 59 items had a factor loading ≥0.5. The 7-factor structure is, therefore, valid in this study. We tested for group invariance between the ethnic Chinese participants and participants of other ethnicities. The difference testing gave P = 0.155, demonstrating lack of difference in factor structure between the two groups.

When comparing participants with different KPS, there was a statistically significant difference in the CNAT total scores, 13.0 (16.2) for those with good performance status versus 20.0 (17.5) for those with poor performance status (P < 0.01) [Table 3]. The effect size was approximately 0.4 SD. There was also the good separation of scores for Factor 1 (information and education), Factor 2 (psychological problems), Factor 4 (physical symptoms), Factor 5 (hospital facilities and services), and Factor 7 (practical support). There was no significant difference in scores for Factor 3 (health-care staff) and Factor 6 (social and religious/spiritual support).
Table 3: Comprehensive needs assessment tool factor and total scores by Karnofsky performance status

Click here to view


When comparing participants in the outpatient versus inpatient setting, there was a statistically significant difference in the CNAT total scores – 11.4 (13.9) for those in the outpatient setting and 22.2 (19.3) in the inpatient setting (P < 0.01) [Table 4]. The effect size was approximately 0.6 SD. There was also good separation of factor scores.
Table 4: Comprehensive needs assessment tool factor and total scores by setting

Click here to view


Overall, the internal consistency was high, with a Cronbach's alpha of 0.97 for the total score. All factors had Cronbach's alpha of between 0.80 and 0.93 [Table 5].
Table 5: Cronbach's alpha for comprehensive needs assessment tool factor and total scores (n=328)

Click here to view



 » Discussion Top


This is a validation study of the English version of the CNAT for advanced cancer patients. The results show little ceiling effect but considerable floor effect in this study population. Despite the floor effect, we found good levels of construct validity in terms of CFA results, known-groups validity in relation to performance status and setting of care, and internal consistency.

Significant floor effect was observed for a few factors and may be due to the usage of a narrow 4-point response scale. In the context of a tool that measures unmet needs, the floor effect is of lesser concern clinically as needs-based interventions aim to target those with higher CNAT scores indicating more unmet needs. However, the significant floor effect could have suppressed the difference in CNAT scores by KPS – the two factors with the highest floor effect were the same two factors that did not have significant separation of scores by KPS. The minimal ceiling effect observed is a desirable property as a change from a high baseline level of unmet need can then be monitored.

Factor 6 (social and religious/spiritual support) had a particularly high floor effect with 58.2% endorsing the floor score. This may be due to the lower prevalence of problems and unmet needs with regard to spiritual issues in Asian countries compared to Western countries.[23] Dimensions of spirituality may also have varying salience in different cultures. In Asian culture, spirituality may be experienced more in terms of making sense of one's situation and role rather than as a matter of one's relationship with God.[24],[25] For example, a study on spiritual needs of cancer patients in China found that “to be accepted” and “to take responsibility” were more important than “to talk to someone,” “to pray,” and “to feel God with me.”[26]

Factor 3 (health-care staff) also had a high floor effect with 50.3% endorsing the floor score. The items in this factor related to the interactions with doctors and nurses, for example, to be “respected and treated as a person by my doctor” and to have “nurses to promptly attend to my discomfort and pain.” Having a low floor score may indicate that these aspects of professional care are routinely provided as part of standard care. Nonetheless, it is still a domain that is important to include in a comprehensive assessment of unmet needs, to identify and promptly address any gaps, where present.

A limitation of this study is that it was a cross-sectional study, and thus, we were unable to assess sensitivity to change or test–retest reliability. A longitudinal study was not done as our target sample of patients with advanced cancer were likely to have rapidly deteriorating functional status, and consequently, a high drop-out rate for a follow-up assessment. The low levels of unmet needs expressed by participants also make validity assessment difficult. Future studies may explore a shorter version of the CNAT, which will increase the feasibility of using this tool in the clinical setting.


 » Conclusion Top


The CNAT showed construct and known-group validity and internal consistency in this study sample and can be used to assess the unmet needs of advanced cancer patients in the Singapore context.

Acknowledgments

GMY received salary support from the Lien Centre for Palliative Care.

Financial support and sponsorship

Nil.

Conflicts of interest

There are no conflicts of interest.



 
 » References Top

1.
Ministry of Health Singapore. Principal Causes of Death. Available from: https://www.moh.gov.sg/resources-statistics/singapore-health-facts/principal-causes-of-death. [Last accessed on 2019 Feb 06].  Back to cited text no. 1
    
2.
Becker G, Hatami I, Xander C, Dworschak-Flach B, Olschewski M, Momm F, et al. Palliative cancer care: An epidemiologic study. J Clin Oncol 2011;29:646-50.  Back to cited text no. 2
    
3.
Fishman J, O'Dwyer P, Lu HL, Henderson HR, Asch DA, Casarett DJ, et al. Race, treatment preferences, and hospice enrollment: Eligibility criteria may exclude patients with the greatest needs for care. Cancer 2009;115:689-97.  Back to cited text no. 3
    
4.
Chen LM, Miaskowski C, Dodd M, Pantilat S. Concepts within the Chinese culture that influence the cancer pain experience. Cancer Nurs 2008;31:103-8.  Back to cited text no. 4
    
5.
Im EO, Chee W, Guevara E, Lim HJ, Liu Y, Shin H. Gender and ethnic differences in cancer patients' needs for help: An internet survey. Int J Nurs Stud 2008;45:1192-204.  Back to cited text no. 5
    
6.
Murray SA, Grant E, Grant A, Kendall M. Dying from cancer in developed and developing countries: Lessons from two qualitative interview studies of patients and their carers. BMJ 2003;326:368.  Back to cited text no. 6
    
7.
Barnato AE, Anthony DL, Skinner J, Gallagher PM, Fisher ES. Racial and ethnic differences in preferences for end-of-life treatment. J Gen Intern Med 2009;24:695-701.  Back to cited text no. 7
    
8.
U.S. Department of Health and Human Services Food and Drug Administration, editor. Guidance for Industry Patient-Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims. Silver Spring, MD: Food and Drug Administration; 2009. p. 35.  Back to cited text no. 8
    
9.
Shim EJ, Lee KS, Park JH, Park JH. Comprehensive needs assessment tool in cancer (CNAT): The development and validation. Support Care Cancer 2011;19:1957-68.  Back to cited text no. 9
    
10.
Zhang YP, Zhang Y, Liu WH, Yan YT, Wei HH. Comprehensive unmet needs and correlations with quality of life in Chinese cancer patients. Eur J Cancer Care (Engl) 2018;27:e12813.  Back to cited text no. 10
    
11.
Tian L, Cao X, Feng X. Evaluation of psychometric properties of needs assessment tools in cancer patients: A systematic literature review. PLoS One 2019;14:e0210242.  Back to cited text no. 11
    
12.
Shin DW, Park JH, Shim EJ, Park JH, Choi JY, Kim SG, et al. The development of a comprehensive needs assessment tool for cancer-caregivers in patient-caregiver dyads. Psychooncology 2011;20:1342-52.  Back to cited text no. 12
    
13.
Zhang YP, Zhao XS, Zhang B, Zhang LL, Ni CP, Hao N, et al. Cross-cultural adaptation and psychometric assessment of the Chinese version of the comprehensive needs assessment tool for cancer caregivers (CNAT-C). Qual Life Res 2015;24:1607-14.  Back to cited text no. 13
    
14.
Kao YH, Goh CR. The practice of nondisclosure of advanced cancer diagnosis in Singapore: A continuing challenge. Singapore Med J 2013;54:255-8.  Back to cited text no. 14
    
15.
Wang DC, Guo CB, Peng X, Su YJ, Chen F. Is therapeutic non-disclosure still possible? A study on the awareness of cancer diagnosis in China. Support Care Cancer 2011;19:1191-5.  Back to cited text no. 15
    
16.
Cheung YB, Khoo KS, Thumboo J, Ng GY, Wee J, Goh C. Validation of the English and Chinese versions of the quick-FLIC quality of life questionnaire. Br J Cancer 2005;92:668-72.  Back to cited text no. 16
    
17.
Kane R. Understanding Health Care Outcomes Research. Burlington, MA: Jones and Bartlett Publishers; 1997.  Back to cited text no. 17
    
18.
Muthén LK, Muthén BO. Mplus User's Guide. Los Angeles, CA: Muthén and Muthén; 2017.  Back to cited text no. 18
    
19.
Hu L, Bentler P. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Modeling 1999;6:1-55.  Back to cited text no. 19
    
20.
Marsh HW, Hau KT, Wen Z. In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler's (1999) findings. Struct Equ Modeling 2004;11:320-41.  Back to cited text no. 20
    
21.
Nunnally JC, Bernstein IH. Psychometric Theory. New York, NY: McGraw-Hill; 1994.  Back to cited text no. 21
    
22.
Comrey AL, Lee HB. A First Course in Factor Analysis. Hillsdale, NJ: Erlbaum; 1992.  Back to cited text no. 22
    
23.
Effendy C, Vissers K, Osse BH, Tejawinata S, Vernooij-Dassen M, Engels Y. Comparison of problems and unmet needs of patients with advanced cancer in a European country and an Asian country. Pain Pract 2015;15:433-40.  Back to cited text no. 23
    
24.
Lee GL, Ow MY, Akhileswaran R, Pang GS, Fan GK, Goh BH, et al. Quality of life domains important and relevant to family caregivers of advanced cancer patients in an Asian population: A qualitative study. Qual Life Res 2015;24:817-28.  Back to cited text no. 24
    
25.
Hsiao SM, Gau ML, Ingleton C, Ryan T, Shih FJ. An exploration of spiritual needs of Taiwanese patients with advanced cancer during the therapeutic processes. J Clin Nurs 2011;20:950-9.  Back to cited text no. 25
    
26.
Cheng Q, Xu X, Liu X, Mao T, Chen Y. Spiritual needs and their associated factors among cancer patients in China: A cross-sectional study. Support Care Cancer 2018;26:3405-12.  Back to cited text no. 26
    



 
 
    Tables

  [Table 1], [Table 2], [Table 3], [Table 4], [Table 5]



 

Top
Print this article  Email this article
Online since 1st October '05
Published by Wolters Kluwer - Medknow