Page 184 - Contributed Paper Session (CPS) - Volume 7

CPS2056 Nurul Hafizah Azizan et al.
effort by examining the effect of scale format (either anchor labels or end
points labels) on the reliability of Likert‐type rating scales. As mentioned in
previous studies, the findings of this study also revealed that few response
categories tended to result in lower test‐retest reliability. Besides, scale format
significantly affects the performance of measurement instrument, with the
scales with end points labelled were likely to produce lower test‐retest
reliability rather than the scales with all the response options clearly labelled.
The use of graphic or visual rating scale also had important implication on
survey research especially with children as respondents. Cremeens (2007)
yielded important findings as the results suggested that among three types of
rating scale (categorical scale, faces and thermometer), categorical scale is
more preferable to be used for the items measuring ability factors while faces
scale is found to be more effective to be used for items assessing social
construct in order to improve measurement instrument reliability.

4. Conclusion
From the review, it is found that the rating scales used has a significant
effect on the quality of measurement instrument used for the survey. These
include number of response alternatives, format and labels of rating scales
used. Apart from that, it is also important to study the effect using a central
category such as “neutral” response and to examine the interaction between
the number of response categories and items used for future research. In
addition, it is suggested to examine whether the type of psychometric model
used gives a significant implication on the findings obtained.

References
1. Allahyari, E., Jafari, P., & Bagheri, Z. (2016). A Simulation Study to Assess
the Effect of the Number of Response Categories on the Power of
Ordinal Logistic Regression for Differential Item Functioning Analysis in
Rating Scales. Computational and Mathematical Methods in Medicine,
2016.
2. Alwin, D. F. (1997). Feeling thermometers versus 7-point scales: Which are
better? Sociological Methods & Research, 25(3), 318–340.
3. Boynton, P. M. (2004). Administering, analysing, and reporting your
questionnaire. British Medical Journal, 328(7452), 1372–1375.
4. Cicchetti, D., Showalter, D., & Tyrer, P. (1985). The effect of number of
rating scle categories on levels of interrater reliability: A monte carlo
investigation. Applied Psychol Measure, 9(1), 31– 36.
5. Cremeens, J., Eiser, C., & Blades, M. (2007). Brief report: Assessing the
impact of rating scale type, types of items, and age on the measurement
of school-age children’s self-reported quality of life. Journal of Pediatric
Psychology, 32(2), 132–138.

171 | I S I W S C 2 0 1 9