Nordic adolescents responding to demanding survey scales in boring contexts: Examining straightlining

Abstract

Introduction Straightlining, or identical responses across all items within a multi-item scale, is often taken as an indication that responses to all items in a questionnaire are of poor quality. The purpose of this study was to examine straightlining on two scales: The Sense of Unity Scale (SUS) and the short version of the Warwick-Edinburgh Mental Well-being Scale (SWEMWBS).

Methods Data stem from the 2017–2018 data collections in four Nordic countries of the Health Behaviour in School-children study (HBSC) (15-year-old students only; 50.9% girls; n = 5928). Data were weighted to adjust for oversampling of Swedish-speaking Finnish students and to equalize sample size across countries. The main analyses were done with general linear modeling with adjustments for cluster effects (school classes).

Results The proportion with straightlining on SUS was 22.8%, varying from 5.8% among Swedish girls to 46.4% among Finnish boys. The proportion with straightlining on SWEMWBS was 18.4%, varying from 5.2% among Norwegian girls to 46.0% among Finnish boys. Straightlining on one of the scales correlated with straightlining on the other one. Straightlining tended to inflate Cronbach's α values and reduce number of factors in factor analyses. Associations between the two scales and external variables tended to be lower among straightlining students. Associations between external variables (other than SUS/SWEMWBS) are on average slightly weaker among straightliners. Straightlining students obtained more favorable scores on several resource-related variables.

Conclusion Although some problems have been identified, straightlining does not serve well as a general indicator of poor data quality.