Re: Likert scale for survey? (on design principles)

On Sat, 2007-08-04 at 07:03 -0500, Laura Carlson wrote:
> In the minutes, of the HTML WG 2007-08-02 phone conference [1] a
> survey on the design principles is mentioned. [2]
> 
> Something to consider to help prevent bias, might be to have response
> categories evened out over a Likert type of scale [3].
> 
> Instead of the current  1 neutral, 3 positive, and 1 negative scale of:
> 
> > I don't mind if it's there, but it doesn't appeal to me much.
> > Yes, as stated.
> > Yes, though I have suggestions...
> > Yes, but only if changes are made
> > No, because...
> >
> > Comments (or a URI pointing to your comments):
> 
> Perhaps use a five point scale indicating level of agreement like:
> 
> - Strongly Agree
> - Agree
> - Neutral
> - Disagree
> - Strongly Disagree

Thanks for the input on the options; I'm not sure how best
to do this survey...

I chose options like "Yes, but only if changes are made..." because
I know what action to take when someone chooses them.

I don't know what the editors or the WG should do differently
based on a reply of "Disagree" vs "Strongly Disagree".

I'd also like the process to be somewhat iterative, but lots
of "yes, as stated" responses only mean something if they
all refer to the same version of the text.

> Then have the text box to include comments, suggestions, proposed changes  like:
> "Comments, suggestions, proposed changes (or a URI pointing to your ideas)":
> 
> Like it says at wikipedia a lot of things can cause bias in surveys.
> People tend to avoid using extreme response categories (central
> tendency bias), agree with statements as presented (acquiescence
> bias), or try to portray themselves or their organization in a more
> favorable light (social desirability bias). Even the ordering of the
> questions and ordering or the responses can insert bias.
> 
> Best Regards,
> Laura
> 
> [1] http://www.w3.org/2007/08/02-html-wg-minutes.html
> [2] http://www.w3.org/2002/09/wbs/40318/dprv/
> [3] http://en.wikipedia.org/wiki/Likert_scale
> 
-- 
Dan Connolly, W3C http://www.w3.org/People/Connolly/

Received on Monday, 6 August 2007 15:05:18 UTC