Protobi

← All blog posts View post

<p>Straightliners.  You know they must be somewhere in your sample ... respondents 
who give the same answer to every question in a section.  </p>
<p>If you could see the answers for one respondent for one section, it'd be
easy to spot.  But how do you quickly identify all straightlines?
It's pretty easy to find them in Protobi using this one trick...</p>
<p><img src="/images/blog/2018-06-10-flatliners/straightline.png" /></p>


<h2 id="look-for-a-standard-deviation-of-zero">Look for a standard deviation of zero</h2>
<p>A straightliner is someone whose answers don't vary. Standard deviation measures variation.
So a straightliner is  a respondent who has a standard deviation of zero.</p>
<p>To identify straightliner for a section, we just need to calculate the standard deviation of responses for that section for each respondent.
And select those respondents with zero deviation.</p>
<h2 id="example">Example</h2>
<p>Here's an example from the Pew Research Gender and Generations survey. The graph below shows the distribution of all respondents.</p>
<p><img src="/images/blog/2018-06-10-flatliners/q5.png" /></p>
<p>We could click to find respondents who answered any one response in Q5a, Q5b, Q5, etc. 
But otherwise it's not obvious who gave the same answer to each question.</p>
<h2 id="calculate-standard-deviation">Calculate standard deviation</h2>
<p>Select "Transform..." from the context menu and choose "Standard deviation" from the dialog.  Also deselect "Hide children".</p>

<p><img src="/images/blog/2018-06-10-flatliners/q5-dialog.png" /></p>
<p>This will calculate the standard deviation for that section for each respondent
and show the result as a distribution.  </p>
<p>Here we've also set "Round by" to "log" to see the distribution better:</p>
<p><img src="/images/blog/2018-06-10-flatliners/q5-deviation.png" /></p>
<h2 id="select-respondents-with-zero-deviation">Select respondents with zero deviation</h2>
<p>Here we can see there are 124 respondents who gave the same answer to each question in this section:</p>
<p><img src="/images/blog/2018-06-10-flatliners/q5-flatliners.png" /></p>
<p>Here there are 25 respondents who said "Very strong conflicts" to every question in this section. 
And 8 who respondend "There are not conflicts " to every question.</p>
<h2 id="caution">Caution</h2>
<p>Just because they answered the same answers in one section doesn't mean they didn't mean it.
They could be honestly giving the same answer.</p>
<p>But straightline answers are an important consideration in context.  For instance, a respondent who completes a 45 minute questionnaire
in 15 minutes and has several sections with flatline answers in more than one section would legitimately be suspect.</p>
<h2 id="try-it">Try it</h2>
<ol>
<li>Find a section of your survey where you're concerned about straightliner.</li>
<li>Set the Transform for that section to 'Standard deviation'</li>
<li>Click to select respondents with zero deviation</li>
</ol>
<p>Then see if there are other aspects of their answers that would trigger 'red' or 'yellow' flags...</p>
<p>Want to discuss your  survey?  Contact our team at <a href="mailto://support@protobi.com">support@protobi.com</a></p>

Date

Status

Slug edit

Thumbnail

Categories Manage