Protobi

← All blog posts View post

<h1 id="clean-revise-survey-data">Clean/revise survey data</h1>
<p>Sometimes you need to change the data from your survey, for all sorts of good reasons.
This article shows a few different ways to do that...</p>
<p><img src="/images/blog/2019-10-10-edit-data/edit-data-excel.png" alt="{filename}" style="max-width: 480px"/></p>

<h2 id="1-edit-data-directly-in-excel-and-upload">1. Edit data directly in Excel and upload</h2>
<p>For project teams in a hurry, a time-honored approach is to download the data, modify it in Excel, and upload the revised file. This is fine, and here's an article how to do that:  <a href="https://help.protobi.com/update-project-data">https://help.protobi.com/update-project-data</a>.</p>
<p>In the example above, you manually edit cell E5 to from 999 to 120, then upload the revised file.</p>
<p>But we generally don't recommend this approach.  You or a teammate might later need to repeat these edits with new data.</p>
<h2 id="2-transform-data-within-protobi">2.  Transform data within Protobi</h2>
<p>If it's a simple outlier, Protobi has a number of features to recode, transform, and winsorize data.</p>
<ul>
<li><a href="https://help.protobi.com/editaccess/code-text-verbatims"><strong>Recode</strong></a> selected vaues e.g. missings to zero, or 999 to missing. </li>
<li><a href="https://help.protobi.com/design/extreme-values-winsorize-trim-or-retain"><strong>Winsorize</strong> or <strong>trim</strong></a> values to cap them within reasonable ranges for reporting and summary stats.  See </li>
</ul>
<p>In the example above, you could set element <strong>Q1</strong> to squash answers to the range 0 to 120.</p>
<p>The benefit of keeping your changes in the app is that it's clearly documented, is easily modified,
and updates whenever the data is refreshed.</p>
<h2 id="3-revise-data-programmatically-in-protobi">3.  Revise data programmatically in Protobi</h2>
<p>Rather than edit data values directly, we recommend identifying the rules
and programming those in Protobi as a <a href="https://help.protobi.com/advancedusers/process-data-in-protobi">data process</a>.  Here's an article on that:  </p>
<p>The benefit of writing your changes as code is that they can be reapplied when new data arrives, 
plus the rules are documented if you ever need to review, revise, or reverse them. </p>
<p>You can write code that either runs every time the project is opened (aka "Precalculate"),
which is useful for smaller code or when the study is still in field.</p>
<p>Or you can write code that runs once on request and stores the result for rapid access (aka "Data process"). 
This is useful when the code is complex or you want to lock the result down. </p>
<h2 id="4-revise-data-programmatically-in-r-python-or-spss">4.  Revise data programmatically in R, Python or SPSS</h2>
<p>Protobi is designed to play well with other data tools such as R or SPSS.  For heavy lifting, particularly statistical modeling like regression, clustering or conjoint analysis, it's easy to get data from Protobi into your preferred toolset, and then back into Protobi for display.</p>
<p>Protobi has a full featured <a href="https://help.protobi.com/advancedusers/protobi-r-library">R library</a> and <a href="https://help.protobi.com/advancedusers/protobi-rest-api?from_search=40798940">REST API</a> to support working in other languages:</p>

Date

Status

Slug edit

Thumbnail

Categories Manage