Pilot Survey

Due: Oct 18 by 11:59pm

Weight: This assignment is worth 4% of your final grade.

Assessment: Your submission will be assessed using the rubric at the bottom of this page.

As a team, create a pilot survey - an initial draft of your final survey for preliminary testing. Your fellow classmates will all take your survey and provide feedback. The course instructor will also review and grade your survey and will provide written feedback. Follow the instructions below to prepare your pilot survey.

1. Get Organized

Download and unzip this template for your pilot survey. The folder contains the following files:

  • pilot_survey.Rproj: An R Project file for staying organized.
  • p1-intro.Rmd: The code for creating part 1 of your survey, which should include a welcome page, content form, and eligibility questions for screening our ineligible respondents.
  • p2-choice-questions.Rmd: The code for creating part 2 of your survey, which should include your education content and randomized conjoint choice questions.
  • p3-demos.Rmd: The code for creating part 3 of your survey, which should include any other questions (e.g. demographics) you wish to ask your survey respondents.
  • make_choice_questions.R: The code to generate the choice_questions.csv file.
  • choice_questions.csv: The survey choice question design file.
  • images: A folder of images you’re using in your survey.

2. Write your survey content

The files included in the zip file are taken directly from the example apples conjoint repo on GitHub associated with the blog post on building conjoint surveys in R. This is just placeholder content - you need to replace it with your survey content.

Follow these guidelines in inserting your content:

  • You may directly copy and paste any content you wish from your Survey Plan assignment.
  • In your p2-choice-questions.Rmd file, you should include at least one example choice question (e.g. the first choice question for the first respondent) using your choice question design file (the choice_questions.csv file).
  • Your code should not reference any local files - all files should be hosted online somewhere (e.g. uploaded to a formr run, github.com, etc.), and your code should use the urls to those locations. This includes your choice_questions.csv file as well as any images used in your survey.

Be sure to knit each file often - you should knit each part to html files so you can preview that everything is displaying as expected.

3. Upload your content to formr.org

Using your team google and formr accounts:

  1. Create a Google Sheet for each of your survey .Rmd files. You may directly copy and edit from the example survey parts 1, 2, and 3.
  2. Upload each sheet as a separate Survey in formr, then create a Run linking the surveys together. Be sure to carefully edit the Run settings such that respondents are appropriately screened out as desired.
  3. When you are confident that the Run is ready, turn the “volume” settings to the third setting (“People who have the link can access”).

4. Submit

Create a zip file of everything in your R Project folder associated with your pilot survey. Name your file pilot-survey.zip, then go to your team Box folder and submit your zip file in the “submissions” folder. Only one person from your team should submit the report.

Grading Rubric

35 Total Points

Category Excellent Good Needs work
Organization & Formatting 5
All formatting guidelines are followed.
Most formatting guidelines are followed; only one or two components from the template are missing.
Most formatting guidelines are followed; several components from the template are missing or incomplete.
Survey Content 10 / 9
Rmd files are complete and compile without error to html pages. All referenced files are on the web (not local).
8 / 7 / 6
Rmd files are complete and compile to html pages mostly without error (may need one or two small fixeds). All referenced files are on the web (not local).
5 / 4 / 3
Rmd files are incomplete and / or missing, and they require multiple fixes to compile into html files. References local files that are not yet on the web.
Conjoint Questions 10 / 9
Randomized conjoint questions render on live formr survey without error.
8 / 7 / 6
Randomized conjoint questions render on live formr survey with only one or two errors (e.g. image load fail).
5 / 4 / 3
Randomized conjoint questions have major issues rendering on the live formr survey. Page load fails or content is displayed in an unintelligle manner.
formr 10 / 9
Entire survey renders on live survey without errors, user can get to end and questions are clear and understandable.
8 / 7 / 6
The survey contains one or two errors when rendering in formr, but the user can still get to the end of the survey.
5 / 4 / 3
An error page displays preventing continuation in the survey, or multiple major errors exist in the survey making it difficult to understand the questions.