Sample Rate

Consider when to set the sample rate as high vs as low as possible.

Choosing a Sample Rate

High Sample Rate

  • You want to learn quickly.

  • You want to learn quickly & iterate with a V2 survey.

  • You will only keep this survey up for a short amount of time.

  • Your site has a low volume, so you need a higher percentage of visitors to interact with the survey to get significant results.

  • You’ve chosen to use an inline widget, which looks like content on your page.

  • You want every visitor to interact with this survey.

Low Sample Rate

  • You have lots of time to collect results.

  • The volume on your site is very high, so results will come in quickly regardless of what percentage of guests see the survey.

  • You are creating an evergreen survey that runs on many pages and will exist for a long time.

  • Your survey is an overlay and therefore the widget will inspire more impressions.

  • You are very concerned about disrupting the visitor’s experience.

Adjusting Sample Rates

Do I need to adjust the Sample Rates?

  • Most surveys do not need to adjust sample rates, as you'll discuss the best setting with your CSM before launch.

  • Most Submission rates are impacted by a number of factors, including widget, design, question copy, number of questions, and question order. Consider iterative surveys to get the results you need.

When to Adjust the Sample Rates

  • When running more than one survey on the same site or page, surveys may compete with each other. If one is getting lower responses, you may want to dial the other's sample rates back.

  • Evergreen surveys measure responses over time. When launching, you may want data quickly. However, once you've reached a significant amount of submissions or see a clear pattern, it is worth dial the sample rate down to improve your users' experience.

Last updated