Verification and the threshold
Verification and the threshold
RawQuotes will not name an insight on too little evidence. Two thresholds decide what you see, and both are refusals by design: below them, the page tells you what is missing instead of guessing at a conclusion it can't back up with quotes.
| Threshold | Counted over | Below it |
|---|---|---|
| 10 complete responses in the period | All sources of the project together | No insights are named for the period |
| 3 backing responses for an insight | All sources of the project together | The insight isn't listed |
A complete response is one survey response that reached the end of the survey and answered at least one question marked Count for insights, or one item of a general source. A project with 6 survey responses and 4 imported reviews in October clears the first threshold for October.
Below 10 complete responses
The page shows how many complete responses the period has, out of 10, and how many more are needed. When the current period is still below the threshold, the page opens the last finished period instead; on the current period, View … instead switches to it. Read the responses takes you to the raw answers while you wait for more.
Filtering by source doesn't lower the bar
The source filter narrows insights that were already counted over every source; it never counts again.
- The 10 complete responses are checked for the whole project and aren't checked again under the filter.
- An insight still needs 3 backing responses from all sources to be listed. Under the filter, one the selected sources back fewer than three times is marked Below threshold for this source and shows no quotes.
Messages you may see above the insights
- Insights may no longer cover recent answers. A growing share of recent answers aren't matching any existing insight. Recompute to regroup everything and pick up what's changed.
- Today's recount did not finish. The last attempt to recompute failed, so you're looking at the result of an earlier, successful run: still your respondents' own counts and quotes, only the grouping is older.
- Ready to count your first insights. The period has cleared the threshold but has never been counted. Recompute once to name its first insights.
- Counted — nothing repeated. A count did run, and no answer repeated into an insight. This is a real result, not a failure to compute.
- … responses aren't included in this window's insights. Responses or items arrived for this period after it was last counted. Recompute the week or month to include them.
- Past periods have feedback that isn't counted yet. For example, items you imported with older dates. The list shows each period with its own Recompute. Recomputing a period counts every response in it again, so its current insights may change or disappear.
Recomputing by hand
Recompute, above the insight list, regroups every answer in the selected period from scratch, across all sources. Next to it you see roughly how many analyzed answers (AO) it will use. Whether your plan includes manual recompute is on Plans and billing.