Defining Pass Fail in surveys

Modified on Thu, 15 Oct at 5:29 PM

Defining Pass or Fail in a Survey

How a survey decides pass or fail, including fail choices and the rule that sets an outcome.


Contents


1. Introduction & Context

When a survey is scored, each response is recorded as Pass, Fail, or No Outcome. Pass means the passing criteria were met, Fail means they were not, and No Outcome means none were set or they could not be evaluated. A survey with scoring switched off has no outcome and is purely informational.

Who is it for? Administrators who set a survey's passing criteria, and anyone reviewing responses. What does it impact? The criteria you set decide every response's outcome, and editing a response recalculates it.

Note: For custom outcomes and the full set of outcome types, see What Determines the Outcome of a Survey? in Related Articles. That article also explains the colours: Pass shows as a green label, Fail as red, and No Outcome as grey.

2. Key Features & Functions

  • Pass score: the response's total score is compared to a pass score. At or above it passes, below it fails.
  • Fail choice: a multiple choice answer marked as Fail fails that question when selected.
  • Fail if any of the children fail: when set to Yes, one failed question fails the whole survey, whatever the score.
  • Rule that sets an outcome: a rule links a condition, such as a chosen answer, to a specific outcome.
  • Results per item: a section or question can show its own pass or fail, separate from the overall survey.

3. Requirements

  • Scoring enabled on the survey, otherwise responses show No Outcome.
  • A pass score and scores on the answer choices, for score-based pass or fail.
  • Administrator access to edit the build and set the passing criteria.

4. Step-by-Step Guide

Set a pass score

Score-based pass or fail compares the response's total score, built from the scores on the answer choices, against a pass score you set on the survey. At or above the pass score is a Pass, below it is a Fail, and if the score or pass score is missing the result is No Outcome.

Fail on a specific answer

Use this when one answer should fail the survey on its own, for example "No, we don't have fire extinguishers".

  1. In the build, open the choice on a multiple choice question (the Edit Choice dialog) and tick Fail. Selecting it now fails that question and its section.
  2. To fail the whole survey on it, set Fail if any of the children fail to Yes. The outcome is then Fail whatever the score.
Note: Fail choices apply to standard scoring. A separate threshold-based method also exists, but its behaviour in the current version is still being confirmed, so it is not covered here.
The Edit Choice dialog on a multiple choice question, showing the score field and the Fail tickbox.

The Edit Choice dialog, where a choice can be given a score and marked as a Fail choice.

The rule that sets an outcome

A rule links a condition, such as choosing a certain answer, to a specific outcome, so the system records that outcome in place of a plain pass or fail. Create any custom outcome you need first (in Admin), then:

  1. Open the Survey Build, scroll to the bottom, and expand the Rules section.
  2. Select Add Rule, name it, and set the conditions that should trigger an outcome.
  3. Expand Results, choose Add Result, and select the matching outcome.

If one rule applies, its outcome becomes the survey's. If several apply with different outcomes, the survey shows no single outcome and each result keeps its own.

The Rules and Results sections at the foot of a Survey Build, where a condition is linked to an outcome.

The Rules and Results sections of a Survey Build, where a condition is linked to an outcome.


5. Common Issues & Troubleshooting

SymptomCause and what to do
A Fail choice was selected but the survey still passed.Fail if any of the children fail is not set to Yes. Set it to Yes so a single failed question fails the response.
The response shows No Outcome.Scoring is off, no pass score is set, or the scoring data is incomplete. Enable scoring, set a pass score, and give the answer choices scores.
A rule is satisfied but no outcome appears.More than one rule produced a different outcome, so there is no single one. This is expected. Design the rules so only one applies to a given response.

▾What Determines the Outcome of a Survey?Open full article »

Related article

The full set of outcome types, including custom outcomes, and what the green, red and grey labels mean on a response.

▾How to build a survey?Open full article »

Related article

Building the survey itself, including the questions and answer choices that the scoring described here is applied to.

▾Responding to a SurveyOpen full article »

Related article

Completing and submitting a survey, which is the point at which the outcome described here is calculated.

Was this article helpful?

That’s Great!

Thank you for your feedback

Sorry! We couldn't be helpful

Thank you for your feedback

Let us know how can we improve this article!

Select at least one of the reasons
CAPTCHA verification is required.

Feedback sent

We appreciate your effort and will try to fix the article