📌 The order randomization feature is available on all plans.
What is Randomizing Choice Order?
Randomizing choice order is a feature that sets the choices included in a survey to be displayed in a different order every time.
Why should you use Randomizing Choice Order?
1️⃣ Minimize response bias by reducing order effects
In multiple-choice questions, response trends can vary depending on the order in which choices are presented. For example, an 'order effect' may occur where choices located at the beginning are selected more frequently, or choices seen last are remembered better and selected.
To reduce this impact, Dataspace provides a Randomizing choice order feature that presents choices in a random order, helping you collect more balanced and reliable response data.
2️⃣ Maintain the intent of the question and its logical structure
In some cases, the semantic relationship or logical flow between choices must also be considered. In such cases, you can group related choices together and apply randomization to each group.
By using this method, you can effectively reduce response bias caused by choice order while maintaining the core intent of the question, enabling more stable survey design.
How to Randomize Choice Order
📌 Randomizing choice order can only be applied to general choices and is not applied to screening choices.
Randomize Individual Choices
This is a method of randomly arranging the order of all individual choices included in a question. Please set it using the method below.
step 1. After selecting the desired question, activate the Randomizing choice order toggle in the settings on the right.
step 2. When the toggle is activated, Randomizing individual choices is displayed as ON, and a Randomize choice mark is also displayed on the question.
Randomize Choices by Group
This is a method of designating related choices as a group and randomly arranging the order between groups or within groups. Please set it using the method below.
step 1. After selecting the desired question, activate the Randomizing choice order toggle in the settings on the right.
step 2. If you select Randomize choices by group as the randomization method, you can designate groups. After selecting the choices to be grouped, click the [Add] button to create a group.
💡 Usage tip | If you want to unassign a group, please use [Reset group assignment].
💡 Usage tip | Non-consecutive choices cannot be grouped.
Example: Grouping choice 3 and choice 5 → Impossible
Example: Grouping choices 3, 4, and 5 → Possible
step 3. The created groups are displayed in the list below. Please set them according to the desired randomization method.
Randomize choices within group: To randomly arrange the choices inside a group, activate the toggle to the right of the corresponding group.
Randomize order between groups: To randomly arrange the presentation order between groups, activate the [Randomize order between groups] toggle at the bottom.
Both randomization options can be set simultaneously. In this case, both the order between groups and the choices within each group will be presented randomly.
💡 Usage tip | If you want to turn off the randomization setting, change the randomization method to Do not set in the settings screen. You can readjust the settings at any time as needed.
step 4. Once the settings are complete, Randomize choices by group will be displayed as ON in the settings on the right, and you can check the randomization conditions. Also, a Randomize choice mark will be displayed on the question.
💡 These features are also available in the Dataspace Editor.
If you want to check if the randomization settings have been applied correctly, please utilize the [Preview] feature at the top right.
Each time you run the preview, choices or questions are presented in a random order, allowing you to check in advance the survey flow that actual respondents will see.
Frequently Asked Questions
Q. Can users directly set the order of randomized choices or check in what order they were shown to respondents?
A. Randomization is automatically applied according to the internal system logic. Therefore, users cannot directly specify the exposure order or ratio, nor can they separately inquire about the actual order in which they were presented to each respondent.
Please note that the randomization feature is intended to reduce response bias caused by order.
Do you fully understand the choice randomization settings?
If you still have questions after reviewing this guide, please feel free to contact us at any time through the [Customer Center icon] at the bottom right of the screen.