📌 The order randomization feature is available on all plans.
What is Choice randomization?
Choice randomization is a feature that sets the choices included in a survey to be displayed in a different order every time.
Why should you use Choice randomization?
1️⃣ Minimizes response bias by reducing order effects
In multiple-choice questions, response tendencies can vary depending on the order in which choices are presented. For example, "order effects" can occur where choices placed at the beginning are selected more frequently, or the last choice seen is better remembered and selected.
To reduce this impact, Dataspace provides a Choice randomization feature that presents choices in a random order, helping you collect more balanced and reliable response data.
2️⃣ Maintains the intent and logical structure of the question
There are cases where the semantic relationship or logical flow between choices must be considered. In such cases, you can group related choices and apply randomization at the group level.
By using this method, you can effectively reduce response bias caused by the order of choices while maintaining the core intent of the question, allowing for more stable survey design.
How to use Choice randomization
📌 Choice randomization can only be applied to choices in general questions and does not apply to choices in screening questions.
🔄 Randomize individual choices
This method randomly rearranges the order of all individual choices included in a question. Please set it up using the method below.
step 1. After selecting the desired question, activate the Choice randomization toggle in the settings on the right.
step 2. When the toggle is activated, "Randomize individual choices" is displayed as ON, and a "Choice randomization" mark also appears on the question.
🔄 Randomize choices by group
This method involves designating related choices as a group and randomly rearranging the order between groups or within a group. Please set it up using the method below.
step 1. After selecting the desired question, activate the Choice randomization toggle in the settings on the right.
step 2. If you select "Randomize choices by group" as the randomization method, you can designate groups. After selecting the choices to be grouped, click the [Add] button to create a group.
💡 Usage tip | If you want to undo group designation, please use [Reset group designation].
💡 Usage tip | Non-consecutive choices cannot be grouped.
Example: Grouping Choice 3 and Choice 5 → Impossible
Example: Grouping Choice 3, 4, and 5 → Possible
step 3. Created groups are displayed in the list below. Please set them according to your desired randomization method.
Randomize choices within group: To randomly rearrange choices inside a group, activate the toggle on the right side of that group.
Randomize order between groups: To randomly rearrange the presentation order between groups, activate the [Randomize order between groups] toggle at the bottom.
Both randomization options can be set simultaneously. In this case, both the order between groups and the choices within groups will be presented randomly.
💡 Usage tip | If you want to turn off the randomization setting, simply deactivate the Choice randomization toggle in the settings screen. You can readjust the settings at any time as needed.
step 4. Once the setting is complete, "Randomize choices by group" will be displayed as ON in the settings on the right, and you can check the randomization conditions. Also, a "Choice randomization" mark will be displayed on the corresponding question.
💡 These features are also available in the Dataspace editing screen.
If you want to check if the randomization settings have been applied correctly, use the [Preview] feature at the top right.
Each time you run the preview, choices or questions are presented in a random order, allowing you to check the survey flow that actual respondents will see in advance.
Frequently Asked Questions
Q. Can users directly set the order of randomized choices or check which order was shown to respondents?
A. Randomization is automatically applied according to the system's internal logic. For this reason, users cannot directly specify the exposure order or ratio, nor can they separately inquire about the actual order in which choices were presented to each respondent.
Please note that the randomization feature is intended to reduce response bias caused by order.
Do you fully understand the Choice randomization settings?
If you still have questions after reading this guide, please feel free to contact us via the [Customer Center Icon] at the bottom right of the screen.
To help you solve the difficulties you are experiencing in the survey setting process, our team will help you to the end.