📌 The order randomization feature is available on all plans.
What is Block and Question Order Randomization?
Block and Question Order Randomization is a feature that allows the blocks or questions included in a survey to be displayed in a different order to each respondent.
Why should you use Block and Question Order Randomization?
1️⃣ Reduce order effects to increase data reliability
In a survey, an order effect can occur where the presentation order of questions or choices themselves influences the response.
In this case, responses different from actual perceptions or experiences may be collected, causing bias in the results.
For example, a response to a preceding question may become a judgment criterion for subsequent questions, or if similar questions are placed consecutively, response sincerity may decrease due to lack of concentration or fatigue towards the end of the survey.
To minimize these effects, we provide a randomization feature that displays the order of blocks or questions randomly, helping to collect more balanced and reliable data.
2️⃣ Necessary logical flow and context can be maintained
Even when applying randomization, there may be cases where the logical flow or context of the survey must be maintained. In such cases, you can set it up by grouping related questions together and randomizing only the order between groups or within a group.
This allows for flexible survey design that reduces response bias caused by order while maintaining the understandability of the survey.
How to Randomize Block Order
📌Bock order randomization can only be applied to general blocks and does not apply to screening blocks.
Individual Block Randomization
This method sorts all individual blocks included in the survey in a random order. Please set it up as follows.
step 1. Click Set Block Order Randomization at the bottom of the question list on the left.
step 2. Select Individual Block Randomization as the randomization method and click Confirm.
step 3. Once the setting is complete, Block Order Randomization ON will be displayed at the bottom of the question list on the left. You can check the setting conditions by hovering over it.
Group Block Randomization
This method designates related blocks as a group and sorts the order between groups or within a group randomly. Please set it up as follows.
step 1. Click Set Block Order Randomization at the bottom of the question list on the left.
step 2. When you select Group Block Randomization as the randomization method, you can designate groups. Select the blocks to be grouped and click the Add button to create a group.
💡Tip | If you want to reset group designations, please use Reset Grouping.
💡Tip | Non-consecutive blocks cannot be grouped.
Example: Grouping Block 3 and Block 5 -> Not possible
Example: Grouping Blocks 3, 4, and 5 -> Possible
step 3. Created groups are displayed in the list below. Set them according to your desired randomization method.
Randomize block order within group: To sort blocks within a group randomly, activate the toggle on the right of the corresponding group.
Randomize order between groups: To sort the presentation order between groups randomly, activate the Randomize order between groups toggle at the bottom.
Both randomization options can be set simultaneously. In this case, both the order between each group and the blocks within each group will be presented randomly.
💡Tip | If you want to turn off the randomization setting, change the randomization method to Not set on the setting screen. You can adjust the settings again at any time as needed.
step 4. Once the setting is complete, Block Order Randomization ON will be displayed at the bottom of the question list on the left. You can check the setting conditions by hovering over it.
How to Randomize Question Order Within a Block
📌 Question order randomization can only be applied to general questions and does not apply to screening questions.
Individual Question Randomization
This method sorts all questions randomly without group settings. Please set it up as follows.
step 1. Click Randomize question order within block on the right side of the block containing the questions to be randomized, or select Randomize question order within block from the block's More actions (⋮).
step 2. Select Individual Question Randomization as the randomization method and click Confirm.
step 3. Once the setting is complete, a message saying The order of all questions in this block will be exposed randomly will be displayed at the bottom of the block.
Group Question Randomization
This method designates related questions as groups and sorts the order between groups or within a group randomly. Please set it up as follows.
step 1. Click Randomize question order within block on the right side of the block containing the questions to be randomized, or select Randomize question order within block from the block's More actions (⋮).
step 2. Select Group Question Randomization as the randomization method, then designate questions to be grouped in Group Designation and click the Add button to create a group.
💡Tip | If you want to reset group designations, please use Reset Grouping.
💡Tip | Non-consecutive questions cannot be grouped.
Example: Grouping Question 3 and Question 5 -> Not possible
Example: Grouping Questions 3, 4, and 5 -> Possible
step 3. Created groups are displayed in the list. Set them according to your desired method.
Randomize question order within group: To sort question items within a group randomly, activate the toggle on the right of the corresponding group.
Randomize order between groups: To sort the presentation order between groups randomly, activate the Randomize order between groups toggle at the bottom.
Both randomization options can be set simultaneously. In this case, both the order between each group and the questions within each group will be presented in a randomly sorted order.
💡Tip | If you want to turn off the randomization setting, change the randomization method to Not set on the setting screen. You can adjust the settings again at any time as needed.
step 4. Once the setting is complete, the setting conditions will appear at the bottom of the block.
💡Tip | If question display logic, question skip logic, piping conditions, etc., are used together with randomization settings, the randomization feature may be restricted if it does not fit the survey flow.
💡Tip | Even when adding question display logic, question skip logic, piping conditions, etc., to questions where randomization is already applied, the randomization setting may not be applied if it is not consistent with the survey flow.
These features are also available on the Dataspace edit screen.
If you want to check if the randomization settings have been applied correctly, use the Preview feature at the top right. Each time you run the preview, blocks or questions are presented in a random order, so you can check the survey flow that actual respondents will see in advance.
Frequently Asked Questions
Q. Can users directly set the order of randomized blocks or questions, or check what order was shown to respondents?
A. Randomization is automatically applied according to the internal system logic. Therefore, users cannot directly designate the exposure order or ratio, nor can they separately inquire what order was actually presented to each respondent. Please note that the randomization feature is intended to reduce response bias caused by order.
Do you fully understand the randomization settings?
If you want to set the choice order of a question to random, please refer to the Randomize Choice Order guide.
If you still have questions after reviewing this guide, feel free to contact us at any time through the Help Center icon at the bottom right of the screen.