Define what continues over time
Linden wants to know whether clarity improves after a new priority-setting routine. It can compare suitably protected group results from two pulses without matching individual employees.
Keep a record of the question, response options, dates, eligible group and action taken between waves. These are the continuity needed for group learning.
Account for changes in the population
A reorganization can change who belongs to a team. New starters, departures and different response rates can also affect the comparison. A higher group average is not proof that every person’s experience improved.
Use group definitions that make sense for the question and satisfy the reporting protections. Do not expose a tiny new team simply to preserve a chart breakdown.
Keep anonymous and identified channels separate in the analysis. A named follow-up request may explain a specific concern, but should not be silently linked to a pulse response.
Preserve question changes and limits
If the team rewrites a confusing question, retain both versions and decide what comparison is justified. The improvement may be worthwhile even when it breaks a simple trend line.
Report the action and what the later responses show, while distinguishing association from cause. Other organizational changes may have occurred at the same time.
Use the history to plan the next learning step: retain a useful routine, investigate a persistent issue or improve the collection question. The goal is a continuing record of listening and response, not a hidden profile of each employee.
Work through the Linden example
This is a fictional teaching example. Adapt the fields and rules to the question your own workflow needs to answer.
| Context | Keep | Avoid |
|---|---|---|
| Question | Wording and scale version | Assuming changed wording is identical |
| Population | Group definition and participation | Assuming the same people answered |
| Organization | Relevant changes and timing | Ignoring a reorganization |
| Action | What changed between waves | Claiming it caused all differences |
Build this part of your plan in more detail
These lessons address the next practical questions in this module. Choose the detail your workflow needs, then return to complete the exercise.
- How to Change Survey Questions Without Losing Comparability
Keep a pulse trend honest when wording or scales change.
Add this part to your plan
On workbook page 4, compare two fictional pulses with a team change and a revised question. State which findings remain comparable.
Download workbook (fillable PDF)Compare with a suggested answer
The plan preserves anonymous group comparison, discloses the population and wording changes and avoids claiming individual improvement or a proven effect of the action.
Self-check: Can you explain the trend without identifying individual respondents?
Questions you may have
Can anonymous feedback support longitudinal learning?
Yes, at an appropriate group level. It is different from following the same identified individuals.
Should we keep a confusing question unchanged for the trend?
Not necessarily. Improve it when needed, preserve versions and state the resulting comparison limit.
Apply the method to your work
Use the five-part plan to assess the sources, analysis and permissions your team needs. The solution page shows where a connected platform can support that workflow.
Explore the employee experience solution →