validsurvey.app

Walkthrough

One survey, from draft to report. The pictures come from our sample employee survey: a made-up company with 180 fictional employees.

Part 1 · Before you send it: the Survey Validator

1. Sign in and bring your survey

Open the Validator from the link in your PIN email and sign in with your email and PIN. Your six months start the first time you sign in. Paste your questions one per line (use [Section name] lines to group them), or upload a Word file or a Qualtrics .qsf, .csv or .xlsx. A pre-check shows how each question was read before anything is sent. Each section should use one answer scale. If a section mixes scales (or the whole survey does, with no headings), it says so, and when each scale’s questions sit together it can add the headings for you. Our sample uses three scales and had no headings, so we clicked Add the section headings for me.

The sample survey pasted in, with the pre-check warning of three answer scales but no section headings and offering to add them
The sample survey pasted in. The pre-check on the right shows how each question was understood, and offers to add the missing section headings.

2. Say what it's for

Give the survey a name and a goal: what you want to measure, and what decisions the results will inform. Add who will answer, roughly how many, how you'll report the ratings (not sure is fine: when the survey is ready, it recommends how), and whether you'll compare groups such as departments. Everything that follows is judged against these.

The questions about reporting, how many people will answer, comparing groups and the audience, above the Validate survey button

3. Read the score and the plan

In a minute or two you get a score out of 100, a verdict, and the steps that would get it ready, each with the points at stake. Our sample scored 54.5: one question asks about something people can't know, three measure the same thing as questions in another section but on a different answer scale, and some wording skews the answers. We also said we'd compare groups, and no question sorts people into groups yet: that's one of the calls in step 4.

The Validator's verdict on the sample: 54.5 out of 100, needs design work, with up to 29.5 points at stake in the steps the AI can draft
The sample's first check: 54.5. Steps 1–3 hold enough points to reach the ready line, if the fixes work when you re-check.
How to get it ready: four numbered steps with the points at stake in each, and the last one marked Your call
The steps, in the order to fix them. The last is marked Your call: choices that depend on what you'll do with the results.

4. Revise, your way

Change anything only you would know, like team names, then have the AI draft the fixes and read each draft: keep it only if it still asks what you meant. Or work through the questions yourself: ask about a question, ask for a better wording, edit it, keep it, remove it, or describe what you want to know and it drafts a new question and finds where it goes. The AI's draft keeps the changes you've already made. For bigger problems, structural suggestions propose splitting, merging, dropping or adding questions. Each change comes with its reason, and nothing is final until you re-check. Where only you can decide, it asks you instead of guessing.

The first question from the sample, with its actions and the notes beside it explaining what to fix, why it matters and how sure the review is

5. Re-check as often as you like, then save

Re-check to see the new score. There's no limit on re-checks. When you're at 75 or above, save the survey as a Word file with a Design decisions you own appendix that records each trade-off and your call. If you said you'll compare groups and the survey can't yet, it suggests the questions to add.

The Download menu (report, survey, action plan, findings) above the Comparing groups panel with suggested grouping questions
The downloads, and grouping questions suggested because the sample had none.

Part 2 · After it comes back: the Survey Analyzer

6. Load the results

Open the Analyzer from the same PIN email; the same email and PIN sign you in. Upload your results as Excel or CSV, one row per person. The Analyzer guesses which columns are ratings, comments and groups (department, site, length of service) and which identify people and are never analysed. Check its guesses: the analysis trusts what you set.

Each column of the sample file with Rating, Comment, Group or Not used chosen; ID, email and name are marked as identifying people and never analysed

7. Decide who counts, before you see anything

It flags responses that look rushed or careless and asks whether to keep them, before any result is shown, so the choice can't be steered by what the results say. Whatever you choose is recorded with the results.

The step asking whether to keep 15 responses that may not be reliable: 14 finished very fast and 1 gave the same answer throughout
In the sample, 15 of 180 responses were flagged. We kept them.

8. Read the summary

The summary opens on what you can say: the favourable share on each answer scale, read on its own terms. A panel beside it walks through the findings in seven short steps.

The top of the Analyzer's summary for the sample: 180 responses (82% of 220 invited), satisfaction 67%, agreement 67%, the 0 to 10 rating 86% favourable, and eNPS +9

Then it checks how the questions may have shaped the answers, and sorts the findings into what's safe to say and what needs a caveat, with the words to use.

How the questions shaped the answers, and the Safe to say and Say it with the caveat boxes, for the sample survey
In the sample, one statement reads backwards (agreeing is the bad answer), so the app asks you to check it before trusting that scale's figures.

9. Go further, then share

Each finding links to its analysis: response quality, question by question, scale consistency, hidden groupings, differences between groups and written comments. Groups under 5 people are never shown.

Differences between groups, with Department chosen as the grouping column and the number of people in each department

Ask a question in plain words, then download the summary PDF, a written report or slides. The report page lists exactly what will be sent to the AI before you generate it.

The written report page: what will be sent to the AI, and the area where the report appears with Word and HTML downloads

No limits on re-checks or surveys

Your PIN's only limits are its six months and its $12 of AI. Everything that doesn't use AI is unlimited, and both apps show the AI budget left, in dollars.