Guide
How to evaluate AI workout software with a 30-minute test on your hardest client
A feature list rewards the vendor with the longest page. One hard client, three changed inputs, and an eight-row score sheet give any tool a comparable score in half an hour.
By RaiNGE product teamUpdated 8 min read
Written for coaches and gym owners comparing AI workout tools before paying for one.
Try a baseline run on one invented client: the free sample workout is one workout PDF after a short intake, so you can see what comes back. Get the free sample workout
On this pageRun the test in five steps
Run the test in five steps
- 1
Write the brief (5 minutes)
Pick your hardest client: an injury flag, limited equipment, or a schedule full of gaps. Write one paragraph covering age, goal, days and session length, equipment with load ranges, injury and pain notes, and attendance over the last two weeks. Remove the name and any other identifier.
- 2
Run the tool once (3 minutes)
Enter the brief exactly as written and keep the output. It is your baseline, and it shows how much of the brief the tool used.
- 3
Change one input per run, three times (7 minutes)
Make three more runs, changing one input each time. The table below says what should move and what should stay put. For the shoulder flag, run it twice: a rule removes the same exercises both times, and a model following a prompt may not.
- 4
Time your own review (10 minutes)
Start a timer when you open the baseline draft and stop when you would approve it for the client. If the timer reaches 10 minutes and you are not ready to approve, stop: that is the result. Compare your time with how long you take to write that week by hand.
- 5
Score the outputs (5 minutes)
Score the baseline and the three changed runs on the eight criteria below, 0, 1, or 2 each, using your review time for row 6. Take the worst score across the runs for each criterion, because your roster will include the hard cases. Rows 7 and 8 come from the vendor's written answers and an export you try, so ask for those before you start the clock and score either row 0 until you have it.
These three changes suit most clients. If your hardest client already has a shoulder issue, swap in a different flag, such as a knee, and look for exercises that load that joint to leave the draft or carry a visible caution.
The score sheet: eight criteria, 0 to 2 each
Score every row after each run. The last column defines each score, so you are grading against a written rule.
The pass line: 12 of 16 is a reasonable starting point, and you should move it to suit your clients. Treat rows 2 and 5 as gates: a 0 on either fails the tool whatever the total, because they decide whether an unreviewed mistake can reach a client.
Worked example: two tools that tie on 12
Tool A and Tool B are made up for this example, and so are their scores and times. Both ran the same brief and the same three changes. Writing that week by hand takes the coach 18 minutes.
The totals tie and the decision does not. Tool A is faster to edit, easier to leave, and explains itself better, and it is still the riskier tool for client work. If you only wanted workout ideas for yourself, Tool A could be the sensible pick.
Questions to put to any vendor, live
Put these to the vendor in the demo and write the answers down. Vague answers score low on the matching row.
Ask these in the demo
- Can you run my brief with these three changes while I watch?
- Which parts of this draft came from a rule, and which came from the model?
- If I flag a limitation, which exercises are removed, and where do I see that list?
- Can anything reach my client before I approve it? Can you show me a draft's status?
- Where do exercise names come from, and what happens when the model asks for one that is not in the library?
- Where is client health information stored, who at your company can read it, is it used to train models, and how do I delete it?
- What does the price scale with, and what does it cost after the trial?
- What can I export if I leave, and in what format? Can you show me an export?
- After a client has a program, how do I change it, and can I undo the change?
The same protocol applies to RaiNGE, which is in private beta: run your hardest client through it and score what comes back.
Common questions
How many clients should I test an AI workout tool on?
Start with one, your hardest. A healthy client with a full gym is the easy case, so it tells you little. If the tool passes, run three more that differ from the first: one with limited equipment, one with a flag, and one with a gappy schedule. Commit only after all four pass the gates.
What should I do if two tools tie on score?
Check that both pass the gates on rows 2 and 5. Then break the tie on the costs you pay every week: edit speed (row 6) first, lock-in (row 8) second. If they still tie, run your second-hardest client through both and see which review you finish faster.
Can I trust a vendor demo as the test?
Treat a demo as a tour. It runs on a client the vendor chose because it works. Ask to run your own brief live, with your three changes. If the vendor declines, score every row you could not see as 0 and ask for a trial account instead.
How do I test a tool without pasting a real client's health details?
Build a composite. Keep the facts that change programming: age band, injury area and pain score, equipment, days, and attendance. Drop or change the name, birth date, employer, and location. Read the tool's data terms before any real client goes in, and use row 7 to get the answers in writing.