Can ChatGPT mark your GAMSAT essay?
We ran the same Section II essay through ChatGPT, Claude, Gemini — and our grader. Pick one and see the difference.
A chatbot
Measured: 8–9 high on a strong essay
aptavia
±1 on re-mark
Since the earliest hand-axe, humanity has been defined by a restless urge to improve upon the world it inherited. Every generation has looked at its tools and declared itself the most advanced that has ever lived. Huxley’s warning — that technological progress may merely provide “more efficient means for going backwards” — asks whether movement and progress are the same thing at all. I will argue that they are not: progress is a moral achievement rather than a technical one. Machines accelerate us; only judgement can steer.
The clearest evidence for Huxley’s anxiety is the gap between what our tools can do and what we have decided they are for. The engagement algorithm is a marvel of optimisation, yet the thing it optimises — attention — was never something its users agreed to sell. Social media has made us lonelier than any generation in history. We built systems faster than we built the norms to govern them, and the result is a culture that mistakes acceleration for direction. Skinner’s point lands precisely here: the real problem is not whether machines think but whether men do. A society that automates its choices has not abolished choice; it has merely stopped noticing who is making them.
Yet to blame the machine is to mistake the mirror for its reflection. Technology has no ambitions of its own; it enlarges whatever intention we bring to it. The same protein-folding models that could, in principle, design a toxin are compressing decades of medical research into years. Wiener saw this clearly: we have modified our environment so radically that we must now modify ourselves — not our bodies, but our habits of deliberation. The demand is not to slow invention but to mature alongside it, much as medicine matured from heroic surgery to informed consent.
This is why Shaw’s formulation is the most complete of the four. Progress is impossible without change, but the change that counts is not the new device; it is the new mind that decides what the device is for. A century ago the measure of a nation was the tonnage of its steel. Today, unevenly and with reluctance, we are learning to measure welfare, attention and trust. That shift in what we count is itself progress of the deepest kind.
Humanity, then, remains defined by its urge to improve the world it inherited. But improvement is a verdict, not a velocity. The societies that deserve the word “progress” will not be those that moved fastest, but those that could still explain — in words their citizens accept — where they were going, and why the destination was worth it.
ChatGPT
Illustrative transcript
This is a strong essay! You’ve engaged thoughtfully with the quotes and your argument builds well across paragraphs. Overall, I’d give it an 8/10. A few suggestions:
1. Grammar & clarity — some sentences are quite long; consider splitting them for readability.
2. Structure — well organised, though transitions between paragraphs could be smoother.
3. Vocabulary — strong overall; watch the repetition of “progress” and vary word choice.
With some minor polish this could easily be a 9/10. Would you like me to rewrite any sections for you?
that’s the whole reply
aptavia — deep mark
Same essay · always this column
64/ scaled
Developing → Competitive
Calibrated to the GAMSAT scale — an estimate, not an official ACER score.
Calibrated rubric — three sub-scores
Marker A 64 · Marker B 63 — agreed
Two independent AI examiners. Disagreement triggers an automatic re-mark.
Inline annotations
“Yet to blame the machine is to mistake the mirror for its reflection.”
REWARDEDA real dialectical turn — you complicate your thesis instead of restating it. This is what Thought & content marks reward.
“Social media has made us lonelier than any generation in history.”
REASONING GAPAn absolute claim with no support. Hedge it, or anchor it to one defensible example — an examiner won’t grant the superlative.
“Since the earliest hand-axe, humanity has been defined by a restless urge to improve…”
CUTThroat-clearing. Your essay actually starts at “Huxley’s warning”. Cutting this buys back roughly 40 seconds.
Fix next
Halve your introduction
Your intro took 6 of your minutes on throat-clearing — cap it at 2. You write two essays in 65 minutes; the time you bank belongs in paragraph three, where your argument peaks.
Evidence the loneliness claim
Replace “lonelier than any generation in history” with something you can defend. One hedged, concrete observation outscores a superlative every time.
End on synthesis, not repetition
Your conclusion re-opens paragraph one. Close on “improvement is a verdict, not a velocity” — the strongest sentence you wrote.
Compared against your last 9 essays · Expression trending up
Why this counts as a mark
“Why would I pay $59 a month when ChatGPT is $30?”
Fair question. Here’s what each dollar actually buys, essay by essay.
Writing advice on demand — but no score you can train against: in our measured test, three chatbots all read a strong essay 8–9 points high.
The gold standard for discussion — at a price that makes weekly marking unrealistic for most students.
Calibrated two-examiner marks on every essay (fair use: up to 10 a day) — plus the full platform: adaptive practice, mocks, study plan.
A month costs less than a single tutor hour.
We marked the same essay three times.
ChatGPT
7/10·9/10·8/10
Two points apart on a scale it invented.
Gemini
72%·85%·78%
A 13-point swing across identical words.
aptavia
64·64·63
Dual-marked against the rubric — within ±1.
A mark you can’t trust twice isn’t a mark.
Numbers illustrative until real captures are published.
It’s not the model — it’s the marking system.
Examiner Engine Ultra runs on the same class of frontier models you might already use. The difference is everything wrapped around them.
Calibrated rubric
Scored on a rubric built from ACER’s two published criteria, calibrated so a 64 means the same thing every time.
Two independent examiners
Both mark blind. Agreement within two points is required before you see a number.
Automatic re-mark
If the markers diverge, a third settles it — before the score ever reaches you.
Timing and memory built in
Feedback assumes two essays in 65 minutes, and reads your last nine essays first.
The honest comparison.
ChatGPT-style chatbot · viewing ChatGPT | Private tutor
| aptavia Deep mark | |
|---|---|---|---|
| Score on the real GAMSAT scale | — invents a scale (8/10, bands, %) | ~ experienced estimate | 40–84, calibrated |
| ACER's two published criteria | — generic writing advice | usually — varies by tutor | our calibrated rubric is built from them |
| Consistent, calibrated re-marks | ~ steadier than we claimed — but 3/3 bots read a strong essay 8–9 high (measured) | ~ human variance | within ±1 on re-marks — measured |
| Inline annotations | — broad bullets | margin notes | anchored to your sentences |
| Timing & exam strategy | — no notion of 65 minutes | exam-day wisdom | paced for 2 essays / 65 min |
| Tracks progress across essays | — blank slate each chat | ~ their notes, their memory | every essay plotted |
| Human nuance & live discussion | the irreplaceable part | ~ voice tutor — close, not equal | |
| Turnaround | instant | 2–5 days | minutes |
| Price per essay | ≈ free | $80–150 / hour | included in Pro ($59/mo) · first free |
| Everyday marked practice | ~ unlimited, but unmarked | — a handful per course | up to 10 marked essays a day |
Fair questions.
“Can’t I just paste the ACER rubric into ChatGPT?”
There’s no official ACER rubric to paste — ACER publishes two assessment criteria, and pasting those in genuinely helps. But ChatGPT still can’t calibrate to the real scale, because it has never seen scored essays across the range — when we measured three current chatbots, all three read a strong essay 8–9 points high. And it still forgets you between chats. The criteria are public; calibration is the work.
“I already pay for ChatGPT Plus.”
Keep it — it’s genuinely useful for brainstorming ideas and drafting practice arguments. It just can’t tell you where you sit on the GAMSAT scale, and it will happily tell you something different tomorrow. Use both; train against the one that’s calibrated.
“Is an AI mark as good as a human tutor’s?”
Different strengths. A good tutor gives you discussion and nuance no software matches — keep yours if you have one. Ours is calibration and repetition: every essay marked the same way, minutes after you write it, at a fraction of the cost.
A chatbot flatters you. An examiner marks you.
See it on your own essay — your first mark is free.
64
Developing → Competitive
Calibrated estimate
ChatGPT, Claude and Gemini are trademarks of their respective owners. Comparison outputs shown are illustrative of typical replies with default settings, not verbatim captures. GAMSAT is a registered trademark of ACER, which is not affiliated with and does not endorse this product. Scores are calibrated estimates.
We stopped guessing and measured it
The experiment: 5 marks per essay, both systems, same day
On 21 August 2026 we took our three published sample essays — full text public, so you can replicate this yourself — and marked each one five times through our dual-examiner pipeline and five times through three current chatbots — a GPT, Grok and Gemini — asked the way a student asks: one plain “please mark my Section 2 essay” prompt, no rubric.
| Essay | Published | Our pipeline | GPT, raw | Grok, raw | Gemini, raw |
|---|---|---|---|---|---|
| Strong essay | 74 | 74 · 74 · 72 · 73 · 74spread 2 | 84 · 82 · 84 · 82 · 84+9.2 vs published · spread 2 | 82 · 79 · 84 · 84 · 82+8.2 vs published · spread 5 | 85 · 82 · 84 · 82 · 82+9 vs published · spread 3 |
| Solid essay | 63 | 64 · 63 · 63 · 64 · 64spread 1 | 70 · 70 · 68 · 69 · 68+6 vs published · spread 2 | 66 · 68 · 66 · 68 · 68+4.2 vs published · spread 2 | 68 · 67 · 70 · 71 · 67+5.6 vs published · spread 4 |
| Mid-range essay | 54 | 54 · 55 · 54 · 55 · 54spread 1 | 58 · 58 · 58 · 58 · 58+4 vs published · spread 0 | 48 · 52 · 51 · 52-3.2 vs published · spread 4 · 1 reply unscorable | 56 · 52 · 52 · 53 · 53-0.8 vs published · spread 4 |
What surprised us: the chatbots were more consistent than we expected — repeat-mark spreads of 0–5 points against our pipeline’s 1–2. We used to say a chatbot “gives a different number every run”; for current frontier models that overstated it, and we’ve corrected our copy.
What the real problem is: flattery — and it’s unanimous exactly where precision matters most. On the strong essay, all three chatbots agreed with each other and not with the calibrated mark: a 74 read as 82–85 by every one of them (+8 to +9 on average). The middle essay came back +4 to +6 everywhere. Only at the bottom did they diverge — one bot read the weakest essay 4 points high, one read it about level, one read it 3 points low and once returned no usable score at all. So the better your writing, the more confidently every chatbot tells you you’re nearer the top band than you are — and a marker that is reliably too kind is worse than a noisy one.
Method & caveats: three essays, five runs per system, three current chatbots (a GPT, Grok and Gemini) via API on a fixed naive prompt — a small, replicable probe, not a study. All three ranked the essays in the correct order; scores were parsed from their own prose, and one Grok reply contained no parseable score. Thirteen of our fifteen pipeline runs were full dual-examiner marks; two (both on the strong essay) returned a single-examiner grade after one examiner errored — both scored 74, inside the dual runs’ 72–74 range — and we count and disclose them rather than quietly re-running. Our pipeline’s marks landed within ±1 of the published marks it produced earlier this month — the re-mark consistency we publish on the calibration page. Our rubric is built from ACER’s two published criteria; it is ours, not ACER’s.