The coaching group met every Saturday in a rented classroom above a stationery shop, and for most of a year it ran on one belief: if aspiring pilots simply studied harder, their aptitude test results would improve. The volunteers who ran it were a retired flight instructor, a former airline ground-staff member and two recent graduates who still remembered the exam hall. They had plenty of goodwill and very little evidence. What follows is how they swapped the debate over preparing for pilot aptitude tests in India for a series of small experiments.
The argument that never ended
Every Saturday ended the same way. One volunteer insisted that timed mock papers were the only honest preparation. Another said students needed slow, untimed practice on concepts first. The instructor believed in reading aloud and explaining each answer to a partner. Nobody was wrong, exactly, but nobody could prove anything either, because every student received a different mix of everything.
The turning point came when one of the graduates asked a quiet question: “What would we have to see to change our minds?” Nobody had an answer. So the group agreed to treat each teaching habit as a question, change one thing for a small set of students, and write down what happened. The rules were simple. Keep each test short. Change only one variable at a time. Make it easy to undo. Decide in advance what a useful result would look like.
Experiment one: the length of a practice session
The first question was about stamina. Did students learn more in one long Saturday block, or in several shorter sessions spread across the week? The group split a single batch of learners into two halves, using the order of the attendance sheet rather than any judgement about who was stronger. Half kept the long Saturday block. The other half received a set of short worksheets to finish on weekday evenings, with the Saturday meeting turned into a review.
After a few weeks, the volunteers compared how many questions each half could answer correctly on a fresh set of practice items drawn from the same topics. The short-session half did noticeably better on recall, but was slower on the longest multi-step problems. Nobody crowned a winner. Both observations went into the notebook, and the next question came up. A small trial need not end a debate; it only has to leave the next choice better informed.
Experiment two: explaining answers aloud
The instructor’s favourite habit got its turn next. Students in one small circle were asked to explain every answer to a partner before checking the key. A second circle worked silently and checked the key straight away. Nothing else changed: same topics, same sheets, same room, same time of day.
The result was less dramatic than the instructor had hoped, but it was informative. Explaining aloud helped most on reasoning questions, where students discovered halfway through a sentence that they had misread the setup. It helped least on memorised facts such as unit conversions, where silent repetition was just as good. The group began to see that “the best method” depended on the kind of question, which is a far more useful conclusion than any slogan.
What a good small experiment looks like
By the third month the volunteers had developed a shared checklist, pinned to the classroom wall. Before any new idea was tried, somebody had to fill in four lines:
- The question: one sentence, phrased so that it can be answered by what the students actually do.
- The single change: exactly one thing that differs between the groups.
- The scale: a handful of students and a few sessions, nothing that would disrupt a whole batch.
- The next step: what the group will do if the change helps, and what it will do if it does not.
That last line mattered most. Teams often run a trial and then discover they never decided what a good result would trigger. Writing the follow-up in advance turned every experiment into a decision rather than a curiosity.
Experiment three: mock papers without the clock
The mock paper debate returned, now with a way to settle it. One group sat practice papers under strict time limits from the start. A second group sat the same papers with no clock for the first few weeks and only introduced timing later. The volunteers were careful here, because a timing change can easily hide other differences. They kept the question banks identical and rotated which volunteer invigilated.
The untimed group built accuracy faster and reported less dread on Saturday mornings. The timed group became comfortable with pressure sooner but made more careless slips early on. Once both groups had been through both phases, the gap largely closed. The takeaway was not “timing is bad” but “sequence matters,” and the group redesigned its calendar so that new students began untimed and moved to timed practice gradually.
Students who want to see what kinds of items turn up in this style of assessment can read this blog’s overview of typical questions that candidates meet in Indian pilot aptitude papers, and a companion piece on building a preparation routine for those tests. Both pair well with the habit of testing your own approach instead of copying someone else’s.
When an experiment fails
Not every trial produced a tidy improvement. One idea was to give students a printed formula sheet at the start of every session. The volunteers expected it to speed things up. Instead, students leaned on the sheet and stopped memorising the relationships behind it. When the sheet was taken away for the last practice paper, scores dipped. The group dropped the idea after a single cycle, which cost almost nothing, and that was the quiet benefit of keeping each test small. A change that backfires on a few students for a few weeks is an inexpensive lesson. A change adopted across a whole programme because it sounded sensible can take a year to unwind.
The volunteers also learned to be honest about noise. With only a handful of students per group, a single unusually motivated learner could tilt a result. So they treated each outcome as a hint, repeated promising ones with a different set of students, and only then changed the standard routine. A result that shows up twice with different people is worth acting on. A result that shows up once is worth a second look.
A look outside the classroom
Around then a volunteer pointed to a website built around one subject: DronesBee describes itself as a hub for drone enthusiasts, mixing articles and news with a shop, product listings and a community forum, plus places to find people who offer drone services. Seeing so many doors into a single topic nudged the group to keep its notes in one shared place. Curious readers can browse that drone-focused website to see the layout.
Experiment four: the aviation entrance question
Some students in the group were not only preparing for aptitude papers but also deciding which entrance routes to pursue. The volunteers held back from confident advice and encouraged students to run a small experiment on their own planning: spend a fortnight reading about one route in depth, note how it felt, then spend the next fortnight on another. The comparison was not about which route was objectively superior but about which one the student could imagine studying for with energy. For background reading, students were pointed to the guide covering aviation entrance exams for Indian students, and then asked to write a half-page reflection of what they had learned.
Those reflections became data of their own.
What changed for the group
By the end of the year, the Saturday meetings sounded different. The arguments had not disappeared, but they now began with “Let us test it” rather than “I know that.” The volunteers kept a shared notebook of every experiment, listing the question, the change, the result and the decision. New teachers read it in their first week. Students were invited to propose experiments too, and some of the best ideas came from them: a pair of students suggested swapping practice partners every session, which turned out to help the quieter learners most.
The group also grew kinder to itself: a disappointing result implicated nobody, since nobody had claimed certainty. Learners began to say things like “I will try reading the question twice before touching the options for a week and see whether my errors change,” which is precisely the mindset an aspiring pilot needs for the long road of training: observe, adjust, observe again.
Borrowing the approach
Borrowing this method requires no classroom and no team. If you are preparing for an aptitude paper alone, pick one study habit this week. Maybe it is the time of day you practise, the order in which you tackle topics, or whether you explain answers aloud to a friend. Change only that, keep the change small and reversible, and note what you see. Next week, either keep the habit, drop it or try a variation.
The coaching group’s lesson was that confidence in a method should be earned, not inherited. Small experiments are a cheap way to earn it. They cost a few evenings, they leave a written record, and they replace opinion with observation. For anyone who hopes to spend a career making careful, evidence-based decisions in a cockpit, that is not a bad habit to start building on the ground.

