Materials Piloting
The systematic trialling of draft materials with target learners before publication or wider release, to surface design faults that internal review cannot. Piloting sits between authoring and final production — close enough to the draft to allow rewrites, close enough to real classrooms to expose problems no desk review catches.
What piloting reveals
Three classes of problem dominate. Pitch errors (material too easy or too hard for the named level) show up in completion rates and learner body language. Rubric ambiguity, where instructions look clear on the page but produce wrong-task behaviour in the room, surfaces in the gap between expected and observed responses. Timing miscalculations, where tasks the writer estimated at ten minutes actually run thirty, distort the unit's pacing assumptions. None of these are reliably caught by editorial review.
Methods
Piloting ranges from informal teacher-feedback rounds to structured observational studies. A typical sequence has writers send draft units to teachers in target contexts, who teach them and complete a structured questionnaire on level, timing, engagement, and outcomes. Observers may sit in on selected lessons. Learner artefacts (completed worksheets, recordings of speaking tasks) are collected and analysed against intended outcomes. Findings feed back into a revision cycle before final production.
Publisher and in-house piloting
Major ELT publishers run multi-country pilots before launching new series, with sample units placed in dozens of schools across target markets. Tomlinson's edited volume Materials Development in Language Teaching (2nd edition, Cambridge University Press, 2011) includes a publisher's-view chapter on piloting that documents this process. In-house teams in language schools or universities run smaller-scale pilots (one or two classes, a single revision cycle) sufficient for institutional materials but rarely reaching the depth of commercial pilots.
Limits
Pilot teachers and learners are not random samples. Piloting in motivated, well-resourced classrooms can produce optimistic results that do not generalise to the wider market. Mishan and Timmis (in their applied linguistics writing on materials development) note that piloting also tends to confirm what writers already believe — the questions asked usually reflect the writer's hypotheses, so unexpected failure modes can pass undetected. Triangulation across multiple piloting sites and instruments mitigates this.
References
- Tomlinson, B. (Ed.). (2011). Materials Development in Language Teaching (2nd ed.). Cambridge University Press.
- Mishan, F. (2005). Designing Authenticity into Language Learning Materials. Intellect.
- Mishan, F., & Timmis, I. (2015). Materials Development for TESOL. Edinburgh University Press.