ELTiverse

Search Terms

Search for ELT terms and concepts

Operationalisation

research-methodologyOperationalization

Operationalisation is the process of defining an abstract concept in concrete, measurable terms. It answers the question: How exactly will you measure this? Every research study must bridge the gap between the theoretical Construct (e.g., "proficiency," "noticing," "motivation") and the specific instrument or procedure used to measure it.

Why It Matters

The way a construct is operationalised determines what the study actually measures — which may or may not match what the researcher claims to measure. Two studies investigating "the effect of Corrective Feedback on acquisition" may operationalise "acquisition" differently:

OperationalisationWhat it actually measures
Timed GJT accuracyImplicit knowledge of the target structure
Untimed GJT accuracyExplicit knowledge — ability to reflect on rules
Spontaneous production in free conversationAutomatised productive knowledge
Elicited Imitation accuracyImplicit oral grammar under time pressure
Metalinguistic explanationDeclarative, analysed knowledge

These are different things. A treatment that improves GJT scores but not spontaneous production has affected explicit but not implicit knowledge. Claiming it "promotes acquisition" depends entirely on how "acquisition" was operationalised.

The Operationalisation Chain

Theory → Construct → Operationalisation → Measurement → Data
  • Theory: Focus on Form promotes noticing, which leads to acquisition
  • Construct: Noticing
  • Operationalisation: Performance on a timed GJT targeting the instructed form
  • Measurement: Percentage of correct judgements
  • Data: 78% accuracy post-treatment vs 52% pre-treatment

Each link in the chain introduces assumptions that can be questioned.

Construct Validity Connection

Construct Validity asks whether the operationalisation actually captures the intended construct. If "proficiency" is operationalised as a multiple-choice grammar test, the study measures grammatical knowledge in a decontextualised format — not the full construct of communicative language ability. This is why Bachman & Palmer (1996) argued for test tasks that reflect real-world language use (see Authenticity).

Common Operationalisations in SLA

ConstructCommon operationalisations
ProficiencyIELTS band, TOEFL score, Elicited Imitation, institutional placement level
NoticingThink-Aloud Protocol reports, Stimulated Recall, eye-tracking fixation data
MotivationQuestionnaire scales (Dörnyei's L2MSS), interview data
AcquisitionPre-post gain on GJT, emergence in production, Effect Size of treatment
FluencySpeech rate, pausing, hesitation phenomena
ComplexityT-unit length, clause subordination ratios

The Danger of Construct Underrepresentation

When a construct is operationalised too narrowly, important aspects are missed. "Writing ability" operationalised as grammatical accuracy alone ignores coherence, task achievement, and lexical range. "Acquisition" measured only by explicit knowledge tests ignores implicit, procedural knowledge.

Key References

  • Bachman & Palmer (1996) — operationalising language ability
  • Ellis (2005) — operationalising implicit and explicit knowledge
  • Norris & Ortega (2000) — how operationalisation of outcome measures affected meta-analytic findings
  • Purpura (2004) — operationalising grammatical knowledge for assessment

Related Terms