Learning Multilingual Assessment
Design fair, valid assessments that work effectively across languages and for multilingual learners.
When to Use
-
International testing programs
-
Multilingual classroom assessments
-
ELL/ESL student assessment
-
Translated assessments
-
Global certification exams
Key Challenges
Language-Dependent Bias
Sources of Bias:
-
Complex vocabulary unnecessary for content
-
Culture-specific scenarios
-
Idioms and figurative language
-
Text-heavy questions
-
Reading speed requirements
Assessment Translation
Challenges:
-
Linguistic equivalence ≠ difficulty equivalence
-
Some concepts harder to express in certain languages
-
Test length varies by language
-
Reading time differences
Multilingual Learner Support
Considerations:
-
Content knowledge vs. language proficiency
-
Accommodations without compromising validity
-
Fair comparison across language groups
Design Principles
- Reduce Language Load
Strategies:
-
Use simple, direct language
-
Short sentences and paragraphs
-
Visual supports (diagrams, charts, images)
-
Minimize unnecessary text
-
Concrete > abstract language
-
Active voice > passive voice
- Avoid Cultural Bias
Review for:
-
Cultural scenarios (unfamiliar contexts)
-
Regional references (geography, events, people)
-
Socioeconomic assumptions
-
Holiday/calendar references
-
Food, sports, leisure activities
- Universal Design
Accessibility Features:
-
Glossaries for technical terms
-
Bilingual glossaries
-
Extended time options
-
Translation tools (for instructions, not content)
-
Text-to-speech support
- Multiple Modalities
Beyond Text:
-
Visual representations
-
Interactive elements
-
Demonstrations
-
Hands-on performance tasks
-
Oral assessment options
Translation Guidelines
Equivalence Types
Linguistic Equivalence: Word-for-word accuracy Functional Equivalence: Same meaning, different words Psychometric Equivalence: Same difficulty across languages
Translation Process
-
Forward translation by subject expert
-
Backward translation to verify
-
Reconciliation of differences
-
Pilot testing in target language
-
Difficulty analysis and adjustment
-
Cultural review
Validation
Field Testing:
-
Differential item functioning (DIF) analysis
-
Compare difficulty across languages
-
Identify biased items
-
Adjust or remove problematic items
Accommodations
Linguistic Supports
Allowed Accommodations:
-
✓ Bilingual glossaries (mathematics terms)
-
✓ Extra time
-
✓ Simplified language instructions
-
✓ Test directions in native language
-
✓ Clarification of test directions
Generally Not Allowed:
-
✗ Translation of test items (depends on purpose)
-
✗ Side-by-side bilingual tests (for language assessments)
CLI Interface
Design language-fair assessment
/learning.multilingual-assessment --content "math-test/" --reduce-language-load --output fair-test.md
Validate translation equivalence
/learning.multilingual-assessment --source "test-en.json" --translations "test-es.json,test-zh.json" --validate-equivalence
Design with accommodations
/learning.multilingual-assessment --assessment "science-exam/" --accommodations "glossary,extended-time,visual-supports"
Cultural bias review
/learning.multilingual-assessment --test "reading-test/" --bias-check --cultures "Hispanic,East Asian,Middle Eastern"
Output
-
Language-fair assessment design
-
Translation guidelines
-
Cultural bias analysis
-
Accommodation recommendations
-
Validation protocols
-
Equivalence reports
Composition
Input from: /curriculum.assess-design , /learning.translation-quality
Works with: /learning.cultural-adaptation , /learning.language-level-calibration
Output to: Fair, valid multilingual assessments
Exit Codes
-
0: Multilingual assessment designed
-
1: Excessive language dependence
-
2: Cultural bias detected
-
3: Translation equivalence compromised