《TEM考试效度研究》

1. BACKGROUND TO TEM1

1.1 The ELT Syllabus1

1.2 Objectives of the TEM Tests1

1.3 History of the TEM Tests1

1.4 Organization of the TEM Tests6

2. VALIDATION STUDY8

2.1 Aims of the Validation Study Project8

2.2 Formulation of the Project Proposal8

2.3 Organization of the Validation Project9

2.4 Description of the Study10

3. VALIDATION INSTRUMENTS12

3.1 Test Specifications12

3.2 Prototype Tests (TEM4/8-95)13

3.3 External Measures14

3.4 Questionnaires14

4. INTERNAL STATISTICAL VALIDATION18

4.1 TEM4-9518

4.2 TEM8-9530

5. EXTERNAL STATISTICAL VALIDATION43

5.1 Concurrent Validity43

5.2 Predictive Validity48

5.3 Perceived Validity48

6. ADMINISTRATIVE PROCEDURES OF THE TEM TESTS53

6.1 The Testing Team in SISU53

6.2 Item Writing53

6.3 Trialling55

6.4 Item Moderation56

6.5 Marker Standardization56

6.6 Score Reporting60

6.7 Statistical Analysis60

6.8 Organizational Structures for the TEM Test Administration61

7. OVERALL SUMMARY62

APPENDICES65

Appendix Ⅰ Tables of Test Formats (1990-1996)67

Appendix Ⅱ Prototype Tests(TEM4/8-95)75

Appendix Ⅲ Project Framework128

Appendix Ⅳ TEM Project Schedule 1993-1996130

Appendix Ⅴ Test Specifications (TEM4/8)134

Appendix Ⅵ Teachers' Assessment Form169

Appendix Ⅶ TEM4 Questionnaires (to Teachers/Candidates/Administrators)171

Appendix Ⅷ TEM8 Questionnaires (to Teachers/Candidates/Administrators)189

Appendix Ⅸ Table 1: CITC and AIID for Listening (Original)213

Appendix Ⅹ Table 1: CITC and AIID for Listening233

Appendix Ⅺ List of PAR4/8 Universities258

Appendix Ⅻ Table 1: Correlation of PAR4 with TEM4259

Appendix ⅩⅢ TEM4 Replies to Open-ended Questions270

Appendix ⅩⅣ TEM8 Replies to Open-ended Questions276

Appendix ⅩⅤ TEM4 Summary Table of Objective Questions282

Appendix ⅩⅥ TEM8 Summary Table of Objective Questions290

Appendix ⅩⅦ Item Writer Training Package297

Appendix ⅩⅧ Dictation Marking Scheme300

Appendix ⅩⅨ Translation Marking Scheme301

Appendix ⅩⅩ Composition/Note-writing Marker Training Pack304

Appendix ⅩⅩⅠComposition/Note-writing Marker Reliability Study Data309