Jessy's Little Teaching Box

2010年4月25日 星期日

Week10's reading reflection

  • Week10’s reading reflection
    Alderson, J. C. (2000). Technology in testing: the present and the future. System, 28(4), 593-603.
    The topic of this piece reading is computer-based language testing. This paper discusses and lists the advantages and disadvantages about language test on computers, explores in detail development in Internet-based testing using the examples of TOEFL and DIALANG.
    Disadvantages:
     Computer-based tests are currently limited in the item types that they allow. Besides items types like MC, gap filling or cloze, other item type may be more appropriate. But they are really harder to applied in a setting wher responses must be machine-scorable.
     There is a lack of computer literacy tutorial about various test techniques and test answer skills that would be used by students in the tests. For example, reading on papers is much more different from reading on the screen.
     The most important disadvantage is the current limitations about language skills that can be tested on a computer. Speaking and writing are really hard to be assessed in any meaningful way right now.
    Technical advantages of computer-based testing:
     Computer-based testing removes the need for fixed delivery dates and locations that are normally required by traditional paper-based testing.
     Results of such kind of tests can be available immediately after the test.
     If tests are diskette- and CD ROM-based, tests delivered over the Internet are even more flexible if delivery or purchase of disks is not required.
     CBTs can utilize specially designed templates for item instruction by using special software or just the Internet.
     CBTs, and especially Internet-delivered tests, can access large databases of items, which mean that test security can be greatly enhanced.

    Pedagogic advantages of CBTs:
     Computer-based tests can be made more user-friendly than traditional paper-based tests. It also make is possible to give users immediate feedbacks once a response has been made. The concept based here is that feedback given immediately after finishing an activity is likely to be more meaningful and effective.
     Computers can also be user-friendly in offering a range of support to test takers. For example, helpful facilities can be accessed on line, like on-line dictionaries. Such kind of performance can also been taken into account in deriving test results for test scores.


The conclusion is that a research agenda is needed, and such a research agenda flows naturally from two sources:
 The issues that we found in the development of CBTs, like TOEFL.
e.g.: what should the entry point or level be? How is the best determined for any given population?
 The issues that come from the claimed advantages and disadvantages of computer-based testing.
IT-based assessment may not improve on current modes of assessment, because of the compensations of the medium in terms of convenience, speed, and so on, we need to be certain that IT-based assessment does not reduce the validity of what we do.

1 則留言:

  1. I haven't try any formal CBTs before. In my opinion it is convenience to assess, save manpower and cost to mark, and test-takers can have immediate feedback etc. However,it may be suitable for some objective marking item types, say MC, fill in blanks etc.,it may not be suitable for marking open-ended questions, say, essay. And I think, for some important exams, in order to ensure the reliability,it's better to group the candidates in a place instead of letting them to do the assessment at home or elsewhere.

    回覆刪除