• Skip to primary navigation
  • Skip to main content

site logo
The Electronic Journal for English as a Second Language
search
  • Home
  • About TESL-EJ
  • Vols. 1-15 (1994-2012)
    • Volume 1
      • Volume 1, Number 1
      • Volume 1, Number 2
      • Volume 1, Number 3
      • Volume 1, Number 4
    • Volume 2
      • Volume 2, Number 1 — March 1996
      • Volume 2, Number 2 — September 1996
      • Volume 2, Number 3 — January 1997
      • Volume 2, Number 4 — June 1997
    • Volume 3
      • Volume 3, Number 1 — November 1997
      • Volume 3, Number 2 — March 1998
      • Volume 3, Number 3 — September 1998
      • Volume 3, Number 4 — January 1999
    • Volume 4
      • Volume 4, Number 1 — July 1999
      • Volume 4, Number 2 — November 1999
      • Volume 4, Number 3 — May 2000
      • Volume 4, Number 4 — December 2000
    • Volume 5
      • Volume 5, Number 1 — April 2001
      • Volume 5, Number 2 — September 2001
      • Volume 5, Number 3 — December 2001
      • Volume 5, Number 4 — March 2002
    • Volume 6
      • Volume 6, Number 1 — June 2002
      • Volume 6, Number 2 — September 2002
      • Volume 6, Number 3 — December 2002
      • Volume 6, Number 4 — March 2003
    • Volume 7
      • Volume 7, Number 1 — June 2003
      • Volume 7, Number 2 — September 2003
      • Volume 7, Number 3 — December 2003
      • Volume 7, Number 4 — March 2004
    • Volume 8
      • Volume 8, Number 1 — June 2004
      • Volume 8, Number 2 — September 2004
      • Volume 8, Number 3 — December 2004
      • Volume 8, Number 4 — March 2005
    • Volume 9
      • Volume 9, Number 1 — June 2005
      • Volume 9, Number 2 — September 2005
      • Volume 9, Number 3 — December 2005
      • Volume 9, Number 4 — March 2006
    • Volume 10
      • Volume 10, Number 1 — June 2006
      • Volume 10, Number 2 — September 2006
      • Volume 10, Number 3 — December 2006
      • Volume 10, Number 4 — March 2007
    • Volume 11
      • Volume 11, Number 1 — June 2007
      • Volume 11, Number 2 — September 2007
      • Volume 11, Number 3 — December 2007
      • Volume 11, Number 4 — March 2008
    • Volume 12
      • Volume 12, Number 1 — June 2008
      • Volume 12, Number 2 — September 2008
      • Volume 12, Number 3 — December 2008
      • Volume 12, Number 4 — March 2009
    • Volume 13
      • Volume 13, Number 1 — June 2009
      • Volume 13, Number 2 — September 2009
      • Volume 13, Number 3 — December 2009
      • Volume 13, Number 4 — March 2010
    • Volume 14
      • Volume 14, Number 1 — June 2010
      • Volume 14, Number 2 – September 2010
      • Volume 14, Number 3 – December 2010
      • Volume 14, Number 4 – March 2011
    • Volume 15
      • Volume 15, Number 1 — June 2011
      • Volume 15, Number 2 — September 2011
      • Volume 15, Number 3 — December 2011
      • Volume 15, Number 4 — March 2012
  • Vols. 16-Current
    • Volume 16
      • Volume 16, Number 1 — June 2012
      • Volume 16, Number 2 — September 2012
      • Volume 16, Number 3 — December 2012
      • Volume 16, Number 4 – March 2013
    • Volume 17
      • Volume 17, Number 1 – May 2013
      • Volume 17, Number 2 – August 2013
      • Volume 17, Number 3 – November 2013
      • Volume 17, Number 4 – February 2014
    • Volume 18
      • Volume 18, Number 1 – May 2014
      • Volume 18, Number 2 – August 2014
      • Volume 18, Number 3 – November 2014
      • Volume 18, Number 4 – February 2015
    • Volume 19
      • Volume 19, Number 1 – May 2015
      • Volume 19, Number 2 – August 2015
      • Volume 19, Number 3 – November 2015
      • Volume 19, Number 4 – February 2016
    • Volume 20
      • Volume 20, Number 1 – May 2016
      • Volume 20, Number 2 – August 2016
      • Volume 20, Number 3 – November 2016
      • Volume 20, Number 4 – February 2017
    • Volume 21
      • Volume 21, Number 1 – May 2017
      • Volume 21, Number 2 – August 2017
      • Volume 21, Number 3 – November 2017
      • Volume 21, Number 4 – February 2018
    • Volume 22
      • Volume 22, Number 1 – May 2018
      • Volume 22, Number 2 – August 2018
      • Volume 22, Number 3 – November 2018
      • Volume 22, Number 4 – February 2019
    • Volume 23
      • Volume 23, Number 1 – May 2019
      • Volume 23, Number 2 – August 2019
      • Volume 23, Number 3 – November 2019
      • Volume 23, Number 4 – February 2020
    • Volume 24
      • Volume 24, Number 1 – May 2020
      • Volume 24, Number 2 – August 2020
      • Volume 24, Number 3 – November 2020
      • Volume 24, Number 4 – February 2021
    • Volume 25
      • Volume 25, Number 1 – May 2021
      • Volume 25, Number 2 – August 2021
      • Volume 25, Number 3 – November 2021
      • Volume 25, Number 4 – February 2022
    • Volume 26
      • Volume 26, Number 1 – May 2022
      • Volume 26, Number 2 – August 2022
      • Volume 26, Number 3 – November 2022
      • Volume 26, Number 4 – February 2023
    • Volume 27
      • Volume 27, Number 1 – May 2023
      • Volume 27, Number 2 – August 2023
      • Volume 27, Number 3 – November 2023
      • Volume 27, Number 4 – February 2024
    • Volume 28
      • Volume 28, Number 1 – May 2024
      • Volume 28, Number 2 – August 2024
      • Volume 28, Number 3 – November 2024
      • Volume 28, Number 4 – February 2025
    • Volume 29
      • Volume 29, Number 1 – May 2025
  • Books
  • How to Submit
    • Submission Info
    • Ethical Standards for Authors and Reviewers
    • TESL-EJ Style Sheet for Authors
    • TESL-EJ Tips for Authors
    • Book Review Policy
    • Media Review Policy
    • APA Style Guide
  • Editorial Board
  • Support

Toward Speaking Excellence: The Michigan Guide to Maximizing Your Performance on the TSE® Test and SPEAK® Test

November 1999 — Volume 4, Number 2

Toward Speaking Excellence: The Michigan Guide to Maximizing Your Performance on the TSE® Test and SPEAK® Test

Papajohn, Dean (1998)
Ann Arbor, MI: The University of Michigan Press
ISBN 0-472-08524-7 (paper)
Pp. 129
US $16.95; UK £12.95

It is probably inevitable that this book would appear. Like many of the commercial guides to standardized tests, this one promises to maximize the performance of test-takers who study it and carry out its practice exercises. Most bookstores have shelves dedicated to books on how to take the GRE, the GMAT, and the TOEFL. These guides are not only published by commercial publishers such as Barron, Kaplan, and Arco, but by the Educational Testing Service (ETS) itself, which produces test preparation books and software for all three. The book reviewed here promises to maximize the performance of non-native English speakers on another test produced by ETS, the Test of Spoken English (TSE), or its institutional version, the Speaking Proficiency English Assessment Kit (SPEAK).

ETS developed the Test of Spoken English in the 1970s to measure the ability of nonnative speakers to communicate in English. Unlike the TOEFL, which does not measure speaking ability, it serves as an indicator of oral communication skills. It is used to evaluate and screen people who wish to work in the health professions in North America (medicine and nursing, for example), and to evaluate and screen international students for positions as teaching assistants in North American colleges and universities. There are thousands of international students who aspire to teaching assistantships, and likewise many foreign professionals seeking employment in health professions in North America, so it would seem likely that there would be a large market for test preparation materials aimed at the TSE and the SPEAK. It is worth noting that such materials have not previously been marketed, even by ETS itself. This does not appear to be accidental.

I was trained as a TSE rater in 1989, and in the 1990s began administering and scoring SPEAK tests for international teaching assistant (ITA) candidates for a large university. I was curious to see Toward Speaking Excellence because it seemed to me that extensive preparation for these tests could defeat their purpose. I still think so, but will try to review the book on its own terms as well as mine.

The book consists of a two-page introduction followed by eight chapters, two appendices and a very brief bibliography, aimed directly at test-takers, not language professionals. The whole is succinct, well organized (both in terms of text and of visuals), and well edited. It is written in a consistently friendly, respectful tone. From an educational standpoint, I would consider the book an effective tool for its purposes–very thorough and user-friendly. [-1-]

The introductory paragraph states that the book is designed to maximize the testee’s potential on the TSE and the SPEAK. Further on it claims to be useful in preparation for “other oral exams or oral interviews” or for those “who desire to improve their communication skills in general” (p. 1). The next part of the introduction explains that the book contains communication strategies and test-taking strategies for “all the sections of the TSE and SPEAK” (p. 1). It justifies this on the grounds that students will become more “test wise,” buttressing this justification with a quote from the Division of Measurement and Evaluation at the University of Illinois in Champaign-Urbana (1994): “Test-wiseness is positive when it allows students to better demonstrate their knowledge of course material” (p. 1). This seems inappropriate since the TSE and SPEAK do not measure students’ knowledge of any course material, but rather attempt to measure oral communicative ability in general. Any educator would agree that it is important for students to be test-wise in the sense of being informed about a test and being familiar with its format. ETS explains test procedures and provides a sample test on its web site and in its bulletin to familiarize students with the test format, but providing templates for answers to questions designed to elicit spontaneous speech–which in some cases this book does–seems qualitatively different from what most educators would understand as helping students become “test-wise.”

Chapter 1 explains the organization of the book, which follows the organization of the TSE itself. On the test (often given in language laboratories), the test-takers listen to instructions and their responses are tape-recorded. The whole thing lasts 20 minutes. The book provides ways of handling the different sections of the test, beginning with the warm-up questions (chapter 3), then the map section (chapter 4), the picture section (chapter 5), the graph section (chapter 6) and the announcement section (chapter 7). Chapter 1 goes on to present the test’s four rating criteria: a) language function (giving directions, defending an opinion, recommending, and announcing, for example; some of these criteria, like announcing and giving directions, are on all the tests; others vary); b) appropriateness; c) coherence/cohesion; and d) accuracy. The first chapter ends by suggesting general test preparation strategies, such as bringing a watch, and imagining you are speaking to a person in front of you. It also suggests one strategy uniquely possible on the TSE and SPEAK, but not in other oral interview situations: since all the questions are printed out in the test booklet, testees are instructed to follow the printed version of the narrator’s questions so they can give attention to the pronunciation of words, and so they can use the printed words to match their responses. This is undoubtedly good advice, for purposes of passing the test, but it seems to me to degrade the test’s function as a measure of communicative competence, since it diminishes the need for listening comprehension, which is an important factor in the ability to communicate. The opportunity to do this is ETS’s doing, however, not the author’s. Still, I am sure that there are students who, without this advice, would not follow along so closely and consequently not recognize word boundaries, say, or a word itself, information which would be of value. [-2-]

Chapter 2 is a straightforward presentation of the scoring scale for the TSE and the SPEAK, which generally follows ETS’s published explanation. Typical score interpretations are provided (60 is considered very good, 40 middle-of-the-road, 20 bad). Some possible responses are given and scored, and they appear to closely reflect ETS guidelines.

Chapter 3 is the first dedicated to a particular section of the test, the warm-up questions. Even though the warm-up questions are not scored, very detailed instruction and practice are provided. The author explains that this is, first, to build up confidence, and second, just in case the rater does hear these responses, to prevent the rater from getting a bad impression. Students are warned, “Do not try to say too much; the more you say, the more chance you have to mispronounce sounds and confuse the raters if they happen to listen” (page 18). This is one of many strategies offered in the book guaranteed to reduce spontaneity of communication. The warm-up questions, which are meant to do just that–warm the students up–become another site for test anxiety. At the same time, the author has a point. Whether or not the raters intend it, they could possibly be influenced by coming across these responses when they rewind the tapes for rating. This chapter provides extensive practice in how to read and stress numbers, particularly four-digit numbers. This is a useful skill for any professional or incoming teaching assistant in any case. The same is true of the strategy of using question stems, such as I began . . . in response to When did you begin to study English? Ten possible responses which could be used to answer this question are supplied, and students are warned again not to add any extra information to their answers because it would “increase the opportunity for errors.” The author recommends a “short, complete answer” exclusively because it “sounds” fluent.

Chapter 4, on the map section, offers advice about “common themes” for U.S. street names, including instruction on names of states, presidents, and ordinal numbers and their stress patterns. This instruction seems more specifically useful for the test than the ability to read numbers, particularly since the people taking the test are more likely to be asking for street directions in English than giving them. Templates are offered for giving directions, in the form of “sample responses”: “Exit the coffee shop . . . Walk west . . . turn north . . . At Twenty-Third and Main . . . you’ll see . . . on the east side. On the west side is . . .” (p. 35), and so on. Similar templates in the form of sample responses are offered for making recommendations and giving opinions: “I think you really ought to. . . First of all . . .” (p. 30). “If you haven’t [X] . . . I highly recommend it” (p. 37). Organizational markers such as “The first reason . . . The other reason” (p. 37) are suggested and students are strongly advised to sound enthusiastic. Six elaborate practice sets give students plenty of opportunity to rehearse ways of recommending things, justifying recommending them, giving directions, and expressing opinions.

In chapter 5, the picture section, two tense schemata are offered for narrating a picture story, with the caveat that whichever is used (narrating in the present tense or narrating in the past tense), it be used consistently. However, “it is easiest,” the author advises, “to stick with basic past tenses” (p. 48). Two perspectives are offered as alternative modes of response, first and third person. For sounding cohesive, the use of because, as in “Because it was hot . . . ” is suggested. Other expressions such as although and while are recommended. Following these patterns would definitely limit the range of responses that might naturally occur during this task. [-3-]

Test-takers are advised that the picture sequences will always represent some kind of mishap or conflict and told that one of the important things they should do during the period allowed to study the pictures, is to conceive of how the situation could have been avoided, as they will have to offer some solution. Templates are offered for answering this, including the useful needs to . . . in order expression: “The biker needs to ride more carefully” or “The bike path needs to be maintained better” “to avoid” or “in order to avoid” (pp. 52-53). Students are warned not to be demanding in the common situation of role-playing a person trying to persuade someone else to do something. A list of polite expressions is provided. Connective expressions are recommended, such as “Earlier today . . . if you’re going to . . . Furthermore . . . So I would like to . . . Well, if . . . ” (p.55). A number of Papajohn’s suggested transition expressions throughout the book were ones which would be more common in writing than in speech. We don’t say therefore very much, or furthermore, or although. In speech we would be more likely to say so, or since, also, and even though. He is right to assume, though, that the use of the words he suggests would probably impress raters. He also is probably right in his amusing advice to test-takers who do this “persuading” role-play that they should end on a positive note, so as to suggest to the rater that they indeed have the ability to persuade in English.

For what are supposed to be the more open-ended questions, “sample response” templates are provided for discussing pros and cons of issues. It is suggested that these take the form of noting “advantages and disadvantages.” Lexical phrases such as “two important factors . . . On the other hand . . . [X] is another factor . . . ” are provided. Issues are described as having two sides, artificially simplifying issues that might otherwise receive a more nuanced response. Following these directions would be a lot like following those for the traditional 5-paragraph canned essay, and lead to the same dead discourse. The advice is: “choose the side that is easiest for you to talk about” (p. 73). This subverts the intent to measure communicative competence. In the real life tasks the test-takers are being screened for, they cannot simply choose to communicate those facts about physics or economics or autopsies that they find easiest to express.

In chapter 6, test-takers are instructed on how to read coordinate graphs. Like reading numbers (and unlike narrating picture stories), this is a skill directly relevant to the professional demands that will be made on test-takers and is one part of the book where Papajohn’s instructions transcend simply getting through the test. If they can do it on the test, they are genuinely likely to be able to do it in other contexts. Also in this chapter, test-takers are given instructions on how to define and explain field-specific concepts. Useful lexical phrases and a five-step procedure for defining and explaining are provided.[-4-]

Chapter 7 treats the announcement section of the test with detailed instructions for how to open with a greeting statement (being mindful of appropriate register). Many lexical phrases for presenting schedules are suggested and detailed practice given in the pronunciation and stress of months and dates. As in the previous chapters, five practice sets follow the instruction. The practice sets and tests throughout the book seemed well thought out, reflecting the kinds of questions, situations, graphs, and maps ETS provides in its tests. The exceptions were a number of topics that probably would not have passed the ETS cultural bias antennae: whether or not the U.S. should continue to use pennies (p. 92); expressing opinions about people in geographical regions called counties (p. 92); why home ownership is part of the American Dream (p. 91); peanut brittle (p. 78); carpooling (p. 75); ATMs (p. 71); and the “pros and cons of purchasing versus leasing a car” (p. 64). The book ends with two appendices: one which includes two practice tests and the other containing test registration information.

On page 2 the author quotes Hopkins, Stanley, and Hopkins (1990): “Wider experience and training in preparing for and taking tests of all kinds is likely to increase accuracy of measurement and, therefore, the fairness of scores for the students tested.” Given that this test is an attempt to measure communicative competence, I would say that the use of this book would lead to a decrease in accuracy of measurement since its instructions limit spontaneity and decrease (personal) authenticity of response. As a result, the scores may not be fair to the test-takers (who are not evaluated as well as they otherwise would be and may, as a result, be faced with demands they are not ready to fulfill) or to employers (who may be led to assume more competence than exists) or to colleagues or patients or coworkers of test-takers (who depend on the test-takers’ competence in many ways) or to people who take the test and have not been given these instructions and who therefore may not disguise their real competence (or lack thereof) in similar ways. It’s anybody’s guess how much difference the book might make for a given testee. It is not likely to turn a score of 20 or 30 into a 60, but very high and very low proficiency levels are never the hard choices confronted by raters or score users. It is the intermediate cliff-hangers who present the most difficulty. These are the people who would be most likely to have their scores inflated by the extensive rehearsal the book recommends. Putting someone who is not competent to be there in the position of lab instructor to students handling dangerous equipment and substances can have serious consequences. It is also very dangerous to employ medical personnel who do not communicate well. You want to have the most and the best information available to you to make such decisions. And while ETS routinely warns score users that they should use other indicators as well, the fact is that most institutions give great weight to scores on the TSE and the SPEAK.

In sum, I would say that this book is likely to do very well what it promises–to maximize test scores on the TSE and the SPEAK. It will probably also be a good seller for the University of Michigan Press. I am sorry to see it appear, though, because I think it will achieve higher test scores for students at the expense of degrading the quality of the information the tests provide.

References

University of Illinois, Division of Measurement and Evaluation. (1994, Fall). Q & A, 2(1). Champaign-Urbana: Author.

Hopkins, D. D., Stanley, J. C., & Hopkin, B. R. (1990). Educational and psychological measurement and evaluation. Englewood Cliffs, NJ: Prentice-Hall.

Sharon Myers
Texas Tech University
<ntmye@ttacs.ttu.edu>

© Copyright rests with authors. Please cite TESL-EJ appropriately.

Editor’s Note: Dashed numbers in square brackets indicate the end of each page for purposes of citation.

[-5-]

© 1994–2025 TESL-EJ, ISSN 1072-4303
Copyright of articles rests with the authors.