Georgetown University LogoGeorgetown University Library LogoDigitalGeorgetown Home
    • Login
    View Item 
    •   DigitalGeorgetown Home
    • Georgetown University Institutional Repository
    • Georgetown College
    • Department of Linguistics
    • Graduate Theses and Dissertations - Linguistics
    • View Item
    •   DigitalGeorgetown Home
    • Georgetown University Institutional Repository
    • Georgetown College
    • Department of Linguistics
    • Graduate Theses and Dissertations - Linguistics
    • View Item
    JavaScript is disabled for your browser. Some features of this site may not work without it.

    Comparing Native and Non-native Raters of US Federal Government Speaking Tests

    Cover for Comparing Native and Non-native Raters of US Federal Government Speaking Tests
    View/Open
    View/Open: Brooks_georgetown_0076D_12371.pdf (2.4MB) Bookview

    Creator
    Brooks, Rachel Lunde
    Advisor
    Connor-Linton, Jeffrey
    Abstract
    Previous Language Testing research has largely reported that although many raters' characteristics affect their evaluations of language assessments (Reed & Cohen, 2001), being a native speaker or non-native speaker rater does not significantly affect final ratings (Kim, 2009). In Second Language Acquisition, some researchers conclude that performance and perception differences exist between native and non-native speakers, while others contend that there is little conclusive evidence to support end state differences. The US Federal Government requires speaking test raters to be both native and high-proficiency speakers of the test language (FBI, 2009). An exploration of how the native speaker is defined in research reveals a lack of common understanding, referring both to an ideal speaker and a native acquirer of language.
     
    This study built on previous research by expanding the breadth of proficiency levels rated to include highly articulate examinees, regrouping the raters to represent three ideas of nativeness (native/non-native speakers, speaking proficiency, and first language), and examining final and linguistic category ratings to reveal the raters' scoring construct. Thirty FBI speaking testers, native and non-native speakers of English, rated 25 English Speaking Proficiency Tests. They assigned ratings for the overall test and linguistic categories, including functions, organization, structures, vocabulary, fluency, pronunciation and social/cultural appropriateness. Using ANOVAs and MANOVAs, the results indicated no significant difference between the native and non-native speaker groups. When raters were grouped by English proficiency level, lower proficiency raters gave significantly lower ratings, both in the final and in many linguistic category ratings, although with a small effect size.
     
    Non-native speakers rated comparably to native speakers in the results, but significant differences occurred between rater groups when they were arranged by rater English speaking proficiency and first language. The results suggested that rater training organizations should consider rater proficiency level rather than whether or not they are native speakers. Additionally, they supported the theory that non-native speakers can demonstrate language acquisition equivalent to native speakers, at least when evaluating language. Finally, it was recommended that researchers and testing practitioners that use native speakers should clearly define and justify their use, or avoid the native speaker term altogether.
     
    Description
    Ph.D.
    Permanent Link
    http://hdl.handle.net/10822/559500
    Date Published
    2013
    Subject
    government; language testing; native speaker; proficiency; speaking; Linguistics; Language and culture; Linguistics; Language;
    Type
    thesis
    Publisher
    Georgetown University
    Extent
    294 leaves
    Collections
    • Graduate Theses and Dissertations - Linguistics
    Metadata
    Show full item record

    Related items

    Showing items related by title, author, creator and subject.

    • Thumbnail

      Comparison of Values of Alaska Native and Non-Native Alcoholics Counselors 

      Berryhill-Paapke, Elise; Johnson, Mark E. (1995)
    Related Items in Google Scholar

    Georgetown University Seal
    ©2009 - 2022 Georgetown University Library
    37th & O Streets NW
    Washington DC 20057-1174
    202.687.7385
    digitalscholarship@georgetown.edu
    Accessibility
     

     

    Browse

    All of DigitalGeorgetownCommunities & CollectionsCreatorsTitlesBy Creation DateThis CollectionCreatorsTitlesBy Creation Date

    My Account

    Login

    Statistics

    View Usage Statistics

    Georgetown University Seal
    ©2009 - 2022 Georgetown University Library
    37th & O Streets NW
    Washington DC 20057-1174
    202.687.7385
    digitalscholarship@georgetown.edu
    Accessibility