|USFDC Home||| RSS|
This item is only available as the following downloads:
EDUCATION POLICY ANALYSIS ARCHIVES A peer-reviewed scholarly journal Editor: Gene V Glass College of Education Arizona State University Copyright is retained by the first or sole author who grants right of first publication to the Education Policy Analysis Archives EPAA is a project of the Education Policy Studies Laboratory. Articles are indexed in the Dir ectory of Open Access Journals (www.doaj.org). Volume 12 Number 50 September 22 2004 ISSN 1068-2341 After Exit: Academic Achievement Patterns of Former English Language Learners Ester J. de Jong University of Florida Abstract With few exceptions, accountability systems for programs for English language learners (ELLs) have focused on th e achievement patterns of ELLs who are still considered limited English proficie nt and program evaluations have been unable to answer the question whether ELLs actually catch up with English proficient peers after attending a bilingual or English as a Second Language (ESL) program. Disaggregating data for former ELLs can therefore provide important information for long-term district and pr ogram accountability. The study was concerned with the achievement patterns in English language arts, Math, and Science of former ELLs who attended a bilingual and a English as a Second Language (ESL) program. It also explored whether length of program participation and grade level exited played a significant role in predicti ng academic achievement patterns for these exited students. Results indicate that 4th grade students more closely paralleled nonELL students achievement patterns than 8th grade students, particularly for the BE students. While length of program particip ation is not a significant predictor of former ELLs academic success, exit grade do es emerge as an important variable to take into consideration in setting exit guidelines. Introduction The inclusion of English language learners (ELLs) in recent accountability and school reform efforts (e.g., No Child Left Behind ) has placed bilingual and English as a Second Language (ESL) programs under renewed scrutiny as to thei r ability to overcome the linguistic barriers ELLs encounter when entering U.S. schools. With f ew exceptions, the effectiveness of bilingual/ESL programs has been evaluated on the performance of ELLs still being served through the program.
After exit: Academic achievement patterns of former English language learners 2 2 While providing some information about the perfor mance of limited English proficient students, these program evaluations are unable to describe what happens to ELLs once the latter have been placed in a mainstream classroom on a fulltime basis after having been reclassified as fluent English proficient. This article is concerned with the question whether ELLs in fact catch up academically after they exited from a bilingual or ESL program. It is argued that including former ELLs in accountability planning will provide a bett er understanding of whether a school or district has been able to provide equal educational opportuni ties for this group of students. After a brief overview of the schooling of ELLs in the United Sta tes, the article discusses exit policies, the role of exit rates in ELL program evaluations, and academ ic achievement patterns for former ELLs. Then, the results of a study examining former ELLs 4th and 8th grade achievement patterns in English language arts, mathematics, and science will be pr esented. The article concludes with the studys implications for future program evaluations and policies. Issues of Exit in ELL Programs Background Title VI of Civil Rights Act (1964) requires school districts to take affirmative steps to avoid discrimination against ELLs based on their limited pr oficiency in English. In the landmark court case Lau v. Nichols (1974) the Supreme Court proclaimed, there is no equality of treatment merely by providing students with the same facilities, tex tbooks, teachers, and curriculum; for students who do not understand English are effectively foreclosed from any meaningful education (cited in Teitelbaum and Hiller, 1977, p. 7). The co urt refrained, however, from recommending one particular program to remedy such discriminati on, pointing out that the intervention could be instruction in the students native language or in English. In Castaeda v. Pickard (1981) the court identified three criteria to assess when a district s intervention can be considered adequate: it must have theoretical merit, it must be implemented wi th sufficient resources, and it must demonstrate its effectiveness through program ev aluation (Crawford, 1999). Not surprisingly then, different programs have been developed and implemented to meet the needs of ELLs over the last three decades. Generally speaking, these programs differ according to the language of instruction (bilingual or En glish-only), program goals (bilingualism or English proficiency), and the programs target group (ELLs only or ELLs and native English speakers) (Brisk 1998; Ovando, Collier, and Coombs, 2003). Much of the controversy regarding the schooling of ELLs has focused on whether schools should ad opt bilingual or English-only approaches (for detailed overviews of the effectiveness debate, see August and Hakuta, 1997; Collier, 1992; Crawford, 1997; Cummins, 1996; Rossell and Bake r, 1996). One implied feature shared by the majority of the programs is their temporary nature: the ultimate goal is to prepare ELLs for placement in a mainstream classroom within a certain time frame. As a result, deciding when and how to exit ELLs from a bilingual or ESL progra m plays an integral role in the schooling of ELLs.1 Furthermore, the temporary nature draws attention to the length of time the students remains in a program. Both issues are discussed in more detail below. Exit Policies Little agreement exists as to how to determine eligibility of minority language speakers for specialized language services (e.g., Rossell and Bake r, 1988) and, subsequently, on how to decide that 1 Exceptions are maintenance bilingual programs. Perceived and implemented as mainstream programs, they typically do not include an exiting process.
Education Policy Analysis Archives Vol. 12 No. 50 3 3 ELLs no longer need bilingual or ESL services. There is substantial variation within and across states in exit policies and guidelines. States and districts differ widely in whether to use a cut-off score on a test and in what cut-off score to se lect to determine exit-readiness (De Avila, 1990). Further, some states have no guidelines rega rding which assessments to use, others either recommend or mandate the use of certain instrume nts, including standardized achievement tests, English oral language proficiency tests, English lit eracy tests, or teacher judgment (De George, 1988; Gandara and Merino, 1993, Fleischman and Hopstock, 1993; Rossell and Baker, 1988). Comparison of exited students across states and even across di stricts is therefore extremely difficult (Linquanti, 2001). The choice of assessment instrument, the use of cut-off scores, and the data used to make placement decisions for ELLs reflect a districts definition of the linguistic needs of ELLs, the purpose of the ELL program, and expectations for mainstream classroom teachers to be able to work with ELLs (DeAvila, 1990; Nadeau and Miramontes, 1988). For instance, defining ELLs needed language proficiency as survival oral lang uage proficiency may translate into an exclusive reliance on oral assessments for exiting and a focus in the ESL program on oral language development rather than literacy development. Simila rly, exit policies that use similar criteria for different grade levels assume that the same (basi c) skills are sufficient for ELL student success in the mainstream classroom. Language proficiency needed for successful participation in a Kindergarten classroom clearly differs, however, from that requi red for a high school mainstream classroom or even a third grade classroom (Corson, 2001). As a result of such policies, a mismatch between the skills developed in the ESL program and those re quired in the mainstream classroom can emerge (Chamot and OMalley, 1994; Lucas and Wagner, 1999). This, in turn, may lead to inappropriate referrals to special education services (Cummins, 1984; Gersten, 1996). Length Of Time In The Program The length of time ELLs participate in a bilingual/ESL program has also received much attention, particularly as an indicator of prog ram effectiveness. Gersten and Woodward (1995) state that, a critical indicator of the success of any bilingual instruction program for language minority students is the rate at which student leave specialized classes for second language learners and enter mainstream classes (p. 227). Some have claimed that prolonged segregation from mainstream peers will hinder ELLs English language developmen t and academic progress (Porter, 1998; Rossell, 2000). There is little evidence, however, that b ilingual students languish in their programs (Krashen, 2001). Several states indicate that thei r average program participation of ELLs is around three years. For instance, the Florida Department of Education reported that an average length of program participation of 3.1 in 2000 across all gr ade levels., with secondary students (grades 6 through 10) remaining slightly longer (four to fi ve years; OMSLE, 2001). Illinois reported that over 77% of the students in bilingual programs had been in the program for less than three years (Illinois State Board of Education, 2000). Regardless of th ese trends, extended program attendance continues to be perceived as a negative feature of a bilingual /ESL program, regardless of its design. Without examining exited students academic performance af ter they have exited, it is difficult to draw conclusions about the role of le ngth of stay in the program. Length of stay in the program is also interpreted to imply that the more quickly ELLs exit, the better the program (Gandara and Merino, 1993; Linquanti, 2001).2 The assumption that a direct 2 In some cases, the discussion is reduced to exit percentages. For instance, Ron Unz, the founder of Proposition 227 to abolish bilingual education in California, criticized bilingual education for having a 95% failure rate because it was reported that only 5% of ELLs were reclassified annually.
After exit: Academic achievement patterns of former English language learners 4 4 relationship exists between exit rates and progra m success ignores, however, that the rate of student progress through a bilingual or ESL program will n ecessarily be influenced by individual student variables, program quality, as well as school vari ables (e.g., Gandara and Merino, 1993; Thomas and Collier, 2002). If exit rates are to be used as an outcome measure, they cannot be solely tied to a particular program but must include a wide rang e of contextual variables. Moreover, as was illustrated above, inconsistent exit practices make it difficult to draw conc lusions about a programs ability to exit students or to compare districts or states. A district with a low exit cut-off score may have a higher exit rate than a district with a more challenging cut-off score. In this case, comparing each districts exit rate would not reveal an ything about the quality of the program. Second, assuming mainstreaming minority child ren out of a bilingual program into an English-only program will promote the development of English literacy skills more effectively than if children were maintained in a bilingual program (p. 129-130) has also been criticized. Cummins (1980) labels this assumption the exit fallacy, wa rning that a premature exit from a bilingual or ESL program may negatively affect ELLs academic success in the mainstream. To be sure, current second language (L2) acquisition theory emphasize s interaction with native English speakers for effective L2 development (e.g., Ellis 1999; Fillmore, 1991). Further, student segregation may lead to the marginalization of the schooling of ELLs (De Jong, 1996; Valds, 2001). Yet, there is little empirical evidence that placement in a mainstream classroom will necessarily be more beneficial for ELLs. For instance, ELLs who are placed in mainstre am classes without specialized services (due to parent waiving access to such services) perform well below the national norm on standardized tests (Thomas and Collier 2002; Waters, 2001). Several studies (Harklau, 1999; Harper and Platt, 1998; Valds, 2001; Verplaetse, 2000) have documented the lack of ELL classroom participation and the absence of interactions between ELLs and native English speakers in secondary mainstream classrooms. A lack of comprehensible input, limited access to academically engaging instruction, and few opportunities for second language developmen t can make mainstream classrooms ineffective learning environments for ELLs. Finally, it is not empirically established that a quick exit implies long-term academic school success, when controlling for student background and program variables. Indirect evidence against this quick-exit assumption comes from studie s showing that ELLs in long-term bilingual programs are successful academically (e.g., Holm and Holm, 1990; Lindholm-Leary, 2001; Ramirez, 1992; Thomas and Collier, 2002). Ramirez (1998) fo und that former students performed better than English speakers on standardized tests in the San Francisco school district and reports that these students had, on average, attended a bilingual prog ram for 4-5 years. On the other hand, Gersten and Woodward (1995) report that after 3-4 years of program attendance, former ELLs still performed under the 25th percentile in middle school on the Comprehensive Test of Basic Skills (CTBS). Clearly, long program attendance does not necessarily impede nor guarantee academic success. The relationship between exit rate and subsequent school success was more directly explored in a study the New York Department of Educatio n (2000). The study found that ELLs who exited in the early elementary grades (K-4) and who entered in PK/K-2 performed at or above the citywide average in Math and Reading in 7th and 8th grade, respectively. This study suggests that perhaps entry grade and exit grade level may play a role in pr edicting ELLs school success after exit (see also Goldberg, 1997). Though faulty in its reasoning (e.g., De Jong an d Ramos, 2003), the California debate illustrates the dominance of this issue in setting educational po licy. See also Grissom (2004) for a longitudinal analysis of exit percentages.
Education Policy Analysis Archives Vol. 12 No. 50 5 5 Former ELLs and Program Accountability Proponents and opponents of bilingual or ELS a pproaches have used program evaluations to argue for or against the implementation of certain programs. Labeled advocacy-oriented program evaluations by August and Hakuta (1997) these studies typically compare the outcomes of a bilingual and an ESL program in the first three ye ars of implementation. Though severely criticized on methodological and theoretical grounds (Aug ust and Hakuta, 1997; Rossell and Baker, 1996; Willig and Ramirez, 1993), these studies nevertheless continue to fuel much of the debate on the schooling for ELLs. Importantly, these evaluations have typically focused on the achievement patterns of ELLs as they are still classified as limi ted English proficient. While such an approach can provide useful short-term feedback, it cannot assess whether the program has succeeded in preparing the students for effective participati on in the mainstream. To answer this question, program evaluations must go beyond the bilingual /ESL program achievement data and include data on the school performance of graduates from such specialized programs. Few studies have explored the academic achi evement of former ELLs. ELLs are rarely tracked once they have exited from the bilingual /ESL program and few states disaggregate and report their statewide testing data for former ELLs An examination of the achievement patterns of two states with high ELL enrollment that do report such data, Florida and California, illustrates that former ELLs tend to lag behind fluent English-speaki ng peers, particularly at the secondary level. In Florida, for example, the Florida Department of Education (2001) reports that between 12 and 20 percent fewer former ELLs pass the states test than fluent English speakers in math and reading at grades 4, 5, 8, and 10. Second, former ELLs ten d to perform better on math tests than on reading or content area (science, social studies) tests. SAT-9 data from California show that about 10-12% fewer former ELLs score above the 50% percentile in science and social studies (Grades 9-11), whereas their scores for math at these grade levels essentially parallel those of English-only students (California Department of Education, 2001). Th ese statewide achievement patterns underscore the need to include former ELLs in state and district accountability systems. The exclusion of former ELLs from progra m and district accountability reflects the perception that the responsibility for meeting the needs of ELLs is that of the bilingual/ESL teacher. Once a student is fixed and exited from the program, mainstream teachers (expect to be able to) treat them as native English speakers (Cummins, 2000; Lucas and Wagner, 1999; Shannon, 1990). Thus, from a mainstream perspective, exi ted students are not distinguished as a separate group because they are now native English spea kers. They are also largely ignored from a bilingual/ESL perspective because they no longer fall wi thin the confines of specialized services. In contrast, the inclusion of former ELLs in the accountability debate of bilingual/ESL programs acknowledges that the entire school/district is res ponsible for the learning of ELLs and not only the bilingual program (Carter and Chatfield, 1986). It also emphasizes that this accountability includes a second language learners entire school career and not only the few years that s/he attends a bilingual/ESL program. The purpose of this study was, therefore, to examine the academic achievement of former ELLs. For the purpose of the study, former ELLs are defined as those students who were classified as limited English proficiency upon school entry an d attended a bilingual or an ESL program, who were then reclassified as fluent English proficient and enrolled fulltime in a mainstream classroom. In addition to general achievement patterns in En glish language arts, math, and science, the study also explored role that length of bilingual/ESL program attendance played in predicting academic
After exit: Academic achievement patterns of former English language learners 6 6 success. To examine the role of varying academic proficiency demand from grade to grade, the analysis also included the grade at whic h students exited as a second variable. Research Design The study took place in medium-sized school district in the Northeastern United States. The district enrolls close to 8,000 students and implements a bilingual (BE) and an English as a Second Language (ESL) program. The district wa s chosen because of its long-standing experience with ELLs (the first bilingual classroom was established in the late 1960s), its consistency in program philosophy and implementation, and its emphasis on quality of education for all ELLs. The study explores the following two research questions. The first question is whether former ELLs in this district close the academic achievement gap with stud ents in regular education. The second research question examines the role of two variables (lengt h of program participation and grade of exit) in predicting academic achievement. Program context The districts bilingual education (BE) program is designed for native Portuguese or Spanish speakers with limited English proficiency and who are dominant in their native language. The goal of the program is to prepare its students to su cceed in a mainstream classroom. Prior to 1995, the elementary bilingual program was run as a traditio nal transitional bilingual education program with a focus on transitioning to English literacy and exit within three years. After 1995, the model changed to include continued access to the native language and an exit process that emphasized readiness for the mainstream classroom. When considering the data below, it should therefore be kept in mind that the 8th grade former BE students went through an early-exit bilingual program design at the elementary level, whereas the 4th grade former BE students attended a program that was in line with the new model, i.e., a late-exit/maintenance program. The elementary BE programs are located in schools with the largest proportions of students e ligible for free/reduced lunch. The Portuguese programs are located in two schools where more than 50% of the students are eligible free/reduced lunch (63% and 51%). The two Spanish bilingual programs have 38% and 29% of their students eligible for free/reduced lunch, respectively. The ESL program is a self-contained program with the same objective as the BE program: to prepare students to succeed in a mainstream cl assroom. The elementary ESL program is taught in English and serves a multilingual population. Students home language backgrounds include Russian, Chinese, Hindi, Japanese, Korean, and seve ral other languages. The school in which the ESL program is located has the lowest percentage of students eligible for free/reduced lunch (16%) in the district. Traditionally, the ESL program has served a student population with access to educated parents and native-language resources ou tside school, such as a Korean Saturday school. Exit guidelines The process of exiting students is the same for the ESL and the bilingual program and is outlined in a district document. For oral langua ge, students are expected to score minimally a 4 on comprehension and on production on a rating rubric that ranges from 0 (no oral proficiency) to 5 (oral proficiency is like a native speaker). For Eng lish literacy, students are expected to score a Level 3 (fluent reader/writer) on the Language Assessmen t Scale, a formal language proficiency test (Duncan and De Avila, 1988). Academic performance is not included in the form of formal tests. Bilingual and ESL teachers understand, however, the limitations of formal tests and take a wholechild approach when making decisions about exiting students, including student personality and attitudes as well as strengths in the content areas.
Education Policy Analysis Archives Vol. 12 No. 50 7 7 Participants The sample of exited students was determine d by examining exit forms used by the district since 1995 as well as individual student records in the bilingual department. Students whose parents requested their childs exit before the teacher recommended such an exit were excluded as were exited students for whom it could be determine d that they were eligible for special education services. This resulted in a total sample of 56 0 identified exited students who were recommended for exit during or after Kindergarten. To ans wer the research questions, a subset was created for those exited students who took th e state test between 1998 and 2000 in grade 4 or grade 8. This process resulted in a sample of thirty-eight 4th grade exited students (tw elve from the BE program and twenty-six from the ESL program) and fifty-six 8th grade exited students (thirty-six BE program students and twenty ESL program students) for whom all required data were available (see Table 1). Table 1 Exited Students Sample characteristics ESL Program BE Program Sample Size Grade 4 N=26 N=12 Sample Size Grade 8 N=20 N=36 Exit Grade Level K-2 (74%), 3-5 (13%), 6-8 (13%) K-2 (33%), 3-5 (60%), 6-8 (7%) Average program attendance Grade 4: 2.2 years Grade 8: 2.6 years Grade 4: 3.1 years Grade 8: 3.4 years School characteristics 16% free/reduced lunch 29%-63% free/reduced lunch The majority of the ESL program students ex ited between Kindergarten and second grade (76%); 13% exited between third and fifth grade an d between sixth and eighth grade. Of the exited BE program students, one-third exited before third grade, 60% exited between grades three and five and 7% exited during the middle school years (grade 6-8). The average length of program participation for the 4th grade ESL program students was 2.2 years (median = 2.0; range =3.6) and for the BE program students 3.1 years (median=3.0; range 2.7). The 8th grade ESL program students stayed in their program for an average of 2.6 years (median=2.0; range=6.0), whereas the BE program students completed an average of 3.4 yea rs (median=3.0; range=5.0). The exit figures parallel those in the state where more than 80% of th e ELLs are reported to exit within three years. Instruments The academic achievement outcome measure is a mandated state test developed by the state based on its curriculum standards. Between 1998 and 2000 the state test was administered for English Language Arts (ELA), Mathematics, and Scie nce at grades 4, 8, and 10. The test consists of multiple choice, short-answer, and essay questions, and also includes a writing sample for English Language Arts. Students raw scores are converted into scaled scores, which are then divided into four proficiency categories: Failing, Needs Improv ement, Proficient, and Advanced Proficiency. The study examined distribution of 4th and 8th grade exited and regular education students over the proficiency levels in the three subject area s (ELA, Mathematics, and Science). Regular education excludes students classified as ELLs as well as students eligible for special needs services.
After exit: Academic achievement patterns of former English language learners 8 8 Analysis To answer the first research question, whether exited ELLs are performing at similar levels as their peers, closing the achievement gap was defined as exited students showing similar patterns on the state test as students in regular education in the district and/or the state as represented by the percentage of students in each of the proficiency categories. Because there were so few students in the Advanced category, it was decided to collapse the Proficient and Advanced Proficient categories into one. Both categories indicate that students ar e meeting state expectations for the grade level. The analysis therefore considered the percentage of exited and regular education students in ELA, Mathematics, and Science at three proficiency levels: Failing (F), Needs Improvement (NI), and Proficient (P). The second question examines the role of time variables. The first variable is the variable related to exit rates, namely Length of BE or ESL program attendance This variable was defined as the period between entry into the bilingual/ESL pr ogram and the date of exit (one school year (9 months) is one year). Secondly, the analysis considered the exit grade : the grade level at which was the student exited (e.g., second grade or fourth grad e) to take into consideration the increased levels of academic demand placed on former ELLs as th ey exit. A regression analysis was done to see which, if any, variables had a significant effect on achievement outcomes for each of the achievement tests (ELA, Mathematics, and Scienc e). While these two programs are in the same district, direct comparison between the two prog rams is not possible since student background variables were not controlled for. Results Academic achievement patterns To answer the question whether exited studen ts close the achievement gap when compared to the regular education population, the percentage of students scoring in the Failing (F), Needs Improvement (NI) or the Proficient (P) proficiency levels was calculated for 4th and 8th grade exited students for three subject areas, ELA, Mathematics, and Science (Tables 2 and 3). T-test analysis revealed significant program differences for 4th grade mathematics (p<0.01) and, to a lesser extent, for 4th grade science (p=.04), and 8th grade math and science (p=0.04 and p=0.03, respectively). No significant differences were found for English lang uage arts between the ESL and BE program. The results will therefore be presented by program model. ESL program results The 4th grade ESL exited students and the districts regular education students show a similar distribution of scores in the three subject areas (Table 2). However, fewer ESL program students score at the Proficient level in ELA as compared to regular education students. The 8th grade ESL exited students show similar achievement patterns as students in regular education at the district and the state level for ELA and mathematics. For science, on the other hand, more ESL exited students scores fall into the failing category, although they match the district and the state patterns at the proficient/advanced pr oficiency level. Like the elementary students, fewer 8th grade ESL exited students scored at the Proficiency level in ELA.
Education Policy Analysis Archives Vol. 12 No. 50 9 9 Table 2 Proficiency Levels for Grade 4 and Grade 8 former ESL students for English Language Arts, Mathemat ics, and Science (1998-2000) compared to regular education studen ts in the district and the state ENGLISH LANGUAGE ARTS MATHEMATICS SCIENCE Grade 4 F NI P/Adv F NI P/Adv F NI P/Adv ESL 3.8% 76.9% 19.2% 3.8% 30.8%65.4% 3.8% 34.6% 61.5% District 2.7% 65.3% 31.9% 9.6% 40.3%50.1% 3.2% 27.2% 69.6% State 6.7% 69.2% 24.1% 14.4%43.6%41.9% 5.7% 32.5% 67.7% Grade 8 F NI P/Adv F NI P/Adv F NI P/Adv ESL 9.5% 33.3% 57.1% 19% 38.1%42.9% 28.6%19% 52.4% District 6.7% 24.1% 69.2% 14.4%43.6%41.9% 5.7% 32.5% 61.7% State 7.2% 27.4% 65.8% 34.1%28.4%37.7% 34.2%30.7% 35.1% Bilingual Program Results More BE exited students score in the Needs Improvement category than in the Proficient category for mathematics and science, a pattern different from the regular education students. The BE exited students more closely parallel the dist ribution of the regular education students at the district and state level for ELA (see Table 3). Table 3 Proficiency Levels for Grade 4 and Grade 8 former BE students for English Language Arts, Mathemat ics, and Science (1998-2000) compared to regular education studen ts in the district and the state ENGLISH LANGUAGE ARTS MATHEMATICS SCIENCE Grade 4 F NI P/Adv F NI P/Adv F NI P/AdvBE 0.0% 92.3% 7.7% 7.7% 69.2% 23.1% 7.7% 61.5% 30.8% District 2.7% 65.3% 31.9% 9.6% 40.3% 50.1% 3.2% 27.2% 69.6% State 6.7% 69.2% 24.1% 14.4% 43.6% 41.9% 5.7% 32.5% 67.7% Grade 8 F NI P/Adv F NI P/Adv F NI P/AdvBE 5.6% 41.7% 52.8% 52.8% 30.6% 16.7% 41.7%44.4% 13.9% District 6.7% 24.1% 69.2% 14.4% 43.6% 41.9% 5.7% 32.5% 61.7% State 7.2% 27.4% 65.8% 34.1% 28.4% 37.7% 34.2%30.7% 35.1%
After exit: Academic achievement patterns of former English language learners 10 10 The 8th grade exited BE students show a different pattern. Their score distribution diverges from regular education students, having more st udents in the failing category for mathematics and science and fewer in the Proficiency category. For ELA, on the other hand, exited BE program students resemble the pattern for regular educatio n students. Like the elementary students, fewer BE students scored at the Proficiency level in ELA. Length Of Program Partic ipation And Grade Exited The second research question explored wh ether two variables, length of program participation and grade exited, predicted exited students academic achievement outcomes. No significant correlations were found between length of program participation and scaled scores. When controlling for program model, the regression analysis revealed the following patterns. Exit grade level emerged as a significant predictor for 4th grade ELA and Science (p<.01), i.e., the higher the grade level that the student exited, the lower their scores on the 4th grade state test in ELA and Science. At the 8th grade level, neither variable was found as a significant predictor of academic achievement. A significant inter action effect between grade exited and program model emerged, however, for 8th grade science (p<.09), though with a sma ll effect size (r=.05). For the exited ESL program students, the lower the grade level they exited, the better their 8th grade science scores. Exited BE program students scores, on the other ha nd, slightly improved as they exited at higher grade levels. Discussion This study considered the achievement of bilin gual students who at one time were classified as limited English proficient, attended a bilingu al or ESL program, and who are now participating in a mainstream classroom without specialized se rvices. The first research question examined the extent to which former ELLs in one district were ab le to meet grade level expectations as compared to their peers. Results indicate that, in general, 4th grade exited students score distribution over the three proficiency levels (Failing, Needs Improv ement, Proficient) resembled those of regular education students at the district and state level fo r ELA, Mathematics, and Science. At the same time, more former BE and ESL program students sc ored in the Needs Improvement rather than the Proficient category for ELA. The same trend em erged for mathematics and science for exited BE program students. For the elementary school leve l, then, the well-designed BE program and ESL program, together with the mainstream program, appear to meet the language and academic needs of ELLs when considering proficiency categories. The fact that fewer 4th grade exited students are proficient raises an important question for the future: will these former ELLs eventually perfor m at the proficient level or will the gap widen as more demands are placed on students ability to mediate content through language? Non-cohort standardized state test data from Florida and Calif ornia suggest a widening rather than a closing gap between regular education students and former E LLs for reading as well as the content areas for students at the higher grade levels (California De partment of Education, 2001; OMSLE, 2001). On the other hand, quasi-longitudinal data from bilingu al programs suggest that ELL may close the gap over time, provided they have had a strong bilingu al schooling base for more than 4 years (Thomas and Collier, 2002). These data emphasize the import ance for school districts to track former ELLs throughout their school career. This can be achieved when districts keep a language status code for ELLs when these students leave their program. Most districts identify ELLs through a code such as ELL or LEP (limited English proficient) but delete such identification when the student leaves the ESL/bilingual program. Instead, the ELL/LEP code can be changed to a code that identifies
Education Policy Analysis Archives Vol. 12 No. 50 11 11 them as a mainstreamed student. For example, the Florida Department of Education uses the code LF for students who exited within the last two years and LZ for students who exited more than two years ago. Such a code could also contain pr ogram type data. Long-term cohort data for former ELLs is needed to see if a gap exists and whether it widens, closes, or remains the same as former ELLs go through the grades. The analysis of the 8th grade exited students academic achievement showed a different picture. The gap between former exited students an d the regular education students was the largest for mathematics (BE exited students only) and sc ience (both BE and ESL exited students) with more students scores falling into the Failing categor y. Counter to other district-level studies (e.g., Abella, 1992; Gonzalez, 2001; Waters, 2001), this st udy found that the former ELLs largely matched the score distribution of English speakers over the three proficiency levels for English language arts. This may be partially due to a strong middle school English department in the district. It may also be related to former ELLs access to acquiring th e necessary English skills during their elementary schooling (cf. the stronger ELA patterns for the 4th grade former ELLs). This finding also underscores the importance of distinguishing b etween the language skills developed through ELA and the content areas. The content areas have their own register and make specific language demands on students, particularly at the second ary level (e.g., Carrasquillo and Rodriguez, 1996; Corson, 2001; Short, 2002), and language skills learned in the ELA class may not necessarily be sufficient or appropriate for the content area classr oom. Even very fluent bilingual students may need teachers to provide them with more sophistic ated ways to discuss and engage with academic content (Cummins, 2000; Freeman, Freeman, and Mercuri, 2002; Gibbons, 2002) and demonstrate their learning on a formal test. The 8th grade patterns also revealed a gap between BE and ESL program students, with the ESL program students performing be tter than the BE students in ma th and science. Several factors may contribute to these program differences. First, the elementary ESL program is located in a school with a higher socio-economic status and has traditionally enrolled students from homes with higher parent education levels. The 8th grade students would have been representative of this group of ESL program students. The BE program studen ts, on the other hand, are primarily from lower socio-economic background and their schools have an overall higher percentage of students who qualify for free/reduced lunch. While the BE students had remained in their program slightly longer (3.4 years versus 2.6 years for the ESL program students), this difference was statistically insignificant (see Krashen, 1996, however, regarding the role of socioeconomic status and program length). Another factor that may have played an important role is the nature of the elementary bilingual program that the 8th grade BE students had attended. They went through an early-exit bilingual program that focused on English literacy de velopment with a quick shift to English in the early grades. If the bilingual students exited th e bilingual program proficient in English but were lagging behind academically, it would have been di fficult to catch up in these areas. ESL program students, on the other hand, were exposed to a full curriculum in the mainstream earlier on. Gradelevel content area development in longer-term prog rams, such as a bilingual education program, is therefore crucial. While earlier test data are unavailable for the 8th graders, this studys 4th grade BE program results suggest that the revised elementary BE program (a late-exit bilingual program) may be providing ELLs with a better start in the mainst ream classroom in English language arts as well as math and science. This trend would be consis tent with other studies in the field (e.g., Thomas and Collier, 2002). The third research question examined the role of two variables: length of program participation and grade level exited. When c ontrolling for program type, length of program participation was not a significant predictor of ex ited students achievement patterns. While it is often assumed that students who stay in a program longer are students with academic difficulties,
After exit: Academic achievement patterns of former English language learners 12 12 this study found no significant correlation between length of time in the program and academic achievement scores in either prog ram. Exit grade, on the other hand, did emerge as a significant variable, at least for the 8th grade students. This finding may reflect the fact that the language of school increasingly becomes more dependent on students ability to negotiate meaning through linguistic means (Cummins, 2000; Corson, 2001). Students move from predominantly oral discussions and activities grounded in their own personal experiences (K-2) to writing and talking about abstract content-related concepts and th ey must master the more complex vocabulary, syntactic structures, and pragmatic conventions that are appropriate for the specific discourse of the subject and the grade level (de Jong & Harper, in press). Guidelines for exit should include this awareness of students ability to manipulate language for academic purposes appropriate to the grade level they are entering. Bunch, Valdez, Lotan, Cohe n, and Abram (2002), for instance, developed an academic oral language assessment that uses grad e-level appropriate academic classroom tasks that require students to explain and persuade. Rather than a fixed criterion for all grade levels, a more flexible approach is needed that considers the in creased demands that will be placed on an exited student and the extent to which continuing academ ic language needs of ELLs can be met in the mainstream classroom. Instead of po licies that label ELLs either as in or out of specialized services, a more gradual approach would allow servi ces to change as ELLs become more proficient (Gandara and Merino, 1993; Linquanti, 2001). Mo reover, it stresses the importance for mainstream teachers to be prepared to continue the devel opment of the academic language proficiency once ELLs exit (Cummins, 2000; Echevarria, Vogt, and Short, 2000; Gibbons, 2002). Finally, the significant interaction betw een exit grade and program found for 8th grade exited students is intriguing, though the results must be interpreted with caution due to the small sample size. The ESL program did better if students entered exited in the lower grades, whereas students in the BE program did better if they exited at a higher grade. In the absence of a significant correlation between length of program attendance and achievem ent, this finding points to the possibility of a differential impact of program type, possibly in co mbination with socioeconomic status. If the ESL program closes the gap for ELLs with more affluent parents and who exit at lower grade levels (i.e., K-2) but not for students who exit at higher gr ade levels and/or whose needs are more extensive than can be met within a short time, its effectivene ss is limited to a very specific target population. A similar differential program effect was observed in a study by the New York Board of Education (2000). In this study, the achievement patterns fo r students who had attended a bilingual program were less sensitive to length of program attendanc e than those of ESL program students. Such a finding supports the need to move away from a one -model-fits-all approach to more complex ways to meeting the needs of ELLs. Clearly, more rese arch is needed for a better understanding of the interaction between program features, school variab les, student characteristics, and academic achievement patterns (August and Hakuta, 1997; Nadeau and Miramontes, 1988). Although the analysis has limited power due to the small number of students at each grade level, the role of exit grade warrants further exploration with a larger sample. Conclusion Exited ELLs are important to consider within a larger framework of district accountability. The analysis of former ELLs achievement data illustrates that former EL Ls may not necessarily catch up. This is particularly true for the second ary level, but may remain hidden at the elementary level as students pass the test at the lowest level, but are not quite proficient yet. These findings, which are also found in states such as Californi a and Florida, underscore that the schooling of minority language students is not only the respons ibility of bilingual or ESL teachers but continues
Education Policy Analysis Archives Vol. 12 No. 50 13 13 after students have been exited from such progra ms. Statements about achievement patterns of ELLs and native English-speaking students or cl aims that linguistic barriers for ELLs have been overcome can only be examined when exited ELLs ar e included in the analysis. A district cannot be said to have met ELLs academic and linguistic needs if discrepancies in academic achievement patterns between exited ELLs and native English sp eakers persist. It is therefore important to disaggregate data for former ELLs and follow their achievement over time. When program evaluations include former ELLs achievement, several issues emerge that traditional advocacy-oriented prog ram evaluations, that only include students who are still labeled as limited English proficient, tend to overlook. By examining the role of length of program participation and exit grade, this study confirme d that length of program participation does not appear to play a significant role in predicting future student success. Furthermore, it raised questions regarding the relationship between exit grade and ELLs subsequent academic achievement, the appropriateness of specialized pr ograms for students with certain background characteristics and ages and emphasized the importance of examining long-term academic achievement patterns (Thomas and Co llier, 1997). It will not be sufficient, however, to only examine academic outcome data. The results in this study for the ESL and bilingual program, for 4th and 8th graders, and across subject matters also raise importa nt questions regarding the factors that facilitate or hinder the exit process, how students and teacher mediate the exit process, as well as the social, linguistic, and academic needs of exited students when they first encounter the mainstream classroom and continuing over time as language and content demands increase (e.g., Franson, 1999; Shannon, 1990). Including exited students or former ELLs in the analysis approaches district accountability from a broader perspective than previously taken in advocacy-based program evaluations. Meeting the specialized needs of ELLs cannot be the sole responsibility of a bilingual or ESL program. As Mora (2002) points out, such program attendance re presents, on average, an approximate 4% of a students school career. A focus on former ELLs emphasizes accountability for all teachers involved with bilingual students throughou t the latters school career.
After exit: Academic achievement patterns of former English language learners 14 14References Abella, R. (1992). Achievement tests and elemen tary ESOL exit criteria: An evaluation. Educational Evaluation and Policy Analysis 14, 2, pp. 169-174. August, D., & Hakuta, K. (1997) (Eds.). Improving schooling for language -minority children. A research agenda. Washington, D.C.: National Academy Press. Brisk, M.E. (1998). Bilingual education: From compensatory to quality schooling Mahwah, NJ: Lawrence Erlbaum Associates. Bunch, Valdes, Lotan, Cohen and Abram (2002). From testing the trivial to understanding the complex: measuring oral proficienc y in academic language Linguistic Minority Institute. University of California. [online] Available at lm ri.ucsb.edu/profdev/2/lmri_conferences/ 02_conf/02_handouts/Bunch.ppt California Department of Education (2001). STAR state summary report Author. Carrasquillo, A.L., & Rodriguez, V. (1996). Language minority students in the mainstream classroom. Philadelphia: Multilingual Matters. Carter, T. P. & Chatfield, M. (1986). Eff ective schools for language minority students. American Journal of Education 97 200-233. Chamot, A.U., & OMalley, J.M. (1994). The CALLA handbook: Implementing the cognitive academic language learning approach Reading, MA: Addison-Wesley. Collier, V. P. (1992). A synthesis of studies exam ining long-term language minority student data on academic achievement. Bilingual Research Journal, 16 (1&2), pp.187-212. Corson, D. (2001). Language diversity and education. Mahweh, NJ: Lawrence Erlbaum. Crawford, J. (1999). Bilingual education: History, politics, theory, and practice (4th ed.). Los Angeles, CA: Bilingual Education Services. Crawford, J. (1997). Best Evidence Research foundations of the Bilingual Education Act Washington, D.C.: National Clearinghouse on Bilingual Education. Cummins, J. (2000). Language, power and pedagogy. Bili ngual children in the crossfire Clevedon: Multilingual Matters. Cummins, J. (1996). Negotiating Identities Education for empowerment in a diverse society Los Angeles, CA: California Association for Bilingual Education. Cummins, J. (1984). Bilingualism and special education: Issues in assessme nt and pedagogy San Diego, CA: College Hill. Cummins, J. (1980). The entry and exit fallacy in bilingual education. NABE Journal 4 25-60.
Education Policy Analysis Archives Vol. 12 No. 50 15 15 De Avila, E. (1990). Assessment of language minor ity students: Political, technical, practical and moral imperatives. Proceedings of the first Research symposiu m on Limited English Proficient Students OBEMLA. De George, G. P. (1988). Assessm ent and placement of language mi nority students: Procedures for mainstreaming. FOCUS Winter, 3. NCBE Occassional Papers in Bilingual Education. De Jong, E. J. (1996). Integrating language minority educ ation in elementary schools. Unpublished doctoral dissertation, Boston University, Boston. De Jong, E.J., & Harper, C. A. (in press). Is ES L just good teaching? In Bigelow, M., & Walker, C. (Eds.), Creating teacher community: Selected papers from the Third International Co nference on Language Teacher Education Minneapolis, MN: Center for Advanced Research on Language Acquisition. De Jong, E.J., & Ramos, F. (2003). Current Eng lish-only initiatives: Misconceptions and broken promises. Sunshine State TESOL Journal, Spring, 22-33. Duncan, S.E., & De Avila, E.A. (1988). LAS: Language Assessment Scales. Reading/Writing. Montery, CA: MacMillan/McGraw-Hill. Echevarria, J., Vogt, M., & Short, D. J. (2000). Making content comprehensible for English language learners. The SIOP model. Needham Heights, MA: Allyn & Bacon. Ellis, R. (1999). Theoretical perspectives on interacti on and language learning. In: Ellis, R. (Ed.), Learning a second language through interaction (pp.3-32). Philadelphia, PA: John Benjamins. Fillmore, L. W. (1991). Second lang uage learning in children: a model of language learning in social context. In E. Bialystok (Ed.), Language processing in bilingual children (pp. 49-69). Cambridge University Press. Fleischman, H.L, & Hopstock, P.J. (1993). Descriptive study of services of Limited English Proficiency students Development Associates, Inc.: Arlington, VA. Florida Department of Education (2001). ESOL 2000/01 Annual status report on the implementation of the 1990 League of United Latin American citizens (LULAC) et. al. v. State Board of Education et. al. consent decree. Tallahassee, Florida: Office of Multic ultural Student Language Education. Franson, C. (1999). Mainstreaming learners of Engl ish as an additional language: The class teachers perspective. Language, Culture and Curriculum 12,1, pp. 59-71. Freeman, Y. S., Freeman, D. E., & Mercuri, S. (2002). Closing the achievement gap: How to reach limitedformal-schooling and long-term English learners Gandara, P., & Merino, B. (1993). Measuring the ou tcomes of LEP programs: Test scores, exit rates, and other mythological data. Educational Evaluation and Policy Analysis 15 (3), 320-338.
After exit: Academic achievement patterns of former English language learners 16 16 Gersten, R. (1996). Literacy instruction for lang uage minority students: The transition years. The Elementary School Journal, 96 (3), 227-244. Gersten, R., & Woodward, J. (1995). A longitudinal study of transitional and immersion bilingual education programs in one district. The Elementary School Journal 95 3, 223-239. Gibbons, P. (2002). Scaffolding language, scaffolding learning Teaching second language learners in the mainstream classroom. Portsmouth, NH: Heinemann. Goldberg, A. (1997). Follow-up study on the Beth lehem, PA, school districts English acquisition program. Read Perspectives, 4 (1), 59-94. Gonzalez, R. M. (2001). Bilingual/ESL programs evaluation report, 1999-2000 Austin Independent School District. Office of Program Evaluation. Grissom, J. B. (2004, July 30). R eclassification of English learners. Education Policy Analysis Archives, 12 (36). Retrieved August 2, 2004 from http://epaa.asu.edu/epaa/v12n36. Harklau, L. (1999). The ESL learning environment in secondary school. In: C.J. Faltis, & P. Wolfe (Eds), So much to say. Adolescents, bilingualism & ESL in the secondary school New York, NY: Teachers College. Harper, C. A., & Platt, E.J. (1998). Full in clusion for secondary school ESOL students: Some concerns from Florida. TESOL Journal 7 (5), 30-36. Holm, A., & Holm, W. (1990). Rock Point: A Navajo way. Annals of the American Academy of Political and Social Science, 508, 170-184. Krashen, S. (2001). How many children remain in bilingual education too long? Some recent data. NABE News 24 (5): 15-17. Krashen, S. (1996). Under attack: The case against bilingual education Culver City, CA: Language Education Associates. Lindholm-Leary, K. J. (2001). Dual language education Tonawanda, NY: Multilingual Matters. Linquanti, R. (2001). The redesignation dilemma: Challenges and choices in fostering meaningful accountability for English learners West Ed: The University of California. Linguistic Minority Research Institute. Policy report 2001-1. Lucas, T., & Wagner, S. (1999). Facilitating second ary English language learners transition into the mainstream. TESOL Journal Winter, 6-13. Mora, J. K. (2002). Proposition 227s second annive rsary: Triumph or travesty? Retrieved on 10/22/02: http://coe.sdsu.edu/people/jmora/Prop227/227YearTwo.htm Nadeau, A., & Miramontes, O. (1988). The reclassi fication of limited English proficient students: Assessing the inter-relationship of selected variables. NABE Journal Spring, 219-242.
Education Policy Analysis Archives Vol. 12 No. 50 17 17 New York City Board of Education (2000). ELL Subcommittee Research Studies Progress Report. New York City. Ovando, C. J., Collier, V.P., & Coombs, M.C. (2003). Bilingual and ESL classrooms: Teaching in multicultural contexts Third Edition. Boston, MA: McGraw-Hill. Porter, R. P. (1998). The case against bilingual education. Atlantic Monthly, 281 (5), 28-39. Ramirez, J.D. (1998). San Francisco Unified School District performanc e of redesignated fluent-English-proficient students (R.FEPs) Long Beach, CAL Califor nia State University. Ramirez, J.D. (1992). Executive summary Bilingual Research Journal, 16 1-62. Rossell, C. H. (2000). Different questions, different answers: A critique of the Hakuta, Butler, and Witt report, How long does it take English lear ners to attain proficiency? READ Abstract. Retrieved from the internet http://www.ceousa.irg/READ/hakuta.html. Rossell, C.H., & Baker, K. (1996). The educat ional effectiveness of bilingual education. Research in the teaching of English, 30 (1), 7-74. Rossell, C.H. & Baker, K. (1988). Selecting and ex iting students in bilingual education programs. Journal of law and education 17, 4, pp. 589-623. Shannon, S. M. (1990). Transition from bilingual programs to all-English programs: Issues about and beyond language. Linguistics and Education 2, pp. 323-343. Short, D. (2002). Language learning in sheltered social studies classes. TESOL Journal 11, 1, pp. 1824. Teitelbaum, H., & Hille r, R. J. (1977). The legal perspective Bilingual education: Current perspectives: Law. Arlington, Virginia: Center for Applied Linguistics. Thomas, W. P., & Collier, V. (2002). A national study on the school effectiveness for language minority students long-term academic achievement. Final Report: Project 1.1. Santa Cruz, CA: Center for Excellence on Education, Diversity, & Excellence. Retrieved on September 19, 2002, http://www.crede.uscs.edu/research/llaa/1.1sc.html. Thomas, W. P., & Collier, V. (2002). A national study on the school effectiveness for language minority students long-term academic achievement. Final Report: Project 1.1. Santa Cruz, CA: Center for Excellence on Education, Diversity, & Excellence. Retrieved on September 19, 2002, http://www.crede.uscs.edu/research/llaa/1.1_sc.html. Thomas, W. P. & Collier, V. (1997). School effectiveness for language minority students NCBE Resource Collection Series, No. 9, Washington, D.C.: NCBE. Valds, G. (2001). Learning and not learning English. La tino students in American schools New York, NY: Teachers College Press.
After exit: Academic achievement patterns of former English language learners 18 18 Verplaetse, L. S. (2000). How content teachers allocate turns to limited English proficient students. Journal of Education, 182 (3). 19-35. Waters, G. (2001). ESL policy and practice: A linguistic human rights perspective. The Clearing House, 74 (6), 296-300. Willig, A. & Ramirez, D. J. (1993). The evaluation of bilingual education. In: M. Beatriz Arias & U. Casanova (Eds.), Bilingual education: Politics, practice, and research (pp. 65-87). Ninety-second yearbook of the National Society for the Stud y of Education. The University of Chicago Press: Chicago, IL. About the Author Ester J. de Jong Assistant Professor, ESOL University of Florida College of Education School of Teaching and Learning 2403 Norman Hall PO Box 117048 Gainesville, FL 32611 PHONE: 352-392-9191 x 280 FAX: 352-392-9193 email@example.com
Education Policy Analysis Archives Vol. 12 No. 50 19 19Education Policy Analysis Archives http:// epaa.asu.edu Editor: Gene V Glass, Arizona State University Production Assistant: Chris Mu rrell, Arizona State University General questions about appropriateness of topics or particular articles may be addressed to the Editor, Gene V Glass, firstname.lastname@example.org or reach him at College of Education, Arizona State University, Tempe, AZ 85287-2411. The Commentary Editor is Casey D. Cobb: email@example.com. EPAA Editorial Board Michael W. Apple University of Wisconsin David C. Berliner Arizona State University Greg Camilli Rutgers University Linda Darling-Hammond Stanford University Sherman Dorn University of South Florida Mark E. Fetler California Commission on Teacher Credentialing Gustavo E. Fischman Arizona State Univeristy Richard Garlikov Birmingham, Alabama Thomas F. Green Syracuse University Aimee Howley Ohio University Craig B. Howley Appalachia Educational Laboratory William Hunter University of Ontario Institute of Technology Patricia Fey Jarvis Seattle, Washington Daniel Kalls Ume University Benjamin Levin University of Manitoba Thomas Mauhs-Pugh Green Mountain College Les McLean University of Toronto Heinrich Mintrop University of California, Berkeley Michele Moses Arizona State University Gary Orfield Harvard University Anthony G. Rud Jr. Purdue University Jay Paredes Scribner University of Missouri Michael Scriven University of Auckland Lorrie A. Shepard University of Colorado, Boulder Robert E. Stake University of IllinoisUC Kevin Welner University of Colorado, Boulder Terrence G. Wiley Arizona State University John Willinsky University of British Columbia
After exit: Academic achievement patterns of former English language learners 20 20AAPE Editorial Board Associate Editors Gustavo E. Fischman & Pablo Gentili Arizona State University & Universida de do Estado do Rio de Janeiro Founding Associate Editor for Spanish Language (19982003) Roberto Rodrguez Gmez Hugo Aboites Universidad Autnoma Metropolitana-Xochimilco Adrin Acosta Universidad de Guadalajara Mxico Claudio Almonacid Avila Universidad Metropolitana de Ciencias de la Educacin, Chile Dalila Andrade de Oliveira Universidade Federal de Minas Gerais, Belo Horizonte, Brasil Alejandra Birgin Ministerio de Educacin, Argentina Teresa Bracho Centro de Investigacin y Docencia Econmica-CIDE Alejandro Canales Universidad Nacional Autnoma de Mxico Ursula Casanova Arizona State University, Tempe, Arizona Sigfredo Chiroque Instituto de Pedagoga Popular, Per Erwin Epstein Loyola University, Chicago, Illinois Mariano Fernndez Enguita Universidad de Salamanca. Espaa Gaudncio Frigotto Universidade Estadual do Rio de Janeiro, Brasil Rollin Kent Universidad Autnoma de Puebla. Puebla, Mxico Walter Kohan Universidade Estadual do Rio de Janeiro, Brasil Roberto Leher Universidade Estadual do Rio de Janeiro, Brasil Daniel C. Levy University at Albany, SUNY, Albany, New York Nilma Limo Gomes Universidade Federal de Minas Gerais, Belo Horizonte Pia Lindquist Wong California State University, Sacramento, California Mara Loreto Egaa Programa Interdisciplinario de Investigacin en Educacin, Chile Mariano Narodowski Universidad Torcuato Di Tella, Argentina Iolanda de Oliveira Universidade Federal Fluminense, Brasil Grover Pango Foro Latinoamericano de Polticas Educativas, Per Vanilda Paiva Universidade Estadual do Rio de Janeiro, Brasil Miguel Pereira Catedratico Universidad de Granada, Espaa Angel Ignacio Prez Gmez Universidad de Mlaga Mnica Pini Universidad Nacional de San Martin, Argentina Romualdo Portella do Oliveira Universidade de So Paulo Diana Rhoten Social Science Research Council, New York, New York Jos Gimeno Sacristn Universidad de Valencia, Espaa Daniel Schugurensky Ontario Institute for Studies in Education, Canada Susan Street Centro de Investigaciones y Estudios Superiores en Antropologia Social Occidente, Guadalajara, Mxico Nelly P. Stromquist University of Southern California, Los Angeles, California Daniel Suarez Laboratorio de Politicas Publicas-Universidad de Buenos Aires, Argentina Antonio Teodoro Universidade Lusfona Lisboa, Carlos A. Torres University of California, Los Angeles Jurjo Torres Santom Universidad de la Corua, Espaa Lilian do Valle Universidade Estadual do Rio de Janeiro, Brasil
xml version 1.0 encoding UTF-8 standalone no
mods:mods xmlns:mods http:www.loc.govmodsv3 xmlns:xsi http:www.w3.org2001XMLSchema-instance xsi:schemaLocation http:www.loc.govmodsv3mods-3-1.xsd
mods:relatedItem type host
mods:identifier issn 1068-2341mods:part
mods:detail volume mods:number 12issue 50series Year mods:caption 20042004Month September9Day 2222mods:originInfo mods:dateIssued iso8601 2004-09-22
xml version 1.0 encoding UTF-8 standalone no
record xmlns http:www.loc.govMARC21slim xmlns:xsi http:www.w3.org2001XMLSchema-instance xsi:schemaLocation http:www.loc.govstandardsmarcxmlschemaMARC21slim.xsd
leader nam a22 u 4500
controlfield tag 008 c20049999azu 000 0 eng d
datafield ind1 8 ind2 024
subfield code a E11-00399
Educational policy analysis archives.
n Vol. 12, no. 50 (September 22, 2004).
Tempe, Ariz. :
b Arizona State University ;
Tampa, Fla. :
University of South Florida.
c September 22, 2004
After exit : academic achievement patterns of former English language learners / Ester J. de Jong.
Arizona State University.
University of South Florida.
t Education Policy Analysis Archives (EPAA)