|USFDC Home||| RSS|
This item is only available as the following downloads:
xml version 1.0 encoding UTF-8 standalone no
mods:mods xmlns:mods http:www.loc.govmodsv3 xmlns:xsi http:www.w3.org2001XMLSchema-instance xsi:schemaLocation http:www.loc.govmodsv3mods-3-1.xsd
mods:relatedItem type host
mods:identifier issn 1068-2341mods:part
mods:detail volume mods:number 15issue 9series Year mods:caption 20072007Month April4Day 3030mods:originInfo mods:dateIssued iso8601 2007-04-30
Readers are free to copy display, and distribute this article, as long as the work is attributed to the author(s) and Education Policy Analysis Archives, it is distributed for noncommercial purposes only, and no alte ration or transformation is made in the work. More details of this Creative Commons license are available at http:/ /creativecommons.org/licen ses/by-nc-nd/2.5/. All other uses must be approved by the author(s) or EPAA EPAA is published jointly by the Colleges of Education at Arizona State University and the Universi ty of South Florida. Articles are indexed by H.W. Wilson & Co. Send commentary to Casey Cobb (c email@example.com) and errata notes to Sherman Dorn (epaa-editor@s hermandorn.com). EDUCATION POLICY ANALYSIS ARCHIVES A peer-reviewed scholarly journal Editor: Sherman Dorn College of Education University of South Florida Volume 15 Numb er 9 April 30, 2007 ISSN 10682341 Examining the Streams of a Retentio n Policy To Understand the Politi cs of High-Stakes Reform1 Christopher P. Brown The University of Texas at Austin Citation: Brown, C. P. (2007). Examining the streams of a retention policy to understand the politics of high-stakes reform. Education Policy Analysis Archives, 15 (9). Retrieved [date] from http://epaa.asu.edu/epaa/v15n9/. Abstract Using John Kingdons (2003) multiple stream s approach to agenda setting, I analyze how key actors within the state of Wiscons in understood the need to construct and implement the states No Social Promotion statutes to improve students academic performance. Policymakers within the state focused their standards-based reforms on the issue of improving students acad emic performance through increasing accountability. In doing so, they did not see these high-stakes policies as a form of punishment for those who fail, but rather, as a tool to focus the education establishment on improving the academic skills and knowledge of all their students. Thus, the retained student is not the primary concern of the policymaker, but rather, the retained student demonstrates the states system of accountability works. Raising the question as to whether those who su pport or oppose high-stakes policies such as these should focus their efforts on the agenda setting process rather than analyzing effects of such policies. I contend that while evaluating a policys effects is important, education stakeholders must pay attention to all three streams of the 1 I would like to thank the editor, Sherman Dorn, and the anonymous reviewer s for their suggestions in strengthening this article.
Education Policy Analysis Archives Vol. 8 No. 9 2 agenda setting process as they promote particular reforms to improve students academic performance. Keywords: education reform; high-s takes accountab ility; retention. Examinando las polticas de corrientes de retencin para entender las reformas de polticas educativas de consecuen cias severas Resumen Utilizando el modelo de John Kingdon (2 003) de corrientes mltiples para entender la configuracin de una agenda de polticas, investigue como actores clave en el estado de Wisconsin entendan la necesidad de construir e implementar reformas que no incluan si stemas de promocin social para mejorar los resultados del desempeo acadmic o de los estudiantes. Los polticos en el estado enfocaron la reforma en el objetivo de mejorar el desempeo de los estudiantes a travs de aumentar los sistemas de ev aluacin-responsables (accountability). Al hacer esto quienes decidan esas poltic as, no consideraban que la s mismas no castigaban a quienes no aprobaban los cu rsos, sino como una herramienta para orientar los esfuerzos del establishment educativo en mejorar las habili dades acadmicas y conocimiento de los estudiantes. De esta manera los estudiantes que eran retenidos no eran la principal consideracin de los polticos, sino que los estudiantes retenidos demostraban que el sistema de evaluacin-responsable del estado estaba funcionando. Haciendo la pregunta acerca de si aquellos que apoyan o se oponen a la polticas de consecuencias severas deberan enfocar sus esfuerzos en el proceso de establecer esas agendas, en vez de analizar los efectos de esas polticas, yo propongo que mientras eval uar los efectos de esas polticas es muy importante, los que deciden esas polticas deberan pr estar atencin a las tres corrientes del proceso de determinacin de la agenda pa ra mejorar el dese mpeo acadmico de los estudiantes. Palabras claves: reformas educativas; evaluaciones con consecuencias severas; retencin Introduction The debate over the use of retention as tool to improve students academic performance has been going on for decades (e.g., Alexander, Entwisl e, & Dauber, 2003; Sashkin and Egermeir, 1993; Smith, & Shepard, 1987). Recently, the use of hi gh-stakes promotion policies at the state (e.g., Florida) and district level (e.g., Chicago) that requi re students to perform at a specific level of proficiency on a assessment measure to advance to th e next grade level have brought this issue back to forefront of education research (e.g., Heubert & Hauser, 1999; Jacobs & Lefgren, 2004; Roderick, Nagaoka, Bacon, & Easton, 2000). Within the ed ucation community, untangling the debate over the effectiveness of these policies to improve students academic performance involves understanding the political and empirical conceptions of this type of reform measure. Politically, the implementation of retention polic ies have had an inconsistent history at the national, state, and local level whereby one admi nistration might support these policies and the next eliminate them altogether (Roderick & Nagoaka, 2005; Shepard & Smith, 1989). However, recent
Examining the Streams of a Retention Policy 3 actions by policymakers at the national (e.g., C linton, 1998; Office of the White House, 2006) and state levels of government (e.g., Texas, Florida) have solidified retention as a major component of the standards-based accountability reform movement This political backing for retention is rooted in a twofold logic. First, the current systems of ed ucation in the United States (U.S.) possess a fatal flawthey socially promote students (advancing them to the next grade level simply because they turn a year older). To correct this flaw, specific performance criteria must be put in place for students to meet to move forward to the next grad e. Failure to meet the performance criteria results in retention. Imbedded in this logic for the need of retention policies is the belief that the threat of repeating a grade level will motivate students to perform their best on the required academic measuresincreasing the performance of all students. Muddling this logic is empirical research. Studies over the past 30 years have consistently shown that teacher retention (e.g., Holmes, 19 89) and retention based on a students level of proficiency on a high-stakes test offer little positive effect for students academic careers (e.g. Roderick & Nagoaka, 2005). While some studies have shown an immediate increase in retained students test scores (e.g., Alexander, Entwisle, & Dauber, 2003; Jacobs & Lefgren, 2004) and an improvement in test scores among those who ac hieve proficiency (e.g., Allensworth, 2005), retention dramatically increases the likelihood that the retained student will leave the education system and continue to perform poorly on these standardized assessments (e.g., Alexander et al., 2003; Allensworth, 2005; Holmes, 1989; Jimerson, Carlson, Rotert, Egeland, & Sroufe, 1997; Meisels, 1992; Perterson, DeGrac ie, & Ayabe, 1987; Reynolds, 1992; Roderick & Nagoaka, 2005; Shepard & Smith, 1986). For instance, Alexander et al. (2003) found the students test scores in their sample increased after retention, but they also found that retaining students significantly increased the likelihood that they will not complete high sch ool. These findings led Alexander et al. (2003) to argue for a more flexible education system that does not have low performing students merely repeat the same grade a second time. However, th ey conclude that the current framing of grade retention within U.S. public schools, which typically has students simply repeat the same grade, offers an early positive but later negative eff ect for these students (p. ix). While these reforms measures produce an uneven set of results, many educational researchers believe that the immediate short-term gains in test scores do not outweigh the l ong-lasting negative effects that result from this intervention (e.g., Roderick & Nagaoka, 2005). This conflict between a logic rooted in not ions of common sense and accountability versus a history of empirical evidence that questions suc h reasoning creates a tenuous policy and research environment--particularly since the opposing sides in this debate of the use of retention both want to improve students academic performance (Cusick, 1992). Amplifying this debate over how to improve students academic performance is the federal governments renewal of the Elementary and Secondary Education Act (ESEA) in 2002, typically referred to as the No Child Left Behind Act (NCLB). While this act does not mandate states that receive Title 1 funding to implement any type of re tention policy, it does require them to have 95% of their students in grade 3 through 8 score at th e proficient level on the state assessments by 2014. These increased academic performance expectations have the potential to influence what types of accountability policies state policymakers might put in place to improve students academic performance. A Case Approach For this case study, I use John Kingdons (2003) multiple streams approach to agenda setting to analyze how education policymakers and stakeholde rs in Wisconsin justified the need to construct
Education Policy Analysis Archives Vol. 8 No. 9 4 and implement the states No Social Promotion statutes as a means to improve students academic performance.2 Through this analysis, I contend that state policymakers implement retention-based policies not to hold students back but rather to instill accountability into the education system, and thus, empirical research that analyzes whether thes e policies improve the retained students academic performance misses the point. Furthermore, this ca se study, like many others (e.g., Roderick, Bryk, Jacob, Easton, & Allensworth, 19 99), demonstrates that these retention policies do achieve many of the policymakers goals by motivating a large urban district to center its resources on improving their students academic performance. A unique feature in this case is that the Wisconsin Legislature and former Republican Governor Tommy Thompson had to amend the states original No Social Promotion (NSP) statutes from a single indicator to a multiple indicator sy stem. This call for change emerged from a set of constituents who typically aligned their views with the Governor and his partys legislators. The debate over amending the statutes did not cente r on retention, but rather, on the issues of local control and a one-size-fits-all approach. In particul ar, state policymakers mandating that local school district personnel use their students test scores on the Wisconsin Knowledge and Concepts Exam (WKCE) to determine whether they would advance from 4th to 5th or 8th to 9th grade. These actions demonstrate that the debate over improving students academic performance through highstakes policies is a political rather than empirical issue. This raises the question as to whether t hose who support or oppose policies such as these should focus their efforts on the agenda setting process rather than effects of such policies. While evaluating a policys effects is important, education stakeholders must pay attention to the politics of policy formulation and offer viable policy alternatives that improve students academic performance if they are to alter the policy agenda. Kingdons Multiple Stream Model This case study of reform can be viewed mi cropolitically (Marshall & Scribner, 1991), as competing arenas (Fowler, 1994; Mazzoni, 1991), a se ries of games (Firestone, 1989), and so on. For this article, I use Kingdons multiple streams model to analyze how policymakers understand the use of retention as a policy lever to eliminate social pr omotion. By bringing their understanding of the policy problem to the forefront, I raise the question as to whether the current emphasis on evaluating the effects of these reforms on students academic performance within education research affects policymakers decisions to implem ent these types of high-stakes policies. For Kingdon (2003), developing policy is a process that includes, at a minimum, the following: the setting of the agenda; specifying alter natives from which a policy choice is to be made; making a choice from the alternatives (i.e., by the president, a governor, or the legislature); and implementing the decision. While this rough outline of the policymaking process seems to follow a lock-step approach, Kingdon does not view policymaking as a linear process that progresses through a series of stages. Rather, Kingdon (2003) concep tualized his multiple streams model to consider why some subjects rise on governmental agendas while others are neglected, and why people in and 2 I presented a version of this paper at the Annual Conference of the American Education Research Association in San Francisco on April 14, 2006.
Examining the Streams of a Retention Policy 5 around government pay serious attention to some al ternatives at the expense of others (p. 196). His concern is not with how policymakers make their fi nal decisions but rather why participants deal with certain issues and neglect others (p. 196). Kingdon (2003) centers his analysis on three expl anations as to how government agendas are set: problems, politics, and visible participants. This agenda setting process evolves out of the coupling of three independently operating streams within the policy process: the problems stream, the policies stream, and the politics stream. Simply put, people recognize problems, they generate proposals for public policy changes, and they engage in such political activities as election campaigns and pressure group lobbying (p. 197). While researchers question whether these separate streams of problems, policies, and politics exist and operate independently within the policy process (e.g., Mucciaroni, 1991), there are times when an opportunity for change arises (e.g., a pre ssing problem, political event, such as an election, or a budget cycle). When what King don (2003) terms a policy window opens, it is an opportunity for advocates of proposals to push their pet solutions, or to push attention to their special problems . .opportunities for action on gi ven initiatives(pp. 173174). It is the policy entrepreneur who couples these streams into a package to address the issue at hand. However, open policy windows do not necessar ily create policy change. It is the role of the policy entrepreneur to take advantage of this open window, or it will be lostwhich means the entrepreneur must wait for the next window (Kingd on, 2003). To take advant age of this window of opportunity, the policy entrepreneur must be persiste nt as well skilled at coupling the solution to the problem and finding policymakers willing to take on their ideas. While an issues chances gain prominence with the coupling of two streams, its chance for success rises significantly when all three streams are coupled together. Policy windows open in the problem stream (e.g., a plane crash) and the political stream (e.g., outcome of an election) Some windows are predictable (e.g., biennial budget cycle) others are not (e.g., natural disaster). Wisconsin as a Test Case In applying this theory of the policymaking process to my investigation into stakeholders understanding of the need for Wisconsins No Social Promotion (NSP) statutes, one finds that the NSP statutes spilled onto the policy agenda th rough the acts of former Governor Tommy Thompson (Republican), a visible participant who take s on an entrepreneurial role within this policy process. With assistance from his administrati on, appointees to various education committees, the Department of Public Instruction (DPI), which is headed by the non-partisan superintendent John Benson, and interests groups, Governor Thompson co upled the problem of social promotion to the political stream through the standards-based acco untability requirements set forth by the federal governments reauthorization of the ESEA in 1994 (known as the Improving American Schools Act ). The Improving American Schools Act (IASA) stated that for states to receive Title 1 funds (the major funding source under ESEA), state po licymakers had to create and implement detailed content and performance standards (by the 199719 98 school year) that were tied to standardsbased assessments in reading and mathstate pol icymakers had until the 20002001 school year to adopt a new system of assessment (Heubert & Ha user, 1999). The law required that schools who received Title 1 funds demonstrate annual yearly progress (AYP) towards the student performance goals set by the states education policymakers (Bidwell, 1996; Goertz, Duffy, & Le Floch, 2001). Title 1 schools that failed to meet these performance expectations were to be designated as being in need of improvement, which meant that they could eventually face corrective action if they did meet
Education Policy Analysis Archives Vol. 8 No. 9 6 state policymakers AYP requirements--including su ch steps as having state or district education officials reconstituting their sc hool (Goertz et al., 2001). While IASA was a predictable policy window, it did not require the state to implement highstakes accountability measures. Rather, Thompson co upled the states retention statutes, which, like most policy solutions, constantly floats in the po licy stream, with a series of additional standardsbased accountability reforms to address a rising concern over the effectiveness of the states education system. This concern emerged from the convergence of varying data sources. One source was the publication of statewide student test results on which the students performed at the average range in all content area except writing where students performed below the national average (Bougie, 1994). A second was a survey released by the Wisconsin Manufacturers and Commerce Association (WMC), which found 61% of the executives in their organization did not believe that the states primary and secondary schools were ad equately preparing children for work after high school (Bergquist, 1994). A third so urce was the release of Education Weeks Quality Counts report in January 1997, which questioned the rigor of Wi sconsins education system. The authors of the report gave Wisconsins public schools low marks across the board. In terms of standards and assessments, the report stated, Wisconsin is no pa cesetter in developing academic standards and gave the state a B(Associated Press, 1997). These concerns over students academic performance were somewhat new to the state. The majority of Wisconsins students have historically performed at the top on numerous national education markers--e.g. the ACT (a college entrance exam), the Scholastic Aptitude Test (SAT), the National Assessment of Educational Progress (NAE P), and a high school graduation rate above the national average (e.g., see WEAC, 2005; Henry, 1993).3 Thompson saw standards-based accountability (SBA) reform as another means to shake up the status quo to improve students academic performance (Mayers, 1995; Thompson, 1996). However, prior to implementing his high-stakes SBA agenda, Thompson, like many governors at that time, took on an entrepreneurial persona towards education reform. Using this persona, Thompson (1996) framed himself as someone who was not part of what he termed the education establishment of government bureaucracy and promoted market-based reforms to change the states education systems (p. 87). Some of his policies were successfulestablishing the Milwaukee Parental Choice Program and the Wisconsin Know ledge and Concepts Exam (WKCE), which was one the first indicators of poor student performance. Other reforms failedattempting to eliminate the position of the State Superintendent of Pu blic Instruction, which the State Supreme Court rejected, and slashing funding for the Department of Public Instruction (DPI) in the 19951997 biennium budget. Either way, Thompson (1996) offe red a constant stream of policy alternatives that shook up the education establishment and softened the state legislature and the electorate in such a way that many of his policy solutions begin to pass through the states most predictable policy window, its biennial budget (Kingdon, 2003). Thompsons success in pushing through the policy window many pieces of his education reform agenda was aided by the fact that Republic ans controlled both houses of the state legislature from 1994 through the 1998 elections, which created a significant force for amending his education 3 In Wisconsin, a dramatic achievement gap exists, particularly in Milwaukee. For instance, Greene, Winters, and Forster (2003), using year 2000 data, rated Wisconsin as having the highest disparity in high school graduation rates between black and white stud ents. Only 40% of black students in WI graduate, compared to a national average of 56 percent; 92% of white WI students graduate, compared to a national average of 78%.
Examining the Streams of a Retention Policy 7 agenda within the state. Unlike the U.S. Congress, the Wisconsin Legislature is, as an administrator from the Department of Administration stated, Ext raordinarily majority-party controlled. There is no filibustering. If youre in the minority party, you have very little influence, and thus, Thompson had ample political support to achieve his education goals. Former Governor Thompson continued to challenge the status quo by working independently from DPI to address the requireme nts put forth by IASA. When Thompson signed legislation to eliminate the Superintendent and fi nancially cripple DPI, he created the Governors Advisory Taskforce on Education and Learning, wh ich worked to formulate educational polices on standards, assessment and accountability.4 Thompson saw high-stakes SBA reforms as the next step in laying a clear plan for greater performa nce and accountability measures for students and schools (Thompson cited in Mayers, 1996, p. A1).5 Benson and DPI, both of whom Thompson a ttempted to eliminate from the reform process, tried to take control of the education agen da setting process by releasing the first of what they hoped to be three drafts of content and perfor mance standards for the states schools in the fall of 1996. The Governors office, through former Lieutenant Governor Scott McCallum, immediately criticized Benson and DPIs work (Karraker, 1996; Wideman, 1996), and political interest groups, such as the Wisconsin Policy Research Institute (WPRI), and a parents group, Parents Raising Educational Standards in Schools (PRESS), questi oned these reforms put forward by Benson and DPI (Brinkman, 1996).6 In his 1997 State of the State message, Thompson offered his own policy alternative to Benson/DPIs work by putting forward a set of content standards,7 reintroducing a proposed a high school graduation test, which he promoted the year before, and called for the elimination of social promotion. The details of these political interactions can become tedious. The primary point is that an escalation in how to respond to this issue of poor student performance emerges between Benson/DPI and Thompson. Both Benson and Thompson portrayed themselves as leaders in education by putting forth ideas that demanded im proved academic performance by all students and a stricter level of accountability. The key political id ea within this political framing of the problem of 4 While Benson was excluded from the Governors Taskforce, he did not disappear from the state education scene; through DPI, he had secured a federal grant to create the content and performance requirements that were put forward by IASA. 5 Thompson also promoted these reforms at the national level. As chairman of the National Governors Association and the Education Commission of the State, he advocated for the establishment of a national clearinghouse on education standards, which became known as Achieve (www.achieve.org), so that stakeholders and the business community can know which states and districts have the best schools and to put pressure on the states that are not doing the job (Thomspon cited in Miller, 1996, p. A1). 6 The WPRI was one of many intere sts groups that the Bradley Foun dation provided funding to (go to http://www.mediatransparency.org) within the state that aligned the organizations conservative agenda (Leverich, 1998). The WPRI issued papers that typically garnered media attention. Advocates representing the WPRI wrote papers promoting issues such as the elimination of the state superintendent, the expansion of the Milwaukee Parental Choice Program, and a pay-for-performance plan for teachers. 7 Thompsons standards were an edit ed version of the Hudson Institutes Modern Red Schoolhouse Standards (Mayers, 1997).
Education Policy Analysis Archives Vol. 8 No. 9 8 poor student performance is not that the state is socially promoting too many kids. Rather, Wisconsins schools are not providing a rigorous educ ation system for their students. This intense debate over the direction of Wisconsins educati on system softened both the legislature and the electorate to the idea that standards-based reform s must be put in place to fix this problem of Wisconsins low performing students (Kingdon, 2003, p. 128). Eventually, Thompson and Benson realized the political chaos that this fragmented process of releasing two sets of standards-based reforms might cause the states local school districts. They settled upon a compromise to pursue the state s standards-based reforms through a committee cochaired by the Lieutenant Governor and Superintendent Benson. In 1998, the State Legislature passed the 1997 1999 biennial budget, which is the primary vehicle for setting the education agenda in Wiscons in. It included Wisconsin Act 237, which put in place Wisconsins Model Academic Standards (WMAS), defining content standards in reading/language arts, math, science, and social studies, the Wisconsin Knowledge and Concepts Exam (WKCE) requirement, the High School Graduation Test (HSGT), and the states No Social Promotion (NSP) statutes. The NSP statutes required all Wisconsin school districts, starting in the 20022003 academic school year, to retain students in grades four and eight if they did not score at least a basic score on the states WKCE, and HSGT was to become the sole determinant for high school graduation (DPI, 2000). While the WMAS eventually garnered a large amount of support at the state and local levels, mixed support existed for the states new perfor mance requirements (Davis, 1998a). The primary concern centered on the issue of using only a stud ents test score to determine whether she is promoted to the next grade level or receives a hi gh school diploma. Conservative white middle-class community-based organizations, such as the Advo cates for Education of Whitefish Bay, schoolbased organizations, such as the Port WashingtonSaukville School Board and the Janesville School Board, and education organizations such as the Wisconsin Education Association Council, the Wisconsin Association of State School Boards, and the Wisconsin Parents and Teachers Association rallied their constituents and lobbied various state legislators to amend the statutes (Davis, 1998b). In the November 1998 election, the Democrats gained control of the State Senate. This altered the structure of who could push policies th rough the states legislative window. In Wisconsin, the State Legislature introduces education legislatio n, typically through appropriation bills. Then, the Governor, using his/her veto power, which includes the line-item veto, can approve or reject the states education legislation. The change in c ontrol of Senate fractured the unified party voice between the Legislative and Executive Branch. So as the voices of dissent over the HSGT and the NSP statutes mounted, this change in the legislative power structure caused state policymakers to reexamine this legislation (Brink man, 1998; Davis, 1998b). While Thompson and his administration initially resisted such changes (Davis, 1998b), the mounting political pressure tipped Thompson towa rds signing the Legislatures budget repair bill on October 4, 1999 to avoid the political fallout that might result from opposing a change to the NSP statutes from his own constituents--e.g., the Advocates for Whitefish Bay (Gladwell, 2000; Kingdon, 2003, p. 161). Amended Statute 118.30 under Wisconsin Act 9 expanded the NSP statutes from a single indicator system to a multiple indi cator system. The burden of adjustment to these policies was now in the hands of the local districts rather than the state policymakers (Kingdon, 2003, p, 110). School districts were to determine gr ade promotion to the 5th and 9th grades on a set of multiple factors, including the students WKCE score, and school districts were to adopt a written policy specifying the criteria that they would use to award a high school diploma, which was to include a students HSGT score (DPI, 2000). Retention was still the result for failing to meet a school districts promotion requirements.
Examining the Streams of a Retention Policy 9 The High School Graduation Test was in a position to remain a part of the states system of accountability, but the departure of Thompson in 2001, a change in administrations in the 2002 election (what Kingdon terms key personnel), and the high cost of the HSGT in a time of budget deficits and social uneasiness over high-stakes re forms led to its eventual demise (Borsuk, 2001).8 This muddled process of pushing Wisconsin s NSP statutes through the policy window results from the coupling of the problem of poor student performance, which became evident through the publication of key indicators and the concerns of constituency groups, with the politics of high expectations and accountability by Thom pson, his administration, and DPI (McLaughlin, 1987). By embedding the NSP statutes in IASAs requirements, which provided a necessary source of funding for Wisconsins public schools, Thomps on was able to push these statutes through the states most predictable window, its biennial budget. However, Thompsons success in pushing the NSP statutes through the policy window met stiff resistance from many of his and the Republicanled Legislatures constituents. Thus, the Legislature responded to critics within the political stream by amending the NSP statutes to a multiple-indic ator retention policy (a pol icy alternative). While Thompson initially resisted such a change, he eventually joined this political bandwagon, and the statutes remain a part of Wisconsins standard s-based accountability policies (Kingdon, 2003, p. 161). Kingdons (2003) agenda setting process is a conc eptual tool that categorizes political actions taken by stakeholders within the policy process. It offers a descriptive and interpretive device to examine how visible actors in the political stream understood the problem of social promotion and justified the need for these states statutes to be pushed through the policy window (Holderness, 1992). Using Kingdons model, I illuminate how po licymakers continue to frame retention policies as a part of the need to hold schools, teachers, and students accountable, and thus, any proposed policy alternative to this issue of correcting social promotion must address these education stakeholders concerns over accountability. Methods The Case The research presented in this article is from an instrumental case study that examined the formulation and implementation of a Wisconsin high-stakes accountability policy at the state and school district level (Stake, 1995; 2000; Yinn, 1994).9 Former Governor Thompson signed Wisconsins NSP statutes into law in 1998. The State Legislature amended them in 1999, and the statutes went into effect during the 20022003 school year. For this article, I focus on how education stakeholders at the state and district level construct the problem of social promotion. Within my intervi ew protocol (Yin, 1989), I asked each participant 8 In this election, Jim Doyle defeated former lieutenant governor Scott Jensen. Jensen took Thompsons position as governor when Thompson left for D. C in 2001. Interestingly, Jim Doyle was the former attorney general who defended the constitutionality of the State Superintendents position when Thompson attempted to eliminate it in 1995. 9 Part of my larger study was funded through th e Wisconsin/Spencer Doctoral Research Program, and I would like to thank that program for its assistance.
Education Policy Analysis Archives Vol. 8 No. 9 10 to describe the origin of the political problem of social promotion within Wisconsin. Furthermore, I had them describe the types of communication and negotiation took place across the various levels of policy formulation and implementation (Rist, 2000). This instrumental case study of high-stakes accountability reform in Wisconsin provides insight into how education stakeholders justif y the relationship between retention and improved students academic performance. Data Generation Data generation for this instrumental case study occurred through interviews of state and district stakeholders between the years of 2002 to 2004 (n=39) and the analysis of political documents related to the state and district policies. The chosen district is a large urban district with almost 25,000 students, which 40% of that population identifying themselves from nonAnglo/European cultures. The interviewees included policymakers, state administrators, government advisors, representatives from state-based political organi zations, district school board members, and district administrators to ensure a valid and reliable case study. (See Table 1 for a description of study participants.) Archival documents included th e NSP legislation from both the 199798 and 1999 legislative sessions; documents generated by the Depa rtment of Public Instruction that focus on this policy (e.g., DPI, 2000); district documents pert aining to the 4th and 8th grade summer school program (e.g., handouts pertaining to the promotio n policies given at the districts Performance and Achievement meetings); the reporting mechanisms that communicate both the existence of the accountability program and its implementation for an individual student (i.e., letters that inform parents of the 4th and 8th grade testing program, report cards, etc); district-level data that examine 8th grade students report card performance an d WKCE performance in relation to student attendance, school, race, ethnicity, income, disabili ty, and English language learner status.; position papers put forward by state agencies, such as th e Legislative Fiscal Bureau; position papers put forward by the state based political organizati ons, such as the Wisconsin Education Association Council; public records, such as testimony from the Senate and Assembly Education Committee hearings on re-writing the NSP statutes, and newspa per articles that examined the formulation and implementation of these policies. Table 1 Informants Participant category N State actors Legislators 6 DPI staff 9 Blue Ribbon Education Panel members 2 Department of Administration, Joint Legislative Council, and Legislative Refere nce Bureau staff 5 State based political orga nization representatives 5 Local actors District-based advocacy group 2 School board members 3 District supervisory st aff and management 6 Parents 1
Examining the Streams of a Retention Policy 11 Data Analysis I employed the following qualitative methods to analyze my data (Emerson, Fretz, & Shaw, 1995; Erikson, 1986; Denzin & Lincoln, 2003; Graue & Walsh, 1998; Strauss, 1996; Wolcott, 1994). After reading the interview transcripts and policy documents twice to identify relevant themes in the data, I then coded the transcripts using both external and internal codes (Graue & Walsh, 1998). Themes came from the relevant data and were read against the text in search of contradictory evidence (Miles & Huberman, 1994; Strauss, 1996; Wol cott, 1994). With these themes, I created a research text that outlined the data according to these themes, which include references to quotes and notes that supported and challenged my initial understanding of this case (Denzin & Lincoln, 2003; Miles & Huberman, 1994). This interpretive do cument that represents the final understanding of how Kingdons multiple streams (2003) intera ct to foster the policy solution of retention as a means to improve students academic performan ce (Denzin & Lincoln, 2003; Eisner, 1991). Analysis Policymakers Justification for Ne eding Wisconsins NSP Statutes In this case of a set of retention statutes, the federal governments IASA opened the policy window, and the NSP statutes were attached as part of the states standards-based reforms. These statutes did not arise from a critical incident and as former assistant superintendent at DPI remarked, the state did not have data to deter mine whether social promotion was occurring or not. Rather, as a former Democratic Sena tor who sat on the Senate Education committee mentioned, these statutes piggy-backe d on to the other SBA reforms. In analyzing the need for these reforms to be on the agenda to standardize the states systems of education, the problem stream is defined differently by the positionality of the stakeholder (Stone, 2002). As Kingdon (2003) and others (e.g., Mazzoni, 1993) point out, it is typically the executive and the legislat ive branch that set the agenda. Thompsonthe policy entrepreneurframed these standards-based accountability reforms as a means to position Wisconsin as an educational leaderthe problem being poor student performance. For instance, he stated, If you wa nt Wisconsin to leadto be No. 1the standards are going to allow us to get there, and the high school graduation test is going to show that we've arrived" (quoted in Jones, 1997, p. B5). Thomps on put forth the idea that by holding students accountable for their performance student achiev ement would improve. As former member of Thompsons Advisory Taskforce on Education and Learning stated, Thompsons big goal was accountability. Embedded within this need fo r accountability, the former Governor thought catching low performance early would pay off for the state and student in the end. For instance, Kevin Keane, Thompsons executive assistant, asserted that: The test is a strong measur e of where a child is at. It lays out what you should know and whether you know it or not. Thompson thin ks it makes common sense to catch children as early as possible. We have a lot of research that shows passing kids along when they dont know th e material is very harmful. Thats how kids who graduate from hi gh school who are illiterate. And then what happens is they cant get a job and they end up ge tting involved in crime and living in poverty (quoted in Shepard, 1998, p. A1).
Education Policy Analysis Archives Vol. 8 No. 9 12 Thompson and Keane frame their policy solution as a logical consequence for students who do not possess the skills necessary to succeed at the next level. Retention will help the student and the state. However, in Keanes justification for these policies, he states that the research demonstrates that socially promot ing students is harmful. Beside s there not being any state data to back this claim up, this statement runs coun ter to most of the empi rical studies that were conducted up until that time, which demonstrate th at retention, not social promotion, increase the likelihood a stud ent will drop-out (e.g., Holm es, 1989; Jimerson, Carlson, Rotert, Egeland, & Sroufe, 1997; Perterson, DeGracie, & Ayabe, 1987; Shepard & Smit h, 1986). These statements demonstrate how the Thomps on administration framed this debate over improving students academic performance throug h common-sense rather than empirical data. As Kingdon (2003) points out, policymakers use empirical work to generate support for their ideas in the political stream when it suits their needs. In this case, the reporter talking with Keane would have to know a genre of research that many peopl e outside the education establishment do not to be able to question Keane about his statement. The power of this political rhetoric exemplifies the burden that exists for those who produce research re sults that run counter to the political framing of the policy problem of education. No matter Keanes understanding of the policy problem or expectations of the results that the Thompson administrations policy solutions would provide, many legislators saw the passage of Wisconsins high-stakes NSP statutes as aftert hought. For instance, the Democratic Senator I mention in the above stated, The issue of eliminating social promotion by making the test be the sole factor for determining a childs prom otion or retention really happened in the blink of an eye. This legislation was part of a larger policy solution to impr ove Wisconsins schools through defining rigorous content and expecting high perf ormance by all. This Se nator (as well as other legislators, bureaucrats, and constituent groups)10 saw the states SBA refo rms coming out of . A national movement that Wisconsin was just asked to come on board with. For Governor Thompson, a national figure am ong the governors, this was one of his issues of interest. Certai nly, when you disaggregat e the data and look at particularly children in scho ol districts that have a high proportion of families in poverty, Wisconsin could do better. Those scores were always significantly below that of the statewide average, and I thin k that may have been another reason for the standards. nd the business community and th e issue of economic development and having a work force which is literate and educated and the idea there that standards should be set. According to this Senator, Th ompson fostered the need for accountability measures within Wisconsin through coupling numerous political di scourses circulating within the policy and politics streams at the st ate and national level. Adding to this idea of political positioning and the states retention policies, I found that ones relationship with the former Governor and his or her belief in the power of high-stakes 10 For instance, a former administrator in the De partment of Administr ations stated, Thompson wasnt any different than mo st governors throughout the country. He was following the standard party line-the National Governors Association and other Republican governors who were making the same policies. Its a very textbook example. Texas had already had these in place. Florida was looking at it. Wisconsin was not that radically different.
Examining the Streams of a Retention Policy 13 policies directly affected how the policymaker just ified the need for these reforms (Spector & Kitsuse, 1987). For instance, another Democr atic Senator who sat on the Senate education committee saw these statutes comi ng out of a culture that saw improving students academic performance through testing kids to death. A Republican Assemblyperson who sits on the Assemblys Committee on Education Reform saw thes e statutes as a way to ensure the state was getting its bang for the buck on education. Moving away from political positioning and par ty loyalty, other legislators tied this problem of social promotion to the concerns of local constituents. For instance, a Republican Assemblyperson who sits on the Assemblys Committee on Education and the Committee on Education Reform stated that, We had heard a lot of anec dotal stories from teachers and parents. There was a sense of frustration that we have children being promoted simply to get them out of the grade and on to the next one. Teachers dont wa nt to deal with them any morebe it a difficult student, troubl emaker, etc. So we did implement the No Social Promotion statutes to get at that, and othe r states have done that too. For this Assemblyperson, feedback from his/her constituents highlighted the fact that students were just passing through the system because teachers di d not want to deal with them any more. This anecdotal reasoning, which feeds into the problem stream, defines the problem of poor student performance as result of social promotion, and th us, the system requires policies that hold students accountable for their learning. Another Republican Assemblyperson, who also sits on the Assemblys Committee on Education, elaborated on this public concern ov er a broken education system. The Assemblyperson commented, People were concerned that boys and girls couldnt read. That when they got out of high school, the diploma meant nothing. They werent ready to go to college, they werent ready to get a job, and so it became pres sure from the ou tside of the education arena that weve got to have some standards to hold people accountable because nobody is holding anybody accountable for anything. The kids are just going throug h the motions--going to class, getting a diploma, and not learning anything. Not only were stakeholders concerned that stud ents werent ready, these legislators saw having high standards and stakes in place as a me ans to insert accountability into the education process and to increase the value of Wisconsins education system. Accountability tightens the education system, and in doing so a student will not be allowe d to go through the motions. These increased performance expectations would address the probl em of poor student performance, and imbedded within this policy solution was the belief that improved student performance would raise the economic and soci al value of Wisconsins education system. Increasing the economic value would assist th e governor and state policymakers in luring business to the state, and these reforms would enhance their social valu e by demonstrating to constituents that the states systems of ed ucation ensured students would exhibit their knowledge and skills before they rece ived a high school diploma. Eliminating social promotion provided these policymakers with a visible political symbol that demonstrates their commitment to improving students academic performance. In essence, retention is a byproduct of the policy and politics of increased accountability. It is not the primary component within either stream, but its presence symbolizes how policymakers create an education system that holds students accountable fo r learning (Kingdon, 2003, p. 97). In talking with legislators and members of Thompsons administration, no one saw the goal of these statutes to be retaining students. Rather, as the Republican Assemblyperson whom I just
Education Policy Analysis Archives Vol. 8 No. 9 14 cited in the above commented that the goal is to identify failure and correct it. The Assemblyperson stated: The goal is not to hold kids back. The go al is to make sure that we teach them what they need to know, and they know it so they can move forward. Its not a vindictive thing. Its a thing thats saying this is where are ou r weak spots are and where we need to improve. We cant contin ue to fail. Kids ge t one chance at this game, and if they mess up, they could be lost for thei r lifetime. As a state, we cant afford that. This Assembly members comments illuminate th e complexity that exists within this debate about how best to improve students academic performance. This assemblyperson saw these policies injecting accoun tability into the syst em. Educators will align their practices with policymakers SBA reforms so that students attain a particular set of skills and knowledge. While there are similarities to the minimal compet ency movement of the early 1980s (e.g., see Archbald and Porter, 1990; Baker and Stites 1990), SBA reforms expect that all students will perform at a high level. Such a framing of education is hard to counter in the agen da setting process, and because the issue of retention ha s always been present in the pol icy stream, concern over a highstakes test that could retain students did not surface to the top of th e political rhetoric in Wisconsin until these policies we re implemented (Kingdon, 2003). These statements demonstra te how the issue of accountability is present in state policymakers framing of the three streams in th e agenda setting process. The problem of poor student performance is the result of school pers onnel not holding their students accountable for their work, and thus, accountability policies need to be put into the states education systems. Politically, by putting forward an image of high standards and accountability, policymakers address stakeholders concerns over students academic performance (Elmore, 1996). Thompsons policy solution coupled the problem and political streams, and intertwined together, he provided a reform agenda for state policymakers that spoke to stakeholders concerns over students academic performance, social promotion, and the states ineffective education systems. Viewing the need for the NSP statutes at the level of implementation While Kingdon (2003) points out that it is bureaucrats who typically concern themselves with the implementation of a policy, the educatio n policy process at the state level adds another layerthe school district (p. 31). As I state in the above, I interviewed school board members and district administrators in a large urban district in Wisconsin, which is referred to as the District hereafter, to understand how school district personne l understand Kindgons streams of the agenda setting process--the problem of social promotion, the need for a policy, and the politics that shaped the process. Using Kingdons streams as a guide, I turn to their comments about the NSP statutes to provide insight into how these stakeholders for whom these policies addressed interpret the problem of social promotion and the effects of the states statutes. While this analysis does not feed into Kingdons agenda setting process per se, it does illuminate how the Thompson Administrations SBA reforms make it difficult for the local school districts in Wisconsin to alter the states agenda for reform. To begin, the implementation of a single -indicator promotion policy caused District administrators to question whether state policymaker s understood the empirical contradictions that existed within their policy solution of retention. School board member #1s comments exemplify this concern.
Examining the Streams of a Retention Policy 15 I think that the social promotion issue is one of those feel-good policies from the state and federal level but has little basis in research or reality. It is policy by fiat, and its a bunch of people who havent the slightest idea of what really happens in schools or classrooms wh o are deciding that this so unds like a good idea to pursue. This statement reflects the disconnect that exis ts between the agenda setting process and the reality that exists at the school level. This District administ rator does not believe that the legislators who formulated the NSP statutes unde rstood how such reforms affect the classroom. According to this school boar d member, if policymakers did, the statutes would not exist.11 School board members and other District personnel wondered whether th e states politicians recognized the negative impact that would result fr om implementing a single indicator accountability system.12 A District administrator from the department research and evaluation stated, Anybody who knows anything about assessment would tell you fl at out, dont use a single test score from a single date to make that decision. Morally, thats just wrong. These references to the research on retention and the use of a single indicator promotion system were common among District personnel. This in part is due to the roles of the policymaker and the district personnel. The policymaker has to put forward an image of acco untability to demonstrate that he or she is addressing the policy problem.13 While on the other hand, district personnel have to implement this policy solution and negotiate its requirements with th e needs of the retained students, their families, their teachers, and so on. The effects of these policies are very different for the policymaker and for the district personnel, and it causes one to question whether the empirical research that examines the effects of retaining students is of value to the state policymakers. Raising the question as to whether empirical research addresses the needs of each stakeholder in the reform process. Politics at the state level are different from th e realities that district personnel face on a daily basis, and as such, district personnel are not pick ing policy solutions that align with evaluation research. Rather, they are implementing policy changes that the state policymakers frame as the solution to the problem, which in this instance do not align with it is known about the overall negative effect of retention a students academic career. Although District administrators questione d the merit of these state reforms, they did recognize the politics that are woven into this process of reform. School board member #2s statements exemplify this understanding of the a ssumptive worlds in which the politics of reform play out (Marshall, Mitchell, & Wirt, 1986). 11 This includes policymakers at the state level as well. For instance, when discussing high-stakes testing, a Democratic senator who sits on the Senates Committee on Education stated, The biggest problem is youve got policy being made by legislators who have never been in a classroom, aside from a photo-op, in years. They have no idea whats going on. It just sounds really good. But its not practical and its not really living in reality. 12 For instance, school member #2 stated Theres no study that I know of that indicates a positive in holding young people behind. In fact, if you start holding them behind, theres a whole bunch of not only academic but social kind of things that obviously would occur. 13 To clarify, many current and former members of Wisconsins Department of Public Instruction publicly questioned the use of a single-indicator prom otion/high school graduation system (e.g., Cook, 2001). For instance, DPI had representatives from CTB McGraw testify in front of Legislators, stating that they did not design the WKCE tests to make a decision about the promotion of a student.
Education Policy Analysis Archives Vol. 8 No. 9 16 Most issues that deal with education you got the political side, which is simplistic. The simplistic things that most people wo uld agree on are that we shouldnt pass kids if theyre not proficie nt. The issue is how do we then get them all to be proficient? Is the solution just not passing them? Well it could be. Thats an easy solution. Then what do we do with a 15year-old 6th grader? Were not going to do anything with them because we know theyre going to drop out, and then thats a whole series of other social sp in-offs that occur from a well-intended policy. These statutes are simplistic in their implementation and in their general focus. This school board members comme nts get at the heart of the co mplexity of education reform. It is easier for state po licymakers to couple th e streams of reform by claiming that the state legislature is going to raise students academic performance by holding students accountable. However, such rhetoric fails to take into account the effects of such polici es on students do not meet these new performa nce requirements once they pass through the policy window (Fuhrman & Elmore, 1990). State policymaker s frame these policies politically as an issue of accountability, and so if a student does not succeed, the cons equence of retention make s sense. However, the retained student raises a set of new issues for the local school district that the states policymakers did not addres s in the NSP statutes. According to these District actors, the policymakers who formulated the states NSP statutes failed to examine what the educational establishment knew about the effects of retention, and in turn, they created a political environment in which District administrators questioned the integrity of the Legislatures education reforms. These admini strators thought that the state policymakers promotion statutes reflected a simple political solution to the problem of poor student performancethe threat of failure would motivate students to work harder. Yet, it was the state legislatures actions that jump started the District personnel into creating intervention programs to address the probl em of students academic performance in grades 4 and 8 (Spillane, 1999). The reforms forced the District to question how it serviced its students. As school board member #1 states, The statutes pu t the responsibility on the teacher to really take account of children who are not doing well. Th is school board members comments touch on the primary concern of many of the state politiciansteachers being held accountable for all their students. School board member #2 extends this idea to the entire district. This member states, If you look at the 4th and 8th grade prom otion, youve got to address that. No district wants to have a large number of children that theyre holding behind. The public would not be very to lerant if I told you 30% of our kids are not going to move on to 5th grade. With these state stat utes in place, District personnel had to examine their current practices and then implement a strategy that addresses the needs of all students. These District stakeholders recognized that if they failed to ready students for promotion that high er failure rates would cause create a different problem --political shame. While the st udent carries th e brunt of the failure through retention, that childs failure also tarnishes the image of the District. This risk of failure caused the District to be accountable for all of its students. The states reforms made District administrato rs examine what the policymakers were asking the Districts teachers to do. In essence, these po licies achieved state policymakers goal. Educators within the District had to begin to align policy, curricula, and teaching to ensure that students would advance to the next grade level. Even though Di strict administrators, such as school board member #2, saw the NSP statutes dictating certain things that have to be done, which in turn limit the Districts priorities, the retention policies focused District personnel on ensuring that students met the Districts promotion requirements.
Examining the Streams of a Retention Policy 17 From a policy perspective, the NSP statutes ca used District personnel to center their efforts on the issue of accountability. District stakeholders picked up the states agenda, which defined the problem of students academic performance through the lens of accountability, and began to focus their efforts on improving students academic pe rformance in the promotion grades. Politically, failure to address the states agenda would have created new problems for District personnel. Thus, the states policymakers reset the districts agenda. I now turn to what this means in terms of altering the education reform agenda within contexts similar to Wisconsin. Discussion Kingdons model, while not flawless, provides order and structure to the unpredictable process of how policies become part of the agen da and move through an open policy window. In this case of eliminating social promotion from the state of Wisconsin, the federal governments IASA opened the policy window for Wisconsins poli cymakers. While this federal policy provided a basic structure to the policy itself, the politics surrounding Wisconsins education system extended those details, and in fact, policymakers expanded the performance expectations for students more than the federal policy requiredadding the HSGT and NSP statutes. Furthermore, the problem of inadequate student performance was not an issue of social promotion, but rather, a range of constituency groups and indicators questioned the effectiveness of the states K-12 education systems. The coupling of standards-based reforms, the politics of accountability, and the problem of inadequate student performance allowed Thompson to push the states NSP statutes through the window and onto Wisconsins legislative books. While the statutes were altered to make an empirically appropriate decision at the local level, the issue of social promotion and the intervention of retention remained (American Educational Re search Association, 2000; Heubert & Hauser, 1999). The analysis here has outlined how stakeholders at the state and district level understood the problem of social promotion and what effects re sulted from these statutes. In essence, state policymakers saw these statutes addressing the n eed to demonstrate that Wisconsins education system was one of the best in the country, and they saw instilling a sense of accountability through the NSP statutes as means to foster this imag ethe problem was political and practical. These statutes would end the practice of passing students through the system simply because they turn a year older and force school personnel to address the academic needs of their unsuccessful learners. Policymakers did not see these policies as means to punish those who fail, but rather, as tool to focus educators on improving the skills and knowledge of all their students. This framing of retention is conceptually differe nt from other studies in which stakeholders view retention as an effective intervention (e.g., Byrnes, 1989; Jacob, St one, & Roderick., 2004; Tompchin & Impara, 1992). In this case, the visibl e actors at the state level define the central problem being the improvement of students acad emic performance on a systems level, not an individual level. Retention is a byproduct from instilling accountability into the education system. The individual who fails due to these statutes is no t the problem. Rather, that individual is the result of a successful system of accountabilitythe reta ined individual demonstrates that the system works. The failure of the education system correct s itself through failing the individual. Without the retained students, the system opens itself up for questioning, and thus, eliminating social promotion becomes an issue of quality control. This case study also demonstrates that the ac tions of the District answered the call by state policymakers to alter their education agenda. The Districts education services were modified (e.g., the creation of a 4th and 8th grade summer program fo r students who fail to meet the initial criteria
Education Policy Analysis Archives Vol. 8 No. 9 18 for promotion set by the District) and District admini strators realigned their goals to reflect the state policymakers reform agenda. While District administrators questioned policymakers understanding of the problem of poor student performance and the use of retention as a policy solution, they recognized that public shame that could come from high rates of retention and aligned their practices to the objectives set fo rth by the state statutes. This case adds to the discussion over the elim ination of social promotion by highlighting how the rise of these NSP statutes onto Wisconsin s education agenda was a political process that centered on fixing the problem of students ac ademic performance by adding accountability measures to the education system. The issue of the effectiveness of these reforms that education researchers concern themselves within their empiri cal work (i.e., improving the performance of the retained students) was not present within how state stakeholders set the education reform agenda. Thus, as the education community continues to prom ote particular education services at the state and local level to improve students academic perfor mance, it must move beyond the issue of what works and address all of Kingdons (2003) streams in the agenda setting process. Implications This case demonstrates how the formulation and implementation of high-stakes accountability policies that attempt to eliminate such things as social promotion go beyond the issue of program or policy effectiveness. Education stake holders must be cognizant of how the legislative and executive branches of government (the agenda-setters) define the policy problem, the policy ideas that exist in the primeval soup, and the po litics that surround the issue of improved student performance. In this case, as with many education reform s, the stakeholders who set the policy agenda framed the system as the primary problem, and as in mo st political incidents, it is much easier to link a policy to the issue of accountability and system fa ilure rather than the performance of individual students. The problem within these streams of the reform process is not retaining students. It is addressing poor student performance, which polic ies such as the NSP statutes do with visible sanctions. In terms of the policy stream, many policymakers, educators, and families believe that a policy solution that requires low performing students to repeat a grade can give them the time they need to raise their skills and knowledge so that th ey are prepared for future grade levels (Byrnes, 1989; Jacob et al., 2004; Tompchin & Impara, 1992). Retaining poor performing students to improve their academic skills and abilities has been a part of the grammar of the American system (Tyack & Tobin, 1994) for decades (without or without legislation), and most policymakers, educators, and parents are comfortable with it (S mith & Shepard, 1987; Tomchin & Impara, 1992). Standardizing the policy of retention across contexts succeeds because it is merely reconfigures an idea that the populace understands (Kingdon, 2003). Unless a significant proportion of a districts or states students are retained, which would create a focusing event on the negative effects of such policies, it is highly unlikely that this issue woul d become part of the states policymakers immediate agenda. In this case, the retention rates of Wi sconsins fourth grade students following the implementation of the NSP statutes slightly incr eased from .32% (200 out of 63,482 students) during the 20012002 school year to 0.54% (334 out of 61, 717 students) during the 20032004 school year, and for the states eighth grade stud ents, the retention rate decreased from 1.17% (782 out of 66,501 students) during the 20012002 sc hool year to .79% (543 out of 68,586 students) during the 20032004 school year (DPI, 2004).
Examining the Streams of a Retention Policy 19 In fact, as NCLB increases its annual academic performance requirements, more students in Wisconsin and across the United States will be iden tified as failing (Linn, 2003), and with the opening of another policy window as federal poli cymakers renew ESEA in 2007, lower proficiency rates will only reinforce the political need to in crease accountability, which could lead to an expansion of retention policies. This case also demonstrates how the formulation and implementation of high-stakes accountability policies that attempt to eliminate such things as social promotion go beyond the issue of program or policy effectiveness. Evaluation is a part of the policy process, and this type of participation is typical for academic researchers (Kingdon, 2003). Over the course of setting the policy agenda, the short-term impact of research is lim ited, but in the long-term, its influence can be considerable (p. 56). However, in this case of retention, the existence of counter empirical studies that support the use of this intervention to impr ove students academic performance can cause one to view the discussions among academics over the effectiveness of retention as a political debate rather than empirical exercise. Nevertheless, the states retention policies provide the states policymakers with a short-term political symbol of concern that demonstrates their effort to improve the states education systems. The immedi ate gain of increased student test scores that retention policies offer (e.g., Jacobs & Lefgren, 2004; Alexander, Entwisle, & Dauber, 2003) reinforce the need for this policy solution. Retaining poor performing students also en sures that any new problems over academic performance for these students will not arise beca use they cannot advance in the system until they can pass the statutes requirements. Therefore, the short-term versus long term effects of this intervention make it difficult for academic resear chers to provide policymakers with a definitive answer about the effectiveness of this type of refo rm in improving students academic performance. In fact, the compactness of the political cycle fo r policymakers as compared to the length of students academic careers makes the immediate impact that this policy solution offers more attractive than long-term or costly reforms. To change the agenda of policies such as the NSP statutes is difficult. Kingdon (2003) points out that the most common methods to alter the agenda result from a focusing event (e.g., an extremely high number of retained students) or a change in administrations. In Wisconsin, retention rates remain low, and although administrations ha ve changed in the Legislature and the Executive branch, this low impact and politically attractive reform remains a part of the education system. Moreover, putting forth a technically feasible alterna tive that addresses accountability and stimulates improved student performance typically costs a dditional money for materials and training of instructional programs or for intervention services such as summer school or prekindergarten (e.g., Darling-Hammond, 1998: McCay, 2001; McCoy an d Reynolds, 1999; U. S. Department of Education, 1999). In Wisconsin, the various consti tuency groups favored local (e.g., the amending of the NSP statutes) and inexpensive reform (e.g., th e elimination of the HSGT)--making any type of change to the education system politically difficu lt. While retention does cost the state and school district the price of another year of school for the r etained student, that cost is hidden through funding formulas based on student enrollment (Rod erick & Nagaoka, 2005). Additionally, with the student retention rates in Wisconsin remaining constant through the implementation of the NSP statutes, it is very difficult to demonstrate an increased cost on the local school district. The question becomes, can empirical research alter the agenda setting process? In Wisconsin, disruptions across the three streams of the agenda setting process did alter, but not eliminate, the states retention statutes. Politica lly, the Senate leadership switched parties and important constituent groups in and outside government raised enough concerns to cause policymakers to revisit the issue. These constitu ent groups offered policymakers a viable policy alternative that addressed the problem of accountability.
Education Policy Analysis Archives Vol. 8 No. 9 20 If education researchers and stakeholders are to influence policy, they must continue to inform policymakers and the public of the longterm positive and negative effects of education reforms. At the same time, they must continue to put policy alternatives into the policy stream that address the issue of accountability in a low-cost and unobtrusive manner. Furthermore, researchers must understand how policy stakeholders across th e various streams of reform frame the problem, which will have a direct impact on the questions researchers should be asking. Understanding the political environment is of the utmost importance. Researchers must ensure that they present their work in such a way th at stakeholders across the streams and political parties can access their work. Politically, educati on stakeholders must also demonstrate how their policy alternative addresses the concerns of policym akers constituents. Thus, having data about the effects of current reforms available, putting achi evable policy alternatives into the policy stream, understanding the various interpretations of the problem, and addressing policymakers political needs in a language that they understand is necessa ry to affect the agenda setting process. Ignoring any of the streams that Kingdon (2003) identifies as part of the agenda setting process will only ensure that the agenda will not be changed. References Alexander, K. L., Entwisle, D. R., & Dauber, S. L. (2003). On the success of failure: A reassessment of the effects of re tention in the primary grades (2nd ed.). Cambridge: Cambridge University Press. Allensworth, E. A. (2005). Dropout rates after hi gh-stakes testing in elem entary school: A study of the contradictory effects of Chicago s efforts to end social promotion. Educational Evaluation and Policy Analysis, 27 341364. American Educational Research Association (2000). AERA position statement concerning high stakes testing in pre-K-12 education Washington, DC: American Educational Research Association. Archbald, D. A., & Porter, A. C. (1990). A retrospective and analysis of roles of mandated testing in education reform Washington, D. C.: Office of Technology Assessment. Associated Press (1997, January 18). Wisconsin schools nothing special, report says. The Capital Times p. A2. Baker, E. L., & Stites, R. (1990). Trends in test ing in the USA. In S. H. Fuhrman and B. Malen (Eds.) The politics of c urriculum and testing (pp. 139157). New York: The Falmer Press. Bergquist, L. (1994, December 14). Public schools fail in employer survey. Milwaukee Journal Sentinel p. A8. Bidwell, C. E. (1996). What sociologist know: Res ponse and rejoinder. In K. M. Borman, P. W. Cookson, Jr., A. R. Sadovnik, & J. Z. Spade (Eds.) Implementing Educational Reform: Sociological Perspectiv es on Education Policy (pp. 2031). Norwood, NJ: Ablex Publishers.
Examining the Streams of a Retention Policy 21 Borsuk, A. J. (2001, May 21). Budget gap may clai m testing: Foes think gr aduation exam will be low priority for the state. Milwaukee Journal Sentinel p. A1. Bougie, D. A., (1994). On statewide achiev ement tests Wisconsin students show mixed performance. Education Forward, 12 (2) Brinkman, P. (1996, September 24). Giving educati on a guideline: Propo sed standards would aim to improve school accountability. Wisconsin State Journal p. B1. Brinkman, P. (1998, December 25). Darling se eks softer legislation on schools social promotion. Wisconsin State Journal C3. Byrnes, D. (1989). Attitudes of st udents, parents, and educators toward repeating a grade. In L. S. Shepard & M. L. Smith (Eds.) Flunking grades: research and policies on retention (pp. 108131). New York: Falmer Press. Christians, C. G. (2000). Ethics and politics in qualitative resear ch. In N. Denzin & Y. Lincoln (Eds .) The Handbook of Qu alitative Research (pp. 133155). Thousa nd Oaks, CA: Sage Publications. Clinton, W. J. (1998). Helping schools end soci al promotions: Memorandum for the Secretary of Education. Retrieved Se ptember 12, 2003, from http://www.ed.gov/pubs/soci alpromotion/directive.html Cook, H. G. (2001, March 11). Testing, testing: Te sting is just one part of educational analysis. Milwaukee Journal Sentinel p. J1. Cusick, P. A. (1992). The Educational System: Its Nature and Logic New York: McGraw-Hill. Datnow, A., & Sutherland, S. ( 2002). The politics of researchin g comprehensive school reform. Peabody Journal of Education, 77, 167188. Darling-Hammond, L. (1998). Alte rnatives to grade retention. The School Administrator, 55 18 21. Davis, A. (1998a, June, 22). La w on social promotion stirs deba te: Backers say it will improve academic performance; foes fear kids will suffer. Milwaukee Journal Sentinel p. B1. Davis, A. (1998b, December 28). Legislators to rethink school testing law: Measure to end social promotions emphasizes one test score, critics say. Milwaukee Journal Sentinel p. A1. Denzin, N. K., & Lincoln, Y. S. (2003). The discipline and practice of qualitative research. In N. K. Denzin and Y. S. Lincoln (Eds.). Collecting and Interpreting Qualitative Materials (2nd ed., pp.145). Thousand Oaks, CA: SAGE Publications. Department of Public Instructio n (2000). Suggestions for local sc hool boards in approaching the development of high school graduation and fourth/eighth grade advancement policies:
Education Policy Analysis Archives Vol. 8 No. 9 22 Implementing the provisions of 1999 Wisc onsin Act 9. Madison, WI: Department of Public Instruction. Department of Public Instruct ion (2004). WINNS successful sc hool guide: What percent of students did not advance to the next grade level? Retr ieved November 20, 2005, from http://data.dpi.state.wi.us/data/gra phshell.asp?fullkey= ZZZZZZZZZZZZ&DN=Non e+Chosen&SN=None+Chosen&TypeCod e=0&ORGLEVEL=ST&GRAPHFILE=RE TENTSCH Eisner, E. W. (1991). The enlightened eye: Qualitative inquiry and the enhancement of educational practice. New York: Macmillan. Elmore, R. F. (1996). Getting to sc ale with good educational practice. Harvard Educational Review66 126. Emerson, R. M., Fretz, R. I., & Shaw, L. L. (1995). Writing ethnographic fieldnotes Chicago: The University of Chicago Press. Erikson, F. (1986). Qualitativ e methods in research on teaching. In M. Whittrock (Ed.), Handbook on research on teaching (pp. 119161). Chicago: Macmillan. Firestone, W. A., & Schorr, R. Y. (2004). Introduction. In W. A. Firestone, R. Y. Schorr, & L. F. Monfils (Eds.), The Ambiguity of teaching to t he test: standards, assessment, and educational reform (pp. 117). Mahwah, NJ: Lawrence Erlbaum Associates. Fowler, F. C. (1994). Education reform comes to Ohio: An applicatio n of Mazzonis arena model. Educational Evaluation and Policy Analysis, 16 335350. Fuhrman, S. H., & Elmore, R. F. (1990). Understand ing local control in the wake of state education reform. Educational Evaluation and Policy Analysis 12 8296. Gladwell, M. (2000). The tipping point: How little th ings can make a big difference Boston: Little, Brown. Goertz, M. E., & Duffy, M. C., Le Floch, K. C. (2001). Assessment and account ability across the 50 states: 19992000 Philadelphia: Consortium for Po licy Research in Education. Graue, M. E., & Walsh, D. J. (1998). Studying children in context: Theories, methods, and ethics Thousand Oaks, CA: SAGE Publications. Greene, J. P., Winters, M. A., & Forster, G. F. (2003, February). Testing High Stak es Tests: Can We Believe the Results of Ac countability Tests? Civic Re port, 33. Retrieved September 2, 2003, from http://www.manhattaninsti tute.org/html/cr_33.htm Heubert, J. P., & Hauser R. M. (Eds.) (1999). High stakes: Testing for tracking, promotion, and graduation Washington, DC: National Academy Press. Henry, T. (1993, September 10). Ten states that do best at educating. Milwaukee Journal Sentinel p. D1.
Examining the Streams of a Retention Policy 23 Holderness, S. T. (1992). The politics of stat e educational policymaking: Usefulness of the Kingdon model. In F. C. Wendel (Ed.), Issues of professional pr eparation and practice (pp. 1731). University Park, PA: University Council for Educatio nal Administration. Holmes, C. T., (1989). Grade level retention effects: A me ta-analysis of research studies. In L. S. Shepard & M. L. Smith (Eds.) Flunking grades: research an d policies on retention (pp. 16 33). New York: Falmer Press. Jacobs, B. A., & Lefgren, L. (200 4). Remedial education and stud ent achievement: A regressiondiscontinuity analysis. The Review of Economics and Statistics, 86 226244. Jacob, R. T., Stone, S. & Roderick, M. (2004). Ending social pr omotion: The response of teachers and students Chicago: Consortium on Chicago School Research. Jimerson, S., Carlson, E., Rotert, M., Egeland, B., & Sroufe, L. A. (1997). A prospective, longitudinal study of the correlates and consequences of earl y grade retention. Journal of School Psychology, 35 335. Jones, R. P. (1997, December 12). Standards must be measur able, Darling says: Lawmaker suggests standards are incomplete, need clarification. Milwaukee Journal Sentinel p. B5. Karraker, L. (1996, De cember 11). Lt. Gov. McCallum leads the fight. Racine Journal Times p. A1. Kingdon, J. W. (2003). Agendas, alternatives, and public policies (2nd ed.). New York: Longman. Leverich, J. (1998). Anatomy of a moveme nt. Retrieved Septem ber 12, 2004, from http://www.weac.org/Resource /1998-99/nov98/anatomy.htm Linn, R. L. (2003). Accountability: Resp onsibility and reason able expectations. Educational Researcher, 32, 313. Marshall, C., Mitchell, D., & Wi rt, F. (1986). The context of state-level policy formation. Education Evaluation an d Policy Analysis, 8 341378. Marshall, C., & Scribner, J. D., (1991). Its all po litical, Inquiry into micropolitics in education. Education and Urban Society, 23 347355. Mayers, J. (1995, September 21). Benson to outline school reform. Wisconsin State Journal p. B1. Mayers, J. (1996, January 25 ). Thompson, Benson are doin g their homework: Education standards, values on forefront. Wisconsin State Journal p. B1. Mayers, J. (1997, January 31). Think tank supplied academic standards: Educators recognize source of guideline in governors speech. Wisconsin State Journal p. A1. Mazzoni, T. L. (1991). Analyzing state school policymaking: An arena model. Educational Evaluation and Policy Analysis, 13 115138.
Education Policy Analysis Archives Vol. 8 No. 9 24 Mazzoni, T. L. (1993). The changing politics of state education po licy making: A 20-year Minnesota perspective. Educational Evaluation and Policy Analysis, 15 357379. McCay, E. (Ed.) (2001). Moving beyond retentio n and social promotion Bloomington, IN: Phi Delta Kappa International. McCoy, A. R., & Reynolds, A. J. (1999). Grade retention and school performance: An extended investigation. Journal of School Psychology, 37 273298. McDaniel, J. E., & Miskel, C. G. (2002). Stak eholder salience: Business and educational policy. Teachers College Record, 104 325356. McLaughlin, M. W. (1987). Learning from Ex perience: Lessons from Policy Implementation. Educational Evaluation and Policy Analysis, 9 171178. Meisels, S. J. (1992). Doing harm by doing good: Iatrogenic effects of early childhood enrollment and prom otion policies. Early Childhood Research Quarterly, 7 155174. Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis Thousand Oaks, CA: Sage. Miller, C. (1996, April 14). Governor ringing a new bell. Appleton Post-Crecent ., p. A1. Morgan, J. R. (1996, December 7). Keep school standards basic. Wisconsin State Journal p. A11. Mucciaroni, G. (1991). The ga rbage can model and the study of policymaking: A critique. Polity, 24 459482. Office of the White House (2006, April 18). President discusses American competitiveness initiative. Retrieved May, 5, 2006 from http://www.whitehouse.gov/news/ releases/2006/04/20060418-4.html Peterson, S E., DeGracie, J. S., & Ayabe, C. R. (1987). A lo ngitudinal study of the effects of retention/promotion on ac ademic achievement. American Educational Research Journal, 24, 107118. Reynolds, A. J. (1992). Grade retention and school adjustme nt: An explanatory analysis. Educational Evaluation and Policy Analysis, 14 101121. Rist, R. C. (2000). Infl uencing the policy process with qualit ative research. In N. Denzin & Y. Lincoln (Eds .) The Handbook of Qualitative Research (pp. 10011017). Thousand Oaks, CA: Sage Publications. Roderick, M., Bryk, A. S., Ja cob, B. A., Easton, J. Q. & Allenswort h E. (1999). Ending social promotion: Results from the first two years. Chicago: Consortium on Chicago School Research. Roderick, M., Nagaoka, J., Bacon, J., & Easton, J. Q. (2000). Update: Ending social promotion. Passing, retention, and achievem ent trends among promoted an d retained students, 1995 1999 Chicago: Consortium on Chi cago School Research.
Examining the Streams of a Retention Policy 25 Roderick, M., Nagaoka, J. (2005). Retention under Chicagos high-stakes testing program: Helpful, harmful, or harmless? Educational Evaluation and Policy Analysis, 27 309340. Sashkin, M., & Egermeier, J. (1993). School change models and proc esses: A review and synthesis of research and politics Washington, D. C.: Office of Educational Research and Improvement. Shepard, J. (1998, June 29). Massi ve failures under test law feared. The Capital Times p. A1. Shepard, L., & Smith, M. L. (198 6). Synthesis of research on sc hool readiness and kindergarten retention. Educational Leadership, 44 7886. Shepard, L. A., Smith, M. L., (1989). Introd uction and overview. In L. A. Shepard & M. L. Smith (Eds.), Flunking grades: Research and policies on retention (pp. 115). London: Falmer Press. Smith, M. L., & Shepard, L. A. (1987). What does nt work: Explaining pol icies of retention in the early grades. Phi Delta Kappan, 69 129134. Spector, M., & Kitsuse, J. L. (1987). Construc ting social problems. New York: Aldine De Gruyter. Spillane, J. P. (1999). State and local government relati ons in the era of standards-based reform: Standards, and state policy instruments, and local instructional policy making. Educational Policy, 13 546572. Stake, R. E. (1995). The art of case study research Thousand Oaks, CA: Sage Publications. Stake, R. E. (2000). Case studies. In N. Denzin & Y. Lincoln (Eds.), The handbook of qualitative research (pp. 435454). Thousand Oa ks, CA: Sage Publications. Stone, D. (2002). Policy Paradox: The art of political decision making (Revised ed.). New York: W. W. Norton & Company. Strauss, L. S. (1996). Qualitative analysis for social scientists Cambridge: Cambridge University Press. Thompson, T. G. (1996). Power to the people: An American state at work. New York: Harper Collins. Tompchin, F. M., & Impara, J. C. (1992). Unraveling teachers belief about grade retention. American Educational Research Journal, 29 199233. Tyack, D. B., & Tobin, W. (1994). The Gramm ar of schooling: Why has it been so hard to change? American Educational Research Journal, 31 453479. United States Department of Education (1999). Taking responsibility fo r ending social promotion Washington, D. C.: U. S. Department of Education.
Education Policy Analysis Archives Vol. 8 No. 9 26 Wideman, S. (1996, November 15). Panel slams education standards. Appleton Post-Crescent p. A1. Wisconsin Education Asso ciation Council (2005). St atistics and fa cts about Wisc onsins Great Schools. Retrieved Sep tember 5, 2005, from http://www.weac.org/GreatSchools/statsfacts.htm Wolcott, H. F. (1994). Transforming qualitative data: Descri ption, analysis, and interpretation. Thousand Oaks, CA: SAGE Publications. Yinn, R. (1994). Case study research: Design and methods (2nd ed.). Thousand Oaks, CA: Sage Publications. About the Author Christopher P. Brown University of Texas at Austin Email: firstname.lastname@example.org Christopher P. Brown is an assistant professor in the Department of Curriculum and Instruction at the University of Texas at Austin. His research interests include the intersection of education policy, curriculum, instruction, and assessment; standards-based reform; and early childhood/early elementary education.
Examining the Streams of a Retention Policy 27 EDUCATION POLICY ANALYSIS ARCHIVES http://epaa.asu.edu Editor: Sherman Dorn, University of South Florida Production Assistant: Chris Murre ll, Arizona State University General questions about ap propriateness of topics or particular articles may be addressed to the Editor, Sherman Dorn, email@example.com. Editorial Board Noga Admon Jessica Allen Cheryl Aman Mi chael W. Apple David C. Berliner Damian Betebenner Robert Bickel Robert Bifulco Anne Black Henry Braun Nick Burbules Marisa Cannata Casey Cobb Arnold Danzig Linda Darling-Hammond Chad d'Entremont John Diamond Amy Garrett Dikkers Tara Donohue Gunapa la Edirisooriya Camille Farrington Gustavo Fischman Chris Frey Richard Garlikov Misty Ginicola Gene V Glass Harvey Goldstein Jake Gross Hee Kyung Hong Aimee Howley Craig B. Howley William Hunter Jaekyung Lee Benjamin Levin Jennifer Lloyd Sarah Lubienski Susan Maller Les McLean Roslyn Arlin Mickelson Heinrich Mintrop Shereeza Mohammed Michele Moses Sharon L. Nichols Sean Reardon A.G. Rud Lorrie Shepard Ben Superfine Cally Waite John Weathers Kevin Welner Ed Wiley Terrence G. Wiley Kyo Yamashiro Stuart Yeh
Education Policy Analysis Archives Vol. 8 No. 9 28 A rchivos A nalticos de P olticas E ducativas http://epaa.asu.edu Editores Gustavo E. Fischman Arizona State University Pablo Gentili Universidade do Estado do Rio de Janeiro Asistentes editoriales: Rafael O. Serrano (ASU) & Lucia Terra (UBC) Hugo Aboites UAM-Xochimilco, Mxico Armando Alcnt ara Santuario CESU, Mxico Claudio Almonacid Avila UMCE, Chile Dalila Andrad e de Oliveira UFMG, Brasil Alejandra Birgin FLACSO-UBA, Argentina Sigfredo Chiroque IPP, Per Mariano Fernndez Enguita Universidad de Salamanca. Espaa Gaudncio Frigotto UERJ, Brasil Roberto Leher UFRJ, Brasil Nilma Lino Gomes UFMG, Brasil Pia Lindquist Wong CSUS, USA Mara Loreto Egaa PIIE, Chile Alma Maldonado University of Arizona, USA Jos Felipe Martnez Fernndez UCLA, USA Imanol Ordorika IIE-UNAM, Mxico Vanilda Paiva UERJ, Brasil Miguel A. Pereyra Universidad de Granada, Espaa Mnica Pini UNSAM, Argentina Romualdo Portella de Oliveira Universidade de So Paulo, Brasil Paula Razquin UNESCO, Francia Jos Ignacio Rivas Flores Universidad de Mlaga, Espaa Diana Rhoten SSRC, USA Jos Gimeno Sacristn Universidad de Valencia, Espaa Daniel Schugurensky UT-OISE Canad Susan Street CIESAS Occidente,Mxico Nelly P. Stromquist USC, USA Daniel Surez LPP-UBA, Argentina Antonio Teodoro Universidade Lusfona, Lisboa Jurjo Torres Santom Universidad de la Corua, Espaa Llian do Valle UERJ, Brasil
xml version 1.0 encoding UTF-8 standalone no
record xmlns http:www.loc.govMARC21slim xmlns:xsi http:www.w3.org2001XMLSchema-instance xsi:schemaLocation http:www.loc.govstandardsmarcxmlschemaMARC21slim.xsd
leader nam a22 u 4500
controlfield tag 008 c20079999azu 000 0 eng d
datafield ind1 8 ind2 024
subfield code a E11-00516
Educational policy analysis archives.
n Vol. 15, no. 9 (April 30, 2007).
Tempe, Ariz. :
b Arizona State University ;
Tampa, Fla. :
University of South Florida.
c April 30, 2007
Examining the streams of a retention policy to understand the politics of high-stakes reform / Christopher P. Brown.
Arizona State University.
University of South Florida.
t Education Policy Analysis Archives (EPAA)