xml version 1.0 encoding UTF-8 standalone no
record xmlns http:www.loc.govMARC21slim xmlns:xsi http:www.w3.org2001XMLSchema-instance xsi:schemaLocation http:www.loc.govstandardsmarcxmlschemaMARC21slim.xsd
leader nam a22 u 4500
controlfield tag 008 c20069999azu 000 0 eng d
datafield ind1 8 ind2 024
subfield code a E11-00480
Educational policy analysis archives.
n Vol. 14, no. 7 (March 02, 2006).
Tempe, Ariz. :
b Arizona State University ;
Tampa, Fla. :
University of South Florida.
c March 02, 2006
Effects of a state mandated policy (site-based councils) and of potential role incumbents on teacher screening decisions in high and low performing schools / I. Phillip Young [and] Kimberly Miller-Smith.
Arizona State University.
University of South Florida.
t Education Policy Analysis Archives (EPAA)
xml version 1.0 encoding UTF-8 standalone no
mods:mods xmlns:mods http:www.loc.govmodsv3 xmlns:xsi http:www.w3.org2001XMLSchema-instance xsi:schemaLocation http:www.loc.govmodsv3mods-3-1.xsd
mods:relatedItem type host
mods:identifier issn 1068-2341mods:part
mods:detail volume mods:number 14issue 7series Year mods:caption 20062006Month March3Day 22mods:originInfo mods:dateIssued iso8601 2006-03-02
Readers are free to copy display, and distribute this article, as long as the work is attributed to the author(s) and Education Policy Analysis Archives, it is distributed for noncommercial purposes only, and no alte ration or transformation is made in the work. More details of this Creative Commons license are available at http:/ /creativecommons.org/licen ses/by-nc-nd/2.5/. All other uses must be approved by the author(s) or EPAA EPAA is published jointly by the Colleges of Education at Arizona State University and the Universi ty of South Florida. Articles are indexed by H.W. Wilson & Co. EDUCATION POLICY ANALYSIS ARCHIVES A peer-reviewed scholarly journal Editor: Sherman Dorn College of Education University of South Florida Volume 14 Number 7 Marc h 2, 2006 ISSN 1068Â–2341 Effects of a State Mandated Po licy (Site-Based Councils) and of Potential Role Incumbents on Teacher Screening Decisions in High and Low Performing Schools I. Phillip Young University of California-Davis Kimberly Miller-Smith Southwest Licking County Local School District-Ohio Citation: Young, I. P. & Miller-Smith, K. (2 006). Effects of state mandated policy (sitebased councils) and role incumbents on te acher screening decisions in highand lowperforming school districts. Education Policy Analysis Archives, 14 (6). Retrieved [date] from http://epaa.asu.edu/epaa/v14n7/. Abstract Some states have viewed teacher sele ction as a means of improving student performance and have mandated the use of site-based teacher councils. To assess the utility of this legislative action, an experimental study was conducted. This study uses a 2X3X2 factorial de sign that varies state legisl ation, role of the decision maker, and academic performa nce of the school site. Cr edentials of hypothetical teacher candidates were evaluated as if screening for a va cant position, and evaluations were submitted to a MANOVA Results indicate that legislated alterations in the teacher-selec tion process failed to have any substantial effects on outcomes in the screening of teacher candidates for el ementary school positions. Although screening decisions were found to be the same for participants affiliated with both lowand high-performing sc hool districts, te achers were more appreciative of candidateÂ’s credentials than either principals or parents. Keywords: teacher selection; screening decisions; site-based councils.
Education Policy Analysis Archives Vol. 14 No. 7 2 Introduction Importance of teacher selection is well document within the professional literature. As early as the 1930Â’s Graces (1932) noted that Â“wise selection is the best means of improving the system, and the greatest lack of economy exists whenever teachers have been poorly chosen or inadequately adapted to their professionÂ” (p. 191). This sentim ent, as noted by Graces, continues to be echoed today (Chounet, 2002). Â“In recent years, the issue of teacher quality has once again risen to the top of the school reform agendaÂ” (Liu & Johnson, 2003). Given the importance of teacher selection, th e process by which teachers are selected to fulfill their assigned duties within the public school setting varies across states of the Union (Liu & Johnson, 2003). Most states have and continue to delegate this responsibility to educational administrators (Cuban, 1988), while at least one st ate (Kentucky) vests this authority with site-based councils (SBC) (see KERA, 1990). Potential differences in these legislative actions relative to the screening and selection of teachers have failed to receive any consideration within the professional literature. As a result of this void it is unclear, to date, if legislative actions mandating SBCs have any effects on outcomes for the teacher-selection process. Such information has important implications fo r guiding public policy makers when shaping the teacher-selection process at the state and local school district level. To provide empirical data about teacher-selection processes differing according to legislative intent is the purpose of this study. Within this study, we explore this thorny issue of different configurations for the selection of teachers from several different perspectives. First, we examine a particular type of sel ection decision. The type of selection decision considered in this study involves screening applicants on the bases of their paper credentials. Well noted in the selection literature is that Â“there are situations where decisions are made on the basis of paper informationÂ” (Cleveland & Landy, 1983, p. 619) submitted by applicants. According to research from the private sector (Macon & Di pboye, 1994; Thoms, McMasters, Roberts, & Dombkowski, 1999), as well as the public sector (Liu & Johnson, 2003), decisions made on the basis of paper credentials serve a gate keeping functi on for delimiting an initial applicant pool. As indicated by Cable and Gilovich (1998), Â“beca use interviews are time intensive and costly, interviewers generally prescreen job applicants on the basis of their resumes before granting interviewsÂ” (p. 501). Second, we hold constant the type of selection de cision explored in this study (screening as opposed to interviewing decision) and vary the legisl ative actions of state governments. Legislative actions of state governments are manipulated to include one state (Kentucky, experimental condition) requiring SBCs and to include another contiguous state (Ohio) failing to delegate through legislative processes SBCs as a quasi control (s ee Campbell & Stanley, 1963). By comparing (main effect) screening decisions for teacher candidates between these states (experiment vs. control), we provide certain insights about the potency of legisl ative actions on the part of state legislatures relative to a particular phase of the teacher-selection process. Third, potentially confounding any differences for a main effect involving legislative intent on the part of state governments varying in met hods for selecting teachers between states are the type of potential participants taking part in the selection process. That is, if a main effect were detected for the legislative process, then is this main effect due either to differences from the legislative enactments of state governments or to varying perceptions of different roles of participants? To sort among these possible explanat ions, we manipulated also the role of potential participants between both states in this study.
Effects of a State Mandated Policy 3 Fourth, we explore the outcomes of teacher sc reening decisions for high-performing and low-performing school districts. Implied by exis ting teacher selection research is that highperforming school districts may do something differ ent from low-performing school districts within the teacher-selection process (Wise, et.al., 1987). To a ssess if public school districts in general should follow those practices used by high-performing school districts from a modeling perspective is still another purpose of this study. More pointedly, the research questions addressed in this study are as follow: (1) Are teacher screening decisions differe nt in a state mandating SBCs for selection from screening decisions in a state failing to mandate SB Cs; (2) are teacher screening decisions a function of the roles held by potential SBC members; (3) are teacher screening decisions related to the performance of a public school district; and (4) are teacher screening decisions related systematically to some combination of state legislation, role of potential incumbents, and/or performance of a school district? Literature According to the emerging body of teacher selection research, the teacher-selection process includes decisions of individuals as applicants an d decisions of administrators as employers (Winter, Ronau, & Munoz, 2004). Both research streams contribute to knowledge about the recruitment and selection of teachers but in varying ways. Resear ch addressing these different decision sources (applicants and administrators) has produced two separate but related research streams. One research stream emerges from the recruitment liter ature and focuses on the decisions of applicants (for a recent review see Winter & Me lloy, 2004), while the other stream associated with the selection literature addresses the decisions of organizational representatives (discussed below). It is the later research stream that is the focus of our study, the decisions of organizational representatives as potential employers within the teacher-selection process. Decisions of organizational representatives are purported to occur at separate stages within the teacher-selection process. One stage involves scr eening decisions where the initial applicant pool is reduced to include only those candidates perceived to be worthy of further consideration within the teacher-selection process (Young & Ryerson, 1986). The other stage involves interviewing decisions to determine which candidates will receive actual job offers at the culmination of the selection process (Young & Delli, 2002). Research indicates that screening and interviewi ng decisions differ in another significant way beyond outcome of the selection process (Gorman, Clover, & Doherty, 1978), and this difference demands separate consideration within the research literature for understanding the teacherselection process. Importantly, these decisions differ with respect to the mode of applicant stimuli on which each type of decision is based (Macan & Dipboye, 1994). That is, screening decisions are based on pape r credentials submitted by teacher applicants (for a model, see Young & Delli, 2002). On the other hand, interviewing decisions are based on the interpersonal interactions between organizational repr esentatives and applicants (Cable & Gilovich, 1998). Because of these important differences in outcomes (screening versus hiring) as well as in applicant stimuli (paper credentials versus inter personal interactions) driving selection decisions, we focus in this manuscript on screening as opposed to interviewing decisions. To investigate screening decisions of organi zational representatives within the teacherselection process, empirical studies have been characterized largely as being driven by a legislative enactment and/or interpreted through the lens of a particular person perception theory. Most legislative studies are couched within the context of specific federal enactments, while most theorybased studies are rooted in a particular pers on perception theory. Each of these orientations
Education Policy Analysis Archives Vol. 14 No. 7 4 (legislative and theory) contributes in unique ways to the general knowledge about the teacherselection process and warrants some attention in this manuscript. Legislative Studies Specific federal enactments receiving attention within the teacher selection literature include the Age Discrimination in Employment Act (ADEA), Title VII of the Civil Rights Act, and/or the American with Disabilities Act (ADA). Within legi slative studies, characteristics of hypothetical teacher candidates are manipulated to yield applic ants either covered by or exempted from the legislative acts as noted. That is, hypothetical teac her candidates are depicted under or over 40 years of age as specified by the ADEA, being female or ma le as addressed by Title VII of the Civil Rights Act, and/or having acknowledged or unacknowledged handicapping conditions as covered by ADA. Reactions of principals toward these different c onfigurations of applican ts have been assessed relative to compliance with federal guidelines With respect to chronological age of teacher candidates as addressed by the ADEA, screening d ecisions for hypothetical teacher applicants have been assessed in several studies. Young and Allison (1982) varied the chronological age of teacher candidates and found that both superintendents and principals preferred 29 year old teacher candidates over 49 year old teacher candidates at the screening stage of the teacher-selection process. Several other studies have reported simila r evidence of age discrimination at the screening stage of the selection process (Young & Joseph, 1989; Young & McMurray, 1986; Young & Voss, 1986). As with chronological age of teacher candid ates as covered by ADEA, sex of teacher candidates has been explored at the screening stage of the teacher-selection process relative to compliance with Title VII of the Ci vil Rights Act. Stollard (1990) as well as Wallich (1984) failed to detect any preference for a particular sex group. However, Reis, Young and Jury (1999) found that participants preferred females over males at the screening st age of the selection process. Only a single study found in the published literature addresses the compliance of public school administrators with the Americans with Disabilities Act. Young and Prince (1999) varied acknowledged disability of teacher candidates unde r three experimental conditions: confined to a wheel chair, limited to a crutch, or no disability [the control condition]. Their results indicated that disabled teacher candidates were more likely to be extended an interview offer than teacher candidates without an acknowledged disability. Person Perception Theories In contrast to legislative studies addressing the compliance of public school administrators, most theory-based studies focus on general psycholog ical/sociological theories pertaining to person perceptions. General person perception theories drawn from the psychological/sociological literature have been used to cast the reactions of organizational representatives about teacher candidates on a theoretical framework. Goals of theory-based studies within the teacher-selection context are to provide a framework for understand ing the dynamics of the decision making process from a broad perspective (Arvey & Faley, 1992) b eyond statistical effects and are not to provide specific tests for particular theoretical orientati ons (Young, Chounet, Buster, & Sailor, 2005). That is, theory-based studies guide the interpretation of outcomes rather than provide confirmations of theoretical constructs for testing theories.
Effects of a State Mandated Policy 5 Theory-based studies within the teacher-selection context have approached this administrative task involving the screening of tea cher candidates from several perspectives as a framework for understanding the decision making of public school administrators. Decisions made by public school administrators have been cast onto several different theoretical frameworks. Included among these frameworks are decremented theory, similarity-attraction theory, and social distance theory. The decremented theory (Botwinick, 1978) pert ains to the aging process and suggests that younger job candidates will be more suited for high activity positions than older job candidates. To examine the utility of this theory for explaining teacher selection decisions, Young, Rinehart, and Baits (1997) varied the physical-demand characteris tics associated with particular focal teacher positions in two separate analyses. Physical-demand characteristics varied by Young, Rinehart, and Baits include focal positions between disciplines (physical education vs. physics) as well as within a discipline (general science vs. chemistry). They found that younger teacher applicants were preferred over older teacher applicants for high physical demand focal positions. Similarity-attraction theory (Byrne, 1961) indicates that organizational representatives (public school administrators) would recommend more likely those similar to self for an interview than those dissimilar to self. Similarity has been explor ed relative to age cohorts (Bowman, 1999) and to sexual groupings (Reis, et al., 1999) within the teacher screening process. Little support has been reported for this particular theoretical orient ation as a framework for understanding teacher screening decisions within the public school setting. In contrast to the similarity-attraction theo ry, social distance theory (Bogardus, 1967) attempts to explain how individuals (organizational representatives) view those different from themselves. Research in this area has held constant characteristics of the organizational representative and has varied characteristics of applicants. Several studies (Young & Fox, 2002; Young & De La Torre, in press; Young & Oto, 20 04) have held constant characteristics of the organizational representative and have varied nati onal origin of the applicant: Asian candidate, Hispanic candidate, or Native American candidate. Results from these studies indicate that national origin of job candidates moderate screening decisions of job candidates for different focal positions. Purpose of this Study Results of teacher selection research following these methodological approaches involving either legislative studies or theoretical framework s have considerably advanced current knowledge about this important administrative task within the educational setting. As noted in our review of published teacher selection studies, most legislat ive studies explored screening decisions from an outcome perspective (do administrators conform?) relative to various protected class statuses of applicants as defined by existing federal enactmen ts (age, disability status, sex, and ethnic group). Absent from this literature is any study of mand ated initiatives bearing on the structure of the selection process per se. One such state initiative th at has altered substantially the structure of the teacher-selection process is the Kentucky Educ ation Reform Act (KERA) (1990), and we examine this alteration for teacher selection from several perspectives. KERA decentralizes the teacher-selection pro cess from a unilateral procedure involving solely administrators to a multilateral procedure involving multiple stakeholders. This change is accomplished through the use of site-based teacher councils comprised of principals, teachers, and parents (Lindle, 2000). If this particular stateÂ’s legislated initiative involving site-based decision councils has any effect on the outcomes of the teacher process, then we would expect screening decisions for teacher candidates to be different from those assessed in a state not mandating site-
Education Policy Analysis Archives Vol. 14 No. 7 6 based decision making. To assess potential eff ects associated with different teacher-selection processes, we compare screening decisions made in Kentucky mandating site-based decision councils with screening decisions made in a c ontiguous state (Ohio) vesting teacher screening decisions legislatively with school administrators. Within our study, we commingle legislative actions with a theory-based framework. Theorybased studies addressing teacher selection have approached this administrative task from an interactional perspective through varying personal char acteristics of administrators and applicants to create similar and dissimilar pairings. In contrast to existing research protocol, we hold the characteristics of applicants constant and varied the role of potential evaluators (principal, parent, or teacher). The role of the evaluator may well infl uence outcomes of the selection process. According to role theory, an individualÂ’s role within the teacher-selection process is an important determinant for selection outcomes because role shapes perceptions of decision makers beyond context (Michener, DeLamater, & Myer, 2004) If role theory has any utility within the present context as a theoretical framework for explaining screening deci sions made by organizational representatives, then we would expect to detect either a main effect for role of the evaluator or an interaction effect between role of the evaluator and legislative acti ons of states varying the teacher-selection process (site-based vs. non-site-based). Results from state accountability measures in dicate great variability among public schools relative to performance on academic performance index measures. It is well noted that some of this variability in performance is due, at least in pa rt, to the proficiency of the classroom teacher (Chounet, 2002; Graces, 1932), and it is assum ed generally that high-performing schools do something different from low-performing school s within the teacher-selection process. This assumption has deep roots with a seminal study ad vocating the selection pra ctices of only purported flagship school districts (Wise, et.al., 1987) as a means of improving the selection process and advancing the learning of students. Although this study by Wise, et. al. (1987) is dated, it is important to note that the general assumption of high-performing school districts doing something different from low-performing school districts within the teacher-selection process has escaped entirely empirical investigation within this im portant area. To assess for potential differences between high-performing and low-performing school districts relative to the teacher screening process is another advancement of this study. If this basic modeling assumption has any validity, then we would expect that high-performing sc hools would make teacher screening decisions different from low-performing schools. Method The population for this study is all public elementary school buildings in two neighboring states, Kentucky and Ohio. Kentucky mandates si te-based teacher councils for the selection of teachers, while Ohio vests this authority with pu blic school administrators. Given this particular population configuration, consideration was afford ed to the power of statistical tests and to potential return rates for selecting participants to take part in this study. A power analysis was performed for a fixed effect 2X3X2 factorial design with a conventional medium effect size ( 2 =.25), a tradition statistical power of .80, and an established alpha level of .05 (Cohen, 1977). This calculation rendered a total sample size of 168 participants with 14 participants per cell. A review of existing re turn rates from similar types of studies suggested over-sampling this population to insure adequate statistical power (Newton, Giesen, Freeman, Bishop, & Zeitoun, 2003), and a total of 624 part icipants were sampled at random and requested to participate in this study.
Effects of a State Mandated Policy 7 Independent Variables One independent variable manipulated in this study is the state-legislated process for selecting teachers. The state-legislated process was varied to include elementary schools mandated to use site-based councils and elementary schools ex empted from such legislation. To operationalize these two different experimental conditions, half of our sample was selected at random from a state delegating teacher selection to site-based councils (Kentucky) and half of our sample was selected at random from a state delegating teacher selection to administrators (Ohio). Another independent variable manipulated in this study is the role of the evaluator within the teacher screening process. The role of the evaluator was varied to include principals, teachers, and parents as potential legislated site-based coun cil members identified by KERA. To increase the statistical integrity of our analysis, several steps were taken in the selection of these different role incumbents across both states. When selecting potential role participants for taking part in this study, we were concerned about independence of observations, basic know ledge about school operations, and motivational level for participants. With respect to independence of observations, characteristics of elementary schools vary in many ways (size, diversity, faculty demography, instructional programs, school climate, etc.), and each of these ways or some combination of these ways could influence screening decisions at the local school building level if more than a single role participant is selected from the same school. To control for a dependency within as well as across buildings and states, only a single role incumbent (principal, teacher, or parent) was selected at random from any particular school building and requested to take part in this study. In addition to being concerned about dependen cy among participants within the teacherselection process, SBC members in Kentucky are involved with and are exposed to basic information about several other areas in the performa nce of their duties. Examples of some of these areas are space utilization, discipline, classroom management, and extra curricular programs (see Newton, Winter, & Keedy, 2001). Although this type of information is available readily to principals in general and teachers in general when fulfilling their assigned job responsibilities, such is not the case always for parents, especially a random sample of parents in general likely containing many of those detached by choice from school operations. Also, a random sample of parents in general would likely yield a sample of potential participants for this study unwilling to assume an y leadership responsibilities as required for SBC membership. To control for knowledge about scho ol building operation as well as motivation to serve in a school building leadership capacity within as well as between states, we selected at random from PTA/PTO presidents. This choice, as a means for operationalization of the parent role in our study is far from perfect but perhaps the best amon g alternatives in this type of legislative study. This choice of PTA/PTO presidents controls at least partially for both basic knowledge about school operation and willingness to serve in a lead ership role at the school building level. All PTA/PTO presidents are parents even though all SBC council members are not PTA/PTO presidents. Most importantly, an exact match bet ween parents fulfilling SB C membership roles in Kentucky fails to exist in our control state (or any other state), but PTO/PTA presidents exist in both states, and in both states, these parents are likely to share a similar knowledge base about school operations and to have assumed a leadership ro le by fiat at the local school building level. Still another independent variable manipulated in this study was the academic performance of public school districts, in this study categorized as low vs. high through the median split on a composite accountability measure. Contained with in this accountability measure was student performance on state proficiency tests, promotion rates, and attendance data. Because each state
Education Policy Analysis Archives Vol. 14 No. 7 8 used a different proficiency test for assessing academic performance, all competency measures (proficiency test, promotion rates, and attendance data ) were transformed to a standardized score (z score) within each state. Standardized scores were then summed to compute an overall composite score (accountability indices) within each state. With in each state, a median split was performed on the basis of accountability indices based on composite measures encapsulating academic performance, graduation rates, and attendance standards. This process has certain disadvantages. The most notable disadvantage is that a much stronger manipulation of low and high performa nce could have been obtained through using only elementary schools plus or minus one standard deviation above or below the mean accountability measure. This stronger manipulation based on plus or minus one standard deviation involves excluding approximately 68% of the elementary sc hools in each state (the majority) but strengthens considerable the potency of the manipulation. As such, the research question changes from comparing lowand high-performing school districts to comparing the highest of the high with the lowest of the low. However, our choice of using a median split has certain advantages. Most notably, by including all elementary schools, our findings gene ralize to a much broader population. This broader population is likely to have far greater appeal to legislators as well as other policy makers that are interested in what are the best practices for the most and not a select few. Also, not to be overlooked with our process for defining low versus high-performing elementary schools is the manner by which we pe rformed the median split. We performed our median split on a linear composite score distribu tion containing multiple measures (academic, promotion and attendance) rather than on a univar iate score distribution involving only a single variable for defining academic accountability. Ad vantages of a linear composite score distribution over a univariate score distribution were noted early on by Fisher (1936), and graphically, this same general (albeit not specific) phenomenon is illustra ted more recently by Stevens (2002) using a discriminant analysis example (see p. 303, Figure 7.3). Dependent Variables The two dependent variables focused on evaluations of hypothetical teacher candidates by participants. One dependent variable measured a candidateÂ’s perceived skill levels according to specific job related criteria. The other dependent va riable assessed the willingness of evaluators to consider the teacher candidate for a selection interview. Perceived skill levels of teacher candidates wer e measured according to six separate criteria. These criteria were the knowledge of curriculum, th e ability to transmit knowledge, contribution to the overall school program, the ability to create a friendly classroom environment, the ability to maintain a discipline classroom, and potential for professional growth. Each criterion was rated by participants on a 4-point Likert type scale where a higher rating corresponded to a more favorable evaluation on any specific criterion than a lower rating on the same criterion. Ratings on these criteria were used to calculate an overall composi te score for each hypothetical teacher candidate. A coefficient alpha for such a composite score has been reported by others to be .91 (Young & Fox, 2002). Using a 3-week interval for a test-retest procedure, Wallich (1984) reported a stability coefficient of .88 for ratings on these same criteria. In addition to evaluating the perceived comp etency of teacher candidates according to specific criteria, evaluators were requested to in dicate their probability of extending an interview opportunity to the hypothetical teacher candidate. Pr obability of an interview offer was rated on a 10 point Likert type scale where higher ratings indica ted a greater probability of an interview offer than
Effects of a State Mandated Policy 9 lower ratings on this 10 point scale. Lower bound reliabilities for this scale, as assessed with procedures advocated by Wanous and Reichers (1996) are reported consistently to range within the mid .80Â’s within the published literature (Young & Chounet, 2003; Young & Fox, 2002).1 Procedure To assess the effects of independent variables on dependent variables in this study, hypothetical teacher candidates were created throug h the use of paper type credentials as found in most college placement files and as used by most public school districts (Lui & Johnson, 2003; Thoms, et. al., 1999). Because market demand chara cteristics can vary greatly according to the type of teacher position sought and influence screenin g decisions, we held constant the type of focal position sought in this study (Young, et. al. 1997) The particular focal teacher position used in our study is an elementary school teacher. Included within the paper credentials for ea ch potential elementary school teacher was salient information as found on most typical resumes used by teacher candidates when seeking employment with a public school district. This in formation included specific sections of the resume addressing in detail career objectives, educ ational obtainment, professional experiences, extracurricular activities, certification information, professional memberships, community activities, and future ambitions of teacher candidates. To control for potential confounding effects within the credentials associated with age of candidates (Y oung & Fox, 2002) and sex of candidates (Reis, Young, & Jury, 1999), all dates were omitted an d only initials were used for given names. For each of the experimental conditions, all candidate information was held constant, and each potential participant received an identical set of credentials for hypothetical teacher candidates in the mail. Accompanying the credentials of tea cher candidates were a cover letter, a questionnaire for participants, a teacher candidate evaluation form, a pre-addressed envelope for return of information, and a pre-addressed post card for recei ving results of the study. Contents of the cover letter solicited the participation of subjects, reque sted that the individuals evaluate the teacher candidate as if screening applicants for a vaca nt elementary school teacher position, assured evaluators of anonymity relative to their participation in this study, and offered a complete debriefing if they returned the pre-addressed post card. After our initial mailing, all participants r eceived a post card as a reminder for their participation. Following the post cards and a time la pse, e-mails were sent to encourage participation in this study. Finally after the post cards and the e-mails, all participants received information packets again by mail and were en couraged to respond if they had not provided already the requested information. Of the 306 participants returning packets, 41 of the participants either failed to follow directions or submitted incomplete information relative to candidate evaluations, and responses from this group were deleted from our data base, leaving a response rate of 49%. 1 ` The reliability of a single item scale as sugge sted by Wanous and Reic hers (1996) represents purportedly a lower bound reliability that builds on the assumption that the correlation (rxy) is restricted by the reliability of rxx (composite evaluation measure) and the reliability of ryy (probability of an interview offer). Given that rxx is provided by coefficient alpha (composite evaluation measure) and that rxy is assessed with the data (correlation between composite evaluation and an interview offer), ryy (reliability for an interview offer), a lower bound for reliability is calculat ed through solving for the unknown va lue relative to reliability being a necessary but not sufficient condition.( yy xx xy xyr r r r ).
Education Policy Analysis Archives Vol. 14 No. 7 10 Design and Analysis This study used a completely crossed 2X3X2 facto rial design where state legislative actions (site-based vs. non-site-based), role of potential evaluators (principal, teacher, or parent), and academic accountability of the elementary school buildings (low vs. high) varied. Because other studies have reported response rates to vary by treatment conditions in similar teacher selection studies and to produce a treatment by response bias (Young & Chounet, 2003), we explored this possibility with our data. A chi-square test was calcul ated to determine if a systematic relationship existed between response rates and treatment c onditions, and results of the chi-square test (X2 = 17.88, df=11, p<.05) indicated that a systemat ic relationship failed to exists between response rates and treatment conditions in our study. Even though a systematic relationship fa iled to emerge between response rates and treatment conditions with these data, unbalanced designs, according to Stevens (2002) Â“is a fairly common occurrence in certain areas of research, and there is no simple solution for this problemÂ” (p. 33). Several solutions are proposed, however, wi thin the methodological literature. Included among these solutions are using an unweighted means analysis (Winer, 1962), a mean substitution procedure (Kirk, 1968), and a sub sampling process (Zar1984). Given that the power analysis, as suggested by Cohen (1977), indicated a need for only 168 subjects to meet our initial parameter specificati ons, we sampled at random from those completed responses provided by participants. To obtain a completely balanced experimental design, 14 participants were selected at random for each expe rimental condition to net a final sample size of 168. This latter sampling process for unbalanced designs is recommended by Zar (1984) to obtain a completely balanced design for purposes of statistical analyses. Prior to submitting our data to a multivaria te analysis of variance, several different assessments were performed. Reliability assessments were performed for each dependent variable, with an alpha of .89 for the composite score of ratings summed across the six criteria. With respect to the single item pertaining to the probability of an interview offer rated on a 1Â–10 point scale, procedures advocated by Wanous and Reichers (1 996) suggested a lower bound reliability of .82 with these data. Given that the MANOVA procedure assumes a multivariate normal distribution and equal variance-covariance matrices, we assessed how wel l our data met these assumptions. Although a direct multivariate test for normality fails to exist, we assessed for departures in kurtosis and skewness for each dependent variable and found th at both the composite scores based on criteria ratings (kurtosis=.79 and skewness=-.71) and the probability of interview offers (kurtosis=.69 and skewness=-.87) met normality assumptions. Likewi se, LeveneÂ’s test for homogeneity of variancecovariance across dependent variables indicated non-significant differences for the composite scores based on criteria ratings (F=1.45, p=.16) and th e probability of interview offers (F=.90, p=.55). Means and standard deviations for the composite ratings of candidatesÂ’ perceived proficiency on the job related criteria and the probability of an interview offer for these candidates are found in Table 1, and these data were submitted to a multivariate analysis of variance (MANOVA). Specific tests were performed for each main effect and for all interaction effects. To evaluate these MANOVA effects, a PillaiÂ’s Trace was used, and a statistically significant multivariate main effect was detected only for the organizationa l role of the participant (PillaiÂ’s Trace=.066, F(2,156), p=.033, 2 =.033) (see Table 2).
Effects of a State Mandated Policy 11 Table 1 Summary Statistics for Evaluation Scores by Stat e, Organizational Role, and School Performance Site Based Legislation (KY) No Site Based Legislation (OH) School performance Parent Teacher PrincipalParent Teacher Principal Composite criteria ratings (1Â–4 scale) High Performance Mean (S.D.) N 2.83 (0.39) 14 2.99 (0.41) 14 2.74 (0.53) 14 2.74 (0.55) 14 2.94 (0.67) 14 2.77 (0.54) 14 Low Performance 2.93 (0.59) 14 3.06 (0.70) 14 2.88 (0.33) 14 2.76 (0.52) 14 3.38 (0.39) 14 2.83 (0.76) 14 Likely interview o ffer (1Â–10 scale) High Performance 6.86 (1.41) 14 7.79 (0.37) 14 7.07 (1.90) 14 6.43 (2.41) 14 6.79 (2.67) 14 6.71 (2.27) 14 Low Performance 8.00 (1.80) 14 7.43 (0.24) 14 7.71 (1.59) 14 6.86 (1.99) 14 8.64 (1.15) 14 7.07 (2.27) 14 Table 2 Multivariate Analysis of Variances Results Classification PillaiÂ’s Tr ace F Value F Probability Reform State Status (A) .026 2.048 .132 Organizational Role (B) .066 2.653 .033* School Performance (C) .031 2.476 .087 State X Role .012 0.458 .767 State X School Performance .003 0.232 .793 Role X School Performance .016 0.643 .632 AxBxC .031 1.222 .301 *p < .05, effect = 2 =.033 To explore this significant multivariate ma in effect further as suggested by Weinfurt (2001)Â—Â“by far the most popular way of proceedin g from a significant effect in MANOVA is to perform univariate ANOVAs for each dependent variableÂ” (p. 262)Â—we examined separate univariate analysis of variance (ANOVA) for the role of participants relative to each dependent variable. These analyses are found in Tables 3Â–4. Here, the significant multivariate effect is likely attributable to differences detected for the organiza tional role of participants relative to ratings on the composite evaluation score, and no statistica lly significant differences were detected for the probability of an interview offer.
Education Policy Analysis Archives Vol. 14 No. 7 12 Table 3 Univariate Test Result s for Composite Score Classification DF MS F Reform State Status (A) 1 0.041 0.000 Organizational Role (B) 2 1.470 4.841* School Performance (C) 1 0.799 2.629 State X Role 2 0.246 0.810 State X School Performance 1 0.051 0.167 Role X School Performance 2 0.153 0.505 AxBxC 2 0.236 0.776 *p < .05, effect= 2 =.06 Table 4 Univariate Test Results for Pr obability of Interview Offer Classification DF MS F Reform State Status (A) 1 6.482 1.664 Organizational Role (B) 2 6.256 1.606 School Performance (C) 1 19.339 4.964* State X Role 2 2.911 0.747 State X School Performance 1 1.720 0.442 Role X School Performance 2 0.339 0.087 AxBxC 2 8.756 2.247 *p < .05. Although a statistically significant univaria te effect is detected for district performance, a multivariate statistical effect was not detected and the later should not be interpreted. Insight about these differences as detected with the composite criteria ratings is provided by conducting pairwise comparisons among the differe nt organizational representatives (see Table 5). Pairwise comparisons among the different role in cumbents revealed two statistically significant differences. Both elementary school principals and elementary school parents differed from elementary school teachers in their perceptions of teacher candidates as assessed on the composite score measuring competencies according to the si x criteria used to evaluate teacher candidates. Table 5 Bonferroni Test of Multiple Comparison s among Role Members on Composite Scores Roles Administrator Parent Teacher Mean Rating 2.81 (A) 2.82 (A) 3.10 Roles sharing a common line are not statis tically different at the .05 level. Discussion Results from this study expand current know ledge about the teacher-selection process from a procedural as well as a substantive perspective. Procedurally, most legislative studies within the professional literature have been explored largely from a compliance perspective relative to uniform federal guidelines governing the employee selection process. Within these type of studies, employment policies (ADEA, ADA, or Title V II) have been held constant, and specific characteristics of applicants (age, ethnic group, disa bility status, or sex) have been varied to assess
Effects of a State Mandated Policy 13 the compliance of school administrators relative to these legislative acts. In our study, we did the opposite. That is, we were able to vary employment polic ies addressing a specifi c phase of the teacherselection process while holding constant characteris tics of the teacher candidate. Through using a quasi control group (see Campbell & Stanley, 1963 ) unavailable for research focusing on uniform federal mandates that are constant across states, we are able to assess effects of rather than compliance with a specific employment policy (KERA) initiative formulated by a legislated body. As a result of this different slant for exploring teach er selection decisions, our findings indicated that this particular policy initiative involving the use of site-based teacher councils has little effect on outcomes at the screening stage of the teacher-selection process (see Table 2). Indeed, teacher screening decisions emanating from a state mandating the use of site-based teacher councils (Kentucky) were found to be similar to those occurring in a state relegating the teacher-selection process to school administrators (Ohio). Although there is likely some degree of blurring with respect to actual teacher selection pra ctices within each state, our manipulation in this area is not weak from a legislative perspective From a legislative perspective, one state has mandated the use of site-based decision making re lative to teacher selection (our experimental group, Kentucky), while the other state (our cont rol group, Ohio) has failed to decentralize through legislation the teacher-selection process. Although it might be hypothesized that many districts use a collaborative process for selecting teachers (including our control state), suc h a hypothesis is questionable when it comes to screening as opposed to selecting (interviewing) teachers. Within our control state (Ohio), some urban school districts (e.g., Akron City School Di strict) use only administrators for screening teachers to insure that affirmative actions goals are met, other suburban school districts (e.g., Dublin City Schools) use commercial teacher screening in struments (e.g., Teacher Perceiver Instrument) administered only by corporate trained administrators for screening teacher applicants, and many rural school districts screen teacher applicants at the administrative level be fore involving additional stakeholders (teachers and/or parents) in the in terviewing process because interviewing is time intensive and costly (Cable & Gilovich, 1998). Wi thin our experimental st ate involving SBCs, the process is different than in our control state. Further strengthening our manipulation of th is legislative initiative involving the decentralization of the teacher-selection process is a temporal factor. In each state, the procedure used to screen and select teachers has been operating for over a decade. As such, each state should be well practiced in its particular legi slated method for selecting teachers. Potentially confounding findings relative to vesting selection with either a legislated decentralized process versus a legislated centralized teacher-selection process are the actual roles of participants taking part in the selection proce ss. No doubt, some potential roles may be more capable than other potential roles when it comes to the selection of teacher s, and existing teacher selection research has examined teacher selection al most exclusively from the perspectives of school administrators. Others have noted, however, that perspectives vary by role of the evaluator and that individuals lacking specific role experience in a part icular focal position use different information for evaluating potential job candidates than those possessing role experience (Barr & Hitt, 1987). Within the context of our study involving KERA, the roles deemed most important are parents, principals, and teachers because these cons tituents are viewed as those closest to students and best equipped to make teacher selection decisi ons (Appalachia Educational Lab, 1992; Knnapel, Moore, Coe, & Aagaard, 1995; Lindle & Shrock 1993). To assess the potential confounding involving the teacher-selection process (decentra lized versus centralized) and the role of the evaluators (parents, principals, or teachers) within this process, we manipulated the latter as well as the former potential sources of systematic variance within the teacher screening process through
Education Policy Analysis Archives Vol. 14 No. 7 14 using a fixed-effect experimental design. Although we failed to detect either a main effect or an interaction effect involving legislated action on the part of state mandates involving the teacherselection process (see Table 2), we did find a statistically significant main effect for role of a potential screening member within the teacher-screening process (see Table 2). Teachers evaluate hypothetical teacher candidates consistently higher than either principals or parents on one of the dependent variables assesse d in our study (see Table 4). Unlike principals or parents, teachers as members of the screening committee rated hypothetical teacher candidates higher on their professional competencies as asse ssed by the composite evaluation score focusing on job skills. However, with respect to offers for an interview, all role incumbents rated hypothetical teacher candidates similarly (see Table 3). At least two explanations are offered for the a bove finding. One explanation is based on role theory that suggests Â“a personÂ’s role determines not only behavior but also beliefs and attitudesÂ” (Michener et al., 2004, p. 8) and to alter these a ttributes requires a role change on the part of the decision maker. As such, teachers screening applicants would likely view all teacher applicants favorably on skill related criteria unless there is co mpelling evidence to the counter because these are the same skills teachers use everyday in their current role. The other explanation is based on the political ramification associated with devaluing the job skills of a potential colleague. That is, teachers performing screening decisions may fail to devalue a job candidateÂ’s skills within the selection process because the former may fear that an applicant could become ultimately a co-worker in their imme diate job setting. To learn subsequently that a colleague rated job qualifications of an applican t low within the selection process would fail to promote future harmonious relationships among facu lty in the event that an applicant becomes an employee within the same building. To explore the utility of these different potenti al explanations for the main effect involving the role of the evaluators as detected within this study, future resear ch is needed in this particular area of investigation. With respect to our first ex planation that is nested within context of role theory, only teachers held a role congruent with the hypothetical applicant, and it is unclear if these findings are a function either of the specific roles manipulated (administrator parent, or teacher) or of the role congruence/incongruence among screen ers. Consequently, future research should vary the role of screeners within the selection process to include focal applicant positions located within the same building but varying to include a congruent role position (as done in this study) as well as a role incongruent position (e.g., counselor) within the same experimental context. Likewise, to determine the validity of our ex planation concerning political ramifications associated with devaluating the credentials of a potential colleague by teachers within the same school building, additional research is warranted th at varies the assignment of teacher candidates (within a building versus within a different build ing). Other research drawing on social distance theory has shown that principals use different standards for evaluating teacher candidates depending on whether the applicant is to be assigned to the same school building (proximal evaluation) or to a different school building (distal evaluation), and tea chers may well form similar types of impressions (Oto, 2003). Until these later types of investigations are conducted, it is unclear which of our explanations (role congruence or role proximity) is most viable for the current findings. In addition to exploring the effects of policy enactments on the part of state governments (decentralized versus centralized decision making) an d the role of different evaluators (parents, principals, or teachers) within the teacher scr eening process, we examined the outcomes of the teacher screening process for low-performing and high-performing school districts. Conventional wisdom fueled, at least in part, by a national stud y (Wise, et al., 1987) may have led many to assume that high-performing school districts do somethin g different from low-performing school districts when it comes to the procurement of teacher candidates as employees. Within our study we tested
Effects of a State Mandated Policy 15 partially this assumption by examining the teach er screening decisions in both highand lowperforming elementary schools as defined by performance on state mandated criteria. We found that screening decisions for hypot hetical teacher candidates were the same regardless of an elementary schoolÂ’s accountability le vel as defined by a standard set of criteria used in both states (see Table 2). This last finding, like our previous finding, is amenable also to at least two explanations both of which have implications for research and practice involving the teacherselection process in the field setting. One explanation is that studies contrasting elementary schools defined as different relative to accountability measures may offer little insight about improving the teacher-selection process because these schools pe rform similarly when it comes to screening teacher candidates. The other explanation for our finding rests with our specific experimental protocol. Within our study, qualifications of teacher candidates wer e held constant and personnel in both highand low-performing elementary schools evaluated the sa me teacher candidate that was equally qualified (or unqualified) in all experimental conditions. In re ality, low-performing schools may fail to enjoy as an adept applicant pool as high-performing schools, and low-performing schools, although equally proficient as high-performing schools in the tea cher-selection process, must choose among the less able teacher candidates in the field setting. That is, selection processes/outcomes would be the same for equal candidate pools but differe nt for unequal candidate pools. This second explanation for our findings has some support within the professional literature. Winter and Morganthal (2002) found that an im portant factor influencing applicantsÂ’ attraction toward vacant focal positions is the academic achievement of assigned students, and this finding implies that given a choice among schools the most able candidates seek only high-performing schools. To cast additional light on our findings relative to selection practices in highand lowperforming schools, future research should vary both the achievement levels of schools and the quality of teacher candidates within the same study. Not to be overlooked when considering the above mentioned speculations are the operational parameters used to define lowand high-performing schools. We used a median split based on a linear combination of composite scores (proficiency test, promotion rates, and attendance data) to define low-performing and high -performing schools. Because relative levels of performance were defined within states, this pro cess assumes that talent is similar and equally distributed within both our experimental and control state. However, to assume otherwise implies that elementary students are better endowed in on e state as compared to the other state and would have produced a statistically significant (and undetected) interaction effect with these data if academic accountability influences screening decisions. When differentiating between high and low pe rformance in each state among elementary schools, we used a median split. This operational decision has both disadvantages as well as advantages. The major disadvantage is that a potentially stronger operational method of differentiating between lowand high-performing schools exists. Samples could have been drawn from the extremes of the distribution on accounta bility measures for elementary schools (e.g., more than one standard deviation from the mean). Clearl y, sampling from the extremes of the distribution would have provided a much stronger manipula tion by eliminating approximately 68% of the schools in each state. As such, the basic research question would have changed from one exploring how lowand high-performing schools may differ with in the selection process to one that explores how the lowest of the low and highest of the high schools may differ within the teacher-selection process. Interestingly, even if we had chosen the str onger manipulation and even if we had found a statistically significant statistical effect for accounta bility, our same research question as posed in this study would remain still unanswered and would plague still policy makers from a practical
Education Policy Analysis Archives Vol. 14 No. 7 16 perspective in guiding their deliberations about alte ring selection practices. That is, what is best for most elementary schools and not just the highest 16 % the lowest 16%? Although this later research question remains unanswered on the basis of our da ta, a statistically significant effect with our approach (that we failed to detect) would have been the more informing. In contrast to the approach contrasting extremes, we sought to capture screening decisions typical of all schools in both states given the legisl ative thrust of our study. To differentiate between lowand high-performing schools in our study, we performed a median split on the basis of a composite linear score that included all schools an d not a select few. This choice of an operational definition for low and high performance on an acco untability measure has some specific tradeoffs as noted in the method section of this manuscript and as discussed in the earlier paragraphs. Because we failed to detect statistically signif icant effects for academic accountability among elementary schools with our data, considerably more re search is warranted in this area, research that approaches academic accountability of elementary schools from a truly experimental viewpoint as opposed to an applied legislative perspective as has been done in this study. There are still questions whether selection practices at the screening stage of the selection differ for the extreme low and high performers. Although we would speculate that valid selection practices would be realized more likely by considering school specific demand characteristi cs than by mimicking selection practices of the elite, only additional research can provide suc h information through comparing those school performing far from state averages. Collectively, these results imply other specific recommendations that warrant the consideration of policy makers and educational personnel. First, changes in the status quo (centralized versus decentralized selection practice s) should be based on empirical evidence rather than strictly a political agenda. If empirical inform ation is lacking relative to alternative teacher selection practices as noted within the literature, then these governing bodies should fund site-based studies to guide their decision making process befo re enacting any changes on a statewide basis. Second, attempts to mimic the teacher selecti on practices of high-performing elementary schools in low-performing elementary schools is without any empirical support in the general selection literature and the data in this study. Such attempts to study only high-performing schools as done in the past (Wise, et al., 1987) ignore ot her important contextual factors beyond the teacher that influence the performance of public schools. Based on our data, such future efforts require attention to the composition of applicant pools relative to quality, the role congruence of evaluators and applicants within the teacher-selection process, and especially to traditional selection paradigms focusing on pre-employment assessme nts and post-employment outcomes. Finally, our study, like all studies, suffers from specific limitations. Most importantly, we chose specific states (Kentucky and Ohio) varying teacher-selection processes, manipulated selective role incumbents (parents, principals, and teacher s) within the teacher-selection process, defined academic accountability of elementary schools accord ing to certain criteria, focused on a particular type of focal position (elementary teacher candidate), used the same set of teacher credentials across all experimental conditions, examined only scr eening as opposed to interviewing decisions, and assessed screening decisions relative to specific criteria. Consequently, any generalization beyond these restraints is pending further investigations.
Effects of a State Mandated Policy 17 References Arvey, R. D. & Faley, R. H. (1992). Fairness in selecting employees (2nd ed.). Reading, MA: Addison-Wesley. Appalachia Educational Lab (1992). Notes from the field: Educational reform in rural Kentucky, 1991Â–1992 Office of Educational Research and Improvement, Washington D.C. Barr, S.H. & Hitt, M.A. (1987). A comparison of selection decisions models in management versus student samples. Personnel Psychology 39 599Â–617. Bogardus, E. S. (1967). Measuring social distances. In M. Fishbein (Ed,), Readings in attitude theory and measurement (pp, 71Â–76). New York: John Wiley. Botwinick, J. (1978). Aging and behavior: A co mprehensive integration of research findings New York: Springer. Bowman, J. S. (1998). The relationship between applicant ag e and evaluator age in pre-interview screening of teacher applicants Unpublished doctoral dissertation, The Ohio State University, Columbus. Byrne, D. (1961). Interpersonal attraction and attitude similarity. Journal of Abnorm al and Social Psychology 62(3), 713Â–715. Cable, D.M. & Gilovich T. (1998). Looked ov er or overlooked? Prescreening decisions and postinterview evaluations. Journal of Applie d Psychology, 83 501Â–508. Campbell, D.T. & Stanley, J.C. (1963). Expe rimental and quasi-exp erimental designs for research. In N.L. Gage (Ed.), Handbook of research on teaching (pp. 171Â–246). Chicago: Rand McNally & Co. Cleveland, J.N., & Landy, F. J. (1983). The effects of pers on and job ster eotypes on two personnel decisions. Journal of Applied Psychology, 68 609Â–619. Cohen, J. (1977). Statistical Power analysis for the behavioral sciences New York: Academic Press. Chounet, F. P, (2002). The influence of chronological age of applicants and the mode of applicant stimulation on screening decisions ma de by elementary school principals Unpublished doctoral dissertation, The University of California, Davis. Cuban, L (1988). The managerial imperative and the pr actice of leadershi p in the schools Albany: State University of New York Press. Fisher, R.A. (1936). The use of multiple measurements in taxonomic problems. Annals of Eugenics, 7 179Â–188.
Education Policy Analysis Archives Vol. 14 No. 7 18 Graces, F.P. (1932). The administration of American education New York: Macmillan. Gorman, C.D., Clover, W.H., & Doherty, M. E. (1978). Can we learn anything about interviewing real people from Â“interviewsÂ” of paper people? Two st udies of the external validity of a paradigm. Organizational Behavior & Human Decision Processes, 22 (2), 165Â– 192. Kannapel, P.J., Moore, B.D., Coe, P. & Aagaar d, L. (1995). Six head s are better than one? School-based decision ma king in rural Kentucky. Journal of Research in Rural Education, 11 (1), 15Â–23. Kentucky Educatio nal Reform Act of 1990. (1990). H. B. 940, General Assembly, Regular Session, Volume 1. Kirk, R. M. (1968). Experimental design: Experimental pr ocedures for the behavioral sciences Belmont, CA: Wadsworth. Lindle, J.C. (2000). School-based decision making In J. M. Petrosko & J.C. Lindle (Eds.), 2000 Review of Research on Kentucky Education Reform Act (KERA) (pp. 279Â–305). Lexington KY: Kentucky Institute for Education Research. Lindle J.C. & Shrock, J. (1993) School-based decision-making co uncils and the hiring process. NASSP Bulletin 77, 71Â–76. Lui, E. & Johnson, S.M. (2003). New teachersÂ’ experiences in hiri ng: Late, rushed, and information poor Cambridge, MA: Project on the Next Generation of Teachers. Macan, T.H. & Dipb oye, R. L. (1994) The effects of the applicat ion on processing of information from the employment interview. Journal of Applied Social Psycholog y, 24(14), 1291Â–1314. Michener, H.A., Delamater, J.D., & Myers, D.J. (2004). Social Psychology. Belmont, CA: Wadsworth/Thomson Learning. Newton, R.M., Giesen, J., Freeman, J., Bishop H., & Zeitoun, P (. 2003). Assessing the reactions of men and wo men to attributes of the principalship. Educational Administration Quarterly, 39 468Â–503. Newton, R.M., Winter, P.A., & Ke edy, (2001). Teacher attraction to school council service in Kentucky: Implications for national school reform. Planning and Changing 32 (1), 84Â– 103. Oto, T. (2003). Effects of national origin, chronological age, and locu s of decision on teacher selection decision: A social distance and person-organization fit perspective. Unpublished doctoral dissertation, University of California, Davis. Pounder, D.G. & Merrill (2001). Job desirability of the high school princi palship: A job choice theory perspective. Educational Administration Quarterly, 37 27Â–57.
Effects of a State Mandated Policy 19 Rebore, R.W.(1995). Personnel administration in ed ucation: A management approach Needham Heights, MA: Simon & Schuster. Reis, S.C., Young, and Jury J.C. (1999). Female Admini strators: A crack in the glass ceiling.. Journal of Personnel Evalua tion in Education, 13 (4),71Â–82. Stevens, J.P. (2002). Applied multivariate statistics for the social scienc es. Mahwah, NJ: Lawrence Erlbaum Associates. Stollard, J.B. (1990). An investigation of factors in resumes that influence the selection of teachers. Unpublished Ph.D. dissertation, Ohio State University. Wallich, L.R. (1984). The effects of age and sex on the prescreening selection of teachers Unpublished Ph.D. dissertation, Un iversity of Wisconsin-Madison. Wanous, J. P., & Reichers, A. E. (1996). Estimating the reliab ility of a single -item measure. Psychological Reports, 78 (2), 631Â–634. Winer, B.J. (1962). Statistical principles in experimental design McGraw-Hill: New York. Weinfurt, K.P. (2001). Multivaria te analysis of variance. In L. Grimm & P. Yarnnold (Eds,), Readings and understanding multivariate statistics (pp. 245Â–276). Washington DC: American Psychological Association. Winter, P.A., & Melloy, S. H. (2004). Teacher recruitment in a reform state: Effects of school classification, signing bonus, and applicant experience Paper presented at the American Educational Research Associ ation, San Diego, CA. Winter P.A., & Morganthal, J.R. (2002). Principa l recruitment in a reform environment: Effects of school achievem ent and school level on applicant attraction to the job. Educational Administration Quarterly, 38 319Â–340. Winter, P. A., Ronau, R. N., & Muoz, M. A. (2004). Evaluating urba n teacher recruitment programs: An application of priv ate sector recruitment theories. Journal of School Leadership, 14 85Â–104. Wise, A.E., Darling-Hammond, L., Berry, B., Berlin er, D., Haller, E., Pras kac, A., & Schlechty. (1987). Effective teacher selection fr om recruitment to retention RAND, Santa Monica:CA.. Young, I.P., & Allison, B.H. (1982). Effects of candidate age and experience on school superintendents and principals in selecting teachers. Planning and Changing, 13 (4), 245Â– 256. Young, I.P., & Chounet, P.F. (2003). Effects of chronologica l age and information media on teacher screening decisions for elementary school principals, Journal of Personnel Evaluation in Education, 17 (2), 157-172
Education Policy Analysis Archives Vol. 14 No. 7 20 Young, I.P., Chounet, P.F., Buster A., & Sailor, S. (2005). Effe cts of student achievement on satisfaction of newly ap pointed teachers: A cognit ive dissonance perspective. Journal of School Leadership, 15 (4), 35-51. Young, I. P. & De La Torre, X.G. (In press). Su perintendentsÂ’ perceptions about social distance, succession, and Â“sunsetÂ” provisions for Asian, Hispanic, and Native American candidates seeking building le vel administrator positions: A structural model and an empirical investigation Journal of School Leadership. Young, I.P., & Delli, D.A. (2002). The validity of the Teacher Perceiver In terview for predicting performance of classroom teachers. Educational Administration Quarterly, 38 (5) 586Â– 612. Young, I.P., & Fox, J. A. (2002). Asian, Hi spanic and Native American job candidates: Prescreened or screened with the selection process. Educational Administration Quarterly, 38 (4), p. 530Â–554. Young, I. P., & McMurray, B. ( 1986). Effects of chronological age, focal position, quality of information, and quality of information on screening deci sions for teacher candidates. Journal of Research and Deve lopment in Education, 19 (4), 1Â–10. Young, I.P., & Oto, T. (2004). Th e impact of principals screenin g decisions for Asian, Hispanic, and Native American teacher ca ndidates as viewed from a so cial distance perspective. Leadership and Policy in Schools, 3 (4), 295Â–323. Young, I.P., & Prince, A. L. (1 999). Legal implications for teacher selecti on as defined by the ADA and the ADEA. Journal of Law and Education, 28 (4), 517Â–530. Young, I.P., Rinehart, J. S., & Baits, D. M. (1 997). Age discrimination: Impact of chronological age and perceived position demand s on teacher screening decisions. Journal of Research & Development in Education, 30 (2), 103Â–112. Young, & Ryerson, D. (1986). Teacher selection: Legal, practi cal, and theoretical aspects. (UCEA Monograph Series). University Park, PA : University Council for Educational Administration. Young, I. P., & Voss, G. M. (1986). Effects of age, focal position and amount of resume information on teacher selection decisions. Journal of Educational Equity and Leadership, 6 (1), 27Â–44. Zar, J. H. (1984). Biostatistical analysis (2nd Ed.). Englewood Cliffs NJ: Prentice-Hall.
Effects of a State Mandated Policy 21 About the Authors I. Phillip Young University of California-Davis Kimberly Miller-Smith Southwest Licking County Local School District-Ohio Email: email@example.com I. Phillip Young is a professor of education at the University of California Â–Davis and co-directs both a Joint Doctoral Program in Educational Leadership and the University of California Educational Research Ce nter. His research interests incl ude human resour ce issues in education. Kimberly MillerÂ–Smith is Assistant Superintendent at Southwest Licking Local School District. Her research interests are human resource issues and organizational change strategies.
Education Policy Analysis Archives Vol. 14 No. 7 22 EDUCATION POLICY ANALYSIS ARCHIVES http://epaa.asu.edu Editor: Sherman Dorn, University of South Florida Production Assistant: Chris Murre ll, Arizona State University General questions about ap propriateness of topics or particular articles may be addressed to the Editor, Sherman Dorn, firstname.lastname@example.org. Editorial Board Michael W. Apple University of Wisconsin David C. Berliner Arizona State University Robert Bickel Marshall University Gregory Camilli Rutgers University Casey Cobb University of Connecticut Linda Darling-Hammond Stanford University Gunapala Edirisooriya Youngstown State University Mark E. Fetler California Commission on Teacher Credentialing Gustavo E. Fischman Arizona State Univeristy Richard Garlikov Birmingham, Alabama Gene V Glass Arizona State University Thomas F. Green Syracuse University Aimee Howley Ohio University Craig B. Howley Ohio University William Hunter University of Ontario Institute of Technology Daniel Kalls Ume University Benjamin Levin University of Manitoba Thomas Mauhs-Pugh Green Mountain College Les McLean University of Toronto Heinrich Mintrop University of California, Berkeley Michele Moses Arizona State University Anthony G. Rud Jr. Purdue University Michael Scriven Western Michigan University Terrence G. Wiley Arizona State University John Willinsky University of British Columbia
Effects of a State Mandated Policy 23 EDUCATION POLICY ANALYSIS ARCHIVES English-language Graduate -Student Editorial Board Noga Admon New York University Jessica Allen University of Colorado Cheryl Aman University of British Columbia Anne Black University of Connecticut Marisa Burian-Fitzgerald Michigan State University Chad d'Entremont Teachers College Columbia University Carol Da Silva Harvard University Tara Donahue Michigan State University Camille Farrington University of Illinois Chicago Chris Frey Indiana University Amy Garrett Dikkers University of Minnesota Misty Ginicola Yale University Jake Gross Indiana University Hee Kyung Hong Loyola University Chicago Jennifer Lloyd University of British Columbia Heather Lord Yale University Shereeza Mohammed Florida Atlantic University Ben Superfine University of Michigan John Weathers University of Pennsylvania Kyo Yamashiro University of California Los Angeles
Education Policy Analysis Archives Vol. 14 No. 7 24 Archivos Analticos de Polticas Educativas Associate Editors Gustavo E. Fischman & Pablo Gentili Arizona State University & Universidade do Estado do Rio de Janeiro Founding Associate Editor for Spanish Language (1998Â—2003) Roberto Rodrguez Gmez Editorial Board Hugo Aboites Universidad Autnoma Metropolitana-Xochimilco Adrin Acosta Universidad de Guadalajara Mxico Claudio Almonacid Avila Universidad Metropolitana de Ciencias de la Educacin, Chile Dalila Andrade de Oliveira Universidade Federal de Minas Gerais, Belo Horizonte, Brasil Alejandra Birgin Ministerio de Educacin, Argentina Teresa Bracho Centro de Investigacin y Docencia Econmica-CIDE Alejandro Canales Universidad Nacional Autnoma de Mxico Ursula Casanova Arizona State University, Tempe, Arizona Sigfredo Chiroque Instituto de Pedagoga Popular, Per Erwin Epstein Loyola University, Chicago, Illinois Mariano Fernndez Enguita Universidad de Salamanca. Espaa Gaudncio Frigotto Universidade Estadual do Rio de Janeiro, Brasil Rollin Kent Universidad Autnoma de Puebla. Puebla, Mxico Walter Kohan Universidade Estadual do Rio de Janeiro, Brasil Roberto Leher Universidade Estadual do Rio de Janeiro, Brasil Daniel C. Levy University at Albany, SUNY, Albany, New York Nilma Limo Gomes Universidade Federal de Minas Gerais, Belo Horizonte Pia Lindquist Wong California State University, Sacramento, California Mara Loreto Egaa Programa Interdisciplinario de Investigacin en Educacin Mariano Narodowski Universidad To rcuato Di Tella, Argentina Iolanda de Oliveira Universidade Federal Fluminense, Brasil Grover Pango Foro Latinoamericano de Polticas Educativas, Per Vanilda Paiva Universidade Estadual Do Rio De Janeiro, Brasil Miguel Pereira Catedratico Un iversidad de Granada, Espaa Angel Ignacio Prez Gmez Universidad de Mlaga Mnica Pini Universidad Nacional de San Martin, Argentina Romualdo Portella do Oliveira Universidade de So Paulo Diana Rhoten Social Science Research Council, New York, New York Jos Gimeno Sacristn Universidad de Valencia, Espaa Daniel Schugurensky Ontario Institute for Studies in Education, Canada Susan Street Centro de Investigaciones y Estudios Superiores en Antropologia Social Occidente, Guadalajara, Mxico Nelly P. Stromquist University of Southern California, Los Angeles, California Daniel Suarez Laboratorio de Politicas Publicas-Universidad de Buenos Aires, Argentina Antonio Teodoro Universidade Lusfona Lisboa, Carlos A. Torres UCLA Jurjo Torres Santom Universidad de la Corua, Espaa