A Synthesis of Research on Language of Reading Instruction for ...

15 downloads 27420 Views 4MB Size Report
Review of Educational Research. Summer 2005, Vol. 75, No. 2, pp. 247-284 ... of Hispanic origin (NCES, 2004), and this is also one of the fastest growing of all groups. .... When a child enters kindergarten or first grade with limited proficiency in .... Yet bilingual models can vary substantially in quality, amount of expo-.
American Educational Research Association

A Synthesis of Research on Language of Reading Instruction for English Language Learners Author(s): Robert E. Slavin and Alan Cheung Source: Review of Educational Research, Vol. 75, No. 2 (Summer, 2005), pp. 247-284 Published by: American Educational Research Association Stable URL: http://www.jstor.org/stable/3516050 Accessed: 12/08/2009 13:12 Your use of the JSTOR archive indicates your acceptance of JSTOR's Terms and Conditions of Use, available at http://www.jstor.org/page/info/about/policies/terms.jsp. JSTOR's Terms and Conditions of Use provides, in part, that unless you have obtained prior permission, you may not download an entire issue of a journal or multiple copies of articles, and you may use content in the JSTOR archive only for your personal, non-commercial use. Please contact the publisher regarding any further use of this work. Publisher contact information may be obtained at http://www.jstor.org/action/showPublisher?publisherCode=aera. Each copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed page of such transmission. JSTOR is a not-for-profit organization founded in 1995 to build trusted digital archives for scholarship. We work with the scholarly community to preserve their work and the materials they rely upon, and to build a common research platform that promotes the discovery and use of these resources. For more information about JSTOR, please contact [email protected].

American Educational Research Association is collaborating with JSTOR to digitize, preserve and extend access to Review of Educational Research.

http://www.jstor.org

Reviewof EducationalResearch Summer2005, Vol. 75, No. 2, pp. 247-284

A Synthesis of Research on Language of Reading Instruction for English Language Learners Robert E. Slavin Johns Hopkins University Alan Cheung Success for All Foundation This article reviews experimental studies comparing bilingual and Englishonly reading programs for English language learners. The review method is best-evidence synthesis, which uses a systematic literature search, quantification of outcomes as effect sizes, and extensive discussion of individual studies that meet inclusion standards. A total of 17 studies met the inclusion standards. Among 13 studies focusing on elementary reading for Spanishdominant students, 9favored bilingual approaches on English reading measures, and 4found no differences,for a median effect size of + 0.45. Weighted by sample size, an effect size of +0.33 was computed, which is significantly different from zero (p < .05). One of two studies of heritage languages (French and Choctaw) and two secondary studies favored bilingual approaches. The review concludes that although the number of high-quality studies is small, existing evidence favors bilingual approaches, especially paired bilingual strategies that teach reading in the native language and English at different times each day. However, further research using longitudinal, randomized designs is needed to determine how best to ensure reading success for all English language learners.

KEYWORDS: bilingual education,English language learners,language of instruction, reading,researchreview. The reading education of English language learners(ELLs) has become one of the most importantissues in all of educational policy and practice. As the pace of immigrationto the U.S. and other developed countries has accelerated in recent decades, increasing numbers of children in U.S. schools come from homes in which English is not the primarylanguage spoken. As of 1999, 14 million Americans aged 5-24, or 17% of that age group, spoke a language other than English at home. This is more than twice the number of such individuals in 1979, when only 9% of Americans aged 5-24 spoke a language other than English at home (NCES, 2004). Although many children of immigrantfamilies succeed in reading, too many do not. In particular,Latino and Caribbeanchildren are disproportionatelylikely to perform poorly in reading and in school. As No Child Left Behind and other federal and state policies begin to demand success for all subgroups of children, the reading achievement of English language learners is taking on even more importance. Thousands of schools cannot meet their adequate yearly progress goals, for example, unless their 247

Slavin & Cheung

English language learnersare doing well in reading. More important,American society cannot achieve equal opportunity for all if its schools do not succeed with the children of immigrants. Sixty-five percentof non-English-speakingimmigrantsin the United Statesare of Hispanicorigin (NCES, 2004), and this is also one of the fastest growing of all groups.Hispanicshave recentlysurpassedAfricanAmericansas the largestminority group in the United States. Hispanic studentsas a whole, including Englishproficientchildrenin the second generationand beyond, score significantlylower in reading than other students. On the National Assessment of Educational Progress(NAEP; Grigg, Daane,Jin, & Campbell,2003), which excludes children with the lowest levels of English proficiency from testing, only 44% of Latino fourth gradersscored at or above the "basic"level, in comparisonwith 75% of Anglo students.Only 15%of Latinofourthgradersscoredat "proficient"or better, as comparedwith 41% of Anglos. Furthermore,31%of studentswho speak Spanish at home fail to complete high school, as comparedwith 10%of studentswho speak only English (NCES, 2004). There is considerable controversy, among policymakers, researchers, and educators, about how best to ensure the reading success of English language learners.Many aspects of instructionare importantin the readingsuccess of English language learners, but one question has dominated all others: What is the appropriaterole of the native language in the instruction of English language learners?In the 1970s and 1980s, policies and practice favored bilingual education, in which children were taughtpartiallyor entirely in their native language, andthen transitionedat some point duringthe elementarygrades to English-only instruction.Such programsare still widespread,but from the 1990s to the present, the political tide has turnedagainstbilingual education;California,Arizona, Massachusetts,and other states have enacted policies to greatly curtailbilingual education. Recent federal policies restrict the amount of time that children can be taughtin their native language. Among researchers,the debate between advocates of bilingual and English-only reading instructionhas been fierce, and ideology has often trumpedevidence on both sides of the debate (Hakuta,Butler, & Witt, 2000). This articlereviews researchon the languageof readinginstructionfor English languagelearnersin an attemptto applyconsistent,well-justifiedstandardsof evidence to drawconclusions aboutthe role of native languagein readinginstruction for these children.The review applies a techniquecalled "best-evidencesynthesis" (Slavin, 1986), which attemptsto use consistent, clear standardsto identify unbiased, meaningfulinformationfrom experimentalstudies and then discusses each qualifying study, computing effect sizes but also describing the context, design, and findings of each study. Best-evidence synthesis closely resembles meta-analysis,but it requiresmore extensive descriptionof key studies.Details of this procedureare describedbelow. The purposeof this review is to examine the evidence on language of instructionin reading programsfor English language learnersto discover how much scientific basis thereis for competingclaims about the effects of bilingual as opposed to English-only programs.Such a review is needed to inform practitioners,policymakers, and researchersabout the current stateof the evidence on this topic and aboutgaps in the knowledgebase in need of furtherscientific investigation. 248

Language of Instruction For many years, researchers,educators, and policymakers have debated the questionof the appropriatelanguageof readinginstructionfor childrenwho speak languagesotherthanEnglish. Proponentsof bilingualinstructionarguethatwhile childrenarelearningto speakEnglish, they shouldbe taughtto readin theirnative languagefirst,to avoid the failureexperiencethatis likely if childrenare asked to learnboth oral English and English readingat the same time. Programsbased on this philosophytransitionchildrento English-onlyinstructionwhen theirEnglish is sufficientto ensuresuccess, usuallyin thirdor fourthgrade.Alternatively,many bilingualprogramsteach young childrento readboth in theirnative languageand in English, at differenttimes of the day or on alternatingdays. Thereis a greatdeal of evidence thatchildren'sreadingproficiencyin theirnative languageis a strong predictorof their ultimate English reading performance(Garcia, 2000; Lee & Schallert, 1997; Reese, Garier, Gallimore,& Goldenberg,2000) and that bilingualism itself does not interfere with performancein either language (Yeung, Marsh,& Suliman,2000). Bilingual advocatesalso arguethatwithoutnative language instruction,Englishlanguagelearnersarelikely to lose theirnativelanguage proficiency,or fail to learnto readin theirnative language,losing skills thatareof economic and social value in the world today. Opponentsof bilingual education, on the otherhand, arguethatnative languageinstructioninterfereswith or delays English language development,and relegates childrenwho receive such instruction to a second-class,separatestatuswithinthe school and,ultimately,withinsociety. They reason that more time on English reading should translateinto more learning(see Rossell & Baker, 1996). Reviews of the educationaloutcomesof nativelanguageinstructionhavereached sharplyconflictingconclusions. In a meta-analysis,Willig (1985) concludedthat bilingual education was more effective than English-only instruction.WongFillmoreand Valadez (1986) came to the same conclusion.However, a review by Rossell and Baker (1996) claimed that most methodologicallyadequatestudies found bilingual education to be no more effective than English-only programs. Greene(1997) re-analyzedthe studiescited by Rossell and Bakerandreportedthat thetreatments, manyof the studiestheycitedlackedcontrolgroups,mischaracterized or hadotherseriousmethodologicalflaws.Amongthe studiesthatmet an acceptable standardof methodologicaladequacy,including all of the studies using random assignmentto conditions, Greene found that the evidence favored programsthat madesignificantuse of nativelanguageinstruction.AugustandHakuta(1997) concludedthatalthoughresearchgenerallyfavoredbilingualapproaches,the natureof the methodsused andthe populationsto which they were appliedwere moreimportantthanthe languageof instructionperse. Quantitativeresearchon the outcomesof bilingualeducationhas diminishedin recentyears, but policy and practiceare still of researchon this topic.The followbeing influencedby conflictinginterpretations ing sectionssystematicallyexaminethisevidenceto attemptto discoverwhatwe can learnfromresearchto guide policies in this controversialarena. English Immersionand Bilingual Programs When a child enters kindergartenor first grade with limited proficiency in English,the school faces a seriousdilemma.How can the child be expectedto learn the skills andcontenttaughtin the earlygradeswhile he or she is learningEnglish? 249

Slavin& Cheung There may be many solutions, but two fundamentalcategories of solutions have predominated:English immersionand bilingual education. English Immersion In immersionstrategies,Englishlanguagelearnersareexpectedto learnin English fromthe beginning,andtheirnativelanguageplays littleor no role in dailyreading lessons. Formalor informalsupportis likely to be given to ELLs to help them cope in an all-Englishclassroom.Such supportmay includehelp from a bilingual aide who providesoccasionaltranslationor explanation,a separateclass in English as a Second Languageto help build oral English skills, or use of a carefulprogression from simplifiedEnglish to full English as children'sskills grow. Teachersof English languagelearnersmay use languagedevelopmentstrategiessuch as total physical response (acting out words) and realia (concrete objects to represent words) to help studentsinternalizenew vocabulary.Teachersmay simplify their languageand teach specific vocabularythatis likely to be unfamiliarto ELLs (see Calder6n, 2001; Carlo et al., 2004). Immersion may involve placing English languagelearnersimmediatelyin classes containingEnglishmonolingualchildren, or it may involve teachingELLsin a separateclass for some time untilthe children are ready to be mainstreamed.These variationsmay well have importancein the outcomes of immersionstrategies,but their key common featureis the exclusive use of Englishtexts, with instructionoverwhelminglyor entirelyin English. Many authorshave made distinctionsamong variousforms of immersion.One term often encounteredis "submersion,"primarilyused pejoratively to refer to "sink or swim" strategiesin which no special provision is made for the needs of Englishlanguagelearners.This is contrastedwith "structuredEnglishimmersion," which refersto a well-planned,gradualphase-inof English instructionrelying initially on simplificationand vocabulary-buildingstrategies.In practice,immersion strategiesare rarelypure types; and in studies of bilingual education,immersion strategies are rarely described beyond their designation as the English-only "controlgroup." Bilingual Education Bilingual education differs fundamentallyfrom English immersion in that it gives English language learners significant amounts of instruction in reading and/or other subjects in their native language. In the United States, the overwhelming majorityof bilingual programsinvolve Spanishbecause of the greater likelihoodof a criticalmass of studentswho are Spanish-dominantand the greater availabilityof Spanishmaterials.Therearebilingualprogramsin Portuguese,Chinese, and other languages, but these are rare. In transitionalbilingual programs, children are taughtto read entirely in their native language throughthe primary grades;they transitionto English readinginstructionsomewherebetween the second and fourthgrades.English oral languageproficiencyis taughtfrom the beginning, and subjectsother than readingmay be taughtin English. But the hallmark of transitionalbilingualeducationis the teachingof readingin the nativelanguage for a periodof time. Such programscan be "early-exit"models, with transitionto English completed in second or thirdgrade, or "late-exit"models, in which children may remainthroughoutelementaryschool in native-languageinstructionto ensuretheirmasteryof readingand contentbefore transition(see Ramirez,Pasta, 250

Research on Languageof ReadingInstructionforELLs

Yuen, Billings, & Ramey, 1991). Alternatively,"pairedbilingual"models teach childrento readin both English and theirnative languageat differenttime periods each day or on alternatingdays. Within a few years, the native languagereading instructionmay be discontinued,as childrendevelop the skills to succeed in English. Willig (1985) called this model "alternativeimmersion,"becausechildrenare alternativelyimmersedin native languageand English instruction. Two-way bilingualprograms,also called "duallanguage"or "dualimmersion," providereadinginstructionin the nativelanguage(usuallySpanish)andin English both to ELLs and to English speakers(Calderon& Minaya-Rowe,2003; Howard, Sugarman,& Christian,2003). For the ELLs, a two-way programis like a paired bilingual model, in that they learn to read both in English and in their native languageat differenttimes each day. A special case in bilingual education is the kind of programthat is designed more to preserveor show respect for a given language than to help childrenwho are genuinely struggling with English. For example, Morgan (1971) studied a programin Louisianafor childrenwhose parentsoften spoke Frenchat home but generallyspoke English as well. Such "heritagelanguage"programsare included in this review if the outcome variablein the study is an English readingmeasure. However, these programsshould be thoughtof as addressinga differentproblem fromthataddressedby bilingualor immersionreadinginstructionfor childrenwho are limited in English proficiency. Problems of Research on Language of Instruction Researchon the achievementeffects of teachingin the child's nativelanguage, in comparisonwith teaching in English, suffers from a numberof inherentproblems beyond those typical of otherresearchon educationalprograms.First, there are problemsconcerningthe ages of the childreninvolved, the length of time they have been taught in their first language, and the length of time they have been taught in English. For example, imagine that a transitionalbilingual program teaches Spanish-dominantstudentsprimarilyin Spanishin GradesK-2 and then graduallytransitionsthem to English by fourthgrade.If this programis compared with an English immersionprogram,at what grade level is it legitimateto assess the childrenin English?Clearly,a test in second gradeis meaningless,as the bilingual childrenhave not yet been taughtto readin English. At the end of thirdgrade, the bilingual studentshave partiallytransitioned,but have they had enough time to become fully proficient?Some would argue that even the end of fourthgrade would be too soon to assess the childrenfairly in such a comparison,as the bilingual childrenneed a reasonabletime periodin which to transfertheirSpanishreading skills to English (see, for example, Hakuta,Butler,& Witt, 2000). A relatedproblemhas to do with pretesting.Imaginethata studyof a K-4 transitional Spanish bilingual programbegan in third grade. What pretest would be meaningful?An Englishpretestwould understatethe skills of the transitionalbilingual students, while a Spanish test would understatethe skills of the English immersionstudents.Forexample, Valladolid(1991) comparedgains from Grades 3 to 5 for childrenwho had been in eitherbilingual or immersionprogramssince kindergarten.These children's"pretest"scores are in fact posttestsof very different treatments.Yet studies comparingtransitionalbilingual and immersionprogramsaretypicallytoo brief to have given the studentsin the transitionalbilingual 251

Slavin & Cheung

programsenough time to have completed the transitionto English. In addition, many studies begin after students have already been in bilingual or immersion treatmentsfor several years. The studiesthatdo look at 4- or 5-yearparticipationsin bilingualor immersion programsare usually retrospective(i.e., researcherssearch records for children who have alreadybeen throughthe program).Retrospectivestudiesalso have characteristicbiases, in thatthey begin with the childrenwho ended up in one program or another.Forexample,childrenwho areremovedfrom a given treatmentfor systematicreasons,such as Spanish-dominantstudentsremovedfromEnglishimmersion becauseof theirlow performancethere,can greatlybias a retrospectivestudy, makingthe immersionprogramlook more effective thanit was in reality. Many inherentproblemsrelateto selection bias. Childrenend up in transitional bilingualeducationor English immersionby many processes thatcould be highly consequentialfor the outcomes. For example, Spanish-dominantstudentsmay be assigned to Spanishor English instructionon the basis of parentpreferences.Yet parentswho would select English programsare surely differentfrom those who would select Spanishin ways thatmatterfor outcomes. A parentwho selects English may be moreor less committedto education,may be less likely to be planning to returnto a Spanish-speakingcountry,or may feel morepositive aboutassimilation. Thomas and Collier (2002) reported extremely low scores for Houston studentswhose parentsrefusedto have theirchildrenplaced in eitherbilingualor English as a Second Languageprograms.Are those scores due to relativelypositive effects of bilingual and ESL programs,or are there systematic differences between children whose parents refused bilingual or ESL programsand other children?It is impossible to say, as no pretestscores were reported. Bilingual programsare more likely to exist in schools with very high proportions of English languagelearners,and this is anotherpotentialsource of bias. For example, Ramirez et al. (1991) found that schools using late-exit bilingual programshad much higherproportionsof ELLs thandid early-exitbilingualschools, and English immersionschools had the smallest proportionof ELLs. This means that whateverthe languageof instruction,childrenin schools with very high proportionsof ELLs are conversingless with native English speakersboth in and out of school thanmightbe the case in an integratedschool andneighborhoodthatuses English for all studentsbecause its proportionof ELLs is low. Most problematically, individualchildrenmay be assignedto native languageor Englishprograms because of theirperceivedor assessed competence.Native languageinstructionis often seen as an easier, more appropriateplacementfor ELLs who are struggling to readin theirfirstlanguage, whereasstudentswho arevery successful readersin their firstlanguageor are felt to have greaterpotentialare placed in English-only classes. This selectionproblemis most vexing at the pointof transition,as the most successful studentsin bilingualprogramsgo throughthe transitionearlierthanthe least successful children. A study comparingbilingual and immersionprograms involving thirdor fourthgradersmay be seriouslybiased by the fact thatthe highest-achievingbilingualstudentsmay have alreadybeen transitioned,with the result thatthe remainingstudentsare the lowest achievers. A source of bias not unique to studies of bilingual educationbut very importantin this literatureis the "file drawer"problem:the fact that studies showing no differences are less likely to be publishedor to otherwise come to light. This is a 252

Research on Languageof ReadingInstructionfor ELLs

particularproblemin studies with small sample sizes, which are very unlikely to be publishedif they show no differences.The best antidoteto the file drawerproblem is to search for dissertationsand technical reports,which are more likely to presenttheir dataregardlessof the findings (see Cooper, 1998). Finally, studiesof bilingualeducationoften say too little aboutthe bilingualand immersionprogramsthemselves or the degree or qualityof implementationof the programs.Yet bilingualmodels can vary substantiallyin quality,amountof exposure to English in and out of school, teachers' language facility, time duringthe school day, instructionalstrategiesunrelatedto languageof instruction,and so on. Because of these inherentmethodologicalproblems,an adequatestudycomparing bilingualandimmersionapproacheswould (a) randomlyassign a largenumber of childrento be taughtin Englishor theirnativelanguage;(b) pretestthemin their native languagewhen they begin to be taughtdifferentially,either in their native languageor in English (typicallyin kindergarten);(c) follow them long enoughfor the latest-transitioningchildrenin the bilingualconditionto have completedtheir transitionto English and have been taughtlong enough in English to make a fair comparison;and (d) collect datathroughoutthe experimentto documentthe treatments received in all conditions.Unfortunately,only a few, very small studies of this kind have ever been carriedout. As a result,the studiesthatcomparebilingual and English-onlyapproachesmust be interpretedwith greatcaution. Review Methods This section focuses on researchcomparingimmersionand bilingual reading programsappliedwith English languagelearners,with measuresof English reading as the outcomes. The review method,best-evidence synthesis (Slavin, 1986), uses the systematicinclusioncriteriaandeffect size computationstypical of metaanalyses (see Cooper, 1998; Cooper& Hedges, 1994) but discusses the findingsof critical studies in a form more typical of narrativereviews. This strategy is particularlywell suited to the literatureon readingprogramsfor English language learners,because the studiesare few in numberand are substantivelyand methodologically diverse. In such a literature,it is particularlyimportantto learnas much as possible from each study, not just to average quantitativeoutcomes and study characteristics. LiteratureSearch Strategy The literaturesearch benefited from the assistance of the federally commissioned NationalLiteracyPanel on the Developmentof LiteracyAmong Language MinorityChildrenand Youth, chairedby Diane August and Timothy Shanahan. The first authorwas initially a memberof the panel but resigned in June 2002 to avoid a 2-year delay in publicationof the presentarticle.The article,however, is independentof the panel's reportand uses differentreview methodsand selection criteria.Research assistants searchedERIC, Psychological Abstracts,and other databases for all studies with the following descriptors: language minority students,Englishlanguage learners,bilingualeducation,bilingualstudents,bilingualism, English as a second language, English immersion,dual language, and two-waybilingual education.Citationsfrom otherreviews and articles were also obtained.In particular,every effort was made to find all studies cited in previous reviews. Fromthis set, we selected studies thatmet the criteriadescribedbelow. 253

Criteriafor Inclusion The best-evidence synthesis focused on studies that met minimal standardsof methodologicaladequacyand relevanceto the purposesof the review. These were as follows: Criterion1. The studiescomparedchildrenwho were taughtreadingin bilingual classes with those taughtin English immersionclasses, as definedearlier. Criterion2. Eitherrandomassignmentto conditionswas used, or pretesting or other matchingcriteriaestablishedthe degree of comparabilityof bilingual and immersiongroupsbefore the treatmentsbegan. If these matchingvariables were not identical at pretest,the analyses made adjustmentsfor pretestdifferences, or else data permittingsuch adjustmentswere presented.Studies without control groups, such as pretest-posttestcomparisonsor comparisonswith "expected"scores or gains, were excluded. Studies with pretest differences exceeding one standarddeviationwere excluded.Those with pretestdifferences less thanone standarddeviationwere includedif the researchershadcarriedout appropriatestatisticaladjustments. A special categoryof studies was rejectedon the basis of the requirementof pretestmeasurementbefore treatmentsbegan. Those were studies in which the bilingualandimmersionprogramswere alreadyunderway before pretestingor matching.Forexample, Danoff, Coles, McLaughlin,and Reynolds (1978), in a widely cited study, compared 1-yearreading gains in many schools by using bilingual or immersionmethods.The treatmentsbegan in kindergartenor first grade, but the pretests (and, later, posttests) were administeredto children in Grades2-6. Because the bilingualchildrenwere taughtprimarilyin theirnative language in K-1 and the immersion children were taught in English, their pretestsin secondgradewould surelyhave been affectedby theirtreatmentcondition. Meyer and Feinberg (1992, p. 24) noted the same problemwith reference to the Grades 1-3 componentof the Ramirezet al. (1991) study:"Itis like watching a baseball game beginning in the fifth inning: If you are not told the score from the previous innings, nothing you see can tell you who is winning the game."Similarly,severalstudiestestedchildrenin upperelementaryor secondarygradeswho had experiencedbilingualor immersionprogramsin earlier years. These studies were included if premeasureswere availablefrom before the programsbegan, but in most cases such premeasureswere not reported,so there was no way to know if the groups were equivalent beforehand (e.g., Thomas & Collier, 2002; Curiel,Stenning,& Cooper-Stenning,1980). Criterion3. The subjects were English language learnersin elementaryor secondary schools in English-speaking countries. Studies that mixed ELLs and English monolingual students in a way that did not allow for separate analyses were excluded (e.g., Skoczylas, 1972). Studies of children learning a foreign language were not included. However, Canadianstudies of French immersionhave been widely discussed and are thereforediscussed in a separate section. Criterion4. The dependentvariablesincludedquantitativemeasuresof English reading performance, such as standardizedtests and informal reading inventories.If treatment-specificmeasureswere used, they were includedonly if there was evidence that all groups focused equally on the same outcomes. 254

Research on Language of ReadingInstructionfor ELLs

Measures of outcomes related to reading, such as language arts, writing, and spelling, were not included. Criterion5. The treatmentdurationwas at least 1 school year. For the reasons discussed earlier,even 1-year studies of transitionalbilingual education are insufficient,because studentstaughtin theirnative languageareunlikely to have transitionedto English.Studiesshorterthan 1 yeardo not addressthe question in a meaningfulway. Studies thatpassed an initial screeningfor germanenessto the topic, includingall studies cited by Rossell and Baker (1996) or by Willig (1985), are listed in the Appendix,which indicateswhethereach study was includedand, if not, the main reasonsfor exclusion. Limitations It is importantto note thatthe review methodsappliedin this best-evidencesynthesis have some importantlimitations.First, in requiringmeasurableoutcomes and control groups, the synthesis excludes case studies and qualitative studies. Many such descriptive studies exist and are valuable in suggesting programsor practices that might be effective. Description alone, however, does not indicate how much childrenlearnedin a given programor what they would have learned had they not experiencedthat program.Second, it is possible that a programthat has no effect on readingachievementmeasuresmight neverthelessincrease children's interestin reading or readingbehaviors outside school. However, studies rarely measuresuch outcomes in any systematic or comparativeway, so we can only speculateaboutthem. Finally, it is importantto note thatmany of the studies reviewedtook place manyyearsago. Social andpoliticalcontexts, as well as bilingual andimmersionprograms,have changed,so it cannotbe takenfor grantedthat outcomesdescribedherewould applyto outcomesof bilingualandimmersionprogramstoday. Computationof Effect Sizes If possible, effect sizes were computedfor each study. These were computed as the experimentalmean minus the control mean, with the result divided by a pooled standarddeviation. When informationwas lacking, however, effect sizes were estimated using exact t or p values or other well-established estimation methods (see Cooper, 1998; Cooper & Hedges, 1994; Lipsey & Wilson, 2001). For studies that lacked means and standarddeviations and reportedno significant difference between the experimentaland controlgroups and did not indicate the direction of the effect (e.g., Cohen, 1975), an estimated effect size of zero was used. Only English reading measureswere used in determiningeffect sizes, even if othermeasureswere mentionedin the text. No study was excluded solely on the grounds that it did not provide sufficient informationfor computationof an effect size. Data Analysis All datawere enteredinto the betaversionof the ComprehensiveMeta-Analysis Program(Borenstein,2005) to estimatethe effect sizes of each study,to calculatethe overallmeanweightedeffect sizes, andto test whetherthe meanweightedeffect size 255

Slavin & Cheung

was derivedfroma homogeneousset (Q statistic).The weightingfactorwas sample size, so thateffect sizes from largersamplescontributedmoreto the meanthandid thosefromsmallersamples.Eachstudycontributeda single effect size to the overall meanweightedeffect size. Forstudiesthathad morethanone independentgroupor one independentoutcome measure,effect sizes were calculatedseparatelyfor each groupand measure.These effect sizes were then averagedto createone effect size for the study.For longitudinalstudies,the last time-pointwas used to estimatethe overalleffect of the study.Forexample,if a studyfollowed a groupof childrenfrom Grade1 to Grade5, the outcomemeasuresfor fifthgraderswere used to generatethe effect sizes. Previous Quantitative Reviews

The debate about empirical research on language of instruction for English language learners has largely pitted two researchers, Christine Rossell and Keith Baker, against several other reviewers. Rossell and Baker have carried out a series of reviews and critiques arguingthatresearchdoes not supportbilingual education (see Baker & de Kanter, 1981, 1983; Baker, 1987; Rossell, 1990; Rossell & Baker, 1996; Rossell & Ross, 1986). The most comprehensive and recent version of their review was published in 1996. In contrast, Willig (1985) carriedout a meta-analysis and concluded that research favored bilingual education, after controls were introduced for various study characteristics. Other reviewers using narrativemethodshave agreed with Willig (e.g., Wong-Fillmore & Valadez, 1986). Baker (1987) and Rossell and Baker (1996) criticized the Willig (1985) review in detail, and Willig (1987) respondedto the Baker (1987) criticisms. In a review commissionedby the TomasRiveraCenter,JayGreene(1997) carefully reexaminedthe Rossell andBaker(1996) review. WhereasRossell andBaker used a "vote-counting"methodin which they simply countedthe numbersof studies thatfavoredbilingual,immersion,or otherstrategies,Greene(1997) carriedout a meta-analysis in which each study produced one or more effect sizes, the proportionof a standarddeviationseparatingbilingualandEnglish-onlyprograms. Greenecategorizedonly 11 of the 72 studiescited by Rossell andBakeras methodologically adequate,and among those he calculatedan effect size of +0.21 favoring bilingualover English-onlyapproacheson English readingmeasures.Among five studies using randomassignment,Greene calculatedan effect size of +0.41 on English readingmeasures. As partof this review, we attemptedto obtainevery study reviewed by Rossell and Baker (1996) and by Willig (1985), as well as additionalstudies, and independently reviewed each one against the set of standardsoutlined previously. Consistent with Greene, we found that the Rossell and Baker (1996) review acceptedmany studies that lacked adequatemethodology. The Appendix lists all of the reading studies cited by Rossell and Baker according to categories of methodological adequacyoutlined in this article, which closely follow Greene's categorization.As is apparentfrom the Appendix, only a few of the studies met the most minimal of methodological standards,and most violated the inclusion criteriaestablishedby Rossell and Baker(1996) themselves. We found, however, that most of the 16 studies cited by Willig also did not meet these minimal standards.These are also noted in the Appendix. In itself, this does not mean that the 256

Researchon Languageof ReadingInstruction for ELLs overall conclusions of eitherreview are incorrect,but it does mean that the question of effects of languageof instructionon readingachievementmustbe explored with a different set of studies than the ones synthesized by either Rossell and Baker or Willig. The Rossell and Baker and Willig studies can be categorized as follows (following Greene, 1997): 1. Methodologicallyadequate studies of elementaryreading. These studies comparedEnglishlanguagelearnerswho were taughtto readthroughbilingual strategieswith those who were taughtthroughEnglish-onlystrategies, with randomassignmentor well-documentedmatchingon pretestsor other importantvariables. All of these studies focused on Spanish-dominant students. 2. Methodologicallyadequate studies of heritage language programs. Two studies,one involving Choctawin Mississippi andone involving Frenchin Louisiana,evaluatedbilingualprogramswith childrenwho generallyspoke English but were expected to benefit from introductionof their cultural language. 3. Methodologically adequate studies of secondary programs. We put two secondaryschool studies (Covey, 1973; Kaufman, 1968) in this separate category. 4. Canadianstudies of French immersion.Several studies (e.g., Lambert& Tucker, 1972; Genesee & Lambert, 1983) evaluated French immersion programsin Canada.However, because they compared immersion with monolingual English instruction or with brief French-as-a-secondlanguageclasses, these studieswere not evaluationsof bilingualeducation. 5. Studiesin whichthe targetlanguagewas not the societal language.In addition to Canadianstudies of French immersionin non-Francophoneareas (e.g., Day & Shapson, 1988), there was a study by Ramos, Aguilar, and Sibayan(1967) thatexaminedvariousstrategiesfor teachingEnglishin the Philippines. 6. Studies of outcomes other than reading. A few studies (e.g., Lum, 1971; Legarreta,1979; Pena-Hughes& Solis, 1980) assessed only oral language proficiency,not reading. 7. Studies in which "bilingual" treatmentsinvolved little use of native language reading instruction. A few studies (e.g., EducationalOperations Concepts, 199la, 1991b) evaluatedprogramsthat may be called bilingual but thatin fact made only incidentaluse of the native languageand did not use native languagereadingtexts. 8. Studiesin whichpretestingtookplace after treatmentswere underway. As notedearlier,manystudies(e.g., Danoff et al., 1978;Rosier & Holm, 1980; Rossell, 1990; Thomas& Collier, 2002; Valladolid, 1991) comparedgains made in bilingual and immersionprogramsafter the programswere well under way. Both the Willig review and the Rossell and Baker review included such studies, and Greene (1997) accepted some of them as "methodologicallyadequate";but we would argue that they add little to understandingthe effects of bilingualeducation. 9. Redundantstudies. Rossell and Baker included many studies that were redundantwith otherstudiesin theirreview. Forexample, one longitudinal 257

Slavin& Cheung study (El Paso, 1987, 1990, 1992) issued threereportson the same experiment, but it was countedas three separatestudies. Curiel's 1979 dissertation was publishedin 1980, and both versions were counted. 10. Studies with no evidence of initial equality. Several studies either lacked dataon initialachievement,beforetreatmentsbegan,or presenteddataindicating pretestdifferencesin excess of one standarddeviation. 11. Studies with no appropriate comparison group. Many of the studies included by Rossell and Baker had no control group. For example, Burkheimer,Conger,Dunteman,Elliott, andMowbray(1989) andGersten (1985) used statistical methods to estimate where children should have been performingand then comparedthatestimatewith theiractualperformance. Rossell and Bakerset standardsrequiring"a comparisongroup of LEP studentsof the same ethnicityand similarlanguagebackground,"yet they included many studies that did not have such comparison groups. Furthermore,manystudiesincludedby Rossell andBakerlackedany information about the initial comparabilityof childrenwho experiencedbilingual or English-only instruction (e.g., Matthews, 1979). These include studies that retroactivelycompared secondary students who had participated in bilingual or English-only programs in elementary schools but failed to obtain measures of early academic ability or performance (e.g., Powers, 1978;Curielet al., 1980). Otherstudiescomparedobviously noncomparablegroups. For example, Rossell (1990) compared 1-year gains of English language learnersin Berkeley, California,who were in Spanishbilingual or English immersionprograms;yet 48% of the ELLs, all in the English immersionprograms,were Asian, whereasall studentsin the Spanishbilingualprogram(32%of the sample)were, of course,Latino. Similarly,Legarreta(1979) comparedSpanish-dominantchildrenin bilingual instructionwith mainly English-dominantchildrentaughtin English. Finally,CarlisleandBeeman (2000) comparedSpanish-dominantchildren taught 80% in Spanish and 20% in English with those taught 80% in English and 20% in Spanish, so there was no English-only comparison group. 12. Brief studies. A few studies cited by Rossell and Baker involved treatment durationsless than 1 year. For the reasons discussed earlier, studies of bilingual education lasting only 10 weeks (Layden, 1972) or 4 months (Balasubramonian,Seelye, & de Weffer, 1973) are clearly not relevant. All but one of these brief studies failed to meet inclusion standardson othercriteriaas well (e.g., they lacked pretestsor had outcomes otherthan reading). ThePresent Review This review carriesout a best-evidencesynthesisof studiescomparingbilingual and English approachesto reading in the elementaryand secondary grades that meet the inclusioncriteriaoutlinedabove. These includethe methodologicallyadequate studies cited in the Willig (1985), Rossell and Baker (1996), and Greene (1997) reviews, as well as other studies located in an exhaustive searchof the literature,as describedpreviously. The characteristicsand findings of these studies are summarizedin Table 1 (p. 260). 258

Studies of Beginning Reading for Spanish-Dominant Students The largestnumberof studiesfocused on teachingreadingto Spanish-dominant studentsin the earlyelementarygrades.Thirteenstudiesof this kind met the inclusion criteria. Threecategoriesof bilingualprogramswere distinguished.The most common among the qualifying studies were studies of pairedbilingual strategies,in which studentswere taughtto readin English andin Spanishat differenttimes of the day, beginning in kindergartenor first grade and continuing through the end of the study. Pairingmay not have begun on the first day of the school year, but if childrenwere being taughtto read in both Spanishand English duringtheir firstyear of readinginstruction,the programwas considereda pairedmodel. A second category involved evaluationsof programsin which childrenwere taughtreadingin Spanishfor 1 year before a transitionto pairedbilingual instruction(English and Spanish). A third category consisted of a single study by Saldate et al. (1985), which did not describe the treatments well enough to permit categorization, althoughit seemed to evaluatea transitionalmodel. In Table 1, the elementary studies of Spanish-dominantchildren are listed accordingto these treatmentcategories,with the highest-qualitystudieslisted first. Thatis, randomizedmultiyearstudiesarelisted first,then matchedmultiyearstudies, then matched 1-yearstudies. The studies will be discussed in the same order. Studiesof Paired Bilingual Programs Ten qualifying studies comparedpairedbilingual and English immersionprograms.Plante(1976) randomlyassigned Spanish-dominant,PuertoRicanchildren in a New Haven, Connecticut,elementaryschool with a pairedbilingualmodel or with English-onlyinstruction.Initially,72 childrenwere randomlyassigned,45 to the pairedbilingual groupand 27 to an English-onlycontrolgroup.By the end of the study, 31 childrenremainedin the pairedbilingual group and 22 remainedin the controlgroup.The childrenbegan in kindergartenor firstgrade.The treatment involved a team-teachingarrangementwith one native Spanish-speakingteacher and one English-speakingteacher.It was describedas follows: [Spanish-dominant children]aretaughttheirbasic skills, i.e., reading,writing, arithmetic,social studies,andscience,in Spanish.At the sametime,the English-speakingAnglo teacherinitiatesthe teachingof English,beginning withan aural-oralapproach.Whenan Englishoralvocabularyis sufficiently developedin individualchildren,she initiatesinstructionin the readingand is a conwritingof English.Thekey premisein thisinstructional organization instructionwith both Spanishand English cept of diagnostic-prescriptive resourcesbeing available.(Plante,1976,p. 40) Analyses of pretestscores for the final sample found that the two groups were similar on measures of Spanish and English oral vocabulary.The control group was nonsignificantlyhigheron both measures. Two yearslater,all childrenwere given the Englishform of the Inter-American Test of Readingand the English MetropolitanAchievementTest. Second graders in the pairedbilingual treatmentscored significantlyhigher than control second graders(effect size (ES) = +0.78). The effect size for thirdgraderswas also positive but nonsignificant(ES = +0.26). Total effects were nonsignificant,with a 259

N clL TABLE 1 Languageof reading instruction:Descriptive informationand effect sizesfor qualifyingstudies Intervention Evide N, grade Design, Sample duration characteristics initial e levels Study description Studies of paired bilingual education Plante (1976)

Paired bilingual

Random assignment, 2 years

55 students, Grades 1-2, 2-3

Spanish-dominant PuertoRican studentsin New Haven, CT

Well ma on Sp oral v but El Engli

Huzar (1973)

Paired bilingual

Random assignment, 2 & 3 years

160 students, Grades 1-2, 1-3

Disadvantaged PuertoRican studentsin PerthAmboy, NJ

Well ma on IQ and in achiev

Campeau etal. (1975), Corpus Christi Ramirez etal. (1991)

Paired bilingual

Matched control, 2 years

171 students, Grades K-l

Spanish-dominant studentsin CorpusChristi, TX

Matched Engli Spani pretes

Paired bilingual

Matched control, 2 years

153 students in four schools, Grades K-l

Spanish-dominant LEP students

Very we match SES a backg

Paired bilingual

Matched control, 3 years

206 students, Grades K-2

Spanish-dominant studentsin Houston, TX

Paired bilingual

Matched control, 5 years

126 students, Grades 1-5

Alvarez (1975)

Paired bilingual

Matched control, 2 years

147 students, Grade2

Spanish-dominant studentsin six elementary schools in CorpusChristi, TX Spanish-dominant childrenin two schools in Austin, TX

Matched and in langu profic

Cohen (1975)

Paired bilingual

Matched control, 2-3 years

90 students, Grades K-I, 1-2, 1-3

Spanish-dominant studentsin Redwood City, CA

Matched and in langu profic

Campeau et al. (1975), Kingsville, TX

Paired bilingual

Matched control, 1 year

89 students, GradeK

Spanish-dominant studentsin Kingsville, TX

Matched and et

Campeau et al. (1975), Houston J. R. Maldonado (1977)

,

Matche langu and a achie Matched and n years schoo

TABLE 1 (Continued) Languageof reading instruction:Descriptive informationand effect sizesfor qualifyingstudies Intervention Evide N, grade Design, Sample duration levels characteristics initiale Study description Studiesof paired bilingual education Campeau et al. (1975), SantaFe

Paired bilingual

Matched control, 1 year

77 students, Grade I

Hispanicstudents in SantaFe, NM

Similaro prete PBE >

Studiesof I-year transitionalbilingual education J. A. Maldonado (1994)

Bilingual, 1-year transition

Random assignment, 3 years

20 students, Grades 2-4, 3-5

Spanish-dominant special education studentsin Houston,TX

Campeau et al. (1975), Alice, TX

Bilingual, 1-year transition

Matched control, 2 years

125 students, Grades K-l

Spanish-dominant studentsin Alice, TX

Well ma disab langu profic and fa backg Similaro Engli but TB Spani

Studyof bilingual education(unspecified) Saldate et al. (1985)

Unspecified

Matched control, 3 years

38 students, Grades 1-3

Spanish-dominant studentsin Douglas, AZ

Well ma pretes

Studies of heritage languages Morgan (1971)

Paired bilingual

Matched control, 1 year

193 students, Grade 1

French-dominant studentsin Lafayette,LA,

Well ma initia abilit

Catholic Schools

Doebler & Mardis (1980)

Paired bilingual

Matched control, 1 year

63 students, Grade2

Choctaw students in MS

MRT

Well ma initial profic

Secondarystudies

t)

Covey (1973)

Paired bilingual

Random assignment, 1 year

200 students, Grade9

Spanish-dominant studentsin Phoenix, AZ

Well ma pretes

Kaufman (1968)

Paired bilingual

Random assignment, 1 and 2 years

139 students, Grade7

Spanish-dominant studentsin New York City

InitialC vocab comp scores langu non-la IQ, ag Hoffm biling sched were u covar

Note. PBE = Paired Bilingual Education; TBE = Transitional Bilingual Education; El = English Imme

a a

Basic Skills; MAT = MetropolitanAchievement Test; SRAAS = Science ResearchAssociates Asse Effect size estimated;datafor exact computationwere not available.

Slavin & Cheung

mean weighted effect size of +0.50. However, these differences did not control for the control group's pretest advantage,so pretest-adjusteddifferences would have furtherfavoredthe experimentalgroup. On the MetropolitanAchievementTest, total readingscores favoredthe experimental group by 0.4 grade equivalents among second graders and 0.5 grade equivalents among third graders.No standarddeviations or analyses were provided, however. Finally, therewere substantialdifferencesin retentionrates.Only one of the 31 experimentalchildren(3%) was retainedin grade, as comparedwith 13 of the 22 controlchildren(59%).Retentionratesaredeterminedby the teachersinvolved on a subjectivebasis, but this is neverthelessan importantfinding. Not surprisingly,childrenin the bilingualgroupscoredsubstantiallybetteron a Spanishreadingtest thandid the English-onlycontrolgroup(overallES = + 1.02). The Plante (1976) study is small, and with only one class in each treatment, teachereffects were completely confoundedwith treatmenteffects. Yet its use of randomassignmentand a 2-year longitudinaldesign with modest attritionmakes this study an importantpartof the researchbase on bilingualeducation. Huzar (1973) carried out a randomizedexperiment involving 160 SpanishdominantPuerto Rican children in Perth Amboy, New Jersey. On entry to first grade,the childrenwere assignedto one of two treatments:pairedbilingualor control. The paired bilingual treatmentwas described as follows: "One bilingual teachergave readinginstructionto the class in Spanishfor 45 minutes each day, while the monolingual teacher gave reading instructionin English for the same periodof time each day" (Huzar, 1973, p. 34). In the controlgroup,studentswere taughtonly in Englishfor 45 minutesa day. "All teachingprocedures,qualityof materials,andtime periodsfor readinginstruction were the same, with the exception that the experimental classes received instructionin both Spanishand English, with correspondingtextbooks." Therearetwo potentialconfoundsin this study.First,it is unclearwhatthe control group was doing while the experimentalgroup received 45 minutes of daily Spanishreadinginstruction.It may be thatthe experimentalstudentswere receiving more totaltime in reading(Englishplus Spanish).Second, the Englishreading texts used in the two programswere different.The experimentalclasses used a phonetic program,the Miami LinguisticReaders.Controlstudentsused Scott Foresman's Open Highways series. The 160 study subjectswere assigned at randomto four experimentaland four controlclasses. Two classes of each treatmentwere at the second- andthird-grade levels, respectively. Third gradershad been in their respective treatmentsfor 3 years, and second gradershad been in theirs for 2 years. MetropolitanReadiness Test first-gradescores were collected from school records;Lorge-Thordike Intelligence Test scores were obtainedfor thirdgradersand showed no significantdifferences between treatmentgroupsat eithergradelevel. The posttestwas the Englishreadingtest of the Inter-AmericanSeries. For second graders,there were no differences (ES = +0.01). Differences at the thirdgrade level directionallyfavoredthe experimentalgroup (ES = +0.31) but were statisticallysignificantfor boys (ES = +0.44) but not girls (ES = -0.06). The Huzar(1973) and Plante(1976) studies are particularlyimportant,despite takingplace morethana quartercenturyago. Both aremultiyearexperimentsthat, 264

Research on Languageof ReadingInstructionforELLs

because of use of randomassignment,can rule out selection bias as an alternative explanationfor the findings. Both startedwith children in the early elementary grades and followed them for 2 to 3 years. Both used paired bilingual reading instructionby different teachers in Spanish and English, with transitionto allEnglish instructionby second or thirdgrade.The use of both Spanishand English readinginstructioneach day more resemblesthe experienceof Spanish-dominant students in many two-way bilingual programs(see Calder6n & Minaya-Rowe, 2003) thanit does transitionalbilingualmodels, which delay Englishreadinguntil second or thirdgrade. One of the most widely cited studiesof bilingualeducationis a longitudinalstudy by Ramirezet al. (1991), which comparedSpanish-dominantstudentsin English immersionschools with those in two forms of bilingualeducation:early exit (transition to Englishin Grades2-4) and late exit (transitionto English in Grades5-6). Schools in several districtswere followed over 4 years. Immersionand early-exit studentsin four "two-treatment" schools were well matched,but a groupof "one treatment"schools thatimplementedonly bilingualor immersiontreatmentswere poorly matched,accordingto the authors.Late-exitstudentswere lower thantheir comparisongroups in socioeconomic status (SES), and their schools had much lower proportionsof nativeEnglish speakers.For these reasons,no directcomparisons were madeby the authorsbetweenlate-exitand otherschools. The "two-treatment"comparisonof early-exit transitionalbilingual education and English immersionis the importantcontributionof the Ramirezet al. (1991) study. In the immersionprogram,almost all teacherspeech was in English at all gradelevels. In the early-exitclasses, teacherspeech was 31% Spanishin kindergarten, 29% in first grade, 24% in second grade, 17% in thirdgrade, and 2% in fourthgrade.The early-exitprogramwas describedas follows: In an early-exitprogramthere is some instructionin the child's primary language,30 to 60 minutesperday.Thisis usuallylimitedto the introduction of initialreadingskills.All otherinstructionis in English,withthechild'sprimarylanguageusedonly as a support,for clarification.However,instruction in the primarylanguageis quicklyphasedout overthe nexttwo yearsso that by gradetwo, virtuallyall instructionis in English.(Ramirezet al., 1991,p. 2) Although the Ramirezet al. study is invariablycited as a study of transitional bilingual education, it is in fact a study of paired bilingual education, using the definitionapplied in the presentreview. The authorsnoted that in the early-exit kindergartens,35.1%of instructionaltime was spenton English languageartsand 29.9% on Spanish language arts. In first grade the correspondingnumberswere 33.5% (English) and 24.2% (Spanish). In contrast, in the English immersion classes, 63.6% of instructionaltime was spent on English languageartsin kindergarten,and 60.2% in firstgrade. Percentagesof timespenton math,socialstudies,andscience,all in Englishin both treatments,werenearlyidenticalin thetwo treatmentconditions.Overallinstructional time was equivalentin the two conditions,so the immersionand early-exitclasses were spendingaboutthe sameamountof time on languagearts,as EnglishandSpanish timein theearly-exitprogramwas similarto Englishtimein theimmersionclasses. The longitudinalexperimenthad two stages. Childrenwere pretestedin kindergartenand then posttestedat the end of firstgradeon the English Comprehensive 265

Slavin & Cheung

Test of Basic Skills (CTBS). The experimentaland control students were well matchedon pretests,SES, preschoolexperience,and otherfactors.On first-grade CTBS reading,studentsin the bilingualgroupscored significantlyhigherthanthe immersionstudents(ES = +0.53). The second phase of the study followed studentsfrom spring of first grade to thirdgrade. It is not clear why the kindergartencohort was not simply followed, althoughthere were serious problems with attritionover the longitudinalstudy. However, the second-phasestudy does not qualify for inclusion in this review, as it uses a pretestgiven long aftertreatmentshad begun. The Ramirezet al. studywas so importantin its time thatthe NationalResearch Council convened a panel in 1991 to review it and a study by Burkheimeret al. (1989). The panel's report(Meyer & Fienberg, 1992) supportedthe conclusions of the Ramirez et al. comparison of the early-exit and immersion programsin Grades K-l. It expressed concern about the second phase on the same criterion as that applied in the presentreview, that the pretestsfor the second phase were given afterthe studentshad alreadybeen in bilingualor immersiontreatmentsfor 2 years. In the mid-1970s, the AmericanInstitutesof Research(AIR) produceda series of reportson bilingualprogramsaroundthe U.S. (Campeau,Roberts,Oscar,Bowers, Austin, & Roberts, 1975). These are of some interest,with one majorcaveat: The AIR researcherswere looking for exemplarybilingualprograms.They began with 96 candidatesand ultimately winnowed the list down to 8. Programswere excluded if datawere unavailable,not because they failed to show positive effects of bilingual programs.Nevertheless, these sites were chosen on their reputations for excellence, anda site would clearlybe less likely to submitdataif the datawere not supportiveof bilingualeducation.Also, the Campeauet al. (1975) evaluations were organizedas successive 1-year studies, meaning that pretests after the first treatmentyear (K or 1) are of little value. For reasons described earlier, we includedonly cohortsthatwere pretestedbeforetreatmentsbegan.Withthese cautions in mind, the Campeauet al. (1975) studies are describedbelow. A study in CorpusChristi,Texas, evaluateda pairedbilingualprogramin three schools. In kindergarten,the pairedbilingualtreatmentinvolved a 2-hourlanguage periodalternatingEnglishand Spanish."Inboth languages,the patternedpractices stressbasic sentencepatternsandillustratechangesin wordformsandwordorder" (Campeauet al., 1975, p. D-59). Over the course of kindergartenthe proportionof Spanishinstructiondecreasedfrom90%to 50%. In firstgrade,the pairedbilingual classes had a daily 2-hourEnglish readingand languagearts period and a 1-hour Spanishreadingand languageartsperiod: Phoneticanalysisskillsaretaughtfirstin Spanishbecauseof the highlyphoneticnatureof thelanguage.... Englishreadinessskills... aretaughtthrough theHarcourtBraceJovanovichseries.Phoneticanalysisskillsareintroduced afterthechildhaslearnedthemthoughhis Spanishreadinglessons.... There is a heavy phonicsemphasis,with comprehensionskills receivingheavier emphasisas decodingskillsdevelop.(Campeauet al., 1975,p. D-60) Classes in the control groups were "taughtmonolinguallywithout regardfor the languagedominanceof the children"(p. D-66), but otherwiseinstructionalstrategies were similar. 266

Research on Languageof ReadingInstructionfor ELLs

Experimentalandcontrolclasses were pre- andposttestedeach yearfor 2 years. For reasons discussed earlier,we did not include comparisonsin which pretests were given after treatmentswere already under way. For this reason, we only focused on the childrenwho were pretestedin kindergartenin the firststudy year and then posttestedat the end of first grade in the second study year. This cohort was well matchedon the StanfordEarlySchool AchievementTest. Therewere no differences at the end of kindergarten,but the paired bilingual students scored significantly higher than controls on the Inter-AmericanEnglish Reading Test (ES = +0.45) at the end of firstgrade.Therewere also substantialdifferenceson the StanfordReadingAssessment. Experimentalstudentsaverageda gradeequivalent of 2.3, controls 1.8. However, no statisticalcomparisonswere made on the Stanford. The paired bilingual group also scored substantiallybetter than the controlgroupin Spanishreading,of course. A study in Houston also reportedby Campeauet al. (1975) followed three cohortsof studentsin seven pairedbilingual and two English immersionschools. The pairedbilingual programbegan with a Spanish decoding programand then Spanish Laidlaw basals, duringa regularSpanish arts block. Studentswere then taughtEnglish reading, startingwith a transitionalprogramand then continuing with the HarcourtBrace Jovanovichbasal series. Each class had a teacherand an aide. Two control schools, in which Spanish-dominantstudentswere taughtonly in English, were selected on the basis of similarityto seven experimentalschools in language,SES, and priorachievement. Experimentalandcontrolkindergartenstudentswere well matchedon the InterAmerican English Ability Test. At the end of first grade and second grade, the pairedbilingualstudentsscoredsubstantiallyhigherthanthe controlstudents,with effect sizes of +0.69 and +0.54, respectively. Cohen (1975) compared two schools serving many Mexican Americans in RedwoodCity, California.One school was using whatamountsto a two-way bilingual program,in that Spanish-dominantstudentsand English-dominantstudents were taughtin both Spanish and English. However, from the perspective of the ELLs, the treatmentwas the same as a pairedbilingualmodel. Spanish-dominant studentswere taughtSpanishreadingusing readerssuch as Pepin en PrimerGrado andEnglishreadingusing the phoneticMiamiLinguisticSeries. Spanish-dominant and English-dominantstudentswere groupedtogetherfor contentareainstruction but not for reading.Three successive cohorts were comparedat the two schools: GradesK-l, 1-2, and 1-3. In each case, studentswere pretestedandposttestedon a broad range of English reading measures. In all cohorts, Mexican-American students were well matched on English and Spanish pretests. At posttest, there were no significantdifferences, adjustingfor pretests.The data did not allow for computationof effect sizes, so zeros were enteredin Table 1. Maldonado(1977) conducteda 5-year longitudinalstudy on a group of Mexican American children in six elementary schools in Corpus Christi, Texas. The main purposeof this study was to examine how well the bilingual studentswere able to succeed in the regulareducationprogramof the school districtafter they had left the bilingual program.The experimentalgroup consisted of 47 children who had participatedin the bilingual programfor 4 consecutive years, from first to fourthgrades.The controlgroupwas comprisedof 79 childrenwho had been in a regular English-only program for the same 4 years and grades. The study 267

Slavin & Cheung

followed the two groupsuntil they reachedfifth grade, 1 year afterthe experimental group left the bilingual program.Studentsin the experimentalgroupenrolled in the Title VII programtitled "ApprendemosEn Dos Idioma"(We Learnin Two Languages), in which they received "a minimum of 2 hours per day in Spanish language instructionin the areas of language arts, reading,and mathematicsand social studies" (p. 103). No specific descriptive informationabout the control groupwas providedin the study. No statisticallysignificantdifferenceswere found at any gradeaftercontrolling for first-gradepretests. It is importantto note that teachers in both the bilingual group and the control group were bilingual. However, it is not stated how much these bilingual teachers in the control group used Spanish in their classrooms to help childrenwho were in need for bilingualexplanations.As the researcherstated, "Itis highly possible thatthe controlgroupbilingualteachersmight have used the Spanishlanguage for clarificationof some concepts. This in turnwould not only assist those studentsin the comprehensionof those concepts but at the same time lower the differencebetween the groupsin the areasof mathematicsandreading" (p. 104). A study by Alvarez (1975) followed 147 Mexican-Americanchildren in two schools in Austin, Texas, from first to second grades. Students in the bilingual classrooms and the control classrooms in each school were well matched on SES and initial language proficiency. The instruction programin the bilingual classrooms was described as "a balanced combination of Spanish and English (50 percent/50 percent)" (p. 73). However, children who had very limited English proficiency in these bilingual classrooms were initially taught in Spanish. Reading and language arts were taught in both languages each day for 2 hours by the English-speaking and Spanish-speakingteachers. Oral language in English was taughtfor one-half hour daily to the Spanish-dominantchildren, and oral language in Spanish was taught for one-half hour to the Englishdominant children. Studentsin the controlclassroomshad a curriculumsimilarto thatof the bilingual classrooms. The only difference was "that the subject matter was taught completely in English;using the same textbooksfor the Englishcomponentof the bilingual classes, but using twice as much time as the balanced combinationof Spanishand English curriculumdesigned for Mexican studentsin bilingualclassrooms"(Alvarez, 1975, p. 75). The bilingualstudentsscored somewhathigheron the English reading vocabularytest, but the control group scored higher on the English reading comprehension test than the bilingual classes. None of these differenceswere statisticallysignificant. Two of the studies carriedout by Campeauet al. (1975) had 1-yeardurations. The first study was conductedin two low-SES elementaryschools in Kingsville, Texas. Five gradeswere comparedat the two schools: K-4. Only the resultsfrom the kindergartengroups-48 in the bilingualgroupand 41 in the controlgroupare interpretablebecause the pretestsfor othergradeswere administeredafterthe treatmentsbegan. All teachers in kindergartenwere bilingual. Instruction time was equally divided between Spanish (50%) and English (50%). Kindergartenerswith very limited English were taughtprimarilyin Spanish until their English proficiency reacheda point where they could cope with bilingual instruction. 268

Research on Languageof ReadingInstructionfor ELLs

At the end of the study, studentsin both groups were given the same posttests. The mean gains between the two groups were compared. Students in all six kindergartenclasses gained significantly more on the English version of the Inter-AmericanSeries thantheir counterpartsin the control group,with an effect size of +0.42. Another1-yearstudyin SantaFe, New Mexico, comparedpairedbilingualand immersion programs for Spanish-dominantstudents. Pre- and posttests were reportedfor each year, but only first gradewas interpretable,as pretestsfor other years had already been affected by the treatments.Parentschose to place their children in bilingual or English programs, and apparently parents of higherachieving childrenchose the bilingualgroup,as pretestscores were higherin that group. Studentsin the bilingual classrooms received "a bilingual presentationof all the topics of study in the normalcurriculum"(p. D-16). For example, students were taughtcertainconceptsin Spanishin the morningandwere retaughtthe same lesson in Englishin the afternoon.In addition,studentsin the bilingualclassrooms were grouped by ability during language arts and reading periods. No specific descriptioninformationwas providedaboutthe controlclassrooms.At the end of the study, the bilingual group gained slightly more than the control group in English reading, with an effect size of +0.03. However, the bilingual group also gained more in English reading than the English-only group. No standard deviationswere given, so effect sizes for pretestdifferencesandgains could not be computed. Studies of 1-YearTransitionalBilingual Education J. A. Maldonado (1994) carried out a small, randomized study involving English language learners who were in special education classes in Houston. Twenty students in second and third grades with learning disabilities were randomlyassigned to one of two groups. A bilingual group was taughtmostly in Spanishfor a year, with a 45-minuteESL period.Duringa second year, half of the instructionwas in English, half in Spanish.In a thirdyear, instructionwas only in English. The control group was taught in English all 3 years. Students in both groups received the same amount of reading and language instructionand were taughtby similarteachers. Childrenwere pretestedon the CTBS and then posttestedon the CTBS 3 years later.At pretest,the controlgroupscorednonsignificantlyhigherthanthe bilingual group,but at posttest the bilingual group scored far higher. Using the means and standarddeviations presentedin the article, the effect size would be +8.33, but using the given values of t and n, the effect size is + 1.67, a more credibleresult. One of the Campeauet al. (1975) studies,in Alice, Texas, comparedSpanishdominantstudentsin bilingualand Englishimmersionprogramsstartingin kinderin garten,for a 2-yearexperiment.The treatmentinvolved teachingkindergartners Spanish.In firstgrade,childrenwere transitionedto Englishreadingand were then taughtequalamountsof timein eachlanguage.Matchedcontrolstudentsweretaught werecomparableatpreteston Englishmeasures onlyin English.Whilekindergartners of generalability,bilingualstudentsscoredsubstantiallyhigheron a Spanishability test.At posttest(controllingforpretests),bilingualstudentsscoredsubstantiallybetter on the Inter-American Englishreadingtest at the end of firstgrade,after2 years of bilingualeducation(ES = +0.49). 269

Studyof UnspecifiedBilingual Education In a poorly specified studyof bilingualeducation,Saldate,Mishra,and Medina (1985) studied62 childrenin an Arizonabordertown who attendedimmersionor bilingualschools. The bilingualtreatmentappearedto be a transitionalmodel. The childrenwere individuallymatchedon the PeabodyPictureVocabularyTest in first grade. At the end of second grade, the bilingual studentsscored nonsignificantly lower on the English MetropolitanAchievement Test (MAT) (ES = -0.28) and higher on the SpanishMAT (ES = +0.44). This was to be expected, as they had not yet transitionedto English instruction.At thirdgrade, however, the bilingual students(who had now transitionedto English-onlyinstruction)substantiallyoutperformedthe immersionstudentsboth in English (ES = +0.89) and in Spanish (ES = +3.01). This study's small size means thatits resultsshould be interpreted cautiously, especially as the number of pairs dropped from 31 to 19 between second and thirdgrades. Studiesof Heritage Languages Two qualifying studies involved languages other than Spanish. These are reviewed separately, not for this reason alone but also because the languages (Frenchin Louisiana,Choctawin Mississippi)are"heritagelanguages,"whose use was intendedas muchto show respectto children'sculturesas to help non-English speakerssucceed in reading. Morgan (1971) carriedout a study of almost 200 children of French-heritage parentsin ruralLouisiana.Existinggroupsof firstgraders,assignedto bilingualor monolingualclasses, were followed for a year. In the bilingual classes, children were taughtin both Frenchand English. The two groups were virtuallyidentical on English tests of mentalabilitiesandreadinessat the beginningof firstgrade.At the end, the childrentaughtin the bilingualclasses scored higher on four English readingmeasures,with a mediandifferenceof +0.26. Differenceswere significant on measuresof word readingand paragraphreading,but not vocabularyor word study skills. It is importantto note, however, that the childrenin this study were English proficient. Their parents may have spoken some French at home, but both experimentaland control studentsscored well at preteston an English mental abilities test. A 1-yearstudyof 63 Choctawsecond gradersin Mississippi compareda bilingual programin Choctaw and English with English-only instruction(Doebler & Mardis, 1980-1981). There were no significantdifferenceson an English reading measure,controllingfor pretests. Studiesof SecondaryReading Two qualifying studies evaluatedprogramsthat introducedSpanish-language instructionto ELLsin the secondarygrades.Both of these usedrandomassignment. Covey (1973) randomlyassigned 200 low-achieving Mexican-Americanninth gradersto bilingualor English-onlyclasses. The experimentalinterventionis not describedin any detail, but it clearly involved extensive use of Spanishto supplement English in reading,English, and math.The groups' scores were nearlyidentical at pretest,but at posttest the bilingual studentsscored significantlybetteron the StanfordDiagnostic ReadingTest (ES = +0.72). 270

Research on Language of ReadingInstructionforELLs

Kaufman(1968) evaluateda programin which low-achievingSpanish-speaking seventhgraderswere randomlyassignedto bilingualor English-onlyconditionsin two New Yorkjunior high schools. One school participatedin the programfor a year and the other for 2 years. In the bilingual classes, studentsreceived three or four periodsof Spanishreadinginstructioneach week, while controlswere in art, music, or health education. On standardized tests of reading, there were nonsignificantdifferencesfavoringthe bilingualclasses in the 2-yearschool andthe 1-yearschool (ES = +0.23 for both).The secondarystudiespointto the possibility that providing native language instructionto low-achieving ELLs in secondary school mayhelp themwith Englishreading.This applicationis worthyof additional research(also see Klingner& Vaughn,2004). CanadianStudies of French Immersion There are several Canadianstudies (e.g., Lambert& Tucker, 1972) that have played an importantrole in debatesaboutbilingualeducation.These are studiesof Frenchimmersionprograms,in which English-speakingchildrenaretaughtentirely orprimarilyin Frenchin theearlyelementaryyears.RossellandBaker(1996) emphasized these studies as examples of "structuredEnglish immersion,"the approach favoredin theirreview. However,Willig (1985) and otherreviewershave excluded them.TheCanadianstudiesdo notmeettheinclusionstandardsof thisreviewbecause theAnglophonechildrenwerelearninga usefulsecondlanguage,notthelanguagefor whichthey wouldbe held accountablein theirlaterschooling.Althoughmanyof the studiestookplacein Montr6al,the childrenlived in English-speakingneighborhoods and attendedschools in an Englishsystem.The focus of this review is on bilingual educationused to help childrensucceedin the languagein whichthey will be taught in the later grades;but the Frenchimmersionchildrenin Canadawere headed to English secondary schools. Furthermore,these studies all involved voluntary programs,in whichparentswantedtheirchildrento lear French,andthe childrenin these studieswere generallyuppermiddleclass, not disadvantaged. Because French immersion programswere voluntary, children who did not thrive in them could be and routinely were returnedto English-only instruction. This means that the children who completed French immersion programs in Canada were self-selected relatively high achievers. Most important, the "bilingual"programsto which Frenchimmersionis comparedwere nothing like bilingualeducationin the United States.At most, childrenreceived 30 to 40 minutes daily of French as a second language, with far less time in French reading instructionthan a U.S. student in a bilingual programwould receive in English duringand aftertransition(see Genesee & Lambert,1983). Yet in many studies, English comparisongroups were not learning French at all. In the widely cited study by Lambertand Tucker(1972), Anglophones in Frenchimmersionclasses were comparedwith Anglophonestaughtonly in English and with Francophones taughtonly in French.Ironically,studies of this kind, cited by Rossell and Baker (1996) as comparisonsof immersionand bilingualeducation,are in fact comparisons of immersionand monolingualeducation.If they existed, Canadianstudies of, say, Spanish speakerslearningFrench in Francophoneschools in Quebec or English in Anglophone schools in the rest of Canadawould be relevant to this review. But studies of voluntary immersion programsas a means to acquiring Frenchas a second languageare only tangentiallyrelevant. 271

Slavin & Cheung

While the Canadianimmersionstudies are not directlyrelevantto the question of the effectiveness of bilingualprogramsfor ELLs learningthe societal language, they are neverthelessinterestingin gaining a broaderunderstandingof the role of native language in foreign language instruction.As a group, these are matched studiesof high methodologicalquality.Quite in contrastto U.S. studies,however, the focus of the Canadian studies is on whether French immersion harms the English languagedevelopmentof native English speakers.It is taken as obvious thatFrenchall day will producemorefacility in Frenchthan30 to 40 minutesdaily in second-languageclasses. Overall, the Canadianstudies paint a consistent picture (Lambert& Tucker, 1972; Lambert & Tucker, 1977; Barik & Swain, 1975; Barik, Swain, & Nwanunobi, 1977; Genessee & Lambert,1985; Day & Shapson, 1988). At least for the overwhelminglymiddle-classstudentsinvolved, Frenchimmersionhad no negative effect on English readingachievement,and it gave studentsfacility in a second language.The relevance to the U.S. situationis in suggesting that similar second-language immersion programs, perhaps including two-way bilingual programsfor English-proficientchildren, are not likely to harm English reading development.However, the relevanceof these studies to any context in which the childrenof immigrantsare expected to learn the language that they will need to succeed in theirschool and in the largersociety is minimal. Comparisonof Paired Bilingual and TransitionalBilingual Programs As noted earlier,many of the programswith the strongestpositive effects for Englishlanguagelearnersused a pairedbilingualapproach,in which childrenwere taughtreadingin bothEnglishandtheirnativelanguageat differenttimes each day from the beginning of their schooling. This approachcontrastswith transitional bilingual education (TBE) models, in which children are first taught to read primarilyin theirnative languageand only then transitionedgraduallyto Englishonly instruction.Only one study has compared reading outcomes of these two bilingualapproaches. A longitudinalstudyby Gerstenand Woodward(1995) initially favoredpaired bilingualinstructionover TBE but laterfound the two to be equivalent.This study was carriedout with Spanish-dominantELLs in 10 elementaryschools in El Paso. Five schools used a programin which all subjectswere taughtin Englishbut Spanish instructionwas also provided,for 90 minutesdaily in firstgradeand declining to 30 minutes daily in fourthgrade. The transitionalbilingual programinvolved mostly Spanishinstruction,with 1 hourper day for ESL instruction,with gradual transitionto Englishcompletedin the fourthor fifth grade.The childrenwere well matcheddemographicallyon entry to first grade and scored near zero on a measure of English languageproficiency.In Grades4, 5, 6, and 7, Iowa Tests of Basic Skills were comparedfor the two groups. On Total Reading, the pairedbilingual studentsscoredsignificantlyhigherthanthe transitionalbilingualstudentsin fourth grade (ES = +0.31), but the effects diminishedin fifth grade (ES = +0.18) and were very smallin the sixth (ES = +0.06) andseventhgrades(ES = +0.08). Tests of languageand vocabularyshowed similarpatterns.This patternis probablydue to the fact thatthe transitionalbilingualstudentshad not completedtheirtransition to English in fourthand fifth grades.When they had done so, by sixth grade,their readingperformancewas nearlyidenticalto thatof the othergroup. 272

Research on Language of ReadingInstructionfor ELLs

Research comparingalternativebilingual models is far from conclusive, but nothing suggests thatit is harmfulto children'sreadingperformanceto introduce both native languageand English readinginstructionat differenttimes each day. Discussion The most importantconclusion from researchcomparingthe relativeeffects of bilingual and immersionprogramsfor English language learnersis that there are far too few high-quality studies of this question. Willig (1985) and Rossell and Baker (1996) agree on very little, but both of these reviews call for randomized, longitudinalevaluationsto producea satisfyinganswerto this criticalquestion.Of course,manywould arguethatrandomizedevaluationsareneededon most importantquestionsof educationalpractice(see, for example,Mosteller& Boruch,2002; Slavin, 2003); however,in bilingualeducation,they areespecially crucialbecause of the many inherentproblemsof selection bias in this field. Furthermore,this is an area in which longitudinal,multiyearstudies are virtuallymandatory,to track childreninitiallytaughtin theirnativelanguagethroughtheirtransitionto English. Finally, althoughrandomized,longitudinalstudies of this topic are sorely needed, there are simply too few experimentalstudies of all kinds, including ones with matchedexperimentaland controlgroups. Despite these concerns,however, the existing researchon languageof instruction yields some importantlessons at least worthyof furtherstudy.Across 17 qualifying studies of all types of programs, 12 found effects favoring bilingual educationand 5 found no differences.None of the studies found results favoring English immersion. The largest group of studies focused on elementary reading instructionfor Spanish-dominantstudents.Nine of 13 studies in this category favored bilingual approaches,and four found no differences.The medianeffect size for all 13 studies was +0.45. This effect size is higher than the estimate of +0.21 given by Greene (1997), but Greene did not locate the Campeauet al. (1975) studies that added several positive effect sizes. Also, many of the largestpositive effect sizes were from studieswith very small sample sizes. The mean effect size weighted by samplesize for the 13 studiesof elementaryreadingfor Spanish-dominantstudents was +0.33. Using proceduresdescribedby Lipsey and Wilson (2001), this effect was found to be significantlydifferentfrom zero, Q = 29.6, p < .05, df = 12. The weighted mean for the threerandomizedstudies was +0.62, Q = 8.53, p < .05. It was surprisingthatmost of the methodologicallyadequatestudies evaluated forms of bilingual educationquite differentfrom those commonly used in recent years. These arepairedbilingualprograms,in which childrenaretaughtto readin English andin theirnativelanguageat differenttimes each day fromthe beginning of their time in school. Another category of programsprovided just 1 year of native-languageinstructionbefore the transitionto English-only reading.Paired bilingual strategies were used in two of the randomized studies (Huzar, 1973; Plante, 1976), and in a study of a 1-yeartransitionalprogram(J. A. Maldonado, 1994). These practicescontrastwith practicesin transitionalbilingual education, in which childrenaretypicallytaughtto readin theirnative languagefromkindergartento Grades2, 3, or 4, and then transitionedto reading. There are several possible explanationsfor the prevalenceof the pairedbilingual interventionsamongthe studiesreviewed.First,most of the studiestook place 273

Slavin & Cheung

in the 1970s, when Title VII was new. At thattime, pairedbilingual models were popular.Second, for reasonsdiscussedearlierin this review, studiesof transitional bilingual educationare very difficult to perform,as they should begin in kindergartenand continuepast the point of transition.A 4-year longitudinalstudywould be requiredto follow children from kindergartento third grade. Allowing for studentmobility, such a study must startwith a large sample to end up with sufficient numbersof students.The U.S. Departmentof Educationhas recentlyfunded two matchedand one randomizedlongitudinalstudyto evaluatetransitionalbilingual education, but before these only the Ramirez et al. (1991) study had the resourcesto carryout an investigationof this kind, and it did not follow a consistent sample from kindergartento thirdgrade. It is importantto note thatmost of the studies thatdid not qualify for inclusion also used pairedbilingual models, not transitionalbilingualmodels. A key exception was a series of studies by Thomas and Collier (2002) that followed children who hadbeen in transitionalprogramsbut lackedpretestmeasuresfrombeforethe startof the TBE interventions. Because of the dearthof studies of TBE, it is not currentlypossible to say with confidence whetherpairedbilingual models are more effective than transitional models. Only one study,by GerstenandWoodward(1995), madethis comparison. It found differencesfavoringpairedbilingual strategiesin Grades4 and 5 but not in Grades6 and 7. However, given the supportfor pairedbilingual methods seen in this review, it is worthwhileto speculate about why pairedmethods might be beneficial. Teaching a Spanish-speaking English language learner in Spanish can be expected to establish the alphabeticprinciple, the idea that words are composed of distinct sounds represented by letters (see National Reading Panel, 2000). Early in their reading instruction,children learn to combine letters and sounds into words they know. This process is very difficult if children must form letters and sounds into words they don't know, so it may greatly facilitate phonetic development to learn the alphabeticprinciple in a familiar language ratherthan an unfamiliar one. Once a Spanish-speaking child can confidently decode Spanish text, he or she should be able to make an easy transferto decoding any alphabetic language, such as English, by learning a modest number of new sounds for particulargraphemes (Lindsey, Manis, & Bailey, 2003). Several of the studies of pairedbilingual instructionclearly describeda process of teaching Spanish reading phonetically and then, in a planned manner,transferringthose skills to English decoding. Rather than confusing children, as some have feared, reading instruction in a familiar language may serve as a bridge to success in English, as phonemic awareness, decoding, sound blending, and generic comprehension strategies clearly transfer among languages that use phonetic orthographies, such as Spanish, French, and English (see August, 2002; August, Calder6n, & Carlo, 2001; August & Hakuta, 1997; Durgonolglu, Nagy, & Hancin-Bhatt, 1993; Fitzgerald, 1995; Garcia, 2000; Lee & Schallert, 1997; Lindsey, Manis, & Bailey, 2003). Only two studies of secondaryprogramsmet the inclusion criteria,but both of these were very high quality randomized experiments. Covey (1973) found substantialpositive effects of Spanishinstructionfor low-achievingninthgraders; 274

Research on Language of ReadingInstructionfor ELLs

Kaufman(1968) found mixed, but slightly positive, effects of a similarapproach with low-achieving seventh graders. As noted previously, research on language of instruction may suffer from publicationbias: the tendencyfor journalsto publishonly studies thatfind significant differences.However, dissertationsandtechnicalreports(e.g., Covey, 1973; Huzar, 1973; Plante, 1976) less likely to suffer from publicationbias also tended to favor bilingualprograms. Teaching reading in two languages, with appropriate adaptations of the English program for the needs of English language learners, may represent a satisfactory resolution to the acrimonious debates about bilingual education. Proponentsof bilingual educationwant to launchEnglish language learnerswith success while maintainingand valuing the language they speak at home. Opponents are concerned not so much about the use of native language but about delaying the use of English. Paired bilingual models immerse children in both English reading and native language reading at the same time. They are essentially half of a two-way bilingual model; by encouraging English-proficient students to take Spanish reading, any school with a paired bilingual model can readily become a two-way program, offering English-only children a path to early acquisition of a valuable second language (see Calder6n& Minaya-Rowe, 2003; Howardet al., 2003). Languageof instructionmust be seen as only one aspect, however, of instructional programmingfor English language learners.As many previous reviewers have concluded, quality of instruction is at least as importantas language of instruction(for reviews of effective programsand practicesfor ELLs, see August & Hakuta,1997; Fitzgerald,1995; Klingner& Vaughn, 2004; Slavin & Cheung, 2005, in press). Clearly,there is much more thatwe need to know aboutthe role of native language instructionin reading.The researchreviewed in this article may represent the best experimentalstudies currentlyavailable, but better evidence is needed. Longitudinalexperimentsusing randomassignmentof studentsto alternativetreatments are particularlyneeded. Both qualitative and quantitativeresearch are needed to illuminatethe conditionsunderwhich native language instructionmay be beneficial for developing English reading skills, and to explain those effects. Studies that systematically vary programcomponents and studies that combine quantitativeandqualitativemethodsareneededto morefully explain how various interventionsaffect the development of reading skills among English language learners.It is time to end the ideological debates and to focus instead on good science, good practice,and sensible policies for childrenwhose success in school means so much to them, to theirfamilies, and to our nation's future. Note This articlewas writtenunderfundingfrom the Instituteof EducationSciences (IES),U.S. Departmentof Education(GrantNo. R305A040082).However,the views expresseddo not necessarilyreflectIESpositionsor policies. We wouldlike to thankMargaritaCalder6n,Diane August,Tim Shanahan,Isabel Beck, JayGreene,NancyMadden,andBetteChambersfor theircommentson an earlier draft,andSusanDavis andthe Centerfor AppliedLinguisticsfor assistancewith the literaturesearch. 275

References Alvarez, J. (1975). Comparison of academic aspirations and achievement in bilingual

VersusMonolingualClassrooms.Doctoraldissertation,Universityof Texas,Austin. August,D., Calder6n,M., & Carlo,M. (2001). The transferof skills fromSpanishto English:A studyof younglearners.NABENews,May/June,11-12, 42. August, D. (2002). English as a second language instruction: Best practices to support the developmentof literacyfor English language learners. Baltimore: Johns Hopkins

University,Centerfor Researchon the Educationof StudentsPlacedat Risk.

August, D., & Hakuta,K. (1997). Improvingschooling for language-minority children:

A researchagenda.Washington,DC:NationalResearchCouncil. Bacon,H., Kidd,G., & Seaberg,J. (1982). The effectivenessof bilingualinstruction with Cherokee Indian students.Journal of American Indian Education, 21(2), 34-43.

Baker,K. (1987). A meta-analysisof selectedstudiesin the effectivenessof bilingual

education. Review of Educational Research, 57, 351-362. Baker, K., & de Kanter, A. (1981). Effectiveness of bilingual education: A review of

theliterature.(Finaldraftreport).Washington,DC:Officeof TechnicalandAnalytic Systems,U.S. Departmentof Education. Baker,K., & de Kanter,A. (1983). An answerfromresearchon bilingualeducation. American Education, 56, 157-169.

Balasubramonian, K., Seelye, H., & Elizondo de Weffer, R. (1973). Do bilingual education programs inhibit English language achievement? A report on an Illinois

experiment.Paperpresentedat the 7thAnnualConventionof Teachersof Englishto Speakersof OtherLanguages,SanJuan,PuertoRico. Barik,H., & Swain, M. (1975). Three-yearevaluationof a large-scaleearly grade Frenchimmersionprogram:The Ottawastudy.LanguageLearning,25(1), 1-30.

Barik, H., & Swain, M. (1978). Evaluation of a bilingual education program in Canada: The Elgin Study through grade six. Commission interuniversitaireSuisse

de linguistiqueappliquee,Geneva,Switzerland. Barik,H., Swain,M., & Nwanunobi,E. A. (1977). English-Frenchbilingualeducation: The Elgin study through grade five. Canadian Modem Language Review, 33,

459-475.

Bates, E., & May B. (1970). The effects of one experimental bilingual program on verbal ability and vocabulary offirst grade pupils. Doctoral dissertation, Texas Tech

University,Lubbock.

Borenstein, M. (2005). Comprehensive meta-analysis software. Englewood, NJ:

BioStat. Bruck,M., Lambert,W. E., & Tucker,G. R. (1977). Cognitiveconsequencesof bilingual schooling:The St. LambertProjectthroughgradesix. Linguistics,24, 13-33. Burkheimer,G. J., Conger,A. J., Dunteman,G. H., Elliott,B. G., & Mowbray,K. A. (1989). Effectiveness of services for language-minority limited-English-proficient

students.Washington,DC:U.S. Departmentof Education. Calderon,M. (2001). Curriculaand methodologiesused to teach Spanish-speaking limitedEnglish-proficient studentsto readEnglish.In R.E. Slavin & M. Calderon (Eds.), Effective Programs for Latino Students. Mahwah, NJ: Erlbaum. Calder6n, M., & Minaya-Rowe, L. (2003). Designing and implementingtwo-way bilin-

gual programs.ThousandOaks,CA: Corwin. Carlisle,J. F., & Beeman,F. F. (2000). The effects of languageof instructionon the readingandwritingachievementof first-gradeHispanicchildren.ScientificStudies of Reading, 4(4), 331-353.

Campeau,P. L., Roberts,A., Oscar,H., Bowers,J. E., Austin,M., & Roberts,S. J. (1975). The identification and description of exemplary bilingual education pro-

grams.PaloAlto, CA:AmericanInstitutesfor Research. 276

Research on Languageof ReadingInstructionfor ELLs

Carlo,M. S., August,D., McLaughlin,B., Snow, C. E., Dressier,C., Lippman,D., et al. (2004). Closingthe gap:Addressingthe vocabularyneeds of Englishlanguage learnersin bilingual and mainstreamclassrooms.ReadingResearch Quarterly,

39(2), 188-215. Ciriza, F. (1990a). Evalution report of the Preschool Project for Spanish-speaking

Children,1989-90. SanDiego, CA: SanDiego City Schools.

Cohen, A. D. (1975). A sociolinguistic approach to bilingual education. Rowley, MA:

NewburyHousePress. Cooper,H. (1998). Synthesizingresearch(3rded.). ThousandOaks,CA: Sage.

Cooper, H. M., & Hedges, L.V. (Eds.). (1994). The handbook of research synthesis.

New York:RussellSageFoundation.

Covey, D. D. (1973). An analytical study of secondary freshmen bilingual education and its effects on academic achievement and attitudes of Mexican American

students.Doctoraldissertation,ArizonaStateUniversity,Tempe. P. (1980). Achievedreadylevel, selfCuriel,H., Stenning,W., & Cooper-Stenning, esteem,andgradesas relatedto lengthof exposureto bilingualeducation.Hispanic Journal of Behavioral Sciences, 2, 389-400.

Danoff,M. N., Arias,B. M., & Coles, G. J. (1977). Evaluationof theImpactof ESEA Title VIISpanish/English Bilingual Education Programs. Palo Alto, CA: American

Institutesfor Research. Danoff,M. N., Coles, G. J., McLaughlin,D. H., & Reynolds,D. J. (1977).Evaluation of the impact ofESEA Title VIISpanish/English Bilingual Education Programs: Vol. I. Study Design and Interim Findings. Palo Alto, CA: American Institutes for

Research. Danoff,M. N., Coles, G. J., McLaughlin,D. H., & Reynolds,D. J. (1978). Evaluation of the impact ofESEA Title VIISpanish/English bilingual education programs: Vol.

3. YearTwoimpactdesigns.Palo Alto, CA:AmericanInstitutesfor Research.

Day, E. M., & Shapson, S. M. (1988, April). Provincial assessment of early and late French immersion programs in British Columbia, Canada. Paper presented at the

annualmeetingof the AmericanEducationalResearchAssociation,New Orleans.

de Weffer, R. (1972). Effects offirst language instruction in academic and psychological development of bilingual children. Doctoral dissertation, Illinois Institute of

Technology,Chicago. Doebler,L. K., & Mardis,L. J. (1980-1981). Effectsof a bilingualeducationprogram for NativeAmericanchildren.NABEJournal,5(2), 23-28. Durgunoglu,A., Nagy, W. E., & Hancin-Bhatt,B. J. (1993). Cross-languagetransfer of phonological awareness. Journal of Educational Psychology, 85(3), 453-465. Educational Operations Concepts, Inc. (1991a). An evaluation of the Title VII ESEA bilingual education program for Hmong and Cambodian students in kindergarten andfirst grade. St. Paul, MN: Author. Educational Operations Concepts, Inc. (1991b). An evaluation of the Title VII ESEA bilingual education program for Hmong and Cambodian students in junior and senior high school. St. Paul, MN: Author. El Paso Independent School District. (1987). Interim report of thefive-year bilingual education pilot, 1986-1987 school year. El Paso, TX: Office for Research and

Evaluation.

El Paso IndependentSchool District. (1990). Bilingual education evaluation: The sixth

year in a longitudinalstudy.AvailablefromOffice for Researchand Evaluation, 6531 BoeingDrive,El Paso,TX 79925. El PasoIndependent SchoolDistrict.(1992).Bilingualeducationevaluation.Available fromOfficefor ResearchandEvaluation,6531 BoeingDrive,El Paso,TX 79925. instructionin the UnitedStates: Fitzgerald,J. (1995). English-as-a-second-language A research review. Journal of Reading Behavior, 27, 115-152.

277

Slavin & Cheung Garcia, G. (2000). Bilingual children's reading. In M.L. Kamil, P. B. Mosenthal, P. D. Pearson, & R. Barr (Eds.), Handbook of reading research (Vol. 3, pp. 813-834). Mahwah, NJ: Erlbaum. Genesee, F., Lambert, W. E., & Tucker, G. R. (1977). An experiment in trilingual education. Montreal, Canada:McGill University. Genesee, F., & Lambert, W. E. (1983). Trilingual education for majority-language children. Child Development, 54, 105-114. Gersten, R. (1985). Structuredimmersion for language minority students: Results of a longitudinal evaluation. Educational Evaluation and Policy Analysis, 7(3), 187-196. Gersten, R., & Woodward, J. (1995). A longitudinal study of transitional and immersion bilingual education programs in one district. Elementary School Journal, 95(3), 223-239. Greene, J. P. (1997). A meta-analysis of the Rossell & Baker review of bilingual education research. Bilingual Research Journal, 21(2/3). Grigg, W., Daane, M., Jin, Y., & Campbell, J. (2003). The nations's report card: Reading 2002. Washington, DC: U.S. Department of Education. Hakuta, K., Butler, Y. G., & Witt, D. (2000). How long does it take English learners to attain proficiency? (Policy Report 2000-1). Santa Barbara, CA: University of California Linguistic Minority Research Institute. Howard, E. R., Sugarman, J., & Christian, D. (2003). Two-way immersion education: What we know and what we need to know. Baltimore: Johns Hopkins University, Center for Research on the Education of Students Placed at Risk. Huzar,H. (1973). The effects of an English-Spanish primary grade reading program on second and third grade students. Master's thesis, Rutgers University, Camden, NJ. Kaufman, M. (1968). Will instruction in reading Spanish affect ability in reading English? Journal of Reading, 11, 521-527. Klingner, J. K., & Vaughn, S. (2004). Specific strategies for struggling second language readers and writers. In T. L. Jetton & J. A. Dole (Eds.), Adolescent literacy research and practice. New York: Guilford. Lambert,W. E., & Tucker, G. R. (1972). Bilingual education of children: The St. Lambert Experience. Rowley, Quebec, Canada: Newbury House. Layden,R. G. (1972). The relationshipbetween the language of instructionand the development of self-concept, classroom climate, and achievement of Spanish speaking Puerto Rican children. Doctoral dissertation,University of Maryland,College Park. Lee, J., & Schallert, D. L. (1997). The relative contributionof L2 language proficiency and L1 reading ability to L2 reading performance: A test of the threshold hypothesis in an EFL context. TESOLQuarterly, 31, 713-739. Legarreta, D. (1979). The effects of program models on language acquisition by Spanish-speaking children. TESOLQuarterly, 13(4), 521-534. Lindsey, K. A., Manis, F. R., & Bailey, C. E. (2003). Prediction of first-gradereading in Spanish-speaking English-language learners.Journal of Educational Psychology, 95(3), 482-494. Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage. Lum, J. B. (1971). An effectiveness study of English as a second language (ESL) and Chinese bilingual methods. Doctoral dissertation, University of California, Berkeley. Maldonado, J. A. (1994). Bilingual special education: Specific learning disabilities in language and reading. Journal of Education Issues of Language Minority Students, 14, 127-147. Maldonado, J. R. (1977). The effect of the ESEA Title VIIprogram on the cognitive development of Mexican American students. Unpublished doctoral dissertation, University of Houston, Houston, TX. 278

Research on Languageof ReadingInstructionfor ELLs Matthews, T. (1979). An investigation of the effects of background characteristics and special language services on the reading achievement and English fluency of bilingual students. Seattle, WA: Seattle Public Schools, Department of Planning, Research, and Evaluation. Melendez, W. A. (1980). The effect of the language of instruction on the reading achievement of limited English speakers in secondary schools. Doctoral dissertation, Loyola University of Chicago. Meyer, M. M., & Fienberg, S. E. (1992). Assessing evaluation studies: The case of bilingual education strategies. Washington, DC: National Academy of Sciences. Morgan, J. C. (1971). The effects of bilingual instruction of the English language arts achievement of first grade children. Doctoral dissertation, Northwestern State University of Louisiana. Mosteller, F., & Boruch, R. (2002). Evidence matters: Randomized trials in education research. Washington, DC: Brookings Institution Press. National Center for Education Statistics. (2004). Language minorities and their educational and labor market indicators: Recent trends. Washington, DC: U.S. Department of Education. National Reading Panel. (2000). Teaching children to read: An evidence-based assessment of the scientific research literature on reading and its implications for reading instruction. Rockville, MD: National Institute of Child Health and Human Development. Olesini, J. (1971). The effect of bilingual instruction on the achievement of elementary pupils. Unpublished doctoral dissertation, East Texas State University, Commerce. Pena-Hughes, E., & Solis, J. (1980). ABC's: McAllen's Immersion System. McAllen, TX: McAllen Independent School District. Plante, A. J. (1976). A studyof effectivenessof the Connecticut "Pairing" model ofbilingual/biculturaleducation. Hamden,CT: ConnecticutStaff Development Cooperative. Powers, S. (1978). The influence of bilingual instruction on academic achievement and self-esteem of selected Mexican American junior high school students. Doctoral dissertation, University of Arizona, Tucson. Ramirez, J., Pasta, D. J., Yuen, S., Billings, D. K., & Ramey, D. R. (1991). Final report: Longitudinal study of structural immersion strategy, early-exit, and late-exit transitional bilingual education programs for language-minority children. San Mateo, CA: Aguirre International(Report to the U.S. Department of Education). Ramos, M., Aguilar, J. V., & Sibayan, B. F. (1967). The determination and implementation of language policy (Monograph Series 2). Quezon City, The Philippines: Philippine Center for Language Study. Reese, L., Gamier, H., Gallimore, R., & Goldenberg, C. (2000). Longitudinal analysis of the antecedents of emergent Spanish literacy and middle-school English reading achievement of Spanish-speaking students. American Educational Research Journal, 37(3), 633-662. Rosier, P., & Holm, W. (1980). The Rock Point Experience: A longitudinal study of a Navajo school program. Washington, DC: Center for Applied Linguistics. Rossell, C. H. (1990). The effectiveness of educational alternativesfor limited-Englishproficient children. In Imhoff, G. (Ed.), Learning in two languages. New Brunswick, NJ: Transaction Publishers. Rossell, C. H., & Baker, K. (1996). The educationaleffectiveness of bilingual education. Research in the Teaching of English, 30(1), 7-69. Rossell, C., & Ross, J. (1986). The social science evidence on bilingual education. Journal of Law and Education, 15, 385-419. Rothfarb, S. H., Ariza, M. J., & Urrutia, R. (1987). Evaluation of the Bilingual Curriculum Content (BCC) Project: A three-year study, final report. Miami, FL: Office of Educational Accountability, Dade County Public Schools. 279

Slavin & Cheung

Saldate,M., Mishra,S. P., & Medina,M. (1985). Bilingualinstructionandacademic achievement: A longitudinal study. Journal of Instructional Psychology, 12(1),

24-30. Skoczylas,R. V. (1972). An evaluationof some cognitiveandaffectiveaspectsof a Spanishbilingualeducationprogram.Doctoraldissertation,Universityof New Mexico,Albuquerque. Slavin, R. E. (1986). Best-evidencesynthesis:An alternativeto meta-analyticand traditionalreviews. Educational Researcher, 15(9), 5-11. Slavin, R. E., & Cheung, A. (in press). Effective early reading programs for English language learners: Language policy and early literacy education. Greenwich, CT:

InformationAge Publishing.

Slavin, R. E., & Cheung, A. (2005). Effective reading programs for English language

learners.Baltimore,MD:JohnsHopkinsUniversity,CenterforData-DrivenReform in Education.

Stem, C. (1975). Final report of the Compton Unified School District's Title VIIbilingual-bicultural project: September 1969 through June 1975. Compton City, CA:

ComptonCitySchools. Teschner,R.V. (1990). Adequatemotivationand bilingual education.Southwest Journal of Instruction, 9(2), 1-42. Thomas, W. P., & Collier, V. P. (2002). A national study of school effectiveness for language minority students' long-term academic achievement. Santa Cruz, CA:

Universityof Californiaat SantaCruz,Centerfor Researchon Education,Diversity, andExcellence.

Valladolid, L. A. (1991). The effects of bilingual education on students' academic achievement as they progress through a bilingual program. Doctoral dissertation,

UnitedStatesInternational University,Fresno,CA.

Webb, J. A., Clerc, R. J., & Gavito, A. (1987). Comparison of bilingual and immersion programs using structural modeling. Houston, TX: Houston Independent School

District. Willig,A. (1985).A meta-analysisof selectedstudieson the effectivenessof bilingual education. Review of Educational Research, 55(3), 269-317.

Willig, A. (1987). Examiningbilingualeducationresearchthroughmeta-analysisand narrative review: A response to Baker. Review of Educational Research, 57(3),

363-376. Wong-Fillmore,L., & Valadez,C. (1986). Teachingbilinguallearners.In M.C.Wittrock (Ed.), Handbook of research on teaching (3rd ed.). New York: Macmillan.

Yap,K. O., Enoki,D. Y., & Ishitani,P. (1988, April).LEPstudentachievement:Some pertinent variables and policy implications. Paper presented at the annual meeting

of the AmericanEducationalResearchAssociation,New Orleans. Yeung,A. E., Marsh,H. W., & Suliman,R. (2000). Cantwo tongueslive in harmony? Analysisof the NationalEducationLongitudinalStudyof 1988 (NELS88)longitudinaldataon the maintenanceof home language.AmericanEducationalResearch Journal, 37(4), 1001-1026.

Authors ROBERTE. SLAVINis a PrincipalResearchScientistat JohnsHopkinsUniversity and Directorof the Centerfor Data-DrivenReformin Education,JohnsHopkins University, 200 W. Towsontown Blvd., Baltimore, MD 21204; e-mail [email protected] researchinterestsinclude cooperativelearning,comprehensive school reform,policy and practicefor at-riskstudents,Englishlanguage learners,andresearchreview. 280

Research on Languageof ReadingInstructionfor ELLs

ALAN CHEUNGis a ResearchScientist at the Success for All Foundation,200 W. TowsontownBlvd., Baltimore,MD 21204; [email protected]. Startingin August 2005, Dr. Cheung will be an Associate Professor at the HongKongInstituteof Education,Departmentof EducationalPolicyandAdministration,10 Lo Ping Road,Taipo,Hong Kong, China;[email protected]. His researchinterestsincludebilingualeducation,comprehensiveschool reform, privateeducation,andeffectivereadingprogramsfor Englishlanguagelearners.

281

APPENDIX Disposition of studies reviewed Cited by Authors

Remarks

Methodologicallyadequate:Elementaryreading RB RB RB RB and W RB and W RB RB RB RB

Alvarez (1975) Bacon et al. (1982) Campeauet al. (1975) Cohen(1975) Doebler & Mardis(1980) Huzar(1973) J. A. Maldonado(1994) J. R. Maldonado(1977) Morgan(1971) Plante(1976) Ramirezet al. (1991) Saldateet al. (1985)

5 separatestudies met criteria

Methodologicallyadequate:Heritage languages RB

Doebler & Mardis(1980) Morgan(1971)

Choctaw in Mississippi Frenchin Louisiana

Methodologicallyadequate:Secondaryreading RB and W RB and W

Covey (1973) Kaufman(1968) Canadianstudies of French immersion

RB RB RB RB RB RB RB and W

Barik& Swain (1975) Bariket al. (1977) Brucket al. (1977) Day & Shapson(1988) Genesee & Lambert(1983) Genesse et al. (1989) Lambert& Tucker(1972) Studentsnot learning the societal language

RB

Ramos et al. (1967)

LearningEnglish in the Philippines

No readingoutcomes(oral language only) RB and W RB RB

Lum (1971) Bates & May (1970) Elizondo de Weffer (1972)

RB and W RB and W

Legarreta(1979) Pena-Hughes& Solis (1980)

RB RB

Ciriza(1990) Rothfarbet al. (1987)

282

6-monthstudy, no pretestdataprovided 4-month study, no readingoutcomes;also preferencefor English languageusage, EI > TBE KindergartenLanguageAssessment Scales were outcome measure Preschoolonly

APPENDIX (Continued) Cited by Authors

Remarks

Minimaluse of native language instruction RB RB RB RB

Becker et al. (1982) EducationalOperations Concepts(199la) EducationalOperations Concepts(1991b)

Not an evaluationof bilingualprograms No indicationthatK-1 Cambodian,Hmong studentswere taughtin native languages No indicationthatCambodian,Hmong studentsin Grades7-9 were taughtin native languages Study of Direct Instruction;no bilingual comparisongroup

Gersten(1985)

Pretests given after treatmentswere underway RB andW RB RB RB RB and W

RB and W RB RB

Danoff,Arias,& Coles (1977) Melendez (1980) Olesini (1971) Rosier & Holm (1980) Rossell (1990) Skoczylas (1972)

Largepretestdifferences;no separate analysis for Spanish-dominantstudents; more English-dominantchildrenin the controlgroup

Ster (1975) Thomas & Collier (2002) Separatestudies in Maine and Houston Valladolid (1991) Yap, Enoki, & Ishitani(1988) Redundant

RB RB RB RB RB and W RB RB RB

Ariza (1988) Barik& Swain (1978) Cohen et al. (1976) Curielet al. (1980) Danoff, Coles, McLaughlin, & Reynolds (1977, 1978) El Paso ISD (1987, 1990) Genesee, Lambert,& Tucker(1977) McConnell (1980a)

Redundantwith Rothfarb(1987) Redundantwith Bariket al. (1977) Redundantwith Cohen (1975) Redundantwith Curiel (1979) Redundantwith Danoff, Arias, & Coles (1977) Redundantwith El Paso ISD (1992) Redundantwith Genesee et al. (1983) Redundantwith McConnell (1980b)

No evidence of initial equality RB

Ames & Bicks (1978)

RB RB RB and W RB

Barclay (1969) Bacon et al. (1982) Carsrud& Curtis (1979, 1980) Cottrell(1971)

RB

Curiel (1979)

Largepretestdifference;mixed gradesand mixed languages Largepretestdifferences;7-monthstudy No measureof early academicability Mixed Spanish-and English-dominant childrenin the analysis Poorly matchedon SES; ANCOVA was used but no pretestdataprovided No measureof early academicability (continued) 283

APPENDIX (Continued) Cited by Authors

Remarks

No evidence of initial equality RB RB

El Paso ISD (1992) Layden (1972)

RB RB RB RB and W RB RB RB and W

Malherbe(1946) Matthews(1979) Powers (1978) Stebbinset al. (1977) Teschner(1990) Vasquez (1990) Zirkel(1972)

No measureof early academicability Largepretestdifference in both Spanish and English; 10-week study Lackedinformationaboutinitialcomparability Lackedinformationaboutinitialcomparability No measureof early academicability No measureof early academicability No measureof early academicability No measureof early academicability Largepretestdifferencesin Hartfordand Bridgeport;no bilingualinstructionin New Britain,New London

No appropriatecomparisongroup RB

Burkheimeret al. (1989)

RB

Carlisle& Beeman (2000) de la Garza& Marcella(1985) Lampman(1973)

RB

McConnell(1980b)

RB

Medina & Escamilla (1992)

RB

Moore & Parr(1978)

RB

Prewitt-Diaz(1979) Thomas & Collier (1997) Thomas & Collier (2002)

RB

Webb, Clert,& Gavito (1987)

Comparedactualperformanceto expected performance,no real controlgroup Bothgroupswerebilingual(80-20 vs. 20-80) ComparedSpanish-dominantto English-dominant;no pretestdata Mixed Spanish-and English-dominant childrenin the pretestanalysis Comparedto a baseline group;no measure of initial comparability ComparedVietnameseTBE to Hispanic MaintenanceBilingual;no reading outcomes Mixed Spanish-and English-dominant children;also late pretestsfor Grades 1 and 2 17-week study;large pretestdifference No controlgroups Separatestudies in Oregon and Florida lacked controlgroups Scores confoundedwith retentionstatus

Brief studies RB

Balasubramonianet al. (1973)

4-month study Unavailable

RB and W

McSpadden (1979, 1980)

Note. RB = Rossell & Baker, 1996; W = Willig, 1985; TBE = TransitionalBilingual Education;EI = English Immersion;ISD = IndependentSchool District; TBE = transitionalbilingualeducation. 284

Suggest Documents