529 Full
529 Full
529 Full
on Academic Achievement
Evidence from Indonesia
David Newhouse
Kathleen Beegle
Downloaded from by guest on February 12, 2024. Copyright 2006
abstract
Using Indonesian data, this paper evaluates the impact of school type on the
academic achievement of junior secondary school students (grades 7-9).
Public school graduates, after controlling for a wide variety of characteris-
tics, score 0.17 to 0.3 standard deviations higher on the national exit exam
than their privately schooled peers. This finding is robust to OLS, fixed-
effects, and instrumental variable estimation strategies. Students attending
Muslim private schools, including Madrassahs, fare no worse on average
than students attending secular private schools. Our results provide indirect
evidence that higher-quality inputs at public junior secondary schools pro-
mote higher test scores.
I. Introduction
The existing evidence on how the characteristics of schools in devel-
oping economies, including whether they are publicly or privately administered,
affect students’ acquisition of cognitive skills is surprisingly mixed. The effect of edu-
cational policies in general on learning in developing countries is poorly understood;
a recent survey on the topic conceded that “most of what has been learned has been
David Newhouse is a technical assistance advisor in the Fiscal Affairs Department of the International
Monetary Fund. Kathleen Beegle is a senior economist in the Development Economics Research Group at
the World Bank. The material and views expressed here are those of the authors and should not be attrib-
uted to the IMF or the World Bank or their member countries. The authors thank Elizabeth King, Joe
Newhouse, two anonymous referees, and participants of seminars at the World Bank Resident Mission in
Jakarta, Minnesota Development Economics Conference, and Cornell University for useful comments.
David Newhouse will assist any scholar in seeking access to these data between January 2007 and
December 2010. He may be contacted at: International Monetary Fund, 700 19th Street NW, Washington
DC 2043 Phone: 202-623-5682; E-mail: dnewhouse@imf.org.
[Submitted February 2005; accepted November 2005]
ISSN 022-166X E-ISSN 1548-8004 © 2006 by the Board of Regents of the University of Wisconsin System
on their wealth and preference for academic achievement, which raises the prospect
of selection bias in empirical estimates of the effect of school type on test scores. Our
empirical results, however, suggest that after controlling for a large number of house-
hold characteristics, selection bias due to parental preference for achievement is
small. OLS, fixed effects, and instrumental variables estimation methods indicate that
public school students have exit scores that are 0.17 to 0.3 standard deviations higher
than their privately schooled peers. We find no evidence that private schools are more
effective than public schools at raising test scores.
We also examine the relative performance of Madrassah, Muslim non-Madrassah,
secular, and other religious schools, and find two tiers of performance. Students
attending public schools and the small number of students attending non-Muslim reli-
gious private schools perform equally well, while students in secular and Muslim pri-
vate schools each fare worse by the same magnitude. In general, existing studies show
that public junior secondary schools appear to employ higher-quality inputs. Our
results therefore provide indirect evidence that the higher quality of public school
inputs promotes higher test scores. Future research will hopefully lead to a better
understanding of why public schools outperform their private counterparts, by identi-
fying the specific characteristics of schools that explain this disparity.
II. Background
Evans and Schwab 1995; Jimenez, Lockheed, and Paqueo 1992; and Neal 1997). In
Indonesia, evidence on inputs, as well as limited information on per-pupil expendi-
tures, is consistent with longstanding perception that public schools are better. In
terms of schooling inputs, Strauss et al. (2004) and Serrato and Melnick (1995) gen-
erally point to higher-quality inputs in public schools. The teacher-student ratio is an
exception, as it was about 44 percent lower in private junior secondary schools than
in public schools, in both 1997 and 2000. However, textbooks tend to be more avail-
able in public junior secondary schools than in private ones, including textbooks that
are borrowed or provided at no cost. Also, the average faculty education at the junior
secondary level is higher at public schools than private. At public schools, teachers
are significantly less likely to have a second job. Finally, there is limited evidence that
public secular junior secondary schools have higher funding per pupil (Asian
Development Bank 1997).1 Until they were abolished in 1998, public school fees
were actually higher than private fees on average. Unfortunately, further data regard-
ing school financing are unavailable, making it impossible to evaluate the cost-
effectiveness of different school types. Overall, however, the weight of the evidence
from past research indicates that public schools use higher-quality inputs.2
Although public schools appear to use better inputs, there is conflicting evidence as
to whether these inputs translate into higher academic performance among students.
One study from the early 1990s found that junior secondary students who attended
public schools scored higher than their private school peers (World Bank 1998).
However, that study did not address selection bias due to the nonrandom matching of
students to schools. On the other hand, two more thorough studies conclude that after
controlling for selection, private schools are more effective and better managed than
1. In our data, the median ratio of private to public school expenditures is near or slightly greater than one.
This omits the public sector contribution that devotes resources to both public and private schools (World
Bank 1998), making it difficult to assess whether per-pupil spending is higher in public schools.
2. Muslim schools and secular private schools operate with input and interaction with the public education
system. The national ministry accredits private schools, based on student performance on national exams,
and adequacy of school facilities (see World Bank 1998). In addition to receiving financial and in-kind sup-
port from the public sector (noted earlier), much of the decision-making over books and curriculum in pri-
vate junior secondary schools resides with the local education authority (Dinas). In the IFLS3 school survey,
more than 80 percent of private non-Muslim schools and two-thirds of private Muslim schools reported that
the Dinas made decisions for the schools in these areas. Certainly, religious schools are far more likely to
report input on these decisions from the Ministry of Religious Affairs (more than 90 percent of private
Muslim schools as opposed to 25 percent of private non-Muslim schools).
532 The Journal of Human Resources
public schools. James, Suryahadi, and King (1996) find that, after controlling for exit-
ing test scores, private elementary schools in Indonesia incur lower costs per pupil.
They conclude that private management is more efficient at achieving academic qual-
ity. A more recent study goes further and claims that students schooled at private sec-
ular secondary schools enjoy a wage premium of 75 percent over their publicly
schooled peers (Bedi and Garg 2000).
Unfortunately, neither of the two studies that find that private schooling is superior
use a plausibly exogenous source of variation to identify the private school effect.
James, Suryahadi, and King (1996) identify the effect of school type on expenditure
using the religious and demographic composition of its subdistrict (kecamatan),
meaning they assume that these subdistrict characteristics are orthogonal to schools’
Downloaded from by guest on February 12, 2024. Copyright 2006
per-pupil spending. Bedi and Garg’s finding that private schooling raises future adult
earnings is based on the identifying assumption that an adult’s province of birth can
be excluded from the wage equation. This assumes that province of birth is only cor-
related with adult earnings through its effect on the probability of attending a public
or private school. This assumption is violated if province of birth is correlated with
other unobserved factors determining wages, such as personal connections and
human-capital accumulation not attributable to school type. In results below, we find
that province of junior high school attendance has a strong effect on school test
scores, conditional on numerous covariates including school type, which suggests that
this assumption is flawed.3
The implication of the Bedi and Garg study, namely that private secular senior sec-
ondary schools provide a more valuable education than public senior secondary
schools, is puzzling for two reasons. First, as noted above, public schools in Indonesia
look stronger on observed inputs and are widely perceived to be superior to secular
and Muslim private schools. Indeed, studies such as Bedi and Garg find that public
and private Christian secondary schools attract observably stronger students. Second,
some public schools in urban areas screen applicants based on the score of their
national test following elementary school. Students at these schools benefit from a
higher-scoring peer group. The positive effect of private administration would have to
outweigh these peer effects, which appear to be important in other contexts (Hoxby
2000; Somers, Mcewan, and Wilms 2003).
III. Model
3. The finding in our study that selection bias is small with respect to the effect of school type on junior sec-
ondary school exam scores does not imply that selection bias was not present in these two studies, which
used different dependent variables and a smaller set of control variables.
Newhouse and Beegle 533
4. The exact form of the utility function does not affect the results derived below, as long as utility is con-
cave in consumption.
534 The Journal of Human Resources
The difference in utilities between the best available public school and the best
available private option is:
(4) DU * = ln aY1 - Ppubk - ln aY1 - Pprik + d ln aY2 + T pubk - d ln aY2 + T prik +
This model confirms the intuition that a parent that places higher value on educa-
tion is more likely to send their child to public schools, which are assumed to be of
higher average quality. Meanwhile, holding other factors constant, wealthier house-
holds are more likely to send their children to private school. In the United States,
where private schools are generally considered to be higher quality, wealthier, and
more motivated students tend to select into private schools. In Indonesia, however,
where in general public schools are considered to be of higher quality, the two sources
of selection bias are of opposite sign. Thus, the direction and magnitude of bias in
the OLS models is unknown, and depends on the relative strength of unmeasured
wealth and unmeasured motivation in determining students’ choice of school and
their test score.
IV. Data
The primary data source for this study is the three full rounds of the
Indonesia Family Life Survey (IFLS1, IFLS2, and IFLS3). (See Frankenberg and
Karoly 1995; Frankenberg and Thomas 2000; Strauss et al. 2004.) The first round of
the survey sampled 7,200 households in 1993; subsequent surveys attempted to rein-
terview these households and households to which previous household members had
moved. The 1993 sample was drawn from 321 randomly selected villages, spread
among 13 Indonesian provinces containing 83 percent of the country’s 200 million
people. The 321 villages were selected from the sample frame of the 1993 SUSENAS,
the national economic survey, and are located in 149 districts. The sample captures an
impressive amount of Indonesia’s remarkable ethnic and geographic diversity.
We analyze the national Ebtanas test scores of former junior secondary school stu-
dents. In Indonesia, students are evaluated at the end of the three main education lev-
els (elementary, junior secondary, and senior secondary) on the basis of a national
test.6 Data on test scores at all three levels were collected in 1997 and 2000 from all
household members between the ages of 14 and 25. The survey also ascertained the
type of school attended at each level.
This study utilizes data on the presence of public and private schools at the district
level to identify the effect of school type on student’s test score.7 District-level data
on the presence of schools come from the 1998 round of annual census of schools
conducted by the Indonesian Ministry of Education. Eighty percent of the 42,000 sec-
ondary schools in Indonesia responded to this survey. Unfortunately, because of a
budgetary shortfall during the 1998 financial crisis, the education census does not
contain any useful information about private schools, except for their private status
and location. This information is used to construct both the total number of junior sec-
ondary schools and the percentage of district junior secondary schools that are public
Downloaded from by guest on February 12, 2024. Copyright 2006
in the district.
The sample consists of all students who reported, in either 1997 or 2000, taking the
junior secondary school test between 1990 and 2000.8 Of the 5,437 respondents that
reported taking the national junior secondary school exam between 1990 and 2000,
605 were dropped because they did not report scores from their junior secondary
school test. 335 other respondents were dropped because they not report their ele-
mentary school test score, which is a highly significant determinant of junior high test
score. An additional 115 respondents were not included in the sample because they
did not report the district of the junior secondary school they attended. The remaining
full sample consists of 4,382 respondents. The 1,055 excluded respondents are
slightly less likely to have well-educated mothers and fathers, and somewhat less
likely to have attended public school. This suggests that attrition bias, if anything,
might lead to a slight understatement of the positive effect of public schools on test
score.
V. Empirical Framework
in school leaving exams. The test items are collected nationally, and are not specific. Test items that are writ-
ten by trained teachers and lecturers across the country are then reviewed and incorporated into the data bank.
The junior secondary school test, which is calibrated and empirically validated, covers five subjects:
Indonesia, Math, Social Studies, Science, and Moral Lessons from Pancasila (the national ideology).
7. There are 178 districts represented in the data. We chose to aggregate school availability measures at the
district rather than the subdistrict level due to the small number of schools in certain subdistricts. In a previ-
ous version of this paper, we also used a second measure of availability: The share of schools within 25 miles
of the village center that are public. This measure was constructed from the data on the 321 original IFLS
communities. For schools which were not interviewed directly in the IFLS facility survey, we inferred pub-
lic or private status from the school name. The district and village level measures are moderately correlated,
with a correlation coefficient of 0.33. However, the village-availability measure from the IFLS is only appli-
cable to the subsample of students who were interviewed in the same subdistrict where they attended junior
secondary school, which reduced the total sample by about 40 percent. Because limiting the sample to stu-
dents who did not move after graduation caused selection bias, we only use the measures of access derived
from the school census.
8. Test scores were not collected in the 1993 survey.
536 The Journal of Human Resources
2
Jr. High Standardized score
−1
Downloaded from by guest on February 12, 2024. Copyright 2006
−2
−3
−3 −2 −1 0 1 2 3
Elementary Standardized score
Private Public
45 degree line
Figure 1
Junior Secondary Test Score, Conditional on Elementary Test Score, for Public and
Private School Students.
exiting junior secondary schools, smoothed against their test scores exiting elemen-
tary school, separately for public and private junior secondary students. In Figure 1
and throughout the paper, students’ test scores are normalized to a mean of zero and
a standard deviation of one, using the scores of other students that took the national
test in the same year. The shaded regions indicate 95 percent confidence intervals.
Conditional on elementary test scores, students at public junior secondary schools
score higher upon exiting junior secondary school. Moreover, the difference in exit-
ing test scores appears to be greatest for students at the tails of the elementary test
score distribution.
To further probe this initial finding, we control for other observed child and family
characteristics in a regression framework. Including control variables, however,
requires making a tradeoff between the size of the sample and the availability of par-
ticular household characteristics. Because test scores are provided retrospectively,
many respondents first appeared in an IFLS household several years after their grad-
uation from junior secondary school. For these respondents, time-varying household
characteristics such as household consumption are not observed at the time they took
the test. Excluding these time-varying household characteristics may confound esti-
mates of the effect of junior secondary school type on test score. Therefore, we also
present results for two subsamples. The junior secondary school sample consists of
Newhouse and Beegle 537
2,733 respondents who were interviewed within a year of their junior secondary
school graduation.9 When this sample is used, the time-varying characteristics that are
measured within a year of taking the exam are included as control variables. The ele-
mentary school sample consists of 1,948 students who are in the junior secondary
school sample and were also interviewed in a previous round of the survey. For these
respondents, time-varying characteristics such as household consumption are avail-
able both before and after the student’s entry into junior secondary school. To obtain
the OLS results, we estimate the (normalized) score, conditional on characteristics of
the student and their household, as well as type of school attended at the junior sec-
ondary level:
(7) Scorei = bs Xi + cTi + fi
Downloaded from by guest on February 12, 2024. Copyright 2006
9. The junior secondary sample consists of students who took the test in 1999 or 2000 and were interviewed
in 2000, students who took the test between 1996 and 1998 and were interviewed in 1997, and students who
took the test between 1992 and 1994 and were interviewed in 1993. The elementary school sample consists
of students in the junior secondary sample who were also interviewed in a previous survey round.
10. The average elementary school test score for a particular district is constructed by averaging the ele-
mentary test score of all other respondents that attended junior secondary school in the same district. For 16
students in the full sample, no other respondent attended junior secondary school in their district, and the sin-
gle student’s test score was used as the average.
538 The Journal of Human Resources
● Family background: Parental education level, the family’s religion, and the
primary language spoken at home (as a proxy for ethnicity, which was not
recorded).
● Location characteristics: The province in which the student attended junior
secondary school and whether the student at age 12 resided in a village, a
small town, or a big city.
● Type of elementary school: The type of elementary school attended (public
secular, public Madrassah, private secular, private Madrassah, private Muslim
non-Madrassah, or private other).
● Student characteristics: Gender of the respondent is female, working status
Downloaded from by guest on February 12, 2024. Copyright 2006
11. The question in the questionnaire includes four categories. Somewhat unhealthy and unhealthy have
been grouped together. This question was not asked in 1993 and is therefore only available for half of the
sample. Missing observations are grouped as a separate category. For elementary school students, general
health status is reported by the mother or primary caregiver.
Newhouse and Beegle 539
ity on the type of school attended, we use the junior secondary school sample to esti-
mate a multinomial logit regression of school type attendance. The dependent variable
is an indicator of whether the student attended public school, private secular school,
private Muslim-affiliated school, private Madrassah, or a private non-Muslim reli-
gious school.12
We focus on the determinants of attendance at private secular, Muslim-affiliated
private schools, and Madrassahs, because there are few students attending private
non-Muslim religious schools.13 The Madrassah category includes both traditional
Tsaniwayah Pesantren schools, which emphasize the study of the Quran, Arabic
language, and Muslim history, as well as the newer Madrassah schools which inte-
grate these religious subjects with the academic curriculum of the public education
system.
The entire set of household and student characteristics listed in the data section are
included as control variables, but we report only the results from indicators of house-
hold wealth, the student’s prior academic achievement and parental education. Table 1
reports the average marginal effects of each variable on the probability of attending
a particular type of school, and whether the variable was statistically significant in
the multinomial logit model.14 The regression contains two measures of income or
wealth: household per-capita consumption and the floor type of the house. After con-
trolling for a wide variety of other household characteristics, these indicators of
income and wealth are weak determinants of the type of junior secondary school
attended. The marginal effect of log household per-capita consumption for private
secular schools shows that a 10 percent increase in household per-capita consump-
tion lowers the probability of attendance relative to public school by one percentage
12. In this analysis, public Madrassahs are grouped with public secular schools for brevity. Only 7 percent
of public school students attend public Madrassahs.
13. Three percent of the full sample and 10 percent of the private-school attendees attend non-Muslim reli-
gious schools. Of these schools, about 60 percent are Catholic, while the remaining 40 percent are Christian
or Buddhist, or have other religious affiliation. Christian schools are not restricted to Christian students.
Private Catholic and Protestant secondary schools often enroll Muslim students. In the data used, very few
students switched schools at all, let alone switched between public and private schools, during their atten-
dance at the junior secondary level.
14. For dummy variables, the marginal effect is the sample average of the difference in the predicted proba-
bilities when the dummy variable is set to one or zero. For the test score and consumption variables, we report
the average of each observation’s marginal effects of the variable and its square and their joint significance.
540 The Journal of Human Resources
Table 1
Marginal effects of determinants of school type
Private
Private Private Private religious
secular Muslim Madrassah other
Household wealth
Log per-capita −0.011** −0.005 0.003 0.003
expenditure and
square
Downloaded from by guest on February 12, 2024. Copyright 2006
Note: Marginal effects from multinomial logit model estimated on junior secondary school subsample.
Omitted category is public school attendance. * indicates logit coefficients significant at 5 percent; ** at
1 percent. This and all regressions below control for: Elementary school grade repetition, test score, whether
the score was read from the official card, mother’s and father’s education level, type of religion, student’s
sex, whether the student worked in junior high, the general size of the student’s village at age 12, the type of
elementary school, indicators for languages spoken at home, the average district elementary score, and the
number of schools in the district. Junior high and elementary subsample regressions include the per-capita
expenditure and floor type of the household, and the subjective health of the respondent.
Newhouse and Beegle 541
point. Meanwhile, despite the theory that increased wealth increases the probability
of private school attendance ceteris paribus, there is no consistent pattern between
the quality of the floor and the probability of attending private secular or Muslim
school.
The student’s past academic performance has a larger effect on the probability of
attending private school. An increase in the elementary school exam score of one stan-
dard deviation lowers the probability of attending private secular school by nine per-
centage points; the probability of attending private Muslim school falls by seven
percentage points, and the probability of attending a private Madrassah falls by one
percentage point. Grade repetition in elementary school also reduces in the probabil-
ity of attending a secular private school, although this effect is smaller and not statis-
Downloaded from by guest on February 12, 2024. Copyright 2006
15. Results of the fixed effects estimation strategy are not reported for the junior secondary school and ele-
mentary subsamples because there is little variation within family in the time-varying variables that are
included in these subsamples.
542 The Journal of Human Resources
Table 2
Effect of public school attendance on junior secondary school test score
Family
fixed
OLS OLS OLS effects
Note: Robust standard errors in parentheses. * significant at 5 percent; ** significant at 1 percent. Regression
includes other control variables listed below Table 1.
Of course, least squares estimates of the public school effect will be biased if pub-
lic school attendance is correlated with unobserved factors that determine test scores.
In the Indonesian context, the direction of this endogeneity bias is unclear in theory,
as described above. However, the correlation between observable characteristics and
school choice suggests that public schools benefit from positive selection, which
might bias the estimated public school premium upward. Moreover, because parents
choose schools separately for each child within the household, partly on the basis of
unobservable child characteristics, the inclusion of family-level fixed effects does not
eliminate this bias.16
Least squares estimates of the public school effect also will be biased if
recall error in the test score is correlated with the type of school attended. To infor-
mally assess the effect of recall error, we exploit the fact that survey asked respon-
dents to produce their official test report if available. Sixty-two percent of the
respondents in the final sample showed their test card to the interviewer in either
1997 or 2000. We include a dummy variable in the regression for whether the
respondent showed a card. In the regression determining test score in the junior
high school sample, the coefficient on the card dummy is −0.09 and statistically sig-
nificant, which could reflect a mixture of respondents overstating scores recalled
from memory and higher scoring students being less likely to retain their card.
Omitting the card dummy from the regression has a negligible effect on the school-
type coefficients, however, and coefficients on the interactions of the card dummy
16. In the sample of children for whom two siblings attended different types of schools, within-family vari-
ation accounts for 39 percent of the total variation in test scores, which is consistent with intra-household
selection into public schools.
Newhouse and Beegle 543
and school type were not statistically significant. This suggests that recall error
has a weak association with school type, and is unlikely to be a serious concern in
our data.
Nonrandom sorting of students into different types of schools remains a potential
source of bias. To address it, we estimate two-stage-least-squares models of test scores,
employing measures of the local availability of public schools as an instrument for
public school attendance.17 This approach has been used to estimate the effect of
Catholic schooling effect in the United States (see, for example, Neal 1997; Figlio and
Ludwig 2000). The importance of availability of private schools in schooling choices
has been demonstrated in the developing country context (see, for example, Alderman,
Orazem, and Paterno 2001). Data on the presence of public and private schools are
Downloaded from by guest on February 12, 2024. Copyright 2006
available at the district level from the school census data collected by the Ministry of
Education. We measure the percentage of schools that are public in the district of ju-
nior secondary school attendance.
The consistency of the two stage least squares estimate is based on the critical
assumption that local private school proximity is uncorrelated with unobserved deter-
minants of student test scores. This assumption has been questioned in the U.S. con-
text, where evidence suggests that proximity to catholic secondary schools is correlated
with unobserved determinants of 12th grade math and reading test scores (Altonji,
Elders, and Taber 2002). However, that conclusion is largely based on the implausibly
large differences between OLS and 2SLS estimates of the effect of Catholic schooling
on scores, which we do not find in the Indonesia data. Also, the location of American
Catholic secondary schools is heavily influenced by historical pattern of past Catholic
migration (Hoxby 1994), implying that the positive correlation between student unob-
servables and proximity to American Catholic secondary schools does not generalize
to Indonesian private middle schools.
In contrast to selection bias, which likely leads to an overestimate of the public
school premium, it is not clear how the location decisions of public and private
schools will bias the estimated public school effect. If public schools are spread uni-
formly throughout a population that is heterogeneous in its demand for education,
then profit-maximizing private schools will locate in areas where demand for educa-
tion, and therefore student achievement, is higher. In this case, the estimated public
school premium will be biased downward. This downward bias may be mitigated or
reversed by two factors. First, the national education department may maximize edu-
cational achievement by locating public schools in areas with high student ability (for
an example of endogenous program placement, see Pitt, Rosenzweig, and Gibbons
1993). Second, the estimated public school effect could be upwardly biased if private
and/or Muslim schools are more appealing to parents living in areas with undisci-
plined students. Likewise, households themselves may make location decisions based
on school availability. Concerns regarding endogenous matching of households and
schools are lessened to the extent that schools and households locate based on char-
acteristics of the population that are included in the model, such as average district-
level and student-level test scores. Overall, however, theory provides no clear
17. The IV procedure also eliminating bias due to reporting error in test scores, if reporting error is uncor-
related with the local availability of public schools.
544 The Journal of Human Resources
guidance as to whether private schools are more common in areas with unobservably
stronger or weaker students.
To gain insight into the validity of using the percentage of district schools that are
public as an instrument for public school attendance, we regress four important
determinants of test scores on the instrument, while controlling for all other control
variables in the model. These results are reported in Table 3 for mother’s education,
father’s education, elementary school test score, and having repeated a grade at the
elementary level. The percent of junior secondary schools in the district which
are public is not statistically significant in any of the specifications in Table 3.
Moreover, the signs of the estimated effects are not consistent. For example, public
school access is positively correlated with maternal schooling and negatively corre-
Downloaded from by guest on February 12, 2024. Copyright 2006
lated with paternal schooling. In addition, public school access is negatively correlated
Table 3
Effect of public school access: alternative outcome variables
Junior Elementary
secondary Sample
Full Sample and and
sample Variables Variables
Dependent variables
Mother’s education
Percent of junior secondary schools 0.081 0.109 0.069
in district that are public (0.223) (0.240) (0.254)
Observations 4,274 2,699 1,934
Father’s education
Percent of junior secondary schools −0.053 −0.018 −0.098
in district that are public (0.175) (0.199) (0.215)
Observations 4,252 2,666 1,908
Elementary school test score
Percent of junior secondary schools −0.032 0.081 0.191
in district that are public (0.235) (0.268) (0.277)
Observations 4,382 2,733 1,948
R-squared 0.21 0.23 0.25
Repeated a grade in elementary school
Percent of junior secondary schools −0.112 −0.119 −0.294
in district that are public (0.236) (0.278) (0.318)
Observations 4,360 2,687 1,923
Note: Each of the four sets of rows refers to a different dependent variable regressed on access to public
schools for three different samples. Robust standard errors in parentheses. * significant at 5 percent; ** sig-
nificant at 1 percent. Regression includes other control variables listed below Table 1, excluding the depend-
ent variable if listed. Parental education regressions are ordered probits. Elementary test scores regressions
are OLS. Repeated a grade in elementary school regressions are probits.
Newhouse and Beegle 545
with elementary school test score in the full sample but positively correlated in the
other two samples. The lack of a clear positive association between the instrument
and observable determinants of junior high school test score provides some reas-
surance that the instrumental variable estimates are not systematically biased.
Table 4 presents the instrumental variables results of the effect of junior secondary
school choice on test scores. Using a district-level measure of access to private
schools, the public school premium falls slightly to 0.17 for the full sample. The esti-
mated premium rises to 0.31 when the junior secondary sample is used, but falls to
0.16 in the elementary school subsample. None of the instrumental variable estimates
are statistically significant. The first stage F statistic on these instruments ranges from
25 to 37, meaning that finite sample bias due to weak instruments is not an important
Downloaded from by guest on February 12, 2024. Copyright 2006
concern.18
Taken as a whole, the results from regressions estimating the average effect of pub-
lic schools on test scores are consistent. Least squares estimates suggest that public
Table 4
Instrumental variables estimates of the effect of public school attendance on junior
secondary school test score
Junior
Full secondary Elementary
sample sample sample
Note: Robust standard errors in parentheses. * significant at 5 percent; ** significant at 1 percent. Regression
includes other control variables listed below Table 1. The instrumental variable is the percent of junior sec-
ondary schools in the district that are public.
18. When the village-level presence of private schools is used (based on IFLS community data), the results
are only estimated for the subsample of students that were interviewed in the subdistrict in which they went
to junior secondary school. In comparison with the district access instruments, the estimated public school
premium stays roughly the same in the full sample and the junior secondary sample, and rises dramatically
in the elementary school sample (in results not presented here). The first stage F statistics for the village level
instrument are all above 22 in these regressions. We discount the results using village-level instruments,
because the sample excludes inter-subdistrict movers.
546 The Journal of Human Resources
school attendance raises a student’s test score 0.19 to 0.26 standard deviations. Using
district-level access instruments generally results in similar estimated effects, as the
estimated effect ranges from 0.17 to 0.31. The similarity of the magnitudes of the
OLS and the instrumental variable estimates suggest that in total, the endogeneity bias
resulting from parent’s choice of school type does not invalidate the qualitative con-
clusions drawn from the OLS and fixed-effect estimates. Furthermore, the consistent
finding of a positive public school premium across all estimation strategies is strong
evidence that public junior secondary schools, on average, provide superior prepara-
tion for the national exam.
Although the focus has been on test scores, the effect of public school attendance
could be extended to additional affects of attending public junior secondary school.
Downloaded from by guest on February 12, 2024. Copyright 2006
Moreover, these outcomes may provide some insight into the channels through which
public school attendance affects test scores. In 1997, the IFLS records the self-
reported amount of hours a person spent studying at home per week during attendance
of junior secondary school. Because information on study hours was only collected in
1997, the sample size is limited and results should be interpreted with caution. In an
OLS regression, public school attendance is associated with a minor, but statistically
significant, increase of 0.7 hours per week in study time. The estimated magnitude is
similar for the fixed effect model, but rises to an unrealistic 9.3 extra study hours in
the IV model, and neither the fixed effect nor the IV coefficient is statistically signif-
icant. The results are consistent with public school attendance slightly raising study
hours, but are only suggestive, as the OLS results may reflect the tendency for more
motivated students to select public schools.
We also examine the effect of school type on completion of junior secondary
school, though there is less variation in this variable, as more than 95 percent of all
students who start junior secondary school complete the third grade in that school
level. The effect of public school attendance on probability of completion is not sig-
nificant in any of the samples, and the sign of the effect varies across samples.
Table 5
Effect of school type on test score
Notes: Robust standard errors in parentheses. * significant at 5 percent; ** significant at 1 percent. Regression
includes other control variables listed below Table 1.
slightly, to roughly 0.3 standard deviations. Overall, the results suggest that there are
two tiers of schools, with private secular and Muslim schools lagging behind public
schools and other private schools. The effect of school type on test score by gender
shows the same pattern as that observed for the pooled sample in Table 5 (results not
presented).
Is the positive effect of public schooling stronger for brighter students? Table 6 dis-
plays the results from an OLS regression on the full sample in which junior second-
ary school type is interacted with the student’s elementary school test score quintile.
For students in the highest quintile, secular and Muslim private schooling is associ-
ated with a −0.40 and a −0.45 reduction test scores, which is statistically significant
at the 5 percent level. Meanwhile, for students in the second and lower quartile, the
coefficients on school type are smaller. Some public schools in Indonesia, particularly
in urban areas, screen students based on their elementary school test score. The results
suggests that, relative to their privately schooled peers, the brightest public students
benefit the most from this sorting, while less intelligent public school students are not
harmed by it.
Finally, we examine a secondary methodological question: How robust is the
baseline estimated effect of school type if the measures of elementary school
achievement are excluded from the model? Table 7 shows the public school pre-
mium for each sample and methodology, with and without two variables measur-
ing academic perfor-mance in elementary school: the student’s elementary school
548 The Journal of Human Resources
Table 6
Effect of school type by elementary school test quartile
Observations 4,382
R-squared 0.46
Notes: Robust standard errors in parentheses. * significant at 5 percent; ** significant at 1 percent. Regression
includes other control variables listed below Table 1.
test score (and its square), and whether the student repeated a grade in elementary
school. Excluding these elementary school academic performance variables in a
standard OLS regression generally doubles the public school premium. Because
elementary school performance is strongly and positively associated with both
public school attendance and subsequent junior secondary school test perfor-
mance, its omission creates substantial upward bias in the estimated public school
premium.
IX. Conclusion
Table 7
Effect of school type excluding academic achievement in elementary school
Note: Robust standard errors in parentheses. * significant at 5 percent; ** significant at 1 percent. Excludes/Includes indicates if elementary school test score and an indi-
cator for grade repetition at the elementary level are in the specification. Regression includes other control variables listed below Table 1.
Newhouse and Beegle
549
550 The Journal of Human Resources
generally similar; it ranges from 0.17 to 0.31 standard deviations. Informal examina-
tion of the effect of the public school access instrument on elementary school test
score and parental education failed to uncover a systematic pattern. After examining
different types of public and private schools, two tiers of performance emerge.
Students in public school and non-Muslim religious private schools performed better
than students in Muslim schools and secular private schools. However, students
attending public Madrassahs performed no worse than those attending public secular
schools, and students attending private Madrassahs performed no worse than their
counterparts in private secular schools. The test score premium for public and non-
Muslim religious private schools is highest for the brightest students. The estimated
effects of school type pooled by gender are similar to those estimated separately for
Downloaded from by guest on February 12, 2024. Copyright 2006
boys and girls. Finally, not surprisingly, indicators for achievement at the elementary
school level are important covariates whose absence from the model substantially
alters the results.
This research is a first step toward understanding the effects of school type on
cognitive achievement in Indonesia. Recognizing the gaps in the existing literature,
the study assesses the returns to public junior secondary schooling in terms of test
scores, in light of the general finding that public schools use higher-quality inputs.
It is interesting that, despite lower average returns in test scores and higher house-
hold expenditures, some parents choose to send their children to private schools.
Parents may choose private schools because public school enrollment is rationed,
because they prefer Islamic-based moral and religious instruction, or because pri-
vate schools are perceived to have other nonacademic advantages. Future research
should examine the importance of these competing explanations. In addition, iden-
tifying the specific aspects of quality that drive these higher scores will help in
understanding how and why public school students outperform their privately edu-
cated peers.
Appendix 1
Proof that 2DU * > 0, and 2DU * 0.
2v 2Y1
The household chooses to send their child to a public school if the maximum utility
from the most desirable public school exceeds the maximum utility from the most
desirable private school. The difference in utilities between the most desirable public
and private school is:
(A1) DU* = ln Y1pub - ln Y1pri + d ln aY2 + T pubk - d ln aY2 + T prik + v aT pub - T prik
+ c aO pub - O prik .
where
(A2) Y1pub = Y1 - Ppub ,
Table A2
Determinants of junior secondary school test score
Table A2 (continued)
Bugis (0.19)
Chinese 0.48* (0.20)
Madura −0.04 (0.11)
Sasak 0.05 (0.15)
Minang 0.03 (0.14)
Banjar 0.06 (0.12)
Bima 0.12 (0.22)
Makassar −0.76* (0.31)
Palembang 0.001 (0.18)
Sumbawa −0.25 (0.23)
Toraja −0.43 (0.29)
Lahat −0.39** (0.14)
Sumatra Selatan −0.05 (0.13)
Betawi 0.11 (0.14)
Lampung −0.35 (0.27)
Location of junior secondary school
North Sumatra 0.35** (0.11)
West Sumatra 0.40** (0.14)
South Sumatra 0.32 (0.17)
Lampung 0.09 (0.12)
West Java −0.04 (0.10)
Central Java 0.67** (0.10)
Yogyakarta 0.65** (0.11)
East Java 0.53** (0.09)
Bali 0.24 (0.15)
West Nusa Tenggara −0.08 (0.19)
South Kalimantan 0.29* (0.13)
South Sulawesi 1.03** (0.18)
Other province 0.27 (0.68)
Constant −0.69**
Observations 2,733
R-squared 0.49
Notes: Complete results corresponding to Table 5 Column 2. Robust standard errors in parentheses. * signif-
icant at 5 percent; ** significant at 1 percent. Controls for missing information related to repeating ele-
mentary, flooring, self-reported health, school type, residence at age 12, location of junior secondary school,
vocational status of junior secondary school, and parental education.
Newhouse and Beegle 555
(A5) E = dv + ~.
By assumption, Ppri > Ppub, which implies that Y1pub > Y1pri
Taking derivatives with respect to σ and Y1 gives:
a pub k
(A6) 2DU * = bd T - T + dx and
2v pri
2 pub 2 pri
(A11) d < 1,
aY2 + T pubkaY2 + T prik
which means that 2DU * is of the same sign as Tpub − Tpri, which is positive by
2v
assumption.
Meanwhile, in this model higher-income households are more likely to send their
children to private school:
J N
(A12) 2DU * = KK 1pub - 1pri OO+ f Y + T pub - Y2 + T pri p 0
da da <
2Y1 Y1 Y1 2
L P
Since Y1pub > Y1pri by assumption and Tpub > Tpri.
References
Ahuja, Vinod and Deon Filmer. 1996. “Educational Attainment in Developing Countries.”
Journal of Educational Planning and Administration 10(3):229–54.
556 The Journal of Human Resources
Alderman, Harold, Peter Orazem, and Elizabeth Paterno. 2001. “School Quality, School Cost,
and the Public/Private School Choices of Low-Income Households in Pakistan.” Journal of
Human Resources 36(2):304–26.
Altonji, Joseph, Todd Elder, and Christopher Taber. 2002. “An Evaluation of Instrumental
Variables for Estimating the Effects of Catholic Schools.” NBER working paper
9358.
Angrist, Joshua, Eric Bettinger, Erik Bloom, Elizabeth King, and Michael Kremer. 2002.
“Vouchers for Private Schooling in Colombia: Evidence from a Randomized Natural
Experiment.” American Economic Review 92(5):1535–58
Asian Development Bank. 1998. “Financing of Education in Indonesia,” ed. Mark Bray and
R. Murray Thomas. Unpublished.
Bedi, Arjun, and Ashish Garg. 2000. “The Effectiveness of Private Versus Public Schools:
Downloaded from by guest on February 12, 2024. Copyright 2006
Strauss, John, Kathleen Beegle, Agus Dwiyanto, Yulia Herawati, Daan Pattinasarany, Elan
Satriawan, Bondan Sikoki, Sukamdi, Firman Witoelar. 2004. Indonesian Living Standards:
Before and After the Financial Crisis. Rand Corporation, USA, and Institute of Southeast
Asian Studies.
World Bank. 1998. Education in Indonesia: From Crisis to Recovery. Washington, D.C.:
World Bank.
———. 2004. Education in Indonesia: Managing the Transition to Decentralization.
Washington, D.C.: World Bank.
Downloaded from by guest on February 12, 2024. Copyright 2006