SWPBS and Socioeconomics

Influence of School Level Socioeconomic Status and Racial Diversity on Schoolwide Positive Behavior Support Implementation

Jennifer L. Frank, Robert H. Horner, Cynthia M. Anderson

December, 2009

PDF Download

Research Statement

This evaluation brief examines the capacity of schools of varying levels of socioeconomic and racial diversity to implement Tier I (Universal) of schoolwide positive behavior support (SWPBS) with integrity. The three main evaluation questions addressed are: (a) “What percentage of schools are able to achieve 80%-80% implementation status on the School-wide Evaluation Tool (SET) within 1 year?” (b) “Is school socioeconomic status associated with implementation effectiveness?” and (c) “Is school racial diversity associated with implementation outcomes?”

Method

The data sources for this evaluation brief are: (a) School-wide Evaluation Tool (Sugai, Lewis-Palmer, Todd & Horner, 2001) data submitted through thehttp://www.pbssurveys.orgwebsite and (b) the Common Core of Data provided by the U.S. Department of Education’s National Center for Education Statistics (NCES). For the purpose of this analysis, we examined the first post-implementation SET schools’ submitted to PBS Surveys between 2005-06 and 2007-08. Preschools, private schools, and alternative schools were excluded from analyses.

Sample

A total of 890 schools nested within 299 districts in 20 states across the United States and were included in the analysis[1]. A majority of schools were elementary level schools (n = 606), followed by middle (n = 205) and high school levels (n = 73). An additional six schools served non-traditional grade level spans (e.g., 6-10 or K-12). Approximately 33% of schools were located an urban locale (n = 296), 28% were suburban (n = 250), and 39% were located in a rural locale (n = 344). Average student enrollment for elementary schools was 452.95 (SD=195.59), average middle school enrolment was 651 students (SD=271.68), and average high school enrollment was 1120.05 students (SD=808.17). The average number of full-time classroom teachers was 30.52 (SD=14.48) at the elementary level, 43.37 (SD=19.26) at the middle school level, and 67.98 (SD=51.31) at the high school level.

Results

What is the Probability a School will Achieve 80%-80% on the SET within 1 Year?

Results from this sample indicate that, on average, approximately 61% of schools who receive training in tier I of SWPBS will achieve 80%-80% implementation status on the SET within one year. While additional schools achieved the implementation criteria after one year, we focused this analysis only on the SET scores after one year of implementation.

Socioeconomic Status of Student Population

The socioeconomic status (SES) of the student population, as measured by the percentage of students qualifying for free or reduced price lunch (FRL), was not significantly associated with 80%-80% attainment within 1 year (χ2 (4) = 8.18, p =0.09).

Table 1. Frequencies of 80-80 Attainment by Student Socioeconomic Status

Was the 80%-80% Criterion Met?

Yes

No Total

10% or Less Free or Reduced Lunch

30

21

51

11-25% Free or Reduced Lunch

83

45

128

26-50% Free or Reduced Lunch

170

136

306

51-75% Free or Reduced Lunch

179

90

269

More than 75% Free or Reduced Lunch

82

52

134

Total

544

344

888

Note. Two schools were excluded from analyses due to missing data.

As figure 1 illustrates, there was very little difference between very high (less than 10% FRL) and very low (more than 75% FRL) SES schools with regards to implementation status at the end of one year. In fact, approximately 59% of very high SES and 61% of very low SES schools attained 80%-80% status within one year. Examining the pattern of implementation data across schools did not reveal noteworthy trends. Sixty-five percent of schools with 11-25% FRL, 56% of schools with 26-50% FRL, and 67% of schools with 51-75% FRL all attained 80%-80% within one year.

Figure 1. Number and Proportion of Schools Attaining 80%-80% Status within One Year


Racial Diversity of Student Population

The diversity of student population, as measured by the percentage of racial minority students enrolled, was significantly associated with 80%-80% attainment within 1 year (χ2(2) = 8.53, p <.05). However, the relation between student racial diversity and probability of attaining 80%-80% status was not linear, and schools with higher levels of student racial diversity did not differ substantially from their low diversity counterparts.

Table 2. Frequencies of 80%-80% Attainment by Student Racial Diversity

Was the 80%-80% Criterion Met?

Yes

No

Total

Low Diversity

180

129

309

Medium Diversity

151

66

217

High Diversity

213

150

363

Total

345

544

889

Note: Low Diversity = less than 25% minority enrollment, Medium Diversity = 25-50% enrollment, and High Diversity =50% or more minority enrollment. One school was excluded from analyses due to missing data.

As figure 2 illustrates, Medium Diversity schools with minority enrollments between 25-50% had the highest percentage of schools attaining 80%-80% status within 1 year (70%). In comparison, 57% of Low Diversity and 59% of High Diversity schools attained 80%-80% status within 1 year.

Figure 2. Proportion of Schools Attaining 80%-80% Status by Level of Student Racial Diversity


Summary of Findings

Results from these preliminary analyses suggest that a majority of schools (>60%) initiating implementation of SWPBS will successfully attain 80%-80% on the SET within 1 year. Although, a sizeable minority (40%) may require a longer period of time to meet this benchmark, this finding provides further evidence of the feasibility of SWPBS implementation in a very large and diverse array of public school settings.

A second noteworthy finding was that the socioeconomic status of the student population was not significantly associated first year implementation outcomes. In fact, very low SES schools were almost as equally likely to attain 80%-80% status within one year as their very high SES counterparts. Although very low SES schools were somewhat under-represented in this sample, the hypothesis that socioeconomic status significantly advantages (or disadvantages) schools’ implementation efforts was not supported.

Finally, although the level of racial diversity among the student population was significantly associated with first year implementation outcomes, the relation between diversity and SWPBS implementation is complex. The overall pattern in the data observed suggested that medium diversity schools were most likely to attain 80%-80% in one year. The reason why medium diversity schools would outperform their low or high diversity counterparts is an interesting question worthy of further consideration. Although this finding may be an artifact of this particular sample, higher-order interactions (e.g., diversity x locale), or unknown differences within the school or community of medium diversity schools may explain these effects. However, the hypothesis that the level of racial diversity among the student population significantly advantages (or disadvantages) schools’ implementation efforts in a linear way was not supported.

Limitations

Several plausible threats to the validity of inferences and generalizability of findings are worth noting. First, because schools comprising this sample self-selected to submit their data to PBS Surveys, selection bias is possible. The results obtained from this sample may or may not be consistent with similar studies utilizing a prospective random sampling frame. Second, SET data collection occurred under uncontrolled (presumably) naturalistic conditions. Error related to inappropriate SET administration or scoring is possible. Although the sample size for this study was large, not all demographic groups were equally represented. In particular, very affluent schools (less than 10% FRL) were under-represented, and elementary schools were over represented within this particular sample. Categorical binning schemes used to create SES and diversity levels are consistent with those employed by the National Center on Education Statistics Digest of Education Statistics series (see Snyder, Dillow & Hoffman, 2009), however, studies utilizing different cut-points for creating these groups may obtain different results. Finally, the results of this study pertain to implementation outcomes at the end of one year utilizing a single implementation outcome measure. Results of studies examining implementation outcomes for longer durations of time or using different SWPBS implementation measures may vary.

Future Directions

Implementation of comprehensive Schoolwide interventions such as SWPBS is a complex multi-stage process, often requiring the coordination multiple systems and supports. A considerable amount of research to date has focused on processes predictive of implementation success (see Fixsen, Naoom, Blase, Friedman and Wallace, 2005), however, examination of the ways in which fixed school level variables such as SES and diversity interact with implementation demands is an important area for future research. Future research may wish to examine how other fixed variables such as grade level, school locale, or enrollment size may (or may not) influence the probability of implementation success. In all likelihood, these variables can (and probably do) interact, and the implementation challenges faced by schools with low levels of diversity and high levels of poverty, as is common in many rural schools, may be quite different from those faced by highly diverse urban schools with similar levels of poverty. Future exploration of these potential interactions may greatly enhance our understanding of the nature and intensity of support different schools require to achieve implementation success. Finally, this particular analysis was limited to the examination of implementation outcomes within a relatively short duration of time. A more extended longitudinal study examining the predictors of implementation success and sustainability among schools with varying levels of SES and student diversity may help to clarify whether the pattern of implementation results observed in this study are maintained over time.

References

Department of Education, National Center for Education Statistics (2006). Public Elementary/Secondary School Universe Survey Data, 2005-06 [Database]. Retrieved August 20, 2008, and available from Common Core of Data, National Center for Education Statistics Web site, http://nces.ed.gov/ccd/

Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005).Implementation Research: A Synthesis of the Literature. Tampa, FL: Florida Mental Health Institute, The National Implementation Research Network (FMHI Publication #231).

Snyder, T.D., Dillow, S.A., & Hoffman, C.M. (2009). Digest of Education Statistics 2008(NCES 2009-020). National Center for Education Statistics, Institute of Education Sciences, U.S. Department of Education. Washington, D.C.

Sugai, G., Lwis-Palmer, T., Todd, A., & Horner, R.H. (2001). School-wide evaluation tool. Eugene: University of Oregon.

[1] From the eligible sample, two schools presented with missing data which was addressed through pairwise deletion.