Voices in Urban EducationArchives
Using Data for Decisions
VUE Number 18, Winter 2008| VUE Home | Archives | Order Print Copy |
How Community Groups Use Data
By Seema Shah
Seema Shah is a research associate and study director at the Annenberg Institute for School Reform.
> Author's biography
Data provide community organizing groups with powerful tools in their efforts
to argue for educational equity and improvement.
In the late 1990s, high school student
members of South Central Youth Empowered thru Action (SC-YEA), a youth organizing group in Los Angeles, initiated a campaign to protest the dearth of college preparatory courses in their South Los Angeles high schools, a dynamic they called “penitentiary tracking.” Indeed, when students from SC-YEA investigated the high school curricula, they discovered that many of their South Los Angeles high schools offered more “dead-end classes” in floor covering and cosmetology than courses in core subjects such as math and science.
These early organizing efforts led the Community Coalition, SC-YEA's parent organization, to co-convene a broad citywide coalition of more than twenty community groups. The coalition,
Communities for Educational Equity (CEE), represented both African American and Latino neighborhoods in Los Angeles and showed that the problems
of high school rigor and college access went far beyond the schools in
South Los Angeles.1 This was an issue neighborhoods and schools across the city were facing, with far-reaching implications
for the social and economic livelihood of the city.
CEE's aim was ambitious to fight for access to a college preparatory
curriculum for all of Los Angeles Unified School District's high school students. Data analyses and research efforts, carried out with partners such as Education Trust West and UCLA, along with sustained community and political mobilization, were at the core of CEE's ultimate victory a historic six-to-one school board vote in 2005 in favor of the resolution mandating
a college preparatory curriculum. Explained Sandy Mendoza, director of community investment at United Way of Los Angeles and a member of CEE's steering committee:
Community Organizing Groups: A Unique Kind of Community-Based Organization
Community organizing groups such as the Community Coalition represent a unique brand of community-based organization. Rather than providing direct services or playing an advocacy role, community organizing groups make use of professional staff organizers
who work with community members
to build grassroots youth and adult leadership. Community members are helped to build power to alter social, economic, and educational inequities in their communities. Though community organizing groups may vary in their particular methodologies, conducting research, particularly to identify and inform reform campaigns, is an important
component of the organizing cycle (Mediratta 2004).
Despite the importance of research, the complexities inherent
in obtaining, cleaning, analyzing, and interpreting data often make it difficult for community organizing groups to use research. One organizing
group, for instance, was originally interested in developing “report cards” for its district's schools but, ultimately, abandoned the idea. The organizer explained, “It just became too daunting to do the data collection and to figure out exactly what we're trying to do. The more we pushed it, the fuzzier we became ourselves.”
In addition to the limits of their own research capacity and expertise, organizing groups may find it difficult
to access data from often-recalcitrant districts, obtain those data in a timely fashion, and get the data in an easy-to-analyze format. Despite these obstacles, community organizing groups across the country are becoming increasingly
sophisticated in their use of data. Groups that have developed strong data analytic capacity use their analyses to illuminate educational problems and disparities, to identify programmatic and policy solutions to the problems they are surfacing, and, when necessary, to monitor implementation of enacted proposals.
How Community Organizing Groups Use Data Differently from Other Groups
While community organizing groups use data for many of the same purposes,
described in the previous section, as other key constituencies such as district officials or academic researchers, three features distinguish community organizing groups from other educational
stakeholders in their use of data. First, community organizing groups
use data to build their credibility and political power. Second, because of their mission, community organizing groups are especially concerned with integrating data analyses with their on-the-ground knowledge of community issues. Third, community organizing groups are interested in data not “for data's sake,” but to think strategically and specifically about the ways in which data can be used as a tool to generate tangible changes in schooling practices and policies.
Building Political Power
Data users such as school districts or educational researchers inherently possess
power and credibility within policy and decision-making circles. In contrast, outside constituencies, particularly those representing poor neighborhoods and communities of color, often must fight to be viewed as valued participants in the educational decision-making process.
Members of Mothers on the Move in the Bronx, for example, noticed that the education concerns they raised were often construed by educators as particular
problems of individual students, teachers, or principals.
The group responded with data analyses of schooling outcomes. By showing disparities in schooling outcomes
across schools serving low- and high-income neighborhoods, they were able to frame their concerns in systemic terms and, thus, were able to make explicitly political arguments about resource inequities (Mediratta & Karp 2003). As Michelle Renee (2006) notes in her research, community organizing
groups' increasingly sophisticated use of data not only informs their campaign strategies and demands for educational change, but also provides groups with the cachet to establish themselves as credible and legitimate stakeholders who have “done their homework.”
In Chicago, for instance, ACORN used an analysis of teacher turnover and teacher quality in their target West Side neighborhoods to garner prominent media attention and to convince senior school district officials to work with the organization to address the problem.
This work ultimately positioned ACORN as a lead partner in generating
solutions to the crisis in teacher turnover and teacher quality. Chicago ACORN's lead organizer, Madeline Talbott, believes that ACORN's data reports
Some organizing groups, including
Chicago ACORN, have hired their own data analysts to carry out the analyses they need. Others partner with universities and established research organizations to conduct analyses collaboratively.
Indeed, in a longitudinal study of eight community organizing groups that have long, successful histories
of school reform organizing,2 all of the groups in the study had worked with research partners to increase their capacity for data use and analyses.
Community organizing groups' increasingly sophisticated use of data not only informs their campaign strategies and demands for educational change, but also provides groups with the cachet to establish themselves as credible and legitimate stakeholders.
Many of the district administrators and policy-makers interviewed for the longitudinal study identified local community
organizing groups as legitimate power players in their school district, not only because their demands were rooted in data and research, but also because the groups were able to organize
and mobilize grassroots constituencies
to create the necessary political will to win the changes for which the data highlighted the need. A research partner of the Community Coalition describes this critical dynamic:
In this way, the use of data, in tandem
with other organizing strategies, allows groups to build and sustain their political power.
Grounding Data in Community Expertise
Whether working independently or in partnership with an outside research entity to analyze data, the role of community
organizing groups is to ensure that research questions and analyses are rooted in the issues that community
constituents are raising from their day-to-day experience with schools. Marqueece Harris-Dawson, executive director of the Community Coalition, explains:
This intimate knowledge of community
conditions and dynamics positions organizing groups to ask qualitatively
different questions that reflect the concerns of community members. Consequently, community organizing groups are often able to offer a unique
perspective on the data they analyze and to present a more nuanced problem
analysis.
An especially potent example of this comes from the recent work of Austin Interfaith (Nichols 2007). Lisa Robertson, the principal of Travis Heights Elementary School, where Austin Interfaith has worked for many years to build parent and community engagement, observed that students from two nearby housing complexes seemed to be performing differently in school. Suspecting that this was due, in part, to the differential conditions of the respective housing developments, Robertson and members of Austin Interfaith examined a series of student success indicators that compared students
from the two housing developments.
Community organizing groups are often able to offer a unique perspective on the data they analyze and to present a more nuanced problem analysis.
The hard data they gathered supported
their instincts: students from the housing development with poor conditions had higher rates of discipline
problems, a much higher rate of absences, and higher failure rates on the state TAKS exam. A more traditional
analysis done by the district or by an outside researcher unfamiliar with the community would likely have examined the indicators of the entire
school in relation to other schools in the district, or might have disaggregated data by looking at subgroups by race or socio-economic status. However, Austin Interfaith's knowledge of the community and their relationship with the school allowed them to segment the data to demonstrate how poor conditions in the housing complex could be influencing student outcomes. Consequently, Austin Interfaith's recent organizing efforts have focused on pushing for greater accountability and better management of the housing
complex from its managing agent &151; efforts they hope will ultimately improve the academic performance of students drawn from that community.
In the preceding example, Austin Interfaith raised questions drawn from its knowledge of the community that led to new ways of looking at existing data. Yet organizing groups often lack access to key data and, as one organizer indicated, must obtain the data “guerrilla
style.” While legislation such as No Child Left Behind and the Freedom of Information Act stipulate public access to data and have increased access to data for community-based constituencies,
community organizing groups continue
to report challenges in obtaining data, particularly if the district believes the data might be used “against them” in some way.
Other times, publicly reported data may be inconsistent with the experience of community members and may not accurately reflect the reality
of schooling conditions. There are politically expedient ways of computing and reporting data, evidenced by the numerous controversies around the calculation of graduation rates (Carey 2007; Hall 2005). In other cases, discrepancies
between data and reality may exist simply because of a lack of clarity about reporting requirements. For instance, in Oakland, free-lunch data from some of the new small schools developed across the past decade were underreported because principals did not understand the paperwork that needed to be submitted.
Other times, publicly available data may not provide enough nuanced information or may not provide the necessary insights to resolve the questions
that are of deepest interest to community members.
For these reasons, community organizing groups often collect their own data. Alberto Retana, an organizer in Los Angeles, describes the dilemma:
When groups collect their own data, they use a variety of approaches to tap into the experiences of community constituents. Many groups particularly youth organizations conduct surveys. When high school students who were members of Youth United for Change in Philadelphia expressed concerns about testing-preparation practices at their high school, they conducted a survey
of their fellow students to find out specific experiences around testing. Similarly, youth leaders in SC-YEA surveyed
their fellow high school students about the issues that were most pressing
to them, which ultimately led to their college access campaign.
In addition, groups are likely to arrange research meetings with key stakeholders teachers, parents, or district officials to gain their perspective on pressing issues. Oakland Community Organizations (OCO) identified overcrowding and its ripple effects as an issue, not just by looking at data on school utilization rates, but also by interviewing schoolteachers who complained of the difficulty of managing classrooms that were bursting
at the seams and by interviewing school janitors who described the difficulty of keeping the school clean. By interviewing key stakeholders, community
organizing groups are able to develop deeper and more sophisticated analyses that illuminate the consequences
of common problems that might not otherwise be self-evident.
Organizing groups have also demonstrated their sophistication in using data and research to pinpoint solutions to the problems community members surface. Community organizing
groups often reach out to experts in the field and conduct site visits to assess the appropriateness or viability of particular solutions for their community.
Members of OCO, which pushed for and ultimately helped win a districtwide small-schools policy, visited New York City small schools with parent
and school leaders as a part of its research and consulted with experts in the small-schools arena before advancing
their model for small schools, which places parent and community engagement
and local school autonomy at
the center.
Ensuring That Data Analyses
Lead to Action
Primary considerations vary for constituencies
that use data. Academics may be interested in methodological issues and publishing findings in peer-reviewed journals. Districts might be concerned with demonstrating compliance
through reporting frameworks. But community organizing groups
use data specifically and strategically to focus attention on the educational issues facing neglected neighborhoods and populations and to demand the necessary changes. Community organizing
groups use a variety of ways to ensure that data, in the end, serve as a tool to catalyze change.
By sharing data with constituents, allies, and targets, community organizing groups use data to build political and public will.
By sharing data with constituents, allies, and targets, community organizing
groups use data to build political and public will. For instance, the New York City Coalition for Educational Justice (CEJ), after hearing from several school reform experts, examining citywide
data on student performance and teacher quality, and sharing the experiences
of their own children's schooling with one another, identified resource inequities, particularly around curriculum
and instruction, in low-performing middle schools as a major concern.
With assistance from the Annenberg Institute's Community Involvement Program, CEJ (NYCCEJ 2007) produced the report
New York City's Middle-Grade Schools: Platforms for Success or Pathways to Failure? The report established links between resource inequities in New York City's middle schools, resulting in low high school graduation rates and, ultimately, poor economic and social prospects. The report, which drew considerable media attention, set out several recommendations
and led New York City Council Speaker Christine Quinn to convene the Middle Grades Task Force. The Task Force's report, released in August 2007, ultimately resulted in the allocation of new resources to improve education in the middle grades, including
a $5 million fund set aside for fifty of the city's lowest-performing middle-schools.
3 Additionally, New York City Mayor Michael Bloomberg agreed to hire a senior administrator to oversee middle school initiatives.
CEJ, like other community organizing
groups across the country, uses data as a vehicle to argue more effectively and persuasively for the changes and reforms they are advocating. As illustrated
by the CEJ story and the earlier description of Community Coalition's work, community organizing groups that have built the capacity to use data have significant policy victories to show for their efforts. Of course,
districts respond in a variety of ways to the data, sometimes challenging the analyses. Notes one community organizer
wryly, “We can get on any Web site and we can pull all of this data together, which [the district] tends not to agree with, but guess who posts it?
They do it's their data.”
Other times, data analyses are accepted as evidence of the education problems that groups are raising but, due to political concerns or budget limitations, districts may balk at addressing the problem. In the best-case scenarios, analyses generated
by organizing groups allow groups to initiate conversations about community concerns with district offices and other policy-makers that are rooted firmly in data. By grounding conversations in data, stakeholders can work toward a shared understanding of the problems facing urban schools and begin to develop meaningful collaborative relationships
to solve those problems.
In Los Angeles, for instance, the passage of the school board's resolution
to mandate a college preparatory curriculum for all of LAUSD's high school students led to the formation of a committee composed of community
constituents and researchers from CEE, along with district administrators, to ensure the successful implementation
of the resolution. Through this committee, CEE researchers and the district's research team began sharing data and discussing research questions with one another.
As both the community-based researchers and district-based researchers
conducted analyses to assess what kind of supports would be necessary in each of LAUSD's high schools to implement the full college preparatory
curriculum, they found they were getting disparate results because they were using different exclusion criteria in their analyses. In the end, after several
weeks of trying to determine the best approach, the community-based and district-based researchers decided to report the data both ways and to discuss the implications of both sets of analyses. One community-based researcher on the committee observed:
Conclusion
The inherently political landscape of education reform requires that both school districts and community groups use data to leverage their respective positions, frequently placing them at odds with one another and making it difficult to share data or to work collaboratively
on analyses. However, as the example of collaboration in Los Angeles illustrates, under the right circumstances, the efforts of school districts
and community groups to work together can promote a spirit of mutual accountability, ideally leading to better informed education practice and policy.
Warning: include(../permissions_sub.html) [
function.include]: failed to open stream: No such file or directory in
/Library/WebServer/Documents/annenberg/VUE/winter08/Shah.php on line
542
Warning: include() [
function.include]: Failed opening '../permissions_sub.html' for inclusion (include_path='.:') in
/Library/WebServer/Documents/annenberg/VUE/winter08/Shah.php on line
542