Overview
Background
In 2010 the National Association of State Director of Developmental Disabilities Services (NASDDDS) and the Association of University Centers on Disability (AUCD) entered into a partnership to develop products and activities that would promote evidence-based policymaking. NASDDDS defines evidence based policy as “the responsible application of the best available evidence in the design, administration and reform of programs, services and supports in a manner consistent with achieving independence, productivity, inclusion and self-determination for individuals with developmental disabilities ( NASDDDS Research Committee, 2009).
By engaging the Association of University Centers on Disability and its network of researchers and scholars, NASDDDS is seeking to establish a stronger foundation of knowledge to fulfill commitments in federal laws and court cases and parallel statements within the states to achieve national goals for people with intellectual and developmental disabilities, including —
- Increasing self-determination and personal control in decisions affecting people with disabilities and their families;
- Providing opportunities to people with disabilities to live and participate in their own communities;
- Improving quality of life for individuals and families as they define it for themselves;
- Supporting families as the most important and permanent unit of development, protection, and lifelong assistance to persons with disabilities;
- Investing in each individual’s developmental potential and capacity to contribute in age-related roles as productive, respected community members;
- Assuring access to sufficient, high-quality health and social supports to protect each person’s health, safety, rights, and well-being.
(See for sources: Developmental Disabilities Assistance and Bill of Rights Act; Americans with Disabilities Act (ADA) and the Supreme Court’s affirmation in Olmstead; Individuals with Disabilities Education Act (IDEA), The Rehabilitation Act of 1973 as amended; and UN Convention of the Rights of Persons with Disabilities)
Evidence-based Policy
The concept of evidence-based policy
The concept of “evidence-based policy” as conceived by NASDDDS derives from the widely endorsed focus on “evidence-based practice” in clinical health services.
Evidence-based policy recognizes that just as clinical practitioners, policymakers also share professional responsibility for the acquisition and application of the best available knowledge in their professional roles. Specifically, it acknowledges the responsibility of policymakers for the conscientious and efficacious use of evidence to design, manage and reform systems of support for persons with intellectual and developmental disabilities in a manner that predictably yield outcomes of benefit. At the same time, NASDDDS and AUCD as proponents of evidence-based policymaking recognize that the individual policymaker does not control all aspects of policymaking and that competing interests may impede the judicious application of knowledge and best practice. But they also recognize that unless policymakers assure that the best available knowledge is interjected into policy decisions there is substantial risk that their decisions will diminish the well-being of those persons for whom they have accepted responsibility. To avoid such harm NASDDDS has made a commitment to be a significant source of assistance to state directors of developmental disability services and other public officials in meeting their responsibilities to persons with disabilities.
Distinction between evidenced-based policy and evidenced-based practice
In recent years there has been substantial emphasis on evidence-based practices in health services. The foundation of evidence-based practices is generally well-designed, random assignment clinical trials. Such trials are effective and desirable, but are rarely possible within disability services in which people are assured the right to choose their own “treatment”.
Strict adherence to clinical standards in disability service research raises the substantial danger articulated by Lisbeth Schorr:
“Policymakers radically diminish the potential of reforms if they allow themselves to be walked into accepting impoverished definitions of credible evidence.” (Lisbeth Schorr, Education Week, August 25, 2009)
Evidence-based policy derives its definition of evidence less from the realm of clinical research and more from the realm of the everyday world, that is, as articulated in the definition of “evidence” appearing in a standard dictionary:
Evidence: 1. “The data on which a conclusion or judgment may be made < glacial evidence of climatic change>” (Webster’s II New College Dictionary)
Challenges of "evidence in policy arenas"
There are significant challenges in using evidence in policymaking. Many of these challenges derive from the fact that social research seldom produces unequivocal results. Other challenges derive from the fact that much of the available social research is not directly congruent with policy-manipulable variables.
In policy-relevant areas in which there are multiple studies there are likely to be seemingly contradictory findings across the individual studies. This derives from the variation among individuals, social settings and/or the ways in which interventions, programs or policies are implemented.
In policy research it is often necessary to accept the preponderance of good evidence through comprehensive reviews of all the available credible evidence. In the absence of comprehensive authoritative reviews, policymakers are often confronted with “cherry-picked” research in which advocates of different perspectives search carefully within the available research for those studies which best make the case for their desired policy.
In addition to promoting the development of comprehensive objective reviews of literature on key policy topics in developmental disabilities, this initiative is also focused on substantially expanding access and use of outcome based research and evaluation within the states and nation. As part of this effort, states and universities will be supported to work together in the development and analysis of outcome-based assessments of program, service and policy options.
In pursuing the best available research and evaluation as the foundation for evidence-based policy there is recognition that while one might always wish for studies of the highest clinical rigor, the absence of the ability to random assign people “treatment/ non-treatment” has not impeded some of the most important policy decisions in the United States (e.g., seat belt laws, protection from secondhand smoke) which have depended on a preponderance of research in which random assignment was not possible (or ethical).
Activities of the NASDDDS and AUCD partnership in evidenced-based policy
Among the activities being jointly pursued by the NASDDDS and AUCD networks are —
- Identifying the topics of highest importance and/or recurring attention in policy discussions within the states or nation on which a comprehensive and objective review of high quality research and evaluation is needed;
- Developing policy relevant summaries of research and evaluation findings related to topics of highest importance and/or recurring attention to policies affecting persons with developmental disabilities;
- Creating a jointly supported website for the posting of research/evaluation summaries, related research documents and other publications and presentations to serve the purpose of educating public officials, advocates and others with key roles in the policy process;
- Maximizing the use and benefits of National Core Indicators or other outcomes assessment data sets within the states with a specific goal of promoting policy relevant research questions, analyses and products;
- Developing capacities through cross-UCEDD technical assistance in states with National Core Indicators or other outcome-related data sets in personnel of the state UCEDD is relatively inexperienced and unfamiliar with policy research and outcome evaluation;
- Serving as a training opportunity to increase the expertise of graduate students and state staff in policy research and evaluation, and in the development of policy relevant research questions and analyses;
- Undertake other activities with promise of increasing the effective gathering and use of the best available information in designing, evaluating and improving policies, programs and services for individuals with developmental disabilities and their families.