During the past two decades, evaluation has come to play an increasingly important role in the operation of educational and social programs by national, state, and local agencies. Mandates by federal funding agencies that programs they sponsored be evaluated gave impetus to use of evaluation. Realization that evaluation plays a pivotal role in assuring program quality and effectiveness has maintained the use of evaluation even where mandates have been relaxed. With increased use --indeed institutionalization --of evaluation in many community, state, and national agencies, evaluation has matured as a profession, and new evaluation approaches have been developed to aid in program planning, implementation, monitoring, and improvement. Much has been written about various philosophical and theoretical orientations to evaluation, its relationship to program management, appropriate roles evaluation might play, new and sometimes esoteric evaluation methods, and particular evaluation techniques. Useful as these writings are, relatively little has been written about simple but enormously important activities which comprise much of the day-to-day work of the program evaluator. This book is focused on some of these more practical aspects that largely determine the extent to which evaluation will prove helpful.

This practical, very effective resource helps middle and high school teachers and curriculum leaders develop the skills to design instructional tasks and assessments that engage students in higher-level critical thinking, as recommended by the Common Core State Standards. Real examples of formative and summative assessments from a variety of content areas are included and demonstrate how to successfully increase the level of critical thinking in every classroom! This book is also an excellent resource for higher education faculty to use in undergraduate and graduate courses on assessment and lesson planning.

This introductory text describes the principles of invariant measurement, how invariant measurement can be achieved with Rasch models, and how to use invariant measurement to solve measurement problems in the social, behavioral, and health sciences. Rasch models are used throughout but a comparison of Rasch models to other item response theory (IRT) models is also provided. Written with students in mind, the manuscript was class tested to help maximize accessibility. Chapters open with an introduction and close with a summary and discussion. Numerous examples and exercises demonstrate the main issues addressed in each chapter. Key terms are defined when first introduced and in an end-of-text glossary. All of the book's analyses were conducted with the Facets program. The data sets used in the book, sample syntax files for running the Facets program, Excel files for creating item and person response functions, links to related websites, and other material are available at www.GeorgeEngelhard.com. Highlights include: A strong philosophical and methodological approach to measurement in the human sciences Demonstrations of how measurement problems can be addressed using invariant measurement Practical illustrations of how to create and evaluate scales using invariant measurement A history of measurement based on test-score and scaling traditions Previously unpublished work in analyzing rating data, the detection and measurement of rater errors, and the evaluation of rater accuracy A review of estimation methods, model-data fit, indices used to evaluate the quality of rater-mediated assessments, rater error and bias, and rater accuracy. Intended as a supplementary text for graduate or advanced undergraduate courses on measurement or test theory, item response theory, scaling theory, psychometrics, advanced measurement techniques, research methods, or evaluation research taught in education, psychology, and the social and health sciences, the book also appeals to practitioners and researchers in these fields who develop or use scales and instruments. Only a basic mathematical level is required including a basic course in statistic.

Bernard R. Gifford In the United States, the standardized test has become one of the major sources of information for reducing uncertainty in the determination of individual merit and in the allocation of merit-based educational, training, and employment opportunities. Most major institutions of higher education require applicants to supplement their records of academic achievements with scores on standardized tests. Similarly, in the workplace, as a condition of employment or assignment to training programs, more and more employers are requiring prospective employees to sit for standardized tests. In short, with increasing frequency and intensity, individual members of the political economy are required to transmit to the opportunity marketplace scores on standardized examinations that purport to be objective measures of their abilities, talents, and potential. In many instances, these test scores are the only signals about their skills that job applicants are permitted to send to prospective employers. THE NATIONAL COMMISSION ON TESTING AND PUBLIC POLICY In view of the importance of these issues to our current national agenda, it was proposed that the Human Rights and Governance and the Education and Culture Programs of the Ford Foundation support the establishment of a ''blue ribbon" National Commission on Testing and Public Policy to investigate some of the major problems, as well as the untapped opportunities, created by recent trends in the use of standardized tests, particularly in the workplace and in schools.

From EL Education comes a proven approach to student assessment Leaders of Their Own Learning offers a new way of thinking about assessment based on the celebrated work of EL Education schools across the country. Student-Engaged Assessment is not a single practice but an approach to teaching and learning that equips and compels students to understand goals for their learning and growth, track their progress toward those goals, and take responsibility for reaching them. This requires a set of interrelated strategies and structures and a whole-school culture in which students are given the respect and responsibility to be meaningfully engaged in their own learning. * Includes everything teachers and school leaders need to implement a successful Student-Engaged Assessment system in their schools * Outlines the practices that will engage students in making academic progress, improve achievement, and involve families and communities in the life of the school * Describes each of the book's eight key practices, gives advice on how to begin, and explains what teachers and school leaders need to put into practice in their own classrooms * Ron Berger is Chief Program Officer for EL Education and a former public school teacher Leaders of Their Own Learning shows educators how to ignite the capacity of students to take responsibility for their own learning, meet Common Core and state standards, and reach higher levels of achievement. DVD and other supplementary materials are not included as part of the e-book file, but are available for download after purchase.

I personally learned to know Ralph Tyler rather late in his career when, in the 1960s, I spent a year as a Fellow at the Center for Advanced Study in the Behavioral Sciences at Stanford. His term of office as Director of the Center was then approaching its end. This would seem to disqualify me thoroughly from preparing a Foreword to this "Classic Works. " Many of his colleagues and, not least, of his students at his dear Alma Mater, the University of Chicago, are certainly better prepared than I to put his role in American education in proper perspective. The reason for inviting me is, I assume, to bring out the influence that Tyler has had on the international educational scene. I am writing this Foreword on a personal note. Ralph Tyler's accomplishments in his roles as a scholar, policy maker, educational leader, and statesman have been amply put on record in this book, not least in the editors' Preface. My reflections are those of an observer from abroad but who, over the last 25 years, has been close enough to overcome the aloofness of the foreigner. Tyler has over many years been criss-crossing the North American con tinent generously giving advice to agencies at the federal, state, and local levels, lecturing, and serving on many committees and task forces that have been instrumental in shaping American education."

When George Bernard Shaw wrote his play, Pygmalion, he could hardly have foreseen the use of the concept of the self-fulfilling prophecy in debates about standardized testing in schools. Still less could he have foreseen that the validity of the concept would be examined many years later in Irish schools. While the primary purpose of the experimental study reported in this book was not to investigate the Pygmalion effect, it is inconceivable that a study of the effects of standardized testing, conceived in the 1960s and planned and executed in the 1970s, would not have been influenced by thinking about teachers' expectations and the influence of test information on the formation of those expectations. While our study did pay special attention to teacher expectations, its scope was much wider. It was planned and carried out in a much broader framework, one in which we set out to examine the impact of a standardized testing program, not just on teachers, but also on school practices, students, and students' parents.

Attempting fonnally to evaluate something involves the evaluator coming to grips with a number of abstract concepts such as value, merit, worth, growth, criteria, standards, objectives, needs, nonns, client, audience, validity, reliability, objectivity, practical significance, accountability, improvement, process, pro duct, fonnative, summative, costs, impact, infonnation, credibility, and - of course - with the tenn evaluation itself. To communicate with colleagues and clients, evaluators need to clarify what they mean when they use such tenns to denote important concepts central to their work. Moreover, evaluators need to integrate these concepts and their meanings into a coherent framework that guides all aspects of their work. If evaluation is to lay claim to the mantle of a profession, then these conceptualizations of evaluation must lead to the conduct of defensible evaluations. The conceptualization of evaluation can never be a one-time activity nor can any conceptualization be static. Conceptualizations that guide evaluation work must keep pace with the growth of theory and practice in the field. Further, the design and conduct of any particular study involves a good deal of localized conceptualization."

Attempting fonnally to evaluate something involves the evaluator coming to grips with a number of abstract concepts such as value, merit, worth, growth, criteria, standards, objectives, needs, nonns, client, audience, validity, reliability, objectivity, practical significance, accountability, improvement, process, pro duct, fonnative, summative, costs, impact, infonnation, credibility, and - of course - with the tenn evaluation itself. To communicate with colleagues and clients, evaluators need to clarify what they mean when they use such tenns to denote important concepts central to their work. Moreover, evaluators need to integrate these concepts and their meanings into a coherent framework that guides all aspects of their work. If evaluation is to lay claim to the mantle of a profession, then these conceptualizations of evaluation must lead to the conduct of defensible evaluations. The conceptualization of evaluation can never be a one-time activity nor can any conceptualization be static. Conceptualizations that guide evaluation work must keep pace with the growth of theory and practice in the field. Further, the design and conduct of any particular study involves a good deal of localized conceptualization."

This book is about the practice of decision making by school principals and about ways to improve this practice by capitalizing on evaluation dimensions. Much has been written on decision making but surprisingly little on decision making in the school principalship. Much has been also written on evaluation as well as on evaluation and decision making, but not much has been written on evaluation in decision making, especially decision making in the principalship. This book presents two messages. One is that decision making in the principalship can be studied and improved and not only talked about in abstract terms. The other message is that evaluation can contribute to the understanding of decision making in the principalship and to the improvement of its practice. In this book we call for the conception of an evaluation-minded principal, a principal who has a wide perspective on the nature of evaluation and its potential benefits, a principal who is also inclined to use evaluation perceptions and techniques as part of his/her decision-making process. This book was conceived in 1985 with the idea to combine thoughts about educational administration with thoughts about educational evaluation. Studies of decision making in the principalship had already been on their way. We decided to await the findings, and in the meantime we wrote a first conceptual version of evaluation in decision making. As the studies were completed we wrote a first empirical version of same.

Decision-Oriented Educational Research considers a form of educational research that is designed to be directly relevant to the current information requirements of those who are shaping educational policy or managing edu cational systems. It was written for those who plan to conduct such research, as well as for policy makers and educational administrators who might have such research conducted for them. The book is divided into three main parts. Part I is background. Chapter 1 describes some of the basic themes that are woven throughout subsequent chapters on decision-oriented research. These themes include the impor tance of taking a systems view of educational research; of understanding the nature of decision and policy processes and how these influence system re search; of integrating research activities into the larger system's processes; of the role of management in the research process; of researchers and managers sharing a sense of educational purposes; and of emphasizing system improvement as a basic goal of research process. Chapter 2 is a discussion of the background of the research activities that form the bases of this book. Our collaboration with the Pittsburgh public school system is described, as are the methods and structure we used to build the case histories of our work with the district. Part II, encompassing chapters 3 through 9, addresses basic generaliza tions about decision-oriented educational research that we have derived from our experiences."

This book presents comprehensive results from case studies of three innovations in mathematics education that have much to offer toward understanding current reforms in this field. Each chapter tells the story of a case in rich detail, with extensi ve documentation, and in the voices of many of the participants-the innovators, the teachers, the students. Similarly, Volume 2 of Bold Ventures pre sents the results from case studies of five innovations in science education. Volume 1 provides a cross-case analysis of all eight innovations. Many U.S. readers certainly will be very familiar with the name of at least if not all of the mathematics innovations discussed in this volume-for one example, the NCTM Standards-and probably with their general substance. Much of the education community's familiarity with these" arises from the pro jects' own dissemination efforts. The research reported in this volume, however, is one of the few detailed studies of these innovations undertaken by researchers outside the projects themselves.

Examining the Examinations looks at the required advanced science and mathematics examinations taken by university-bound students in seven countries. This research focuses on topics covered, types of questions used, and performance expected from students. The book concentrates on comparisons of the examinations, illustrating their similarities and differences with selected questions taken from the actual examinations. The international comparisons presented offer a window on educational laboratories' in seven countries.

"an invaluable guide for practitioners, quality assurors, university managers and students themselves who wish to better understand the importance of assessment for learning, and it will further scholarship in the field significantly."

-Professor Sally Brown

Assessment for Learning in Higher Education is a practical guide to Assessment for Learning (AfL); a term that has become internationally accepted in Higher Education and features in the learning and teaching strategies of many universities. It is also mandated by official bodies such as QAA in the UK. Many staff in Higher Education are uncertain about how to implement AfL, especially in times of increasingly constrained resources and this vital new guide provides solutions that make best use of assessment as a tool for learning.

This book provides an important and accessible blend of practical examples of AfL in a variety of subject areas. The authors present practical, often small-scale and eminently do-able ideas that will make its introduction achievable. It provides practical case examples both for new lecturers and more experienced staff who may be interested in embedding AfL principles and practice into their university teaching. AfL approaches go beyond minor adaptations to teaching practice, and signify a shift in the foundations of thinking about assessment. With this in mind there is guidance on the development of effective learning environments and communities through the use of:

It provides helpful, realistic guidance backed up by relevant theory and is written in an accessible, jargon-free style, grounded in practical experience and brought to life via a wide range of illustrative examples and case studies.

Assessment for Learning in Higher Education fills a vital gap in assessment literature and as AfL is increasingly on the Higher Education agenda, with the promotion of assessment as a tool for learning, this book will become an essential handbook to guide all academic practitioners.

This book examines important advances and offers a realistic image of the state of the art in student learning outcomes assessment in higher education-a field close to the core of nearly every higher education institution. Producing sound information on what students know and can do is critical to higher education practitioners and future social prosperity. Spanning international, national and institutional developments, the book presents methodological and empirical insights, highlights research challenges, and showcases the enormous progress made in recent years. The book will be of interest to researchers in education assessment and neighbouring fields, and stakeholders like institutional leaders, teachers and graduate employers looking for better insight on returns, governments searching for information to assist with funding and regulation, and members of the public wanting more clarity about outcomes and public investment. This book was originally published as a special issue of Assessment & Evaluation in Higher Education.

Phil R. Manning "Can you prove that continuing education really makes any difference?" Over the years, educators concerned with continuing education (CE) for health professionals have either heard or voiced that question in one form or another more than once. But because of the difficulty in measuring the specific effects of a given course, program, or conference, the question has not been answered satisfactorily. Since CE is costly, since CE is now mandated in some states for re-registration, and since its worth has not been proven in for mal evaluation research, the pressure to evaluate remains strong. The question can be partially answered by a more careful definition of continuing education, particularly the goals to be achieved by CEo Another part of the answer depends on the development of a stronger commitment to evaluation of CE by its providers. But a significant part of the answer might be provided through the improvement of methods used in evaluation of continuing education for health professionals. To address this last concern, the Development and Demonstration Center in Continuing Education for the Health Professions of the Univer sity of Southern California organized and conducted a meeting of academi cians and practitioners in evaluation of continuing education. During a three-day period, participants heard formal presentations by five invited speakers and then discussed the application of the state of the art of educa tional evaluation to problems of evaluation of continuing education for health professionals."

Bernard R. Gifford In the United States, the standardized test has become one of the major sources of information for reducing uncertainty in the determination of individual merit and in the allocation of merit-based educational, training, and employment opportunities. Most major institutions of higher education require applicants to supplement their records of academic achievements with scores on standardized tests. Similarly, in the workplace, as a condition of employment or assignment to training programs, more and more employers are requiring prospective employees to sit for standardized tests. In short, with increasing frequency and intensity, individual members of the political economy are required to transmit to the opportunity marketplace scores on standardized examinations that purport to be objective measures of their and potential. In many instances, these test scores are the abilities, talents, only signals about their skills that job applicants are permitted to send to prospective employers. THE NATIONAL COMMISSION ON TESTING AND PUBLIC POLICY In view of the importance of these issues to our current national agenda, it was proposed that the Human Rights and Governance and the Education and Culture Programs of the Ford Foundation support the establishment of a ''blue ribbon" National Commission on Testing and Public Policy to investigate some of the major problems as well as the untapped opportunities created by recent trends in the use of standardized tests, particularly in the workplace and in schools.

Major "paradigm shifts"-replacing one "world view" with another regarding what constitutes appropriate knowledge do not happen over night. Centuries usually intervene in the process. Even minor shifts admitting alternative world views into the domain of legitimate knowledge producing theory and practice-require decades of controversy, especially, it seems to us, in the field of education. It has only been in the last 20 years or so that the educational research community has begun to accept the "scientific" credibility of the qualitative approaches to inquiry such as participant observation, case study, ethnogra phy, and the like. In fact, these methods, with their long and distinguished philosophical traditions in phenomenology, have really only come into their own within the last decade. The critical perspective on generating and evaluating knowledge and practice-what this book is mostly about-is in many ways a radical depar ture from both the more traditional quantitative and qualitative perspec tives. The traditional approaches, in fact, are far more similar to one another than they are to the critical perspective. This is the case, in our view, for one crucial reason: Both the more quantitative, empirical-analytic and qualitative, interpretive traditions share a fundamental epistemological commitment: they both eschew ideology and human interests as explicit components in their paradigms of inquiry. Ideology and human interests, however, are the "bread and butter" of a critical approach to inquiry."

Ingrained for many years in the science of educational assessment were a large number of "truths" about how to make sense out of testing results, artful wisdoms that appear to have held away largely by force of habit alone. Practitioners and researchers only occasionally agreed about how tests should be designed, and were even further apart when they came to interpreting test responses by any means other than categorically "right" or "wrong." Even the best innovations were painfully slow to be incorporated into practice. The traditional approach to testing was developed to accomplish only two tasks: to provide ranking of students, or to select relatively small proportions of students for special treatment. In these tasks it was fairly effective, but it is increasingly seen as inadequate for the broader spectrum of issues that educational measurement is now called upon to address. Today the range of questions being asked of educational test data is itself growing by leaps and bounds. Fortunately, to meet this challenge we have available a wide panoply of resource tools for assessment which deserve serious attention. Many of them have exceptionally sOphisticated mathematical foundations, and succeed well where older and less versatile techniques fail dismally. Yet no single new tool can conceivably cover the entire arena.