Attempting fonnally to evaluate something involves the evaluator coming to grips with a number of abstract concepts such as value, merit, worth, growth, criteria, standards, objectives, needs, nonns, client, audience, validity, reliability, objectivity, practical significance, accountability, improvement, process, pro duct, fonnative, summative, costs, impact, infonnation, credibility, and - of course - with the tenn evaluation itself. To communicate with colleagues and clients, evaluators need to clarify what they mean when they use such tenns to denote important concepts central to their work. Moreover, evaluators need to integrate these concepts and their meanings into a coherent framework that guides all aspects of their work. If evaluation is to lay claim to the mantle of a profession, then these conceptualizations of evaluation must lead to the conduct of defensible evaluations. The conceptualization of evaluation can never be a one-time activity nor can any conceptualization be static. Conceptualizations that guide evaluation work must keep pace with the growth of theory and practice in the field. Further, the design and conduct of any particular study involves a good deal of localized conceptualization."

Attempting fonnally to evaluate something involves the evaluator coming to grips with a number of abstract concepts such as value, merit, worth, growth, criteria, standards, objectives, needs, nonns, client, audience, validity, reliability, objectivity, practical significance, accountability, improvement, process, pro duct, fonnative, summative, costs, impact, infonnation, credibility, and - of course - with the tenn evaluation itself. To communicate with colleagues and clients, evaluators need to clarify what they mean when they use such tenns to denote important concepts central to their work. Moreover, evaluators need to integrate these concepts and their meanings into a coherent framework that guides all aspects of their work. If evaluation is to lay claim to the mantle of a profession, then these conceptualizations of evaluation must lead to the conduct of defensible evaluations. The conceptualization of evaluation can never be a one-time activity nor can any conceptualization be static. Conceptualizations that guide evaluation work must keep pace with the growth of theory and practice in the field. Further, the design and conduct of any particular study involves a good deal of localized conceptualization."

This book is about the practice of decision making by school principals and about ways to improve this practice by capitalizing on evaluation dimensions. Much has been written on decision making but surprisingly little on decision making in the school principalship. Much has been also written on evaluation as well as on evaluation and decision making, but not much has been written on evaluation in decision making, especially decision making in the principalship. This book presents two messages. One is that decision making in the principalship can be studied and improved and not only talked about in abstract terms. The other message is that evaluation can contribute to the understanding of decision making in the principalship and to the improvement of its practice. In this book we call for the conception of an evaluation-minded principal, a principal who has a wide perspective on the nature of evaluation and its potential benefits, a principal who is also inclined to use evaluation perceptions and techniques as part of his/her decision-making process. This book was conceived in 1985 with the idea to combine thoughts about educational administration with thoughts about educational evaluation. Studies of decision making in the principalship had already been on their way. We decided to await the findings, and in the meantime we wrote a first conceptual version of evaluation in decision making. As the studies were completed we wrote a first empirical version of same.

Decision-Oriented Educational Research considers a form of educational research that is designed to be directly relevant to the current information requirements of those who are shaping educational policy or managing edu cational systems. It was written for those who plan to conduct such research, as well as for policy makers and educational administrators who might have such research conducted for them. The book is divided into three main parts. Part I is background. Chapter 1 describes some of the basic themes that are woven throughout subsequent chapters on decision-oriented research. These themes include the impor tance of taking a systems view of educational research; of understanding the nature of decision and policy processes and how these influence system re search; of integrating research activities into the larger system's processes; of the role of management in the research process; of researchers and managers sharing a sense of educational purposes; and of emphasizing system improvement as a basic goal of research process. Chapter 2 is a discussion of the background of the research activities that form the bases of this book. Our collaboration with the Pittsburgh public school system is described, as are the methods and structure we used to build the case histories of our work with the district. Part II, encompassing chapters 3 through 9, addresses basic generaliza tions about decision-oriented educational research that we have derived from our experiences."

This book presents comprehensive results from case studies of three innovations in mathematics education that have much to offer toward understanding current reforms in this field. Each chapter tells the story of a case in rich detail, with extensi ve documentation, and in the voices of many of the participants-the innovators, the teachers, the students. Similarly, Volume 2 of Bold Ventures pre sents the results from case studies of five innovations in science education. Volume 1 provides a cross-case analysis of all eight innovations. Many U.S. readers certainly will be very familiar with the name of at least if not all of the mathematics innovations discussed in this volume-for one example, the NCTM Standards-and probably with their general substance. Much of the education community's familiarity with these" arises from the pro jects' own dissemination efforts. The research reported in this volume, however, is one of the few detailed studies of these innovations undertaken by researchers outside the projects themselves.

Examining the Examinations looks at the required advanced science and mathematics examinations taken by university-bound students in seven countries. This research focuses on topics covered, types of questions used, and performance expected from students. The book concentrates on comparisons of the examinations, illustrating their similarities and differences with selected questions taken from the actual examinations. The international comparisons presented offer a window on educational laboratories' in seven countries.

This series of essays discusses how progress is identified in a range of disciplines - physics, mathematics, biology, medicine, sociology, linguistics, art history, history, economics and ecology. The articles are based on discussions at a symposium organised by the European Science Foundation and are by acknowledged leaders in the fields covered. They seek to promote communication between the different disciplines, to identify the criteria of advancement and to examine problems in assessing them.

Phil R. Manning "Can you prove that continuing education really makes any difference?" Over the years, educators concerned with continuing education (CE) for health professionals have either heard or voiced that question in one form or another more than once. But because of the difficulty in measuring the specific effects of a given course, program, or conference, the question has not been answered satisfactorily. Since CE is costly, since CE is now mandated in some states for re-registration, and since its worth has not been proven in for mal evaluation research, the pressure to evaluate remains strong. The question can be partially answered by a more careful definition of continuing education, particularly the goals to be achieved by CEo Another part of the answer depends on the development of a stronger commitment to evaluation of CE by its providers. But a significant part of the answer might be provided through the improvement of methods used in evaluation of continuing education for health professionals. To address this last concern, the Development and Demonstration Center in Continuing Education for the Health Professions of the Univer sity of Southern California organized and conducted a meeting of academi cians and practitioners in evaluation of continuing education. During a three-day period, participants heard formal presentations by five invited speakers and then discussed the application of the state of the art of educa tional evaluation to problems of evaluation of continuing education for health professionals."

Bernard R. Gifford In the United States, the standardized test has become one of the major sources of information for reducing uncertainty in the determination of individual merit and in the allocation of merit-based educational, training, and employment opportunities. Most major institutions of higher education require applicants to supplement their records of academic achievements with scores on standardized tests. Similarly, in the workplace, as a condition of employment or assignment to training programs, more and more employers are requiring prospective employees to sit for standardized tests. In short, with increasing frequency and intensity, individual members of the political economy are required to transmit to the opportunity marketplace scores on standardized examinations that purport to be objective measures of their and potential. In many instances, these test scores are the abilities, talents, only signals about their skills that job applicants are permitted to send to prospective employers. THE NATIONAL COMMISSION ON TESTING AND PUBLIC POLICY In view of the importance of these issues to our current national agenda, it was proposed that the Human Rights and Governance and the Education and Culture Programs of the Ford Foundation support the establishment of a ''blue ribbon" National Commission on Testing and Public Policy to investigate some of the major problems as well as the untapped opportunities created by recent trends in the use of standardized tests, particularly in the workplace and in schools.

Major "paradigm shifts"-replacing one "world view" with another regarding what constitutes appropriate knowledge do not happen over night. Centuries usually intervene in the process. Even minor shifts admitting alternative world views into the domain of legitimate knowledge producing theory and practice-require decades of controversy, especially, it seems to us, in the field of education. It has only been in the last 20 years or so that the educational research community has begun to accept the "scientific" credibility of the qualitative approaches to inquiry such as participant observation, case study, ethnogra phy, and the like. In fact, these methods, with their long and distinguished philosophical traditions in phenomenology, have really only come into their own within the last decade. The critical perspective on generating and evaluating knowledge and practice-what this book is mostly about-is in many ways a radical depar ture from both the more traditional quantitative and qualitative perspec tives. The traditional approaches, in fact, are far more similar to one another than they are to the critical perspective. This is the case, in our view, for one crucial reason: Both the more quantitative, empirical-analytic and qualitative, interpretive traditions share a fundamental epistemological commitment: they both eschew ideology and human interests as explicit components in their paradigms of inquiry. Ideology and human interests, however, are the "bread and butter" of a critical approach to inquiry."

Promoting high standards in education while striving for equal opportunities under the budget constraints - these are the new global objectives of education systems. This book brings together research-based evidence on the effectiveness of major Australian, Dutch, and UK improvement efforts in education at both primary and secondary level, whilst making comparisons with similar US initiatives. The book addresses several major questions in this new environment. Those questions include: how to combat educational disadvantages, how to integrate pupils with special educational needs in regular education, how to implement educational standards initiatives, how to restructure secondary education, how to implement decentralized policy-making, and how to implement a class size reduction initiative? Finally, the authors suggest directions for future research in order to increase our understanding of what works in education and why.

America faces a crisis in education and its accompanying effects on the nation's economic and social life. Educators and policy makers need to document the extent of this crisis, to gauge its potential impact, and to develop educational strategies that would boost achievement; this has turned the spotlight on educational assessment - the procedures, practices, and tools that educators use to measure the progress of students, both as individuals and groups. This book deals with a range of issues within the field of educational assessment, with an emphasis on those issues that have sparked the public policy debate in recent years. Much of this volume concerns itself with the impact of testing on various subgroups of the population - blacks, Hispanics, young children, and children considered to be of below average' ability. Taken together, the contributions to this volume represent a broad range of views on differential test performance. (This book is part of the subseries of books based on the Ford Foundation's National Commission on Testing and Public Policy. Previous titles in this program include Gifford & Wing/Test in Defense, Gifford & O'Connor/Changing Assessments, Gifford/Test Policy and the Politics of Opportunity Allocation, and Gifford/Test Policy and Test Performance.)

The media now regularly feature breakthroughs on the influence of prenatal hormones on the brain and behavior, for instance the link to financial performance or risk management. Based on these findings and their own experiments, the authors present the Hormonal Quotient (HQ) as a scientific, holistic and reliable career management and personal development tool for professionals. Eight HQ profiles and their corresponding typical business skills and preferences are presented and enable the reader to benchmark their HQ with peers, design an ideal career plan, build a winning team in business and find the perfect work-life balance. A complimentary website allows readers to easily measure their HQ online.

By the author of "The Right Sensory Mix," Berry-AMA Book Prize Finalist 2011 - one of the four best marketing books in 2011 according to the American Marketing Association Foundation.

The Berry-AMA Book Prize is awarded annually be the American Marketing Association Foundation (AMAF) and recognizes books whose innovative ideas have had significant impact on marketing and related fields.

Bernard R. Gifford As we edge toward the year 2000, the information age is a reality; the global marketplace is increasingly competitive; and the U.S. labor force is shrinking. Today more than ever, our nation's economic and social well-being hinges on our ability to tap our human resources-to identify talent, to nurture it, and to assess abilities and disabilities in ways that help every individual reach his or her full potential. In pursuing that goal, decision-makers in education, industry, and government are relying increasingly on standardized tests: sets of question- with identical directions, time limits and tasks for all test-takers-designed to permit an inference about what someone knows or can do in a particular area. CALIBRATING DIFFERENCE Our emphasis on standardized testing rests on a premise that is so basic it often escapes notice: that we humans are different from each other in ways that are both meaningful and measurable. We differ in terms of cognitive ability; aptitude for performing different kinds of mental and physical tasks; temperament; and interests. But somehow, without sufficient examination, we have taken a great collective leap from that commonplace to the notion that there are precise, measurable gradations of innate ability that can be used to direct children to the right classrooms, and adults to the right job slots.

-Contributors are leading experts which means that each chapter includes up-to-date, high-level, and reputable -Includes new perspectives on established topics like computerized testing and scoring that incorporate technological advances making the book immediately practical to test writers and researchers. -Chapters on assessment through gaming and simulation which introduce newer topics in testing to academics and professionals -Part of our NCME series, this book has been developed and edited by a team of leading experts, ensuring the very best research

The Handbook of Reading Assessment, Second Edition, covers the wide range of reading assessments educators must be able to use and understand to effectively assess and instruct their students. Comprehensive and filled with numerous authentic examples, the text addresses informal classroom based assessment, progress monitoring, individual norm-referenced assessment, and group norm-referenced or 'high-stakes' testing. Coverage includes assessment content relevant for English language learners and adults. A set of test guidelines to use when selecting or evaluating an assessment tool is provided. New and updated in the Second Edition Impact on reading assessment of Common Core Standards for literacy; increased top-down focus on accountability and high stakes tests; innovations in computerized assessment of reading Latest developments in Response to Intervention (RTI) model, particularly as they impact reading assessment International Reading Association standards for reading educators and brief discussion of International Dyslexia Association standards Types of reading assessment, including discussion of formative versus summative assessment Expanded coverage of assessment of reading motivation Expanded coverage of writing assessment New and revised assessments across genres of reading assessment Companion Website: numerous resources relevant to reading and writing assessment; suggestions for evidence-based instructional practices that can be linked to assessment results; PowerPoint slides; test bank; study guides; application exercises

This book was first published in 1977.

Since test items are the building blocks of any test, learning how to develop and validate test items has always been critical to the teaching-learning process. As they grow in importance and use, testing programs increasingly supplement the use of selected-response (multiple-choice) items with constructed-response formats. This trend is expected to continue. As a result, a new item writing book is needed, one that provides comprehensive coverage of both types of items and of the validity theory underlying them.

This book is an outgrowth of the author s previous book, Developing and Validating Multiple-Choice Test Items, 3e (Haladyna, 2004). That book achieved distinction as the leading source of guidance on creating and validating selected-response test items. Like its predecessor, the content of this new book is based on both an extensive review of the literature and on its author s long experience in the testing field. It is very timely in this era of burgeoning testing programs, especially when these items are delivered in a computer-based environment. Key features include

Comprehensive and Flexible No other book so thoroughly covers the field of test item development and its various applications.

Focus on Validity Validity, the most important consideration in testing, is stressed throughout and is based on the Standards for Educational and Psychological Testing, currently under revision by AERA, APA, and NCME

Illustrative Examples The book presents various selected and constructed response formats and uses many examples to illustrate correct and incorrect ways of writing items. Strategies for training item writers and developing large numbers of items using algorithms and other item-generating methods are also presented.

Based on Theory and Research A comprehensive review and synthesis of existing research runs throughout the book and complements the expertise of its authors.

A critical issue in research and development (R&D) management is the structure and use of evaluative efforts for R&D programs. The book introduces the different methods that may be used in R&D evaluation and then illustrates these methods by describing actual evaluation in practice using those methods. The book is divided into two sections. The first section provides an introduction and details on several popular methodologies used in the evaluation of research and development activities. The second half of the book focuses on evaluation in practice and is comprised of several chapters offering the perspectives of individuals in different types of organizations. The book concludes with an annotated bibliography of selected R&D evaluation literature, focusing on post-1985 literature, on research evaluation.

Modern computer technology has opened up several new possibilities for optimizing the administration of educational and psychological tests. In computer adaptive testing (CAT), tests are automatically tailored to the proficiency level of the individual examinees. Currently, nearly all large-scale testing programs in the western world are already adaptive or in the process of becoming so. Written by active CAT researchers from Europe and North America, the chapters offer a comprehensive introduction to the latest developments in the theory and practice of CAT. The book can be used both as a basic reference on the state of the art in CAT and a valuable resource in graduate courses on test theory. The theoretical chapters in this book cover such topics as item selection and ability estimation, item pool development and maintenance, item calibration and model fit, and testlet-based adaptive testing. The practical chapters describe the operational aspects of existing large-scale CAT programs.

At a time when the importance of lifelong education is becoming recognised around the world, this is the first book to explore an important but hitherto neglected area: adult mathematics education. This book is about adults learning mathematics wherever and in whatever circumstances they do so. It brings together researchers in the field and aims to lay the foundations for study and further research and practice in this fast-developing area. It aims to situate research and practice in adults learning mathematics within the wider field of lifelong learning and lifelong education and to be accessible both to the specialist and to the general adult reader. The book features a comprehensive review of the field which sets the scene for sections on: Perspectives on Research on Adults Learning Mathematics; Adults, Mathematics, Culture, and Society; Adults, Mathematics, and Work; and Perspectives in Teaching Adults Mathematics. Topics covered include: mathematics and common sense; statistical literacy and numeracy; new theories on learning mathematics; mathematical competences for the workplace; ethnomathematics; and the training of tutors.