This book presents comprehensive results from case studies of three innovations in mathematics education that have much to offer toward understanding current reforms in this field. Each chapter tells the story of a case in rich detail, with extensi ve documentation, and in the voices of many of the participants-the innovators, the teachers, the students. Similarly, Volume 2 of Bold Ventures pre sents the results from case studies of five innovations in science education. Volume 1 provides a cross-case analysis of all eight innovations. Many U.S. readers certainly will be very familiar with the name of at least if not all of the mathematics innovations discussed in this volume-for one example, the NCTM Standards-and probably with their general substance. Much of the education community's familiarity with these" arises from the pro jects' own dissemination efforts. The research reported in this volume, however, is one of the few detailed studies of these innovations undertaken by researchers outside the projects themselves.

Examining the Examinations looks at the required advanced science and mathematics examinations taken by university-bound students in seven countries. This research focuses on topics covered, types of questions used, and performance expected from students. The book concentrates on comparisons of the examinations, illustrating their similarities and differences with selected questions taken from the actual examinations. The international comparisons presented offer a window on educational laboratories' in seven countries.

This practical, very effective resource helps middle and high school teachers and curriculum leaders develop the skills to design instructional tasks and assessments that engage students in higher-level critical thinking, as recommended by the Common Core State Standards. Real examples of formative and summative assessments from a variety of content areas are included and demonstrate how to successfully increase the level of critical thinking in every classroom! This book is also an excellent resource for higher education faculty to use in undergraduate and graduate courses on assessment and lesson planning.

This introductory text describes the principles of invariant measurement, how invariant measurement can be achieved with Rasch models, and how to use invariant measurement to solve measurement problems in the social, behavioral, and health sciences. Rasch models are used throughout but a comparison of Rasch models to other item response theory (IRT) models is also provided. Written with students in mind, the manuscript was class tested to help maximize accessibility. Chapters open with an introduction and close with a summary and discussion. Numerous examples and exercises demonstrate the main issues addressed in each chapter. Key terms are defined when first introduced and in an end-of-text glossary. All of the book's analyses were conducted with the Facets program. The data sets used in the book, sample syntax files for running the Facets program, Excel files for creating item and person response functions, links to related websites, and other material are available at www.GeorgeEngelhard.com. Highlights include: A strong philosophical and methodological approach to measurement in the human sciences Demonstrations of how measurement problems can be addressed using invariant measurement Practical illustrations of how to create and evaluate scales using invariant measurement A history of measurement based on test-score and scaling traditions Previously unpublished work in analyzing rating data, the detection and measurement of rater errors, and the evaluation of rater accuracy A review of estimation methods, model-data fit, indices used to evaluate the quality of rater-mediated assessments, rater error and bias, and rater accuracy. Intended as a supplementary text for graduate or advanced undergraduate courses on measurement or test theory, item response theory, scaling theory, psychometrics, advanced measurement techniques, research methods, or evaluation research taught in education, psychology, and the social and health sciences, the book also appeals to practitioners and researchers in these fields who develop or use scales and instruments. Only a basic mathematical level is required including a basic course in statistic.

Bernard R. Gifford In the United States, the standardized test has become one of the major sources of information for reducing uncertainty in the determination of individual merit and in the allocation of merit-based educational, training, and employment opportunities. Most major institutions of higher education require applicants to supplement their records of academic achievements with scores on standardized tests. Similarly, in the workplace, as a condition of employment or assignment to training programs, more and more employers are requiring prospective employees to sit for standardized tests. In short, with increasing frequency and intensity, individual members of the political economy are required to transmit to the opportunity marketplace scores on standardized examinations that purport to be objective measures of their and potential. In many instances, these test scores are the abilities, talents, only signals about their skills that job applicants are permitted to send to prospective employers. THE NATIONAL COMMISSION ON TESTING AND PUBLIC POLICY In view of the importance of these issues to our current national agenda, it was proposed that the Human Rights and Governance and the Education and Culture Programs of the Ford Foundation support the establishment of a ''blue ribbon" National Commission on Testing and Public Policy to investigate some of the major problems as well as the untapped opportunities created by recent trends in the use of standardized tests, particularly in the workplace and in schools.

Phil R. Manning "Can you prove that continuing education really makes any difference?" Over the years, educators concerned with continuing education (CE) for health professionals have either heard or voiced that question in one form or another more than once. But because of the difficulty in measuring the specific effects of a given course, program, or conference, the question has not been answered satisfactorily. Since CE is costly, since CE is now mandated in some states for re-registration, and since its worth has not been proven in for mal evaluation research, the pressure to evaluate remains strong. The question can be partially answered by a more careful definition of continuing education, particularly the goals to be achieved by CEo Another part of the answer depends on the development of a stronger commitment to evaluation of CE by its providers. But a significant part of the answer might be provided through the improvement of methods used in evaluation of continuing education for health professionals. To address this last concern, the Development and Demonstration Center in Continuing Education for the Health Professions of the Univer sity of Southern California organized and conducted a meeting of academi cians and practitioners in evaluation of continuing education. During a three-day period, participants heard formal presentations by five invited speakers and then discussed the application of the state of the art of educa tional evaluation to problems of evaluation of continuing education for health professionals."

This edited volume gives a new and integrated introduction to item re sponse models (predominantly used in measurement applications in psy chology, education, and other social science areas) from the viewpoint of the statistical theory of generalized linear and nonlinear mixed models. Moreover, this new framework aHows the domain of item response mod els to be co-ordinated and broadened to emphasize their explanatory uses beyond their standard descriptive uses. The basic explanatory principle is that item responses can be modeled as a function of predictors of various kinds. The predictors can be (a) char acteristics of items, of persons, and of combinations of persons and items; they can be (b) observed or latent (of either items or persons); and they can be (c) latent continuous or latent categorical. Thus, a broad range of models can be generated, including a wide range of extant item response models as weH as some new ones. Within this range, models with explana tory predictors are given special attention, but we also discuss descriptive models. Note that the 'item responses' that we are referring to are not just the traditional 'test data, ' but are broadly conceived as categorical data from a repeated observations design. Hence, data from studies with repeated-observations experimental designs, or with longitudinal designs, mayaIso be modeled. The intended audience for this volume is rather broad."

Major "paradigm shifts"-replacing one "world view" with another regarding what constitutes appropriate knowledge do not happen over night. Centuries usually intervene in the process. Even minor shifts admitting alternative world views into the domain of legitimate knowledge producing theory and practice-require decades of controversy, especially, it seems to us, in the field of education. It has only been in the last 20 years or so that the educational research community has begun to accept the "scientific" credibility of the qualitative approaches to inquiry such as participant observation, case study, ethnogra phy, and the like. In fact, these methods, with their long and distinguished philosophical traditions in phenomenology, have really only come into their own within the last decade. The critical perspective on generating and evaluating knowledge and practice-what this book is mostly about-is in many ways a radical depar ture from both the more traditional quantitative and qualitative perspec tives. The traditional approaches, in fact, are far more similar to one another than they are to the critical perspective. This is the case, in our view, for one crucial reason: Both the more quantitative, empirical-analytic and qualitative, interpretive traditions share a fundamental epistemological commitment: they both eschew ideology and human interests as explicit components in their paradigms of inquiry. Ideology and human interests, however, are the "bread and butter" of a critical approach to inquiry."

Aimed at researchers and students interested in language testing theory and practice, the chapters in this book vary in style and content and are both stimulating and robust. The book brings together a fascinating group of authors from the established to the new, presenting new ideas and challenging current orthodoxies.

Ingrained for many years in the science of educational assessment were a large number of "truths" about how to make sense out of testing results, artful wisdoms that appear to have held away largely by force of habit alone. Practitioners and researchers only occasionally agreed about how tests should be designed, and were even further apart when they came to interpreting test responses by any means other than categorically "right" or "wrong." Even the best innovations were painfully slow to be incorporated into practice. The traditional approach to testing was developed to accomplish only two tasks: to provide ranking of students, or to select relatively small proportions of students for special treatment. In these tasks it was fairly effective, but it is increasingly seen as inadequate for the broader spectrum of issues that educational measurement is now called upon to address. Today the range of questions being asked of educational test data is itself growing by leaps and bounds. Fortunately, to meet this challenge we have available a wide panoply of resource tools for assessment which deserve serious attention. Many of them have exceptionally sOphisticated mathematical foundations, and succeed well where older and less versatile techniques fail dismally. Yet no single new tool can conceivably cover the entire arena.

Regional cooperation in East Asia on various issue areas, such as emergency liquidity mechanisms in finance, the exponential growth of free trade agreements and policy coordination on the environment and public health, developed rapidly after the Asian Financial Crisis. A decade later, the global financial crisis offered a new opportunity for the nascent regional cooperation mechanisms to acquire new depth and meaning - this time, however, in a very different context due to the unfaltering rise of China. How have inter-state cooperation mechanisms, which were devised originally to deal with the problems of the past crisis, fared in the recent global economic turbulence? Can regional integration effectively insulate East Asia from the vagaries of the international market? Should East Asian nations heed the call for regionalism or globalism? This volume not only offers one of the first assessments of how the global economic crisis has affected the prospects for regional integration in East Asia, but it also addresses a number of long-standing debates of interest to East Asian specialists, economists and policymakers: Are crises catalysts for revamping developmental models? Do they provide solid foundations for regional solidarity and integration? Can they help catapult countries into the global limelight? This book was originally published as a special issue of The Pacific Review.

In our current education system too many high school students wind up with too few choices. Students are locked into what is decided for them by a broken system. Too often, they are handed a diploma that holds an empty promise. This practical field book is filled with effective tools from The Education Trust-West. Diploma Matters helps school leaders and teachers examine the current high school experience and develop a detailed action plan that will transform curriculum and ensure that all students are ready for college and the workplace.

"This is a book for practitioners who have seen it all. Linda Murray captures in a straight-forward way the nuts and bolts of how to do the work of reform. Linda, who was an extraordinary superintendent, proves to be a captivating storyteller."--Peter J. Negroni, senior vice president, College Board

"This is a story worth reading, including the specific implications for schools and districts nationwide."--Michael W. Kirst, emeritus professor of Education and Business Administration, Stanford University; president, California State Board of Education; author, Political Dynamics Of American Education

"This book is a definitive 'how to' for effective, meaningful, and lasting school reform." --Kathy Burkhard, former president, San Jose Teachers' Association

A critical issue in research and development (R&D) management is the structure and use of evaluative efforts for R&D programs. The book introduces the different methods that may be used in R&D evaluation and then illustrates these methods by describing actual evaluation in practice using those methods. The book is divided into two sections. The first section provides an introduction and details on several popular methodologies used in the evaluation of research and development activities. The second half of the book focuses on evaluation in practice and is comprised of several chapters offering the perspectives of individuals in different types of organizations. The book concludes with an annotated bibliography of selected R&D evaluation literature, focusing on post-1985 literature, on research evaluation.

Generalizability theory offers an extensive conceptual framework and a powerful set of statistical procedures for characterizing and quantifying the fallibility of measurements. Robert Brennan, the author, has written the most comprehensive and up-to-date treatment of generalizability theory. The book provides a synthesis of those parts of the statistical literature that are directly applicable to generalizability theory. The principal intended audience is measurement practitioners and graduate students in the behavioral and social sciences, although a few examples and references are provided from other fields. Readers will benefit from some familiarity with classical test theory and analysis of variance, but the treatment of most topics does not presume specific background.

In this book, experts in statistics and psychometrics describe classes of linkages, the history of score linkings, data collection designs, and methods used to achieve sound score linkages. They describe and critically discuss applications to a variety of domains. They define what linking is, to distinguish among the varieties of linking and to describe different procedure for linking. Furthermore, they convey the complexity and diversity of linking by covering different areas of linking and providing diverse perspectives.

Since the publication of the first edition of this book in 1983, A Handbook for Medical Teachers has established itself as an ideal resource for new and established teachers who frequently still have little opportunities for education training. Its popularity relates to the successful combination of sound educational principles, a how-to-do-it approach and an entertaining easy-to-read style. It is supported by numerous illustrations, examples, and pertinent cartoons.

This fourth edition has been extensively revised to reflect the major changes that continue to occur in both undergraduate and postgraduate education.

Many academic staff are coming under external and internal review to demonstrate their teaching competence and the quality of their courses and assessments. This book gives valuable help and advice to those having to respond to such pressures.

The illustrations are by Zig Kapelis, formerly Senior Lecturer in Architecture at the University of Adelaide.

Modern computer technology has opened up several new possibilities for optimizing the administration of educational and psychological tests. In computer adaptive testing (CAT), tests are automatically tailored to the proficiency level of the individual examinees. Currently, nearly all large-scale testing programs in the western world are already adaptive or in the process of becoming so. Written by active CAT researchers from Europe and North America, the chapters offer a comprehensive introduction to the latest developments in the theory and practice of CAT. The book can be used both as a basic reference on the state of the art in CAT and a valuable resource in graduate courses on test theory. The theoretical chapters in this book cover such topics as item selection and ability estimation, item pool development and maintenance, item calibration and model fit, and testlet-based adaptive testing. The practical chapters describe the operational aspects of existing large-scale CAT programs.

There seems to be no end to the flood of conferences, workshops, panel discussions, reports and research studies calling for change in the introductory science courses in our colleges and universities. But, there comes a time to move from criticism to action. In 1993, the Division of Undergraduate Education of the National Science Foundation called for proposals for systemic initiatives to change the way int- ductory chemistry is taught. One of the five awards was to design, develop and implement the peer-led Workshop, a new structure to help students learn science. This book is a study of 15 years of work by the Peer-Led Team Learning (PLTL) project, a national consortium of faculty, learning specialists and students. The authors have been in the thick of the action as project evaluator (Gafney) and co-principle investigator (Varma-Nelson). Readers of this book will find a story of successful change in educational practice, a story that continues today as new institutions, faculty, and disciplines adopt the PLTL model. They will learn the model in theory and in practice and the supporting data that encourage others to adopt and adapt PLTL to new sit- tions. Although the project has long since lost count of the number of implem- tations of the model, conservative estimates are that more than 100 community and four year colleges and a range of universities have adopted the PLTL model to advance student learning for more than 20,000 students in a variety of STEM disciplines.

There is mounting hope in the United States that federal legislation in the form of No Child Left Behind will improve educational outcomes. As titanic as the challenge appears to be, however, the solution could be at our fingertips. This volume identifies visual types of cognitive models in reading, science, and mathematics for researchers, test developers, school administrators, policy makers, and teachers. In the process of identifying these cognitive models, the book also explores methodological or translation issues to consider as decisions are made about how to generate psychologically informative and psychometrically viable large-scale assessments based on the learning sciences. Initiatives to overhaul educational systems in disrepair may begin with national policies, but the success of these policies will hinge on how well stakeholders begin to rethink what is possible with a keystone of the educational system: large-scale assessment.

There has been a remarkable growth of interest in the assessment of student learning and its relation to the process of learning in higher education over the past ten years. This interest has been expressed in various ways - through large scale research projects, international conferences, the development of principles of assessment that supports learning, a growing awareness of the role of feedback as an integral part of the learning process, and the publication of exemplary assessment practices. At the same time, more limited attention has been given to the underlying nature of assessment, to the concerns that arise when assessment is construed as a measurement process, and to the role of judgement in evaluating the quality of students' work. It is now timely to take stock of some of the critical concepts that underpin our understanding of the multifarious relationships between assessment and learning, and to explicate the nature of assessment as judgement. Despite the recent growth in interest noted above, assessment in higher education remains under-conceptualized. This book seeks to make a significant contribution to conceptualizing key aspects of assessment, learning and judgement.

At a time when the importance of lifelong education is becoming recognised around the world, this is the first book to explore an important but hitherto neglected area: adult mathematics education. This book is about adults learning mathematics wherever and in whatever circumstances they do so. It brings together researchers in the field and aims to lay the foundations for study and further research and practice in this fast-developing area. It aims to situate research and practice in adults learning mathematics within the wider field of lifelong learning and lifelong education and to be accessible both to the specialist and to the general adult reader. The book features a comprehensive review of the field which sets the scene for sections on: Perspectives on Research on Adults Learning Mathematics; Adults, Mathematics, Culture, and Society; Adults, Mathematics, and Work; and Perspectives in Teaching Adults Mathematics. Topics covered include: mathematics and common sense; statistical literacy and numeracy; new theories on learning mathematics; mathematical competences for the workplace; ethnomathematics; and the training of tutors.

In 1976, the first session on the teaching of evaluation was held at an annual meeting of evaluators. A few hardy souls gathered to exchange ideas on improving the teaching of evaluation. At subsequent annual meetings, these informal sessions attracted more and more participants, eager to talk about common teaching interests and to exchange reading lists, syllabuses, assignments, and paper topics. The ses sions were irreverent, innovative, lively, and unpredictable. Eventually the group for malized itself with the American Evaluation Association as the Topical Interest Group in the Teaching of Evaluation (TIG: TOE). As word of TIG: TOE's activities spread, instructors from all over the country clamored for assistance and advice. It became apparent that a handbook was need ed, a practical interdisciplinary guide to the teaching of evaluation. Donna M. Mertens, a long-standing member of TIG: TOE and an accomplished teacher of evaluation, volunteered to edit the book, and her skills, sensitivity, and experience in the craft of teaching are apparent throughout."