The rediscovery of the value of apprenticeships has been one of the most significant trends in vocational education in recent years, and has prompted an array of research and development projects in countries around the world. In this volume, the renewed interest in the apprenticeship tradition and the various steps towards the implementation of innovative apprenticeship programmes are analysed and discussed from different perspectives.

Beginning with a number of chapters that describe recent developments in apprenticeship training in different national contexts, the book moves on to analyze the way in which both the quality and profitability of apprenticeship act in concert as the most influential drivers of innovation in this field.

In sum, this book makes an important contribution to the international literature on apprenticeship. It draws together some of the leading researchers in the area, and with its overview of a number of national Vocational Education and Training (VET) projects, provides a body of knowledge on current practices and issues that has previously been lacking in this complex interdisciplinary field. The lessons learned from countries' experiences, as presented in this book, provide a valuable platform for policy-makers and scholars alike.

Corporate training and effective performance have become major issues in the 1980s and '90s. Reviews of the training research literature show that, parallel to the growing attention to corporate training, research has also increased in the field, giving a better understanding of the subject and providing fundamental expertise on which trainers can build. The contributions to the book differ in the degree to which they are related to performance issues, but all chapters underline the necessity of thinking from the perspective of effective performance.

In the abstract, training is seen as valuable by most people in business and industry. However, in the rush of providing training programs "on time" and "within budget," evaluation of training is frequently left behind as a "nice to have" addition, if practical. In addition, the training function itself is left with the dilemma of proving its worth to management without a substantive history of evaluation. This book is designed to provide managers, educators, and trainers alike the opportunity to explore the issues and benefits of evaluating business and industry training. The purpose is to motivate more effective decisions for training investments based on information about the value of training in attaining business goals. Without evaluation, the value of specific training efforts cannot be adequately measured, the value of training investments overall cannot be fully assessed, and the contributions of the training function to the corporation's goals cannot be duly recognized. Articles are grouped into three sections, althou~h many themes appear across sections. The first section estabhshes the context of training evaluation in a business organization. The second section emphasizes evaluation of training products and services; and the third section discusses costs and benefits of evaluation, and communication and use of evaluation results in decision making. In Section I, the context of training evaluation is established from a variety of perspectives. First, training and trainin~ evaluation are discussed in the context of corporate strateglc goals.

During the past two decades, evaluation has come to play an increasingly important role in the operation of educational and social programs by national, state, and local agencies. Mandates by federal funding agencies that programs they sponsored be evaluated gave impetus to use of evaluation. Realization that evaluation plays a pivotal role in assuring program quality and effectiveness has maintained the use of evaluation even where mandates have been relaxed. With increased use --indeed institutionalization --of evaluation in many community, state, and national agencies, evaluation has matured as a profession, and new evaluation approaches have been developed to aid in program planning, implementation, monitoring, and improvement. Much has been written about various philosophical and theoretical orientations to evaluation, its relationship to program management, appropriate roles evaluation might play, new and sometimes esoteric evaluation methods, and particular evaluation techniques. Useful as these writings are, relatively little has been written about simple but enormously important activities which comprise much of the day-to-day work of the program evaluator. This book is focused on some of these more practical aspects that largely determine the extent to which evaluation will prove helpful.

This book was first published in 1977.

The highly anticipated second edition of "Understanding by Design" poses the core, essential questions of understanding and design, and provides readers with practical solutions for the teacher-designer. The book opens by analyzing the logic of backward design as an alternative to coverage and activity-oriented plans. Though backward from habit, this approach brings more focus and coherence to instruction. The book proposes a multifaceted approach, with the six "facets" of understanding. The facets combine with backward design to provide a powerful, expanded array of practical tools and strategies for designing curriculum, instruction, and assessments that lead students at all grade levels to genuine understanding. The second edition, a refined work, has been thoroughly and extensively revised, updated, and expanded, including improvement of the UbD Template, the key terms of UbD, dozens of worksheets, and some of the larger concepts. The authors have successfully put together a text that demonstrates what best practice in the design of learning looks like, enhancing for its audience their capability for creating more engaging and effective learning, whether the student is a third grader, a college freshman, or a faculty member.

Since test items are the building blocks of any test, learning how to develop and validate test items has always been critical to the teaching-learning process. As they grow in importance and use, testing programs increasingly supplement the use of selected-response (multiple-choice) items with constructed-response formats. This trend is expected to continue. As a result, a new item writing book is needed, one that provides comprehensive coverage of both types of items and of the validity theory underlying them.

This book is an outgrowth of the author s previous book, Developing and Validating Multiple-Choice Test Items, 3e (Haladyna, 2004). That book achieved distinction as the leading source of guidance on creating and validating selected-response test items. Like its predecessor, the content of this new book is based on both an extensive review of the literature and on its author s long experience in the testing field. It is very timely in this era of burgeoning testing programs, especially when these items are delivered in a computer-based environment. Key features include

Comprehensive and Flexible No other book so thoroughly covers the field of test item development and its various applications.

Focus on Validity Validity, the most important consideration in testing, is stressed throughout and is based on the Standards for Educational and Psychological Testing, currently under revision by AERA, APA, and NCME

Illustrative Examples The book presents various selected and constructed response formats and uses many examples to illustrate correct and incorrect ways of writing items. Strategies for training item writers and developing large numbers of items using algorithms and other item-generating methods are also presented.

Based on Theory and Research A comprehensive review and synthesis of existing research runs throughout the book and complements the expertise of its authors.

Bernard R. Gifford In the United States, the standardized test has become one of the major sources of information for reducing uncertainty in the determination of individual merit and in the allocation of merit-based educational, training, and employment opportunities. Most major institutions of higher education require applicants to supplement their records of academic achievements with scores on standardized tests. Similarly, in the workplace, as a condition of employment or assignment to training programs, more and more employers are requiring prospective employees to sit for standardized tests. In short, with increasing frequency and intensity, individual members of the political economy are required to transmit to the opportunity marketplace scores on standardized examinations that purport to be objective measures of their abilities, talents, and potential. In many instances, these test scores are the only signals about their skills that job applicants are permitted to send to prospective employers. THE NATIONAL COMMISSION ON TESTING AND PUBLIC POLICY In view of the importance of these issues to our current national agenda, it was proposed that the Human Rights and Governance and the Education and Culture Programs of the Ford Foundation support the establishment of a ''blue ribbon" National Commission on Testing and Public Policy to investigate some of the major problems, as well as the untapped opportunities, created by recent trends in the use of standardized tests, particularly in the workplace and in schools.

This book provides an alternative method for measuring individual differences in psychological, educational, and other behavioral sciences studies. It is based on the assumptions of ordinal statistics as explained in Norman Cliff's 1996 Ordinal Methods for Behavioral Data Analysis. It provides the necessary background on ordinal measurement to permit its use to assess psychological and psychophysical tests and scales and interpret the data obtained. The authors believe that some of the behavioral measurement models used today do not fit the data or are inherently self-contradictory. Applications of these models can therefore lead to unwarranted inferences regarding the status of the derived variables. These methods can also be difficult to apply, particularly in small-sample contexts without making additional, unrealistic assumptions. Ordinal methods more closely reflect the original data, are simple to apply, and can be used in samples of any size. The book's approach is in essence a return to simple empiricism in psychological measurement. Ordinal Measurement in the Behavioral Sciences provides: *methods for analyzing test responses; *extensive discussions of ordinal approaches to analyzing data that are judgments of stimuli; *methods for treating psychological data in ways consistent with its ordinal nature so as to stimulate new developments in this area; and *ordinal test theory and the unfolding methods that are applicable to cross-cultural studies. Advanced students, researchers, and practitioners concerned with psychological measurement should find this book relevant. Measurement professionals will find it provides useful and simple methods that stimulate thought about measurement's real issues.

I personally learned to know Ralph Tyler rather late in his career when, in the 1960s, I spent a year as a Fellow at the Center for Advanced Study in the Behavioral Sciences at Stanford. His term of office as Director of the Center was then approaching its end. This would seem to disqualify me thoroughly from preparing a Foreword to this "Classic Works. " Many of his colleagues and, not least, of his students at his dear Alma Mater, the University of Chicago, are certainly better prepared than I to put his role in American education in proper perspective. The reason for inviting me is, I assume, to bring out the influence that Tyler has had on the international educational scene. I am writing this Foreword on a personal note. Ralph Tyler's accomplishments in his roles as a scholar, policy maker, educational leader, and statesman have been amply put on record in this book, not least in the editors' Preface. My reflections are those of an observer from abroad but who, over the last 25 years, has been close enough to overcome the aloofness of the foreigner. Tyler has over many years been criss-crossing the North American con tinent generously giving advice to agencies at the federal, state, and local levels, lecturing, and serving on many committees and task forces that have been instrumental in shaping American education."

When George Bernard Shaw wrote his play, Pygmalion, he could hardly have foreseen the use of the concept of the self-fulfilling prophecy in debates about standardized testing in schools. Still less could he have foreseen that the validity of the concept would be examined many years later in Irish schools. While the primary purpose of the experimental study reported in this book was not to investigate the Pygmalion effect, it is inconceivable that a study of the effects of standardized testing, conceived in the 1960s and planned and executed in the 1970s, would not have been influenced by thinking about teachers' expectations and the influence of test information on the formation of those expectations. While our study did pay special attention to teacher expectations, its scope was much wider. It was planned and carried out in a much broader framework, one in which we set out to examine the impact of a standardized testing program, not just on teachers, but also on school practices, students, and students' parents.

Attempting fonnally to evaluate something involves the evaluator coming to grips with a number of abstract concepts such as value, merit, worth, growth, criteria, standards, objectives, needs, nonns, client, audience, validity, reliability, objectivity, practical significance, accountability, improvement, process, pro duct, fonnative, summative, costs, impact, infonnation, credibility, and - of course - with the tenn evaluation itself. To communicate with colleagues and clients, evaluators need to clarify what they mean when they use such tenns to denote important concepts central to their work. Moreover, evaluators need to integrate these concepts and their meanings into a coherent framework that guides all aspects of their work. If evaluation is to lay claim to the mantle of a profession, then these conceptualizations of evaluation must lead to the conduct of defensible evaluations. The conceptualization of evaluation can never be a one-time activity nor can any conceptualization be static. Conceptualizations that guide evaluation work must keep pace with the growth of theory and practice in the field. Further, the design and conduct of any particular study involves a good deal of localized conceptualization."

Attempting fonnally to evaluate something involves the evaluator coming to grips with a number of abstract concepts such as value, merit, worth, growth, criteria, standards, objectives, needs, nonns, client, audience, validity, reliability, objectivity, practical significance, accountability, improvement, process, pro duct, fonnative, summative, costs, impact, infonnation, credibility, and - of course - with the tenn evaluation itself. To communicate with colleagues and clients, evaluators need to clarify what they mean when they use such tenns to denote important concepts central to their work. Moreover, evaluators need to integrate these concepts and their meanings into a coherent framework that guides all aspects of their work. If evaluation is to lay claim to the mantle of a profession, then these conceptualizations of evaluation must lead to the conduct of defensible evaluations. The conceptualization of evaluation can never be a one-time activity nor can any conceptualization be static. Conceptualizations that guide evaluation work must keep pace with the growth of theory and practice in the field. Further, the design and conduct of any particular study involves a good deal of localized conceptualization."

This volume offers contributions by thought leaders from a variety of disciplines and different perspectives, which are brought together in a final chapter. The contributions give insight in the role of large-scale international assessments as change agents. As national leaders recognize the growing importance of human capital and how it is distributed, policymakers, economists and decision makers in education have become increasingly interested in results from comparative international surveys. These assessments offer important information on the development of cognitive skills and the consequences of differences in the distribution of these skills. Researchers use the data to assess the role of human capital in predicting outcomes and to identify factors that may contribute to the development of more human capital. An invaluable resource for researchers in international comparative education, policy studies, economics, civics education, educational technology, and policy makers.

Decision-Oriented Educational Research considers a form of educational research that is designed to be directly relevant to the current information requirements of those who are shaping educational policy or managing edu cational systems. It was written for those who plan to conduct such research, as well as for policy makers and educational administrators who might have such research conducted for them. The book is divided into three main parts. Part I is background. Chapter 1 describes some of the basic themes that are woven throughout subsequent chapters on decision-oriented research. These themes include the impor tance of taking a systems view of educational research; of understanding the nature of decision and policy processes and how these influence system re search; of integrating research activities into the larger system's processes; of the role of management in the research process; of researchers and managers sharing a sense of educational purposes; and of emphasizing system improvement as a basic goal of research process. Chapter 2 is a discussion of the background of the research activities that form the bases of this book. Our collaboration with the Pittsburgh public school system is described, as are the methods and structure we used to build the case histories of our work with the district. Part II, encompassing chapters 3 through 9, addresses basic generaliza tions about decision-oriented educational research that we have derived from our experiences."

This book presents comprehensive results from case studies of three innovations in mathematics education that have much to offer toward understanding current reforms in this field. Each chapter tells the story of a case in rich detail, with extensi ve documentation, and in the voices of many of the participants-the innovators, the teachers, the students. Similarly, Volume 2 of Bold Ventures pre sents the results from case studies of five innovations in science education. Volume 1 provides a cross-case analysis of all eight innovations. Many U.S. readers certainly will be very familiar with the name of at least if not all of the mathematics innovations discussed in this volume-for one example, the NCTM Standards-and probably with their general substance. Much of the education community's familiarity with these" arises from the pro jects' own dissemination efforts. The research reported in this volume, however, is one of the few detailed studies of these innovations undertaken by researchers outside the projects themselves.

Examining the Examinations looks at the required advanced science and mathematics examinations taken by university-bound students in seven countries. This research focuses on topics covered, types of questions used, and performance expected from students. The book concentrates on comparisons of the examinations, illustrating their similarities and differences with selected questions taken from the actual examinations. The international comparisons presented offer a window on educational laboratories' in seven countries.

This book is about the practice of decision making by school principals and about ways to improve this practice by capitalizing on evaluation dimensions. Much has been written on decision making but surprisingly little on decision making in the school principalship. Much has been also written on evaluation as well as on evaluation and decision making, but not much has been written on evaluation in decision making, especially decision making in the principalship. This book presents two messages. One is that decision making in the principalship can be studied and improved and not only talked about in abstract terms. The other message is that evaluation can contribute to the understanding of decision making in the principalship and to the improvement of its practice. In this book we call for the conception of an evaluation-minded principal, a principal who has a wide perspective on the nature of evaluation and its potential benefits, a principal who is also inclined to use evaluation perceptions and techniques as part of his/her decision-making process. This book was conceived in 1985 with the idea to combine thoughts about educational administration with thoughts about educational evaluation. Studies of decision making in the principalship had already been on their way. We decided to await the findings, and in the meantime we wrote a first conceptual version of evaluation in decision making. As the studies were completed we wrote a first empirical version of same.

This practical, very effective resource helps middle and high school teachers and curriculum leaders develop the skills to design instructional tasks and assessments that engage students in higher-level critical thinking, as recommended by the Common Core State Standards. Real examples of formative and summative assessments from a variety of content areas are included and demonstrate how to successfully increase the level of critical thinking in every classroom! This book is also an excellent resource for higher education faculty to use in undergraduate and graduate courses on assessment and lesson planning.

Developmental Education is an approach to education in school that aims at promoting children's cultural development and their abilities to participate autonomously and well-informed in the cultural practices of their community. From the point of view of Cultural-historical Activity theory (CHAT), a play-based curriculum has been developed over the past decades for primary school, which presents activity contexts for pupils in the classroom that create learning and teaching opportunities for helping pupils with appropriating cultural knowledge, skills, and moral understandings in meaningful ways. The approach is implemented in numerous Dutch primary schools classrooms with the explicit intention to support the learning of both pupils and teachers. The book focuses especially on education of young children (4 - 8 years old) in primary school and presents the underpinning concepts of this approach, and chapters on examples of good practices in a variety of subject matter areas, such as literacy (vocabulary acquisition, reading, writing), mathematics, and arts. Successful implementation of Developmental Education in the classroom strongly depends on dynamic assessment and continuous observations of young pupils' development. Strategies for implementation of both the teaching practices and assessment strategies are discussed in detail in the book.