This book analyses accountability and quality policies relating to learning standards and examines their implications for assessment in higher education. Whilst primarily focusing on the Australian setting, this analysis is located within a broader frame of reference that includes the United Kingdom (UK), the United States of America (US), and the Organisation for Economic Cooperation and Development (OECD). Across these settings, comparative measures of learning have been seen as a policy 'solution' to the problem of 'proving quality' in a globalised and increasingly competitive higher education market. Comparative measures of learning depend on the specification of learning standards. Learning standards attempt to articulate the capabilities expected of graduates, and students' achievement of these is determined through the practices of assessment carried out within institutions. Quality policy, learning standards and assessment practices all intersect within the broader umbrella of accountability, with relevance to governments, higher education providers, employers, parents, and students. The findings reported in this book highlight a number of policy influences, including the rising demands for national and international comparative data on learning standards to compare quality and inform student choice in a globally competitive market.

This book provides a comprehensive and engaging analysis of the purpose and function of student evaluation in higher education. It explores its foundations and the emerging functions, as well as its future potential to improve the quality of university teaching and student learning. The book systematically assesses the core assumptions underpinning the design of student evaluation models as a tool to improve the quality of teaching. It also analyses the emerging influence of student opinion as a key metric and a powerful proxy for assuring the quality of teachers, teaching and courses in universities. Using the voices of teachers in the day-to-day practices of higher education, the book also explores the actual perceptions held by academics about student evaluation. It offers the first real attempt to critically analyse the developing influence of student evaluation on contemporary approaches to academic teaching. Using a practice-based perspective and the powerful explanatory potential of cultural historical activity theory (CHAT), the implications of the changing focus in the use of the student voice - from development to measurement - are systematically explored and assessed. Importantly, using the evidence provided by a unique series of practice-based case studies, the book also offers powerful new insights into how the student voice can be reconceptualised to more effectively improve the quality of teaching, curriculum and assessment. Based on this empirical analysis, a series of practical strategies are proposed to enhance the work of student evaluation in the future university to drive pedagogical innovation. This unique volume provides those interested in student evaluation with a more complex understanding of the development, contemporary function and future potential of the student voice. It also demonstrates how the student voice - in combination with professional dialogue - can be used to encourage more powerful and substantial forms of pedagogical improvement and academic development in higher education environments.

This volume provides an informed review of the accomplishments of the Washington Group on Disability Statistics (WG) in the provision of international data and statistics on disability. It does so within the context of the UN Convention on the Rights of Persons with Disabilities. The volume includes a description of the development and testing of a short set of questions for Censuses, now used in approximately 29 countries and recommended in the U.N.'s Principles and Recommendations for Population and Housing Censuses: The 2020 Round, which includes disability as a core topic to be collected in censuses. It discusses the experiences of several countries on the use of the WG questions and how this has impacted on national agendas in the area of disability. It follows the development and testing of an extended set of questions for use in national surveys other than censuses and examines the challenges of translation and the importance of generating comparable question sets in different languages and within different cultures. It studies the examination of cognitive testing techniques in a variety of countries, and presents the results of the first round of censuses in 2010 in countries using the six question set. The volume includes discussions of the new development of question modules on a broad range of child disability and functioning, and the environmental contexts of participation that are part of the current work of the WG. In addition, it contains a reflection on the use of the WG's functionality approach to identifying disabilities by humanitarian agencies to identify disabilities in populations of displaced persons. A thoughtful conclusion addresses what the development of cross-nationally comparable data can mean for the improvement of circumstances for all persons with disabilities.

These conference proceedings focus on "Assessment for Learning: Within and Beyond the Classroom" in recognition of the power of assessment for learning as a way of boosting student performance. They explore the breadth, depth and quality of the best models and practices, strategies, lessons learnt and discuss cases of successful implementation of assessment within the classroom and beyond, including the virtual space. They also provide fertile ground for stimulating and comparing responsive assessment approaches and practices in relatively new areas of assessment such as graduate capability assessment in view of the need for educational institutions to evidence graduate employability.

The goal of this guide and manual is to provide a practical and brief overview of the theory on computerized adaptive testing (CAT) and multistage testing (MST) and to illustrate the methodologies and applications using R open source language and several data examples. Implementation relies on the R packages catR and mstR that have been already or are being developed by the first author (with the team) and that include some of the newest research algorithms on the topic. The book covers many topics along with the R-code: the basics of R, theoretical overview of CAT and MST, CAT designs, CAT assembly methodologies, CAT simulations, catR package, CAT applications, MST designs, IRT-based MST methodologies, tree-based MST methodologies, mstR package, and MST applications. CAT has been used in many large-scale assessments over recent decades, and MST has become very popular in recent years. R open source language also has become one of the most useful tools for applications in almost all fields, including business and education. Though very useful and popular, R is a difficult language to learn, with a steep learning curve. Given the obvious need for but with the complex implementation of CAT and MST, it is very difficult for users to simulate or implement CAT and MST. Until this manual, there has been no book for users to design and use CAT and MST easily and without expense; i.e., by using the free R software. All examples and illustrations are generated using predefined scripts in R language, available for free download from the book's website.

This book provides an overview and discussion of the evidence base of effective school inspections; reflecting on issues of validity and reliability of school inspections in relation to school effectiveness research, unintended consequences and emergent roles and responsibilities of Inspectorates of Education. Chapters include findings from systematic literature reviews and primary research while also presenting a range of practical examples from inspections systems from all over the world. The book provides relevant background materials for Inspectorates of Education who aim to improve the effectiveness of their systems and working methods, as well as clear examples for researchers aiming to analyse and understand the effectiveness of these systems. The final chapter reflects on changes in the current education landscape and discusses newer models of school inspections that fit within a more decentralized inspection system.

This book examines the challenges of cross-professional comparisons and proposes new forms of performance assessment to be used in professions education. It addresses how complex issues are learned and assessed across and within different disciplines and professions in order to move the process of "performance assessment for learning" to the next level. In order to be better equipped to cope with increasing complexity, change and diversity in professional education and performance assessment, administrators and educators will engage in crucial systems thinking. The main question discussed by the book is how the required competence in the performance of students can be assessed during their professional education at both undergraduate and graduate levels. To answer this question, the book identifies unresolved issues and clarifies conceptual elements for performance assessment. It reviews the development of constructs that cross disciplines and professions such as critical thinking, clinical reasoning, and problem solving. It discusses what it means to instruct and assess students within their own domain of study and across various roles in multiple contexts, but also what it means to instruct and assess students across domains of study in order to judge integration and transfer of learning outcomes. Finally, the book examines what it takes for administrators and educators to develop competence in assessment, such as reliably judging student work in relation to criteria from multiple sources. "... the co-editors of this volume, Marcia Mentkowski and Paul F. Wimmers, are associated with two institutions whose characters are so intimately associated with the insight that assessment must be integrated with curriculum and instructional program if it is to become a powerful influence on the educational process ..." Lee Shulman, Stanford University

This book examines the mathematics achievement of immigrant students on the basis of data from the IEA Trends in International Mathematics and Science Study (TIMSS). It combines an analysis of large-scale assessment data with an in-depth exploration of policy studies and transforms the insights gained into recommendations on how to promote better education for students with an immigrant background. In a world defined by globalization, education systems face the challenge of providing high-quality education for an increasing number of immigrant students. This book addresses topical questions, such as the circumstances and policies that promote good education, and why some countries are more successful than others in catering for the needs of this very diverse group of students. It provides details on the differences between immigrants and non-immigrants in education, includes case studies on policies of two "successful" countries, and gives hints to policy makers for policies that can help improve the situation for immigrant students in schools.

This book analyses and discusses the recent developments for assessing research quality in the humanities and related fields in the social sciences. Research assessments in the humanities are highly controversial and the evaluation of humanities research is delicate. While citation-based research performance indicators are widely used in the natural and life sciences, quantitative measures for research performance meet strong opposition in the humanities. This volume combines the presentation of state-of-the-art projects on research assessments in the humanities by humanities scholars themselves with a description of the evaluation of humanities research in practice presented by research funders. Bibliometric issues concerning humanities research complete the exhaustive analysis of humanities research assessment. The selection of authors is well-balanced between humanities scholars, research funders, and researchers on higher education. Hence, the edited volume succeeds in painting a comprehensive picture of research evaluation in the humanities. This book is valuable to university and science policy makers, university administrators, research evaluators, bibliometricians as well as humanities scholars who seek expert knowledge in research evaluation in the humanities.

The book contains solutions to fundamental problems which arise due to the logic of development of specific branches of science, which are related to pipeline safety, but mainly are subordinate to the needs of pipeline transportation. The book deploys important but not yet solved aspects of reliability and safety assurance of pipeline systems, which are vital aspects not only for the oil and gas industry and, in general, fuel and energy industries , but also to virtually all contemporary industries and technologies. The volume will be useful to specialists and experts in the field of diagnostics/ inspection, monitoring, reliability and safety of critical infrastructures. First and foremost, it will be useful to the decision making persons -operators of different types of pipelines, pipeline diagnostics/inspection vendors, and designers of in-line -inspection (ILI) tools, industrial and ecological safety specialists, as well as to researchers and graduate students.

This book discusses Hong Kong's use of onscreen marking (OSM) in public examinations. Given that Hong Kong leads the way in OSM innovation, this book has arisen from a recognised need to provide a comprehensive, coherent account of the findings of various separate but linked validation studies of onscreen public examinations in Hong Kong. The authors discuss their experience of the validation process, demonstrating how high-stakes innovation should be fully validated by a series of research studies in order to satisfy key stakeholders.

This graduate-level textbook is a tutorial for item response theory that covers both the basics of item response theory and the use of R for preparing graphical presentation in writings about the theory. Item response theory has become one of the most powerful tools used in test construction, yet one of the barriers to learning and applying it is the considerable amount of sophisticated computational effort required to illustrate even the simplest concepts. This text provides the reader access to the basic concepts of item response theory freed of the tedious underlying calculations. It is intended for those who possess limited knowledge of educational measurement and psychometrics. Rather than presenting the full scope of item response theory, this textbook is concise and practical and presents basic concepts without becoming enmeshed in underlying mathematical and computational complexities. Clearly written text and succinct R code allow anyone familiar with statistical concepts to explore and apply item response theory in a practical way. In addition to students of educational measurement, this text will be valuable to measurement specialists working in testing programs at any level and who need an understanding of item response theory in order to evaluate its potential in their settings.

This book capitalizes on the developments in dynamical systems and education by presenting some of the most recent advances in this area in seventeen non-overlapping chapters. The first half of the book discusses the conceptual framework of complex dynamical systems and its applicability to educational processes. The second half presents a set of empirical studies that that illustrate the use of various research methodologies to investigate complex dynamical processes in education, and help the reader appreciate what we learn about dynamical processes in education from using these approaches.

This book presents an in-depth study of assessment innovation and its impact on teaching and learning. The context is New Zealand, and the focus is additional languages other than English and the recent introduction of a radical new assessment of students' spoken proficiency, called interact. The book crosses the traditional theoretical and methodological boundaries associated with language testing research, which focuses on assessment performance, and presents an alternative approach where stakeholders become the centre of interest. It advances our understanding of how assessment innovation impacts on two key groups - teachers and students in schools - based on data collected from a substantial two-year research project. It presents an account of these stakeholders' perceptions of the validity and usefulness of the new assessment in comparison with the more traditional test that it has replaced.Assessing Foreign Language Students' Spoken Proficiency makes an outstanding and original contribution to the field of second and foreign language teaching, providing a theory and research-based account of the development of a learner-centred approach to oral proficiency assessment. It is an important resource for teachers and teacher educators as well as assessment and curriculum specialists worldwide. It deserves to be widely read.

This book serves as an up-to-date Rorschach primer and elaborates on the various applications of Rorschach assessment for adolescents with respect to differential diagnosis, forensic consultation, and therapeutic assessment. It opens with three chapters that provide readers with a basic overview and introduction to the topics integrated throughout the text. The first reviews the development and foundations of the Rorschach Inkblot Method; the second discusses key issues in the assessment of adolescents, with particular attention to differentiating patterns of psychopathology from normal developmental variations; and the third presents general considerations in using performance-based assessment instruments in the assessment of personality functioning in adolescence. Later chapters explore the current status of the Rorschach Inkblot Method with respect to theoretical formulations, research findings, and practice guidelines. The final chapter draws on information in the preceding chapters to present a model for Rorschach assessment of adolescents. This model is designed to facilitate accurate and useful formulations of personality functioning that contribute substantially to advancing responsible adolescent development.

Pitfalls of Scholarship offers an array of reflections on higher education, its entanglements with humanity's pursuit of natural and social knowledge, and the impact national environments have upon it. This book considers the humanities, vocational, and scientific/technological sides of the university from the vantage-point of an Islamic studies scholar in twenty-first century American academia. Four discussions and a personal note make up the parts of these pages. The first discussion sets the stage with a description of the irregularities of our age of late modernity and the limits of scholarship in it. The second focuses on clashes of personal and academic knowledge with social assumptions and convictions. Guiding the discussion is an unlikely narrative from an old era where academic freedom did not exist. The third discussion points to the surprisingly negative impacts of obsession with research methods in the modern academy. "Scholarships of negation" are identified as the main illness of the age, next to popular exaggerations of the value of standard assumptions and excellent academic institutions. The fourth and final section deals with modern education's aspiration toward acquiring democratic quality, and the implications of further democratization of education.

This book is a valuable read for a diverse group of researchers and practitioners who analyze assessment data and construct test instruments. It focuses on the use of classical test theory (CTT) and item response theory (IRT), which are often required in the fields of psychology (e.g. for measuring psychological traits), health (e.g. for measuring the severity of disorders), and education (e.g. for measuring student performance), and makes these analytical tools accessible to a broader audience. Having taught assessment subjects to students from diverse backgrounds for a number of years, the three authors have a wealth of experience in presenting educational measurement topics, in-depth concepts and applications in an accessible format. As such, the book addresses the needs of readers who use CTT and IRT in their work but do not necessarily have an extensive mathematical background. The book also sheds light on common misconceptions in applying measurement models, and presents an integrated approach to different measurement methods, such as contrasting CTT with IRT and multidimensional IRT models with unidimensional IRT models. Wherever possible, comparisons between models are explicitly made. In addition, the book discusses concepts for test equating and differential item functioning, as well as Bayesian IRT models and plausible values using simple examples. This book can serve as a textbook for introductory courses on educational measurement, as supplementary reading for advanced courses, or as a valuable reference guide for researchers interested in analyzing student assessment data.

Develop the knowledge and skills needed for successful formative assessment Formative assessment is a process used by teachers and students to keep learning moving forward. In the 10 years since the first edition of Formative Assessment was published, the practice has become a mainstay in classrooms, but that does not mean that it is easy. Education expert Margaret Heritage walks readers through every step of implementation and offers numerous examples that illustrate formative assessment practices across a range of subjects and grade levels. She explains how to articulate learning progressions, goals, and success criteria; select assessment strategies and provide quality feedback; engage students in self-assessment and self-management; and create an environment that values feedback as part of the learning process. Based on the latest research, this second edition addresses: College and career readiness standards, Common Core State Standards, and Next Generation Science Standards Equity and individual learning needs Discipline-based and student-centered formative assessment Social and emotional learning Written for teachers and those who support them, this book will help all educators develop the skills necessary to get students on the path to success.

This Springer Brief provides theory, practical guidance, and support tools to help designers create complex, valid assessment tasks for hard-to-measure, yet crucial, science education standards. Understanding, exploring, and interacting with the world through models characterizes science in all its branches and at all levels of education. Model-based reasoning is central to science education and thus science assessment. Current interest in developing and using models has increased with the release of the Next Generation Science Standards, which identified this as one of the eight practices of science and engineering. However, the interactive, complex, and often technology-based tasks that are needed to assess model-based reasoning in its fullest forms are difficult to develop. Building on research in assessment, science education, and learning science, this Brief describes a suite of design patterns that can help assessment designers, researchers, and teachers create tasks for assessing aspects of model-based reasoning: Model Formation, Model Use, Model Elaboration, Model Articulation, Model Evaluation, Model Revision, and Model-Based Inquiry. Each design pattern lays out considerations concerning targeted knowledge and ways of capturing and evaluating students' work. These design patterns are available at http://design-drk.padi.sri.com/padi/do/NodeAction?state=listNodes&NODE_TYPE=PARADIGM_TYPE. The ideas are illustrated with examples from existing assessments and the research literature.

Given the academic benefits of assessment-driven teaching, and the growing accountability context of educational systems around the world, there is a rapidly developing need to educate teachers in effectively using assessments to promote, monitor, and report on student learning. However, assessment has historically been a neglected area in teacher education programmes, and empirical research has consistently shown assessment as an area of challenge for many teachers. While there is an increased focus across teacher education and professional literature on enhancing the assessment capacity of educators, there remains little empirical research on innovative and data-based strategies to effectively achieve this goal. The purpose of this text is to consolidate existing research on assessment education and to provoke innovative and effective approaches to educating teachers and teachers-in-training about assessment. Given the dearth of relevant research, this text also considers the matter of retention and extension of initial assessment learning into teaching careers. Combined, the articles in this text provide a foundation for novel thinking about developing teachers' assessment capacity from pre-service to in-service contexts. This book was originally published as a special issue of Assessment in Education.

A key skill to be mastered by graduates today is the ability to assess the quality of their own work, and the work of others. This book demonstrates how the higher education system might move away from a culture of unhelpful grades and rigid marking schemes, to focus instead on forms of feedback and assessment that develop the critical skills of its students. Tracing the historical and sociocultural development of evaluative judgement, and bringing together evidence and practice design from a range of disciplines, this book demystifies the concept of evaluative judgement and shows how it might be integrated and encouraged in a range of pedagogical contexts. Contributors develop various understandings of this often poorly understood concept and draw on their experience to showcase a toolbox of strategies including peer learning, self-regulated learning, self-assessment and the use of technologies. A key text for those working with students in the higher education system, Developing Evaluative Judgement in Higher Education will give readers the knowledge and confidence required to promote these much-needed skills when working with individual students and groups.

Provide students a clear view of what success looks like for any process, task, or product. What does success look like for your students? How will they know if they have learned? This essential component of teaching and learning can be difficult to articulate but is vital to achievement for both teachers and students. The Success Criteria Playbook catapults teachers beyond learning intentions to define clearly what success looks like for every student-whether face-to-face or in a remote learning environment. Designed to be used collaboratively in grade-level, subject area teams-or even on your own-the step-by-step playbook expands teacher understanding of how success criteria can be utilized to maximize student learning and better engage learners in monitoring and evaluating their own progress. Each module is designed to support the creation and immediate implementation of high-quality, high impact success criteria and includes: * Templates that allow for guided and independent study for teachers. * Extensive STEM-focused examples from across the K-12 STEM curriculum to guide teacher learning and practice. * Examples of success criteria applied across learning domains and grades, including high school content, skills, practices, dispositions, and understandings. Ensure equity of access to learning and opportunity for all students by designing and employing high-quality, high-impact success criteria that connect learners to a shared understanding of what success looks like for any given learning intention.