Test fairness is a moral imperative for both the makers and the users of tests. This book focuses on methods for detecting test items that function differently for different groups of examinees and on using this information to improve tests. Of interest to all testing and measurement specialists, it examines modern techniques used routinely to insure test fairness. Three of these relevant to the book's contents are: * detailed reviews of test items by subject matter experts and members of the major subgroups in society (gender, ethnic, and linguistic) that will be represented in the examinee population * comparisons of the predictive validity of the test done separately for each one of the major subgroups of examinees * extensive statistical analyses of the relative performance of major subgroups of examinees on individual test items.

Test Scoring provides a summary of traditional true score test theory and modern item response theory related to scoring tests, as well as novel developments resulting from the integration of these approaches. The background material introduced in the first four chapters builds a foundation for the new developments covered in later chapters. These new methods offer alternative psychometric approaches to scoring complex assessments. Each of the book's contributors draws from the classic literature of traditional test theory, as well as psychometric developments of the past decade. The emphasis is on large-scale educational measurement but the topics and procedures may be applied broadly within many measurement contexts. Numerous graphs and illustrative examples based on real tests and actual data are integrated throughout. This multi-authored volume shows the reader how to combine the coded outcomes on individual test items into a numerical summary about the examinee's performance. This book is intended for researchers and students in education and other social sciences interested in educational assessment and policy, the design and development of tests, and the procedures for test administration and scoring. Prerequisites include an introduction to educational and psychological measurement and basic statistics. Knowledge of differential and integral calculus and matrix algebra is helpful but not required.

To function in modern society complex data must be absorbed and understood at a breakneck pace. The most efficient way to do this is through data-based graphics. This book is an exploration and celebration of graphical methods of data presentation.
"Visual Revelations'" principal purpose is to enlighten, inform, and amuse the reader regarding the shortcomings of common graphical practices; particularly how they can misinform while simultaneously providing models of wonderful graphics. There are many examples of the best graphic practice, graphs that go beyond conveying, facts, and structure to be able to carry emotion as well.
Aimed at an educated, lay audience, this volume benefits anyone who must either convey or receive quantitative information, including designers, statisticians, and people in the media.

Technological and theoretical changes over the past decade have altered the way we think about test validity. This book addresses the present and future concerns raised by these developments. Topics discussed include: * the validity of computerized testing * the validity of testing for specialized populations (e.g., minorities, the handicapped) and * new analytic tools to study and measure validity

This volume contains a collection of essays and discussions which serve as an introduction and guide to current research in the area of drawing inferences from self-selected samples. This topic is of direct interest to a professional audience of survey researchers, pollsters, market researchers, policymakers, statisticians, demographers, economists, and sociologists. The essays themselves and their associated critical discussions are clear and careful; the contributors are among the foremost experts in the field.

This celebrated primer presents an introduction to all of the key ingredients in understanding computerized adaptive testing technology, test development, statistics, and mental test theory. Based on years of research, this accessible book educates the novice and serves as a compendium of state-of-the-art information for professionals interested in computerized testing in the areas of education, psychology, and other related social sciences. A hypothetical test taken as a prelude to employment is used as a common example throughout to highlight this book's most important features and problems. Changes in the new edition include: *a completely rewritten chapter 2 on the system considerations needed for modern computerized adaptive testing; *a revised chapter 4 to include the latest in methodology surrounding online calibration and in the modeling of testlets; and *a new chapter 10 with helpful information on how test items are really selected, usage patterns, how usage patterns influence the number of new items required, and tools for managing item pools.

For disciplines concerned with human well-being, such as medicine, psychology, and law, statistics must be used in accordance with standards for ethical practice. A Statistical Guide for the Ethically Perplexed illustrates the proper use of probabilistic and statistical reasoning in the behavioral, social, and biomedical sciences. Designed to be consulted when learning formal statistical techniques, the text describes common instances of both correct and false statistical and probabilistic reasoning.

Lauded for their contributions to statistics, psychology, and psychometrics, the authors make statistical methods relevant to readers day-to-day lives by including real historical situations that demonstrate the role of statistics in reasoning and decision making. The historical vignettes encompass the English case of Sally Clark, breast cancer screening, risk and gambling, the Federal Rules of Evidence, "high-stakes" testing, regulatory issues in medicine, difficulties with observational studies, ethics in human experiments, health statistics, and much more. In addition to these topics, seven U.S. Supreme Court decisions reflect the influence of statistical and psychometric reasoning and interpretation/misinterpretation.

Exploring the intersection of ethics and statistics, this comprehensive guide assists readers in becoming critical and ethical consumers and producers of statistical reasoning and analyses. It will help them reason correctly and use statistics in an ethical manner. "

"Test Scoring" provides a summary of traditional true score test theory and modern item response theory related to scoring tests, as well as novel developments resulting from the integration of these approaches. The background material introduced in the first four chapters builds a foundation for the new developments covered in later chapters. These new methods offer alternative psychometric approaches to scoring complex assessments.
Each of the book's contributors draws from the classic literature of traditional test theory, as well as psychometric developments of the past decade. The emphasis is on large-scale educational measurement but the topics and procedures may be applied broadly within many measurement contexts.
Numerous graphs and illustrative examples based on real tests and actual data are integrated throughout. This multi-authored volume shows the reader how to combine the coded outcomes on individual test items into a numerical summary about the examinee's performance.
This book is intended for researchers and students in education and other social sciences interested in educational assessment and policy, the design and development of tests, and the procedures for test administration and scoring. Prerequisites include an introduction to educational and psychological measurement and basic statistics. Knowledge of differential and integral calculus and matrix algebra is helpful but not required.

This volume contains a collection of essays and discussions which serve as an introduction and guide to current research in the area of drawing inferences from self-selected samples. This topic is of direct interest to a professional audience of survey researchers, pollsters, market researchers, policymakers, statisticians, demographers, economists, and sociologists. The essays themselves and their associated critical discussions are clear and careful; the contributors are among the foremost experts in the field.

For disciplines concerned with human well-being, such as medicine, psychology, and law, statistics must be used in accordance with standards for ethical practice. A Statistical Guide for the Ethically Perplexed illustrates the proper use of probabilistic and statistical reasoning in the behavioral, social, and biomedical sciences. Designed to be consulted when learning formal statistical techniques, the text describes common instances of both correct and false statistical and probabilistic reasoning. Lauded for their contributions to statistics, psychology, and psychometrics, the authors make statistical methods relevant to readers day-to-day lives by including real historical situations that demonstrate the role of statistics in reasoning and decision making. The historical vignettes encompass the English case of Sally Clark, breast cancer screening, risk and gambling, the Federal Rules of Evidence, "high-stakes" testing, regulatory issues in medicine, difficulties with observational studies, ethics in human experiments, health statistics, and much more. In addition to these topics, seven U.S. Supreme Court decisions reflect the influence of statistical and psychometric reasoning and interpretation/misinterpretation. Exploring the intersection of ethics and statistics, this comprehensive guide assists readers in becoming critical and ethical consumers and producers of statistical reasoning and analyses. It will help them reason correctly and use statistics in an ethical manner.

Test fairness is a moral imperative for both the makers and the users of tests. This book focuses on methods for detecting test items that function differently for different groups of examinees and on using this information to improve tests. Of interest to all testing and measurement specialists, it examines modern techniques used routinely to insure test fairness. Three of these relevant to the book's contents are:
* detailed reviews of test items by subject matter experts and members of the major subgroups in society (gender, ethnic, and linguistic) that will be represented in the examinee population
* comparisons of the predictive validity of the test done separately for each one of the major subgroups of examinees
* extensive statistical analyses of the relative performance of major subgroups of examinees on individual test items.

To function in modern society complex data must be absorbed and understood at a breakneck pace. The most efficient way to do this is through data-based graphics. This book is an exploration and celebration of graphical methods of data presentation. Visual Revelations' principal purpose is to enlighten, inform, and amuse the reader regarding the shortcomings of common graphical practices; particularly how they can misinform while simultaneously providing models of wonderful graphics. There are many examples of the best graphic practice, graphs that go beyond conveying, facts, and structure to be able to carry emotion as well. Aimed at an educated, lay audience, this volume benefits anyone who must either convey or receive quantitative information, including designers, statisticians, and people in the media.

A comprehensive history of data visualization—its origins, rise, and effects on the ways we think about and solve problems. With complex information everywhere, graphics have become indispensable to our daily lives. Navigation apps show real-time, interactive traffic data. A color-coded map of exit polls details election balloting down to the county level. Charts communicate stock market trends, government spending, and the dangers of epidemics. A History of Data Visualization and Graphic Communication tells the story of how graphics left the exclusive confines of scientific research and became ubiquitous. As data visualization spread, it changed the way we think. Michael Friendly and Howard Wainer take us back to the beginnings of graphic communication in the mid-seventeenth century, when the Dutch cartographer Michael Florent van Langren created the first chart of statistical data, which showed estimates of the distance from Rome to Toledo. By 1786 William Playfair had invented the line graph and bar chart to explain trade imports and exports. In the nineteenth century, the “golden age” of data display, graphics found new uses in tracking disease outbreaks and understanding social issues. Friendly and Wainer make the case that the explosion in graphical communication both reinforced and was advanced by a cognitive revolution: visual thinking. Across disciplines, people realized that information could be conveyed more effectively by visual displays than by words or tables of numbers. Through stories and illustrations, A History of Data Visualization and Graphic Communication details the 400-year evolution of an intellectual framework that has become essential to both science and society at large.

During the course of the rhetoric surrounding the 1984 Presidential election campaign in the United States there were a variety of statements made that gave me pause. For example, I heard candidate Ferraro explain her poor showing in pre.election polls by saying. " I don't believe those polls. If you could see the enthusiasm for our candidacy 'out there' you wouldn't believe them either. " Obviously, trying to estimate one's popularity in the entire voting population from the enthusiasm of your supporters at political rallies is not likely to yield accurate results. I suspect that trying to statistically adjust the " rally estimate" through the use of the demographic characteris. tics of those who attend would not have belped enough to be usefuL A modest survey on a more randomly chosen sample would surely have been better. At about the same time, Secretary of Education Terrell Bell released a table entitled State Education Statistics. Among other bits of information, it contained the mean scores on the Scholastic Aptitude Test (the SAT) for 22 of the states. The College Board had previously released these mean scores for all states. At this point the mass media began carrying reports inter preting the differences. The Reagan White House pointed out that spending more money on education was not the way to improve educational outcomes. To support this they pointed to the mean SAT scores of Connecticut and New Hampshire. New Hampshire had modestly higher SAT scores but lower . . per pupil expenditure."

This extraordinary book provides a journey through the jungle of good and bad graphical devices used to illustrate and obfuscate data. The diversity of examples is tremendous: ranging from Napoleon's retreat from Moscow to the O-rings on the space shuttle and from mortalities in hospitals to the schedules of buses. The author's aim is to illustrate how effectively a well-chosen graphic can reveal in an instant the essential truth behind some data whilst a poorly designed representation can conceal an awful truth. As well as providing numerous examples of both, the author includes plenty of helpful ideas to make us all better producers and consumers of graphics.

In his entertaining and informative book "Graphic Discovery," Howard Wainer unlocked the power of graphical display to make complex problems clear. Now he's back with "Picturing the Uncertain World," a book that explores how graphs can serve as maps to guide us when the information we have is ambiguous or incomplete. Using a visually diverse sampling of graphical display, from heartrending autobiographical displays of genocide in the Kovno ghetto to the "Pie Chart of Mystery" in a "New Yorker" cartoon, Wainer illustrates the many ways graphs can be used--and misused--as we try to make sense of an uncertain world.

"Picturing the Uncertain World" takes readers on an extraordinary graphical adventure, revealing how the visual communication of data offers answers to vexing questions yet also highlights the measure of uncertainty in almost everything we do. Are cancer rates higher or lower in rural communities? How can you know how much money to sock away for retirement when you don't know when you'll die? And where exactly did nineteenth-century novelists get their ideas? These are some of the fascinating questions Wainer invites readers to consider. Along the way he traces the origins and development of graphical display, from William Playfair, who pioneered the use of graphs in the eighteenth century, to instances today where the public has been misled through poorly designed graphs.

We live in a world full of uncertainty, yet it is within our grasp to take its measure. Read "Picturing the Uncertain World" and learn how.

"Uneducated Guesses" challenges everything our policymakers thought they knew about education and education reform, from how to close the achievement gap in public schools to admission standards for top universities. In this explosive book, Howard Wainer uses statistical evidence to show why some of the most widely held beliefs in education today--and the policies that have resulted--are wrong. He shows why colleges that make the SAT optional for applicants end up with underperforming students and inflated national rankings, and why the push to substitute achievement tests for aptitude tests makes no sense. Wainer challenges the thinking behind the enormous rise of advanced placement courses in high schools, and demonstrates why assessing teachers based on how well their students perform on tests--a central pillar of recent education reforms--is woefully misguided. He explains why college rankings are often lacking in hard evidence, why essay questions on tests disadvantage women, why the most grievous errors in education testing are not made by testing organizations--and much more.

No one concerned about seeing our children achieve their full potential can afford to ignore this book. With forceful storytelling, wry insight, and a wealth of real-world examples, "Uneducated Guesses" exposes today's educational policies to the light of empirical evidence, and offers solutions for fairer and more viable future policies.

"The use of charts and graphs to make numbers both intelligible and memorable is a surprisingly modern idea. How this idea grew from a curiosity into a basic tool of modern science is a story of remarkable men and curious paradoxes, a story that Howard Wainer tells with zest and sympathetic understanding. Informative, readable, profoundly engaging."--George A. Miller, Princeton University, author of "The Magical Number Seven, Plus or Minus Two"

"I liked this book very much indeed. It will be very useful to the many who are interested in the interplay of forces that have yielded modern science."--Eric T. Bradlow, Wharton School of the University of Pennsylvania

"Fascinating. This book . . . the first to explore the chronological development of graphical data display . . . should be required reading for statisticians, applied researchers, scientists, and certainly for all journalists."--I. Elaine Allen, Babson College

"A delightful and thought-provoking book on statistical graphics. Wainer provides compact case studies of how graphical presentations such as bar charts, plots, and scattergrams can lead to important discoveries. The most compelling examples show how a published graphic could be dramatically improved to avoid misleading interpretations or make new discoveries. The most entertaining parts are his vignettes of historical figures, such as his twin heroes of William Playfair and John Tukey. I enjoyed Wainer's sardonic wit, personal anecdotes, and popular culture references, but the real gift was the clarity of thinking and the wise guidance about deep issues in statistics, data mining, and information visualization."--Ben Shneiderman, College Park, MD

The measurement models employed to score tests have been evolving over the past century from those that focus on the entire test (true score theory) to models that focus on individual test items (item response theory) to models that use small groups of items (testlets) as the fungible unit from which tests are constructed and scored (testlet response theory, or TRT). In this book, the inventors of TRT trace the history of this evolution and explain the character of modern TRT. Written for researchers and professionals in statistics, psychometrics, and educational psychology, the first part offers an accessible introduction to TRT and its applications. The second part presents a comprehensive, self-contained discussion of the model couched within a fully Bayesian framework. Its parameters are estimated using Markov chain Monte Carlo procedures, and the resulting posterior distributions of the parameter estimates yield insights into score stability that were previously unsuspected.

This celebrated primer presents an introduction to all of the key ingredients in understanding computerized adaptive testing technology, test development, statistics, and mental test theory. Based on years of research, this accessible book educates the novice and serves as a compendium of state-of-the-art information for professionals interested in computerized testing in the areas of education, psychology, and other related social sciences. A hypothetical test taken as a prelude to employment is used as a common example throughout to highlight this book's most important features and problems.
Changes in the new edition include:
*a completely rewritten chapter 2 on the system considerations needed for modern computerized adaptive testing;
*a revised chapter 4 to include the latest in methodology surrounding online calibration and in the modeling of testlets; and
*a new chapter 10 with helpful information on how test items are really selected, usage patterns, how usage patterns influence the number of new items required, and tools for managing item pools.