This book analyzes the multimodal verbal and nonverbal behavior of humans in both an artificial game, based on the well-known Mafia and Resistance games, as well as selected other settings. This book develops statistical results linking different types of facial expressions (e.g. smile, pursed lips, raised eyebrows), vocal features (e.g., pitch, loudness) and linguistic features (e.g., dominant language, turn length) with both unary behaviors (e.g. is person X lying?) to binary behaviors (Is person X dominant compared to person Y? Does X trust Y? Does X like Y?). In addition, this book describes machine learning and computer vision-based algorithms that can be used to predict deception, as well as the visual focus of attention of people during discussions that can be linked to many binary behaviors. It is written by a multidisciplinary team of both social scientists and computer scientists. Meetings are at the very heart of human activity. Whether you are involved in a business meeting or in a diplomatic negotiation, such an event has multiple actors, some cooperative and some adversarial. Some actors may be deceptive, others may have complex relationships with others in the group. This book consists of a set of 11 chapters that describe the factors that link human behavior in group settings and attitudes to facial and voice characteristics. Researchers working in social sciences (communication, psychology, cognitive science) with an interest in studying the link between human interpersonal behavior and facial/speech/linguistic characteristics will be interested in this book. Computer scientists, who are interested in developing machine learning and deep learning based models of human behavior in group settings will also be interested in purchasing this book.

--Core textbook featuring accessible but advanced coverage of theory, research, and applications in nonverbal communication from renowned scholars --Usable for undergraduate and graduate courses in communication and psychology departments --Includes a new chapter on identity and impression management, as well as fully updated research coverage throughout --Online resources include an extensive instructor's manual and test bank

Discovering hidden recurring patterns in observable behavioral processes is an important issue frequently faced by numerous advanced students and researchers across many research areas, including psychology, biology, sports, robotics, media, finance, and medicine. As generally, themany powerful methods included in statistical software packages were not developed for this kind of analysis, discovering such patterns has proven a particularly difficult task, due to a lack of a) adequate formalized models of the kinds of patterns to look for, b) corresponding detection algorithms and c) their implementation in available software. The research described in this book is based on the application of such pattern types, algorithms and software developed from the late seventies to the present in the context of research in collaboration with human and animal behavioral research teams at internationally leading universities in the US and Europe, thus testing the usefulness and validity of the pattern types, algorithms and software in numerous research areas. With the (scale independent statistical hierarchical and fractal-like) T-Pattern at its heart, a set of proposed pattern types, called the T-System, forms the basis for the search algorithms implemented as the software THEME (TM) (vs. 6), which is easily available in free educational and full commercial versions.

--Core textbook featuring accessible but advanced coverage of theory, research, and applications in nonverbal communication from renowned scholars --Usable for undergraduate and graduate courses in communication and psychology departments --Includes a new chapter on identity and impression management, as well as fully updated research coverage throughout --Online resources include an extensive instructor's manual and test bank

When people communicate, they often adapt their interaction styles to one another. For example, they may match each other's behavior, synchronize the timing of behavior, or behave in dissimilar ways. This volume analyzes these dyadic interaction patterns and builds a case for a new theory of adaptation: Interaction Adaptation Theory (IAT), which draws the soundest principles from previous theories while being responsive to current empirical evidence. The book concludes with the offer of new research directions that would test the theory in order to bring the research full circle and connect interaction patterns with outcomes. This volume will serve as both a reference guide for researchers and a text for students and faculty in communication, psychology, family studies, counseling, and sociolinguistics.

This book analyzes the multimodal verbal and nonverbal behavior of humans in both an artificial game, based on the well-known Mafia and Resistance games, as well as selected other settings. This book develops statistical results linking different types of facial expressions (e.g. smile, pursed lips, raised eyebrows), vocal features (e.g., pitch, loudness) and linguistic features (e.g., dominant language, turn length) with both unary behaviors (e.g. is person X lying?) to binary behaviors (Is person X dominant compared to person Y? Does X trust Y? Does X like Y?). In addition, this book describes machine learning and computer vision-based algorithms that can be used to predict deception, as well as the visual focus of attention of people during discussions that can be linked to many binary behaviors. It is written by a multidisciplinary team of both social scientists and computer scientists. Meetings are at the very heart of human activity. Whether you are involved in a business meeting or in a diplomatic negotiation, such an event has multiple actors, some cooperative and some adversarial. Some actors may be deceptive, others may have complex relationships with others in the group. This book consists of a set of 11 chapters that describe the factors that link human behavior in group settings and attitudes to facial and voice characteristics. Researchers working in social sciences (communication, psychology, cognitive science) with an interest in studying the link between human interpersonal behavior and facial/speech/linguistic characteristics will be interested in this book. Computer scientists, who are interested in developing machine learning and deep learning based models of human behavior in group settings will also be interested in purchasing this book.

Discovering hidden recurring patterns in observable behavioral processes is an important issue frequently faced by numerous advanced students and researchers across many research areas, including psychology, biology, sports, robotics, media, finance, and medicine. As generally, themany powerful methods included in statistical software packages were not developed for this kind of analysis, discovering such patterns has proven a particularly difficult task, due to a lack of a) adequate formalized models of the kinds of patterns to look for, b) corresponding detection algorithms and c) their implementation in available software. The research described in this book is based on the application of such pattern types, algorithms and software developed from the late seventies to the present in the context of research in collaboration with human and animal behavioral research teams at internationally leading universities in the US and Europe, thus testing the usefulness and validity of the pattern types, algorithms and software in numerous research areas. With the (scale independent statistical hierarchical and fractal-like) T-Pattern at its heart, a set of proposed pattern types, called the T-System, forms the basis for the search algorithms implemented as the software THEME (TM) (vs. 6), which is easily available in free educational and full commercial versions.

Social Signal Processing is the first book to cover all aspects of the modeling, automated detection, analysis, and synthesis of nonverbal behavior in human-human and human-machine interactions. Authoritative surveys address conceptual foundations, machine analysis and synthesis of social signal processing, and applications. Foundational topics include affect perception and interpersonal coordination in communication; later chapters cover technologies for automatic detection and understanding such as computational paralinguistics and facial expression analysis and for the generation of artificial social signals such as social robots and artificial agents. The final section covers a broad spectrum of applications based on social signal processing in healthcare, deception detection, and digital cities, including detection of developmental diseases and analysis of small groups. Each chapter offers a basic introduction to its topic, accessible to students and other newcomers, and then outlines challenges and future perspectives for the benefit of experienced researchers and practitioners in the field.

When people communicate, they often adapt their interaction styles to one another. For example, they may match each other's behavior, synchronize the timing of behavior, or behave in opposite ways. This volume analyzes these dyadic interaction patterns and builds a case for a new theory of adaptation. Interaction Adaptation Theory draws the soundest principles from previous theories while being responsive to current empirical evidence. To develop this theory the authors summarize a broad range of theories that seek to predict and explain adaptation patterns such as synchrony, mirroring, matching, reciprocity, compensation, convergence, and divergence. This volume will serve as both a reference guide for researchers and a text for students and faculty in communication, psychology, family studies, counseling, and sociolinguistics.