This book presents a new basis for the empirical analysis of film. Starting from an established body of work in film theory, the authors show how a close incorporation of the current state of the art in multimodal theory, including accounts of the syntagmatic and paradigmatic axes of organisation, discourse semantics and advanced layout structure, provides a methodology by which concrete details of film sequences drive mechanisms for constructing filmic discourse structures. The book introduces the necessary background, the open questions raised, and the method by which analysis can proceed step-by-step with extensive examples drawn from a broad range of films. The book aims to provide an analytic tool set that will enable the reader to approach the study of film organisation with new levels of detail, probing deeply into the fundamental question of film as to just how it is that films reliably communicate meaning.

The phenomenon of multimodality has, as Jewitt observes, generated interest "across many disciplines...against the backdrop of considerable social change." Contemporary societies are grappling with the social implications of the rapid increase in sophistication and range of multimodal practices, particularly within interactive digital media, so that the study of multimodality also becomes essential within an increasing range of practical domains. As a result of this increasing interest in multimodality, scholars, teachers and practitioners are on the one hand uncovering many different issues arising from its study, such as those of theory and methodology, while also exploring multimodality within an increasing range of domains.

Such an increase and range of interest in multimodality heralds the emergence of a distinct multimodal studies field: as both the mapping of a domain of enquiry, and as the site of the development of theories, descriptions and methodologies specific to and adapted for the study of multimodality. The present volume presents a range of works by an impressive international roster of contributors who both explore issues arising from the study of multimodality and explore the scope of this emerging field within specific domains of multimodal phenomena. Contributors aim to show that each individual work and works in general within multimodal studies represent a dialectic or complementarity between the exploration of issues of general significance to multimodal studies and the exploration of specific domains of multimodality; while characterizing specific works as tending to some degree towards one or other of these main areas of focus. Such a characterization is seen as part of a move towards the identification and thus development of a distinct field of multimodal studies.

The Semiotics of Movement in Space explores how people move through buildings and interact with objects in space. Focusing on visitors to the Museum of Contemporary Art in Sydney, McMurtrie analyses and interprets movement and space relations to highlight new developments and applications of spatial semiotics as he proposes that people's movement options have the potential to transform the meaning of a particular space. He illustrates people's interaction with microcamera footage of people's movement through the museum from a first-person point of view, thereby providing an alternative, complementary perspective on how buildings are actually used. The book offers effective tools for practitioners to analyse people's actual and potential movement patterns to rethink spatial design options from a semiotic perspective. The applicability of the semiotic principles developed in this book is demonstrated by examining movement options in a restaurant and a cafe, with the hope that the principles can be developed and applied to other sites of displays such as shopping centres and transportation hubs. This book should appeal to scholars of visual communication, semiotics, multimodal discourse analysis and visitor studies.

This book is a first attempt to map the broad context of performance studies from a multimodal perspective. It collects original research on traditional performing arts (theatre, dance, opera), live (durational performance) and mediated/recorded performances (films, television shows), as well as performative discursive practices on social media by adopting several theories and methodologies all dealing with the notion of multimodality. As a mostly dynamic and also interactive environment for various text types and genres, the context of performance studies provides many opportunities to produce meaning verbally and non-verbally. All chapters in this book develop frameworks for the analysis of performance-related events and activities and explore empirical case studies in a range of different ages and cultures. A further focus lies on the communicative strategies deployed by different communities of practice, taking into account processes of production, distribution, and consumption of such texts in diverse spatial and temporal contexts.

This accessible introduction to multimodality illuminates the potential of multimodal research for understanding the ways in which people communicate. Readers will become familiar with the key concepts and methods in various domains while learning how to engage critically with the notion of multimodality. The book challenges widely held assumptions about language and presents the practical steps involved in setting up a multimodal study, including: formulating research questions collecting research materials assessing and developing methods of transcription considering the ethical dimensions of multimodal research. A self-study guide is also included, designed as an optional stand-alone resource or as the basis for a short course. With a wide range of examples, clear practical support and a glossary of terms, Introducing Multimodality is an ideal reference for undergraduate and postgraduate students in multimodality, semiotics, applied linguistics and media and communication studies. Online materials, including colour images and more links to relevant resources, are available on the companion website at www.routledge.com/cw/jewitt and the Routledge Language and Communication Portal.

This book develops a new framework for describing the structure of multimodal documents: how language, image, layout and other modes of communication work together to convey meaning. Building on recent research in multimodal analysis, functional linguistics and information design, the book examines the textual, visual, and spatial aspects of page-based multimodal documents and employs an analytical model to describe and interpret their structure using the concepts of semiotic modes, medium and genre. To demonstrate and test this approach, the study performs a systematic, longitudinal analysis of a corpus of multimodal documents within a single genre: an extensively annotated corpus of tourist brochures produced between 1967-2008. The book provides multimodal discourse analysts with methodological tools to draw empirically-based conclusions about multimodal documents, and will be a valuable resource for researchers planning to develop and study multimodal corpora.

This volume presents innovative research on the multimodal dimension of discourse specific to academic settings, with a particular focus on the interaction between the verbal and non-verbal in constructing meaning. Contributions by experienced and emerging researchers provide in-depth analyses in both research and teaching contexts, and consider the ways in which multimodal strategies can be leveraged to enhance the effectiveness of academic communication. Contributors employ both quantitative and qualitative analytical methods, and make use of state-of-the-art software for analyzing multimodal features of discourse. The chapters in the first part of the volume focus on the multimodal features of two key research genres: conference presentations and plenary addresses. In the second part, contributors explore the role of multimodality in the classroom through analyses of both instructors' and students' speech, as well as the use of multimodal materials for more effective learning. The research presented in this volume is particularly relevant within the context of globalized higher education, where participants represent a wide range of linguistic and cultural backgrounds. Multimodal Analysis in Academic Settings contributes to an emerging field of research with importance to an increasing number of academics and practitioners worldwide.

Since the turn of the millennium, there has seen an increase in the inclusion of typography, graphics and illustration in fiction. This book engages with visual and multimodal devices in twenty-first century literature, exploring canonical authors like Mark Z. Danielewski and Jonathan Safran Foer alongside experimental fringe writers such as Steve Tomasula, to uncover an embodied textual aesthetics in the information age. Bringing together multimodality and cognition in an innovative study of how readers engage with challenging literature, this book makes a significant contribution to the debates surrounding multimodal design and multimodal reading. Drawing on cognitive linguistics, cognitive psychology, neuroscience, semiotics, visual perception, visual communication, and multimodal analysis, Gibbons provides a sophisticated set of critical tools for analysing the cognitive impact of multimodal literature.

Since the turn of the millennium, there has seen an increase in the inclusion of typography, graphics and illustration in fiction. This book engages with visual and multimodal devices in twenty-first century literature, exploring canonical authors like Mark Z. Danielewski and Jonathan Safran Foer alongside experimental fringe writers such as Steve Tomasula, to uncover an embodied textual aesthetics in the information age. Bringing together multimodality and cognition in an innovative study of how readers engage with challenging literature, this book makes a significant contribution to the debates surrounding multimodal design and multimodal reading. Drawing on cognitive linguistics, cognitive psychology, neuroscience, semiotics, visual perception, visual communication, and multimodal analysis, Gibbons provides a sophisticated set of critical tools for analysing the cognitive impact of multimodal literature.

This book is a first attempt to map the broad context of performance studies from a multimodal perspective. It collects original research on traditional performing arts (theatre, dance, opera), live (durational performance) and mediated/recorded performances (films, television shows), as well as performative discursive practices on social media by adopting several theories and methodologies all dealing with the notion of multimodality. As a mostly dynamic and also interactive environment for various text types and genres, the context of performance studies provides many opportunities to produce meaning verbally and non-verbally. All chapters in this book develop frameworks for the analysis of performance-related events and activities and explore empirical case studies in a range of different ages and cultures. A further focus lies on the communicative strategies deployed by different communities of practice, taking into account processes of production, distribution, and consumption of such texts in diverse spatial and temporal contexts.

This book develops a new framework for describing the structure of multimodal documents: how language, image, layout and other modes of communication work together to convey meaning. Building on recent research in multimodal analysis, functional linguistics and information design, the book examines the textual, visual, and spatial aspects of page-based multimodal documents and employs an analytical model to describe and interpret their structure using the concepts of semiotic modes, medium and genre. To demonstrate and test this approach, the study performs a systematic, longitudinal analysis of a corpus of multimodal documents within a single genre: an extensively annotated corpus of tourist brochures produced between 1967-2008. The book provides multimodal discourse analysts with methodological tools to draw empirically-based conclusions about multimodal documents, and will be a valuable resource for researchers planning to develop and study multimodal corpora.

The Semiotics of Movement in Space explores how people move through buildings and interact with objects in space. Focusing on visitors to the Museum of Contemporary Art in Sydney, McMurtrie analyses and interprets movement and space relations to highlight new developments and applications of spatial semiotics as he proposes that people's movement options have the potential to transform the meaning of a particular space. He illustrates people's interaction with microcamera footage of people's movement through the museum from a first-person point of view, thereby providing an alternative, complementary perspective on how buildings are actually used. The book offers effective tools for practitioners to analyse people's actual and potential movement patterns to rethink spatial design options from a semiotic perspective. The applicability of the semiotic principles developed in this book is demonstrated by examining movement options in a restaurant and a cafe, with the hope that the principles can be developed and applied to other sites of displays such as shopping centres and transportation hubs. This book should appeal to scholars of visual communication, semiotics, multimodal discourse analysis and visitor studies.

This book presents a new basis for the empirical analysis of film. Starting from an established body of work in film theory, the authors show how a close incorporation of the current state of the art in multimodal theory-including accounts of the syntagmatic and paradigmatic axes of organisation, discourse semantics and advanced 'layout structure'-builds a methodology by which concrete details of film sequences drive mechanisms for constructing filmic discourse structures. The book introduces the necessary background, the open questions raised, and the method by which analysis can proceed step-by-step. Extensive examples are given from a broad range of films. With this new analytic tool set, the reader will approach the study of film organisation with new levels of detail and probe more deeply into the fundamental question of the discipline: just how is it that films reliably communicate meaning?

The phenomenon of multimodality has, as Jewitt observes, generated interest "across many disciplines...against the backdrop of considerable social change." Contemporary societies are grappling with the social implications of the rapid increase in sophistication and range of multimodal practices, particularly within interactive digital media, so that the study of multimodality also becomes essential within an increasing range of practical domains. As a result of this increasing interest in multimodality, scholars, teachers and practitioners are on the one hand uncovering many different issues arising from its study, such as those of theory and methodology, while also exploring multimodality within an increasing range of domains. Such an increase and range of interest in multimodality heralds the emergence of a distinct multimodal studies field: as both the mapping of a domain of enquiry, and as the site of the development of theories, descriptions and methodologies specific to and adapted for the study of multimodality. The present volume presents a range of works by an impressive international roster of contributors who both explore issues arising from the study of multimodality and explore the scope of this emerging field within specific domains of multimodal phenomena. Contributors aim to show that each individual work and works in general within multimodal studies represent a dialectic or complementarity between the exploration of issues of general significance to multimodal studies and the exploration of specific domains of multimodality; while characterizing specific works as tending to some degree towards one or other of these main areas of focus. Such a characterization is seen as part of a move towards the identification and thus development of a distinct field of multimodal studies.

This accessible introduction to multimodality illuminates the potential of multimodal research for understanding the ways in which people communicate. Readers will become familiar with the key concepts and methods in various domains while learning how to engage critically with the notion of multimodality. The book challenges widely held assumptions about language and presents the practical steps involved in setting up a multimodal study, including: formulating research questions collecting research materials assessing and developing methods of transcription considering the ethical dimensions of multimodal research. A self-study guide is also included, designed as an optional stand-alone resource or as the basis for a short course. With a wide range of examples, clear practical support and a glossary of terms, Introducing Multimodality is an ideal reference for undergraduate and postgraduate students in multimodality, semiotics, applied linguistics and media and communication studies. Online materials, including colour images and more links to relevant resources, are available on the companion website at www.routledge.com/cw/jewitt and the Routledge Language and Communication Portal.

This book provides an extended exploration of the multimodal analysis of spatial (three-dimensional) texts of the built environment, culminating in a holistic approach termed Spatial Discourse Analysis (SpDA). Based on existing frameworks of multimodal analysis, this book applies, adapts, and extends these frameworks to spatial texts. The authors argue that choices in spatial design create meanings about what we perceive and how we can or should behave within spatial texts, influence how we feel in and about those spaces, and enable these texts to function as coherent wholes. Importantly, a spatial text, once built, is also a resource which is then used, and an essential aspect of understanding these texts is to consider what users themselves contribute to the meaning potential of these texts. The book takes the metafunctional approach familiar from Systemic-Functional Linguistics (SFL) and foregrounds each metafunction in turn (textual, interpersonal, experiential, and logical), in relation to the detailed analysis of a particular spatial text.

This volume presents innovative research on the multimodal dimension of discourse specific to academic settings, with a particular focus on the interaction between the verbal and non-verbal in constructing meaning. Contributions by experienced and emerging researchers provide in-depth analyses in both research and teaching contexts, and consider the ways in which multimodal strategies can be leveraged to enhance the effectiveness of academic communication. Contributors employ both quantitative and qualitative analytical methods, and make use of state-of-the-art software for analyzing multimodal features of discourse. The chapters in the first part of the volume focus on the multimodal features of two key research genres: conference presentations and plenary addresses. In the second part, contributors explore the role of multimodality in the classroom through analyses of both instructors' and students' speech, as well as the use of multimodal materials for more effective learning. The research presented in this volume is particularly relevant within the context of globalized higher education, where participants represent a wide range of linguistic and cultural backgrounds. Multimodal Analysis in Academic Settings contributes to an emerging field of research with importance to an increasing number of academics and practitioners worldwide.

This book provides an extended exploration of the multimodal analysis of spatial (three-dimensional) texts of the built environment, culminating in a holistic approach termed Spatial Discourse Analysis (SpDA). Based on existing frameworks of multimodal analysis, this book applies, adapts, and extends these frameworks to spatial texts. The authors argue that choices in spatial design create meanings about what we perceive and how we can or should behave within spatial texts, influence how we feel in and about those spaces, and enable these texts to function as coherent wholes. Importantly, a spatial text, once built, is also a resource which is then used, and an essential aspect of understanding these texts is to consider what users themselves contribute to the meaning potential of these texts. The book takes the metafunctional approach familiar from Systemic-Functional Linguistics (SFL) and foregrounds each metafunction in turn (textual, interpersonal, experiential, and logical), in relation to the detailed analysis of a particular spatial text.

This book examines mathematical discourse from the perspective of Michael Halliday's social semiotic theory. In this approach, mathematics is conceptualized as a multisemiotic discourse involving language, visual images and symbolism. The book discusses the evolution of the semiotics of mathematical discourse, and then, proceeds to examine the grammar of mathematical symbolism, the grammar of mathematical visual images, intersemiosis between language, visual images and symbolism and the subsequent ways in which mathematics orders reality. The focus of this investigation is written mathematical texts. The aims of the book are to understand the semantic realm of mathematics and to appreciate the metaphorical expansions and simultaneous limitations of meaning in mathematical discourse. The book is intended for linguists, semioticians, social scientists and those interested in mathematics and science education. In addition, the close study of the multisemiotic mature of mathematics has implications for other studies adopting a social semiotic approach to multimodality.

Multimodal Discourse Analysis is a comprehensive survey of the ways in which enhanced meaning emerges through the interaction of more than one mode of communication. Different modes of communication covered include: Language. Dynamic and static visual images. Architecture and three-dimensional objects in the realm of material lived-in space, as well as electronic media, film and print. This also includes the study of transition and phase, camera and body movement, typography, layout and the use of colour, and how such choices orientate the viewer to particular readings of the text and context. Multimodal Discourse Analysis will be useful to researchers interested in the application of systemic functional linguistics to media studies, discourse analysis and cognitive linguistics.

This book examines mathematical discourse from the perspective of Michael Halliday's social semiotic theory. In this approach, mathematics is conceptualized as a multisemiotic discourse involving language, visual images and symbolism. The book discusses the evolution of the semiotics of mathematical discourse, and then, proceeds to examine the grammar of mathematical symbolism, the grammar of mathematical visual images, intersemiosis between language, visual images and symbolism and the subsequent ways in which mathematics orders reality. The focus of this investigation is written mathematical texts. The aims of the book are to understand the semantic realm of mathematics and to appreciate the metaphorical expansions and simultaneous limitations of meaning in mathematical discourse. The book is intended for linguists, semioticians, social scientists and those interested in mathematics and science education. In addition, the close study of the multisemiotic mature of mathematics has implications for other studies adopting a social semiotic approach to multimodality.