Index Preface and Acknowledgements -- Contents -- Part I: Introduction -- Empirical Multimodality Research: The State of Play -- Part II: Charting Paths for Empirical Research: Theoretical and Methodological Reflections -- Dimensions of Materiality -- From Data to Patterns -- Thinking in Action -- Computational Approaches for the Interpretation of Image-Text Relations -- Part III: Empirical Inroads: Case Studies and Results -- "I can't see why you're laughing": Multimodal Analysis of Emotionalized Political Debate -- A Corpus-Based Approach to Color, Shape, and Typography in Logos -- Pixel Surgery and the Doctored Image -- Multimodal Discourse Analysis Based on the GeM Model -- Conventions in How Korean Films Mean -- An Empirical Multimodal Approach to Open-World Video Games -- List of Contributors -- Index
Summary:
This volume advances the data-based study of multimodal artefacts and performances by showcasing methods and results from the latest endeavors in empirical multimodal research, representing a vibrant international and interdisciplinary research community. The collated chapters identify and seek to inspire novel, mixed-method approaches to investigate meaning-making mechanisms in current communicative artifacts, designs, and contexts; while attending to their immersive, aesthetic, and ideological dimensions. Each contribution details innovative aspects of empirical multimodality research, offering insights into challenges evolving from quantitative approaches, particular corpus work, results from eye-tracking and psychological experiments, and analyses of dynamic interactive experiences. The approaches and results presented foreground the inherent multidisciplinary nature and implications of multimodality, renegotiating concepts across linguistics, media studies, (social) semiotics, game studies, and design. With this, the volume will inform both current and future developments in theory, methods, and transdisciplinary contexts and become a landmark reference for anyone interested in the empirical study of multimodality.
This resource is supported by the Institute of Museum and Library Services under the provisions of the Library Services and Technology Act as administered by State Library of Iowa.