Includes bibliographical references (p. 63-71). Title from opening screen last modified Jan. 7 2009 (viewed on June 10, 2009).
Contents:
Evolution of multimedia information systems, 1990-2008 -- Introduction to the Informedia project -- Reflections/exercises -- Survey of automatic metadata creation methods -- Aural processing -- Visual processing -- Language processing -- Reflections/exercises -- Refinement of automatic metadata -- Computationally intensive approaches -- Temporal and multimodal redundancy -- Leveraging context -- User-controlled precision-recall trade-off -- Reflections/exercises -- Multimedia surrogates -- Video surrogate examples -- Surrogates for collections of video -- Reflections/exercises -- End-user utility for metadata and surrogates effectiveness, efficiency, and satisfaction -- Informedia experiments on various video surrogates -- NIST TRECVID on fact-finding shot-based retrieval -- Exploratory use of multimedia information systems -- Reflections/exercises -- Conclusions.
Summary:
Improvements in network bandwidth along with dramatic drops in digital storage and processing costs have resulted in the explosive growth of multimedia (combinations of text, image, audio, and video) resources on the Internet and in digital repositories. A suite of computer technologies delivering speech, image, and natural language understanding can automatically derive descriptive metadata for such resources. Difficulties for end users ensue, however, with the tremendous volume and varying quality of automated metadata for multimedia information systems. This lecture surveys automatic metadata creation methods for dealing with multimedia information resources, using broadcast news, documentaries, and oral histories as examples. Strategies for improving the utility of such metadata are discussed, including computationally intensive approaches, leveraging multimodal redundancy, folding in context, and leaving precision-recall trade offs under user control. Interfaces building from automatically generated metadata are presented, illustrating the use of video surrogates in multimedia information systems. Traditional information retrieval evaluation is discussed through the annual National Institute of Standards and Technology TRECVID forum, with experiments on exploratory search extending the discussion beyond fact-finding to broader, longer term search activities of learning, analysis, synthesis, and discovery.
Series:
Synthesis lectures on information concepts, retrieval, and services ; # 2
This resource is supported by the Institute of Museum and Library Services under the provisions of the Library Services and Technology Act as administered by State Library of Iowa.