Computational Methods for Integrating Vision and Language

Kenichi Kanatani, Yasuyuki Sugaya

$130.95 $105.07

Paperback

Not in-store but you can order this
How long will it take?

Availability Information

We source books from suppliers in Australia and overseas. For books we don't currently have in stock, the time it takes to get them from our suppliers can vary widely - from a few days to a few months - so we check each book with each supplier to determine the expected time it will take to be supplied to us.

We then advise you accordingly. If the time taken to get any book is too long for you, you can let us know and we will cancel or adjust your order, and refund as required.

To find out the anticipated arrival time for specific items prior to ordering, please contact us by phone or email:

Phone +61 2 9264 3111, or 1800 4 BOOKS (1800 4 26657) if outside Sydney:
option 1 Abbey's Bookshop (Crime, History, Science, Kids & more) • info@abbeys.com.au
option 2 Language Book Centre (ESL & Foreign Languages) • language@abbeys.com.au
option 3 Galaxy Bookshop (Sci-fi, Fantasy, Romance, Graphic Novels) • sf@galaxybooks.com.au

QTY:

English

Springer International Publishing AG
21 April 2016

Pattern recognition; Computer vision; Image processing

Series: Synthesis Lectures on Computer Vision

Modeling data from visual and linguistic modalities together creates opportunities for better understanding of both, and supports many useful applications. Examples of dual visual-linguistic data includes images with keywords, video with narrative, and figures in documents. We consider two key task-driven themes: translating from one modality to another (e.g., inferring annotations for images) and understanding the data using all modalities, where one modality can help disambiguate information in another. The multiple modalities can either be essentially semantically redundant (e.g., keywords provided by a person looking at the image), or largely complementary (e.g., meta data such as the camera used). Redundancy and complementarity are two endpoints of a scale, and we observe that good performance on translation requires some redundancy, and that joint inference is most useful where some information is complementary. Computational methods discussed are broadly organized into ones forsimple keywords, ones going beyond keywords toward natural language, and ones considering sequential aspects of natural language. Methods for keywords are further organized based on localization of semantics, going from words about the scene taken as whole, to words that apply to specific parts of the scene, to relationships between parts. Methods going beyond keywords are organized by the linguistic roles that are learned, exploited, or generated. These include proper nouns, adjectives, spatial and comparative prepositions, and verbs. More recent developments in dealing with sequential structure include automated captioning of scenes and video, alignment of video and text, and automated answering of questions about scenes depicted in images.

By: Kenichi Kanatani, Yasuyuki Sugaya
Imprint: Springer International Publishing AG
Country of Publication: Switzerland
Dimensions: Height: 235mm, Width: 191mm,
Weight: 438g
ISBN: 9783031006869
ISBN 10: 3031006860
Series: Synthesis Lectures on Computer Vision
Pages: 211
Publication Date: 21 April 2016
Audience: Professional and scholarly , Undergraduate
Format: Paperback
Publisher's Status: Active

Kobus Barnard is a professor of computer science at the University of Arizona. He also has appointments in the School of Information: Science, Technology, and Arts (SISTA), Statistics, Cognitive Science, Electrical and Computer Engineering (ECE), and the BIO5 Institute. He leads the Interdisciplinary Visual Intelligence Laboratory (IVILAB.org). Professor Barnard received his Ph.D. in computer science in 2000 from Simon Fraser University (SFU) in the area of computational color constancy, where his dissertation received the Governor General gold medal awarded across all disciplines. He then spent two years at the University of California at Berkeley as a postdoctoral researcher working on modeling the joint statistics of images and associated text, followed by moving to the University of Arizona. His current research addresses problems in interdisciplinary computational intelligence by developing top-down statistical models that are predictive, semantic, and explanatory. Application domains include computer vision, multimedia data, biological structure and processes, astronomy, and human social interaction. His work has been funded by multiple grants from NSF including a CAREER award, DARPA, ONR, ARBC (Arizona Biomedical Commission), and the University of Arizona BIO5 Institute.