Multimodal Comprehension of Language and Graphics: Graphs with and without annotations

An experimental investigation into interaction between language and information graphics in multimodal documents served as the basis for this study. More specifically, our purpose was to investigate the role of linguistic annotations in graph-text documents. Participants were presented with three ne...

Full description

Saved in:
Bibliographic Details
Main Authors: Cengiz Acarturk (Author), Christopher Habel (Author), Kursat Cagiltay (Author), Ozge Alacam (Author)
Format: Book
Published: Bern Open Publishing, 2008-11-01T00:00:00Z.
Subjects:
Online Access:Connect to this object online.
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:An experimental investigation into interaction between language and information graphics in multimodal documents served as the basis for this study. More specifically, our purpose was to investigate the role of linguistic annotations in graph-text documents. Participants were presented with three newspaper articles in the following conditions: one text-only, one text plus non-annotated graph, and one text plus annotated graph. Results of the experiment showed that, on one hand, annotations play a bridging role for integration of information contributed by different representational modalities. On the other hand, linguistic annotations have negative effects on recall, possibly due to attention divided by the different parts of a document.
Item Description:10.16910/jemr.1.3.2
1995-8692