Hull, G.A. & Nelson, M. E. (2005): Locating the semiotic power of multimodality. Written Communication, 22, 224-262.
Link to video in research paper : http://www.oaklanddusty.org/videos.php
The authors selected a digital media project from Digital Underground Storytelling for You(th), based on two critieria: most acclaim received and it was analyzable due to its use of only still images, voice over, and music. The method chosen to analyze the project was to utilize the timeline feature in the software that was used to create it. The story was transcribed and then assigned meaning making based on this timeline. The authors conclude that only by this multimodal method could Randy’s (the composer) story so effectively engaged the audience.
“We also believe our analysis and Randy’s story offer a strong counterclaim to the argument that digital media simply facilitate the multimodal composing that could and does exist apart from computer technologies. If we are correct, the particular meanings and the experience of viewing and constructing these meanings via this form of multimodality are unique. Believing as we do that a culture and atime’s mediational means, our psychological and material tools if you will (cf. Vygotsky, 1978), are intimately connected with our capacities to think, represent, and communicate, it would seem hugely important to widen our definition of writing to include multimodal composing as a newly available means.” (Hull, G.A. & Nelson, M. E. 2005)
The complexity of analyzing this story while it was only two minutes and 11 seconds struck me as I read the details of the authors’ efforts to do so. As with most other previous works addressing digital media, the very newness of the field of research was highlight as well as the subsequent need for more research was stressed.
Possible Discussion Question:
Did the authors’ decision not to analyze the music aspect in as extensively as the words and images of the digital story detract from their research results?
How might meaning making been assigned to the music? What tools could be utilized?
1 comment:
I think music can be a powerful and emotional piece of a product. Music is particularly important in some cultures and it may be important to consider it when analyzing stories that incorporate music.
Post a Comment