Chapter 7: The Multimedia Principle
Butcher describes the Multimedia Principle as the âfinding that learning with words and pictures is more effective than learning with words aloneâ (p.174). This principle also provides justification and context for researching âwhen, how, why, and under what conditionsâ other multimedia principles may help or hinder oneâs learning and it unveils the criteria for creating effective multimedia learning materials (Butcher, p.174-175). Originally, the principle was âfocused on text combined with (static or animated) illustrationsâ while today, it refers to âlearning supported by varied forms of visual and verbal content when presented in combinationâ such as narration with graphs, photographs, diagrams, and charts (Butcher, p.174-175). When choosing or creating an impactful multimedia tool, diagrams (abstract and/or concrete) have been found to, when supplemented by accompanying verbal content, â[facilitate] the development of accurate mental models, [enhance] knowledge integration, better knowledge application and [enable] superior [knowledge] transferâ (Butcher, p.181-183).
Photo by Dennis Scherdt on Unsplash
The Multimedia Principle helps students understand difficult topicsâa study by Clinton et al. found that when undergraduate students studying complex probability have access to resources with text accompanied by relevant visuals, they âdevelop a verbal mental modelâ through âdeeper processing of the textâ and a âvisual mental modelâ that makes them âmore likely to make connections among different ideasâ (p.579-581).
An aspect of cognitive learning that supports and helps explain the Multimedia Principleâs success is the Dual Coding Theory (Butcher, p.193). This theory demonstrates how the human brain stores audio and imagery information in two different âshort-term channelsâ that work together to summarize concepts before transporting them to long term memory (MacMahon, 2013). In EDCI 337, both the Multimedia Principle and the Dual Coding Theory are present in our H5P Toolkit creations, annotations, Canvaâs, and sketchnotes through their uses of verbal and visual content in tandem to engage, motivate and encourage knowledge recall and transfer.
Research
Many lab-based studies have been conducted on the effects of the Multimedia Principle. Mayer & Anderson (1992) found the combination of narration and animation to facilitate learning (Butcher, p.177). Mayer & Andersonâs ideas in multimedia led to the creation of modality, voice, and image principles (Mayer, 2014). In 1993, Hegarty & Just found students learn more thoroughly through the combination of diagrams and text: their findings emphasize the effectiveness of diagrams which was the first form of multimedia (The âOrbis Pictusâ) that is also still used ubiquitously today (Comenius & Bardeen & Hoole, 1887). Cuevas, Fiore, & Oser supported this, with their own research on the use of diagrams for teaching the principles of flight (Butcher, p. 177).
Click here for a closer look at the Orbis Pictus annotation!
In 2004, Rieber, Tzeng, & Tribble found that incorporating interactive models into multimedia lessons supports learning (Butcher, p. 177). Models such as erosion displays, gravity examples, and DNA manipulatives allow students to experience abstract topics in a more tangible way. Videos like Crash Course, which teach a concept through animated scenes and moving diagrams, display this idea through supporting their lectures with animations and moving diagrams.
In these studies, the methods of testing remain uniform. Butcher reveals how research in multimedia assesses learning outcomes through â[memory/retention tests] for instructional materialsâ and âtests of deeper understandingâ such as âtransfer testsâ and âmental modelsâ of instructional materials (p. 179). These tests have been found to prove how multimedia lessons create better outcomes in deeper understanding tests (short answer & inference) than memory tests(multiple-choice, matching, true/false) (Butcher, p.179).
With ever-changing technologies, Butcher states technologyâs role in multimedia instruction is under-researched. For this reason, teachers must make informed decisions on whether to use a technological multimedia tool. Alsadhan et al. maintain that the âsuccessful delivery of e-learningâ relies on the âdesign, development and implementation of high-quality multimedia contentâ (2014, p.26). When more multimedia technology research is conducted, educators can fine-tune their tools and techniques to create lessons supported by research.
 Photo by Eco Warrior Princess on Unsplash
Graphics and Visuals
Furthermore, Butcher discusses the effects of visuals on the learner, and how different learning objectives require different visual formats. Initially, the purpose of static illustrations is examined and it is found that âadding static diagrams or illustrations to a verbal (text or audio) presentation frequently facilitates a deeper understanding of the to-be-learned materialâ (Butcher, p.181). An article by Kari Jabbour (2012) supports this claim by investigating the types of graphics that foster deeper levels of learning. For example, decorative graphics are often âused to inspire instructional display by adding artistic appeal or humor, but [have] no real instructional targetâ (Kari Jabbour, p.13). When incorporating graphics in a lesson, it is critical to eliminate unnecessary information and have an equal balance of text and visuals.
Moreover, Butcher discusses the evolution of dynamic visuals, and how animations in particular influence learning objectives, âanimation is better for task[s] that are complex, but if a diagram can be mentally animated, this is more beneficial for the learnerâ (Butcher, p.184-185). Butcher discusses how animations are useful when performing procedural tasks but are not necessarily useful when attempting to retain information (p.184). This implies that depending on the learning task, the type of graphic âserves a different purpose and is best aligned with specific instructional goal[s], stages of learning⌠and the learnerâs knowledge levelâ (Kari Jabbour, p.15). The article then suggests thatvisuals created by the learner will support a deeper level of understanding as students must process the information and apply it to something (Butcher, p.188).
The Canva and YouTube video as shown above are examples of static versus dynamic visuals. Depending on the type of learning, an educator needs to choose which visual style is better suited for an activity. Click here to get a closer look at the static visual.
Implications and Limitations of the Multimedia Principle
Butcher concludes the chapter by outlining the implications and limitations of Multimedia Instructional Designand the importance of understanding your unique learners. Shah & Khan (2015) support this idea by stating âmultimedia [tools] provide a variety of learning styles at the same time to cater to the requirements of different studentsâ (p.350). Butcher summarizes the findings of multimedia visual and auditory stimuli options through the following benefits: simplifying visuals using well organized semantic models, integrating verbal and visual information both abstractly and concretely; using necessary animations/cues/spotlights, considering existing knowledge for connection making, and allowing students to create their own representations when possible (Butcher, p.194-195). Upon reflection on these findings, the implementation of multimedia in the classroom appears to be a viable option for student success. Through the use of multimedia tools, âlearners become active participants in the teaching and learningprocess instead of being passive learnersâ (Shah & Khan, p.356).
Click here for a closer look at the Sketchnote!
While research on multimedia has provided great insight into helping students learn through verbal and visual means, there are some limitationsto these studies. Educators must take into account the lab setting (which varies greatly from a real-life classroom), the fact that multimedia tools may need to be scaffolded, how effective self-directed online teaching is, and that multimedia in technology requires more research (Butcher, p. 195-197). As new technologies are developed, the Multimedia Principle continues to evolve. Despite its evolution, the idea that learners can benefit from more than one form of instruction (visual and verbal content in combination) remains a timeless and successful pedagogical truth.
References
Alsadhan, A. O., Alhomod, S., & Shafi, M. M. (2014). Multimedia based E-learning : Design and integration of multimedia content in E-learning.International Journal of Emerging Technologies in Learning (iJET), 9(3), 26-30. doi:10.3991/ijet.v9i3.3308
Butcher, K. (2014). The Multimedia Principle. In R. Mayer (Ed.), The Cambridge Handbook of Multimedia Learning (Cambridge Handbooks in Psychology, pp. 174-205). Cambridge: Cambridge University Press. doi:10.1017/CBO9781139547369.010
Clinton, V., Alibali, M.W., & Nathan, M.J., (2016) Learning About Posterior Probability: Do Diagrams and Elaborative Interrogation Help?, The Journal of Experimental Education, 84:3, 579-599, DOI: 10.1080/00220973.2015.1048847
Comenius, J. A., Bardeen, C. W., Hoole, C. (1887). The Orbis Pictus of John Amos Comenius. United States: C.W. Bardeen.
Kari Jabbour, K. (2012). Multimedia Principle in Teaching Lessons. Acta Didactica Napocensia, 5(4), 11-16.
MacMahon, C. (2013, January 15). Dual Coding Theory & Multimedia Learning. [Video file]. https://vimeo.com/57440483
Mayer, R. E. (Ed.). (2014). The Cambridge Handbook of Multimedia Learning(2nd ed.). Cambridge University Press. https://doi.org/10.1017/CBO9781139547369
Shah, I., & Khan, M. (2015). Impact of Multimedia-aided Teaching on Studentsâ Academic Achievement and Attitude at Elementary Level. US-China Education Review A, 5(5), 349-360. doi:10.17265/2161-623x/2015.05a.006