Memorability of Enhanced Informational Graphics The effects of design relevance and chart type on recall
Article Sidebar
Main Article Content
Abstract
Design enhancements are often added to charts, signage, and infographics to help garner attention or communicate a message. Though it is argued that they may also detract user’s focus on the underlying information, prior studies have contributed evidence that visual design enhancements and even simple decorations can improve memory of visual displays. However, there is limited empirical knowledge about how the type of aesthetic enhancements infuences memory, and what informational and data elements are remembered from a visualization. We conducted a user study testing chart types (line, pie, and bar), the presence of color, and whether added enhancements were contextually related to the data topic presented in each chart. We found that enhancements relevant to the data helped in the recall of title and thematic elements, but enhancements did not signifcantly affect recall of specifc data values. This suggests that using relevant enhancements can have a positive effect on memorability of some chart content, but only if the design styles are chosen well to match the information topic. Recall of chart topics for unrelated embellishments was worse than plain, un-enhanced charts, which suggests that visual enhancement can distract or interfere with memorability if the viewer does not understand a meaningful connection between informational topic and design modifcations.
Article Details
References
Atkinson, R.C. and Shiffrin, R.M. (1968). Human memory: A proposed system and its control processes. Psychology of Learning and Motivation 2, 89–195. DOI: https://doi.org/10.1016/S0079-7421(08)60422-3
Bateman, S., Mandryk, R.L., Gutwin, C., Genest, A., McDine, D. and Brooks, C. (2010). Useful junk?: The effects of visual embellishment on comprehension and memorability of charts. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2573–2582. DOI: https://doi.org/10.1145/1753326.1753716 DOI: https://doi.org/10.1145/1753326.1753716
Beecham, R., Dykes, J., Meulemans, W., Slingsby, A., Turkay, C. and Wood, J. (2017). Map Line Ups: Effects of spatial structure on graphical inference. IEEE Transactions on Visualization and Computer Graphics 23(1), 391–400. DOI: https://doi.org/10.1109/TVCG.2016.2598862 DOI: https://doi.org/10.1109/TVCG.2016.2598862
Borgo, R., Abdul-Rahman, A., Mohamed, F., Grant, P.W., Reppa, I., Floridi, L. and Chen, M. (2012). An empirical study on using visual embellishments in visualization. IEEE Transactions on Visualization & Computer Graphics 18, 2759–2768. DOI: https://doi.org/10.1109/TVCG.2012.197 DOI: https://doi.org/10.1109/TVCG.2012.197
Borkin, M.A., Bylinskii, Z., Kim, N.W., Bainbridge, C.M., Yeh, C.S., Borkin, D., Pfister, H. and Oliva, A. (2016). Beyond memorability: Visualization recognition and recall. IEEE Transactions on Visualization and Computer Graphics 22(1), 519–528. DOI: https://doi.org/10.1109/TVCG.2015.2467732 DOI: https://doi.org/10.1109/TVCG.2015.2467732
Borkin, M.A., Vo, A.A., Bylinskii, Z., Isola, P., Sunkavalli, S., Oliva, A. and Pfister, H. (2013). What makes a visualization memorable? IEEE Transactions on Visualization and Computer Graphics 19(12), 2306–2315. DOI: https://doi.org/10.1109/TVCG.2013.234 DOI: https://doi.org/10.1109/TVCG.2013.234
Bylinskii, Z., Kim, N.W., O’Donovan, P., Alsheikh, S., Madan, S., Pfister, H., Durand, F., Russell, B. and Hertzmann, A. (2017). Learning visual importance for graphic designs and data visualizations. Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, 57–69. DOI: https://doi.org/10.1145/3126594.3126653 DOI: https://doi.org/10.1145/3126594.3126653
Chase, W.G. and Simon, H.A. (1973). Perception in chess. Cognitive Psychology 4(1), 55–81. DOI: https://doi.org/10.1016/0010-0285(73)90004-2
Claes, S. and Vande Moere, A. (2013). Street infographics: Raising awareness of local issues through a situated urban visualization. Proceedings of the 2nd ACM International Symposium on Pervasive Displays, 133–138. DOI: https://doi.org/10.1145/2491568.2491597 DOI: https://doi.org/10.1145/2491568.2491597
Cleveland, W.S. and McGill, R. (1984). Graphical perception: Theory, experimentation, and application to the development of graphical methods. Journal of the American Statistical Association 79(387), 531–554. DOI: https://doi.org/10.1080/01621459.1984.10478080
Correll, M. and Heer, J. (2017a). “Black hat visualization.” Paper presented at DECISIVe Workshop, IEEE VIS 2017, Phoenix, Oct 2.
Correll, M. and Heer, J. (2017b). Regression by Eye: Estimating Trends in Bivariate Visualizations. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 1387–1396. DOI: https://doi.org/10.1145/3025453.3025922 DOI: https://doi.org/10.1145/3025453.3025922
Craik, F. I. and Tulving, E. (1975). Depth of processing and the retention of words in episodic memory. Journal of Experimental Psychology: General 104(3), 268. DOI: https://doi.org/10.1037/0096-3445.104.3.268 DOI: https://doi.org/10.1037/0096-3445.104.3.268
Few, S. (2011). “The chartjunk debate: A close examination of recent findings.” Perceptual Edge, April/May/June 2011. http://www.perceptualedge.com/articles/visual_business_intelligence/the_chartjunk_debate.pdf
Haroz, S., Kosara, R. and Franconeri, S.L. (2015). Isotype visualization: Working memory, performance, and engagement with pictographs Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 1191–1200. DOI: https://doi.org/10.1145/2702123.2702275 DOI: https://doi.org/10.1145/2702123.2702275
Harrison, L., Yang, F., Franconeri, S. and Chang, R. (2014). Ranking Visualizations of Correlation Using Weber’s Law. IEEE Transactions on Visualization and Computer Graphics 20(12), 1943–1952. DOI: https://doi.org/10.1109/TVCG.2014.2346979 DOI: https://doi.org/10.1109/TVCG.2014.2346979
Heer, J. and Bostock, M. (2010). Crowdsourcing graphical perception: Using mechanical turk to assess visualization design. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 203–212. DOI: https://doi.org/10.1145/1753326.1753357 DOI: https://doi.org/10.1145/1753326.1753357
Holmes, N. (1984). Designer’s guide to creating charts & diagrams. New York: Watson-Guptill.
Jardine, N., Ondov, B.D., Elmqvist, N. and Franconeri, S. (2019). The Perceptual Proxies of Visual Comparison. IEEE Transactions on Visualization and Computer Graphics 26(1), 1012–1021. DOI: https://doi.org/10.1109/TVCG.2019.2934786 DOI: https://doi.org/10.1109/TVCG.2019.2934786
Kellaris, J.J. and Machleit, K.A. (2016). Signage as Marketing Communication: A Conceptual Model and Research Propositions. Interdisciplinary Journal of Signage and Wayfinding 1(1). DOI: https://doi.org/10.15763/issn.2470-9670.2016.v1.i1.a4
Kim, N., Schweickart, E., Liu, Z., Dontcheva, M., Li, W., Popovic, J. and Pfister, H. (2018). Data-driven guides: Supporting expressive design for information graphics. IEEE Transactions on Visualization & Computer Graphics 23(1), 491-500. DOI: https://doi.org/10.1109/TVCG.2016.2598620 DOI: https://doi.org/10.1109/TVCG.2016.2598620
Kosara, R. (2007). Visualization criticism: The missing link between information visualization and art. 11th International Conference Information Visualization, 631–636. DOI: https://doi.org/10.1109/IV.2007.130 DOI: https://doi.org/10.1109/IV.2007.130
Lahrache, S., El Ouazzani, R. and El Qadi, A. (2018). Visualizations memorability through visual attention and image features. Procedia Computer Science 127, 328–335. DOI: https://doi.org/10.1016/j.procs.2018.01.129 DOI: https://doi.org/10.1016/j.procs.2018.01.129
Li, H. and Moacdieh, N. (2014). Is “chart junk” useful? An extended examination of visual embellishment. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 58(1), 1516–1520. DOI: https://doi.org/10.1177/1541931214581316 DOI: https://doi.org/10.1177/1541931214581316
Lin, S., Fortuna, J., Kulkarni, C., Stone, M. and Heer, J. (2013). Selecting semantically-resonant colors for data visualization. Computer Graphics Forum 32, 401–410. DOI: https://doi.org/10.1111/cgf.12127 DOI: https://doi.org/10.1111/cgf.12127
Liu, Z., Thompson, J., Wilson, A., Dontcheva, M., Delorey, J., Grigg, S., Kerr, B. and Stasko, J. (2018). Data Illustrator: Augmenting Vector Design Tools with Lazy Data Binding for Expressive Visualization Authoring. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. DOI: https://doi.org/10.1145/3173574.3173697 DOI: https://doi.org/10.1145/3173574.3173697
Nuthall, G. (2000). The role of memory in the acquisition and retention of knowledge in science and social studies units. Cognition and Instruction 18(1), 83–139. DOI: https://doi.org/10.1207/S1532690XCI1801_04 DOI: https://doi.org/10.1207/S1532690XCI1801_04
Pandey, A.V., Rall, K., Satterthwaite, M.L., Nov, O. and Bertini, E. (2015). How deceptive are deceptive visualizations?: An empirical analysis of common distortion techniques. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 1469–1478. DOI: https://doi.org/10.1145/2702123.2702608 DOI: https://doi.org/10.1145/2702123.2702608
Quispel, A., Maes, A. and Schilperoord, J. (2016). Graph and chart aesthetics for experts and laymen in design: The role of familiarity and perceived ease of use. Information Visualization 15(3), 238–252. DOI: https://doi.org/10.1177/1473871615606478 DOI: https://doi.org/10.1177/1473871615606478
Ren, D., Lee, B. and Brehmer, M. (2018). Charticulator: Interactive Construction of Bespoke Chart Layouts. IEEE Transactions on Visualization and Computer Graphics 25(1), 789-799. DOI: https://doi.org/10.1109/TVCG.2018.2865158 DOI: https://doi.org/10.1109/TVCG.2018.2865158
Rensink, R.A. and Baldridge, G. (2010). The perception of correlation in scatterplots. Computer Graphics Forum 29, 1203–1210. DOI: https://doi.org/10.1111/j.1467-8659.2009.01694.x
Ritchie, D, and Karge, B.D. (1996). Making information memorable: Enhanced knowledge retention and recall through the elaboration process. Preventing School Failure: Alternative Education for Children and Youth 41(1), 28–33. DOI: https://doi.org/10.1080/1045988X.1996.9944681 DOI: https://doi.org/10.1080/1045988X.1996.9944681
Ruchikachorn, P. and Mueller, K. (2015). Learning visualizations by analogy: Promoting visual literacy through visualization morphing. IEEE Transactions on Visualization and Computer Graphics 21(9), 1028–1044. DOI: https://doi.org/10.1109/TVCG.2015.2413786 DOI: https://doi.org/10.1109/TVCG.2015.2413786
Saket, B., Srinivasan, A., Ragan, E.D. and Endert, A. (2018). Evaluating interactive graphical encodings for data visualization. IEEE Transactions on Visualization and Computer Graphics 24(3), 1316–1330. DOI: https://doi.org/10.1109/TVCG.2017.2680452 DOI: https://doi.org/10.1109/TVCG.2017.2680452
Skog, T., Ljungblad, S. and Holmquist, L. E. (2003). Between aesthetics and utility: Designing ambient information visualizations. IEEE Symposium on Information Visualization, 233–240. DOI: https://doi.org/10.1109/INFVIS.2003.1249031 DOI: https://doi.org/10.1109/INFVIS.2003.1249031
Smith, D.A. and Graesser, A.C. (1981). Memory for actions in scripted activities as a function of typicality, retention interval, and retrieval task. Memory & Cognition 9(6), 550–559. DOI: https://doi.org/10.3758/BF03202349 DOI: https://doi.org/10.3758/BF03202349
Szafir, D.A. (2017). Modeling Color Difference for Visualization Design. IEEE Transactions on Visualization and Computer Graphics 24(1), 392-401. DOI: https://doi.org/10.1109/TVCG.2017.2744359 DOI: https://doi.org/10.1109/TVCG.2017.2744359
Tufte, E. (1983). The visual display of quantitative information. Cheshire: Graphics Press.
Wickham, H., Cook, D., Hofmann, H. and Buja, A. (2010). Graphical inference for infovis. IEEE Transactions on Visualization and Computer Graphics 16(6), 973–979. DOI: https://doi.org/10.1109/TVCG.2010.161 DOI: https://doi.org/10.1109/TVCG.2010.161
Xia, H., Henry Riche, N., Chevalier, F., De Araujo, B. and Wigdor, D. (2018). DataInk: Direct and Creative Data-Oriented Drawing. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. DOI: https://doi.org/10.1145/3173574.3173797 DOI: https://doi.org/10.1145/3173574.3173797
Zacks, J., Levy, E., Tversky, B. and Schiano, D.J. (1998). Reading bar graphs: Effects of extraneous depth cues and graphical context. Journal of Experimental Psychology: Applied 4(2), 119.