Three-Dimensional Gaze Projection Heat-Mapping of Outdoor Mobile Eye-Tracking Data

Main Article Content

James Simpson


The mobilization of eye-tracking for use outside of the laboratory provides new opportunities for the assessment of pedestrian visual engagement with their surroundings. However, the development of data representation techniques that visualize the dynamics of pedestrian gaze distribution upon the environment they are situated within remains limited. The current study addresses this through highlighting how mobile eye-tracking data, which captures where pedestrian gaze is focused upon buildings along urban street edges, can be mapped as three-dimensional gaze projection heat-maps. This data processing and visualization technique is assessed during the current study along with future opportunities and associated challenges discussed. 

Article Details



Alexiou, E., Xu, P., & Ebrahimi, T. (2019). Towards modelling of visual saliency in point clouds for immersive applications. 26th IEEE International Conference on Image Processing (ICIP). Taipei, Taiwan.

Badrinarayanan, V., Kendall, A. & Cipolla, R. (2017). SegNet: A deep convolutional encoder-decoder architecture for image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(12), 2481-2495.

Billger, M., Thuvander, L. & Wästberg, B. S. (2017). In search of visualization challenges: The development and implementation of visualization tools for supporting dialogue in urban planning processes. Environment and Planning B: Urban Analytics and City Science, 44(6), 1012-1035.

Birenboim, A. (2018). The influence of urban environments on our subjective momentary experiences. Environment and Planning B: Urban Analytics and City Science, 45(5), 915-932.

Chiel, H. J. & Beer, R. D. (1997). The brain has a body: Adaptive behavior emerges from interactions of nervous system, body and environment. Trends in Neurosciences, 20(12), 553-557.

Cuthbert, A. R. (2007). Urban design: Requiem for an era–review and critique of the last 50 years. Urban Design International, 12(4), 177-223.

Duchowny, K., Clarke, P., Gallagher, N. A., et al. (2018). Using mobile, wearable, technology to understand the role of built environment demand for outdoor mobility. Environment and Behavior, 51(6), 671-688.

Duchowski, A. T. (2017). Eye Tracking Methodology: Theory and Practice. Springer.

Emo, B. (2015). Exploring isovists: The egocentric perspective. 10th International Space Syntax Symposium (SSS). London.

Emo, B. (2018). Choice zones: Architecturally relevant areas of interest. Spatial Cognition & Computation, 18(3), 173-193.

Findlay, J. M. & Gilchrist, I. D. (2003). Active vision: The Psychology of Looking and Seeing. Oxford UP.

Fisher-Gewirtzman, D. (2018). Integrating ‘weighted views’ to quantitative 3D visibility analysis as a predictive tool for perception of space. Environment and Planning B: Urban Analytics and City Science, 45(2), 345-366.

Fisher-Gewirtzman, D., Burt, M., & Tzamir, Y. (2003). A 3-D visual method for comparative evaluation of dense built-up environments. Environment and Planning B: Planning and Design, 30 (4), 575-587.

Fisher-Gewirtzman, D. & Wagner, I. A. (2003). Spatial openness as a practical metric for evaluating built-up environments. Environment and Planning B: Planning and Design, 30 (1), 37-49.

Fotios, S., Uttley, J., & Yang, B. (2015). Using eye-tracking to identify pedestrians’ critical visual tasks. Part 2. Fixation on pedestrians. Lighting Research & Technology, 47 (2), 149-160.

Foulsham, T., Walker, E., & Kingstone, A. (2011). The where, what and when of gaze allocation in the lab and the natural environment. Vision Research, 51 (17), 1920-1931.

Gallagher, S. (2005). How the Body Shapes the Mind. Oxford UP.

Gehl, J. (2010). Cities for People. Island Press.

Gehl, J., Kaefer, L. J., & Reigstad, S. (2006). Close encounters with buildings. Urban Design International, 11 (1), 29-47.

Gibson, J. (1979). The Ecological Approach to Visual Perception. Houghton Mifflin.

Gramann, K., Gwin, J. T., Ferris, D. P., et al. (2011). Cognition in action: Imaging brain/body dynamics in mobile humans. Reviews in the Neurosciences, 22(6), 593-608.

Hall, E. T. (1966). The Hidden Dimension. Doubleday.

Hassan, D. M., Moustafa, Y. M., & El-Fiki, S. M. (2019). Ground-floor façade design and staying activity patterns on the sidewalk: A case study in the Korba area of Heliopolis, Cairo, Egypt. Ain Shams Engineering Journal, 10 (3), 453-461.

Hausdorff, J. M., Yogev, G., Springer, S., et al. (2005). Walking is more like catching than tapping: Gait in the elderly as a complex cognitive task. Experimental Brain Research, 164(4), 541-548.

Heft, H. (2019). What’s wrong with using photographs of the environment in environmental perception research? 20th Environmental Design Research Association (EDRA) Conference. Brooklyn, NY.

Hein, J. R., Evans, J., & Jones, P. (2008). Mobile methodologies: Theory, technology and practice. Geography Compass, 2 (5), 1266-1285.

Hollander, J. B., Purdy, A., Wiley, A., et al. (2019) Seeing the city: Using eye-tracking technology to explore cognitive responses to the built environment. Journal of Urbanism: International Research on Placemaking and Urban Sustainability, 12(2), 156-171.

Hollander, J. B., Sussman, A., Purdy, A., et al. (2020). Using eye-tracking to understand human responses to traditional neighborhood designs. Planning Practice & Research, 35(5), 1-25.

Holmqvist, K., Nyström, M., Andersson, R., et al. (2011). Eye Tracking: A Comprehensive Guide to Methods and Measures. Oxford UP.

Huskinson, L. (2018). Architecture and the Mimetic Self: A Psychoanalytic Study of How Buildings Make and Break our Lives. Routledge.

Jelic, A., Tieri, G., De Matteis, F., et al. (2016). The enactive approach to architectural experience: A neurophysiological perspective on embodiment, motivation, and affordances. Frontiers in Psychology, 7, 1-20.

Karssenberg, H, Laven J, Glaser M, et al. (2016). The City at Eye Level: Lessons for Street Plinths.

Kiefer, P., Giannopoulos, I., & Raubal, M. (2014). Where am I? Investigating map matching during self-localization with mobile eye tracking in an urban environment. Transactions in GIS, 18(5), 660-686.

Kiefer, P., Giannopoulos, I., & Raubal, M., et al. (2017). Eye tracking for spatial research: Cognition, computation, challenges. Spatial Cognition & Computation, 17(1-2), 1-19.

Koletsis, E., van Elzakker, C. P. J. M., Kraak, M-J., et al. (2017). An investigation into challenges experienced when route planning, navigating and wayfinding. International Journal of Cartography, 3(1), 4-18.

Krukar, J., Schultz, C., & Bhatt, M. (2017). Towards embodied 3d isovists: Incorporating cognitively-motivated semantics of `space’ and the architectural environment in 3D visibility analysis. 11th International Space Syntax Symposium (SSS). Lisbon, Portugal.

Ladouce, S., Donaldson, D. I., Dudchenko, P. A., et al. (2017). Understanding minds in real-world environments: Toward a mobile cognition approach. Frontiers in Human Neuroscience 10, 1-14.

Li, X., Yu, L., Fu, C-W., et al. (2019). Unsupervised detection of distinctive regions on 3D shapes. CoRR, 1(1), 1-16.

Lin, T., Lin. H., & Hu, M. (2017). Three-dimensional visibility analysis and visual quality computation for urban open spaces aided by Google SketchUp and WebGIS. Environment and Planning B: Urban Analytics and City Science, 44 (4), 618-646.

Lynch, K. & Hack, G. (1984). Site Planning. MIT press.

Mallgrave, H. F. (2013). Architecture and Embodiment: The Implications of the New Sciences and Humanities for Design. Routledge.

Mallgrave, H. F. (2015). Embodiment and enculturation: The future of architectural design. Frontiers in Psychology 6: 1-6.

Mallgrave, H. F. (2018). From Object to Experience: The New Culture of Architectural Design. Bloomsbury Publishing.

Marius’t Hart, B. & Einhäuser, W. (2012). Mind the step: Complementary effects of an implicit task on eye and head movements in real life gaze allocation. Experimental Brain Research, 223 (2), 233-249.

Marshall, S. (2012). Science, pseudo-science and urban design. Urban Design International, 17 (4), 257-271.

Mavros, P., Austwick M. Z., & Smith A. H. (2016). Geo-EEG: Towards the use of EEG in the study of urban behaviour. Applied Spatial Analysis and Policy, 9(2), 191-212.

Mehta, V. (2013). The Street: A Quintessential Social Public Space. Routledge.

Middel, A., Lukasczyk, J., Zakrzewski, S., et al. (2019). Urban form and composition of street canyons: A human-centric big data and deep learning approach. Landscape and Urban Planning 183, 122-132.

Morello, E. & Ratti, C. (2009). A digital image of the city: 3D isovists in Lynch’s urban analysis. Environment and Planning B: Planning and Design, 36(5), 837-853.

Mu?ller-Feldmeth, D., Schwarzkopf, S., Bu?chner, S. J., et al. (2014). Location dependent fixation analysis with sight vectors: Locomotion as a challenge in mobile eye tracking. 2nd International Workshop on Eye Tracking for Spatial Research (ET4S). Vienna, Austria.

Noland, R. B., Weiner, M. D., Gao, D., et al. (2017). Eye-tracking technology, visual preference surveys, and urban design: Preliminary evidence of an effective methodology. Journal of Urbanism: International Research on Placemaking and Urban Sustainability, 10 (1), 98-110.

Pfeiffer, T. & Memili, C. (2016) Model-based real-time visualization of realistic three-dimensional heat maps for mobile eye tracking and eye tracking in virtual reality. Proceedings of the Ninth Biennial ACM Symposium on Eye Tracking Research & Applications, 95-102.

Rahman, M. N. & Mehta, V. (2020) Signage Form and Character: a window to neighborhood visual identity. Interdisciplinary Journal of Signage and Wayfinding, 4(1), 35-48.
Rothkopf, C. A., Ballard, D. H. & Hayhoe, M. M. (2007). Task and context determine where you look. Journal of Vision, 7(14), 1-20.

Schwarzkopf, S., Bu?chner, S. J., Hölscher, C., et al. (2017). Perspective tracking in the real world: Gaze angle analysis in a collaborative wayfinding task. Spatial Cognition & Computation, 17(1-2), 143-162. Interdisciplinary
Journal of Signage and Wayfinding; Vol. 5, No. 1 (2021) 74

Simpson, J., Freeth, M., Simpson, K. J., et al. (2019a). Visual engagement with urban street edges: Insights using mobile eye-tracking. Journal of Urbanism: International Research on Placemaking and Urban Sustainability, 12(3), 259-278.

Simpson, J., Thwaites, K., & Freeth, M. (2019b). Understanding Visual Engagement with Urban Street Edges along Non-Pedestrianised and Pedestrianised Streets Using Mobile Eye-Tracking. Sustainability, 11(15), 4251.

Spinney, J. (2015). Close encounters? Mobile methods, (post)phenomenology and affect. Cultural Geographies, 22(2), 231-246.

Sun, M., Herrup, K., Shi, B., et al. (2018). Changes in visual interaction: Viewing a Japanese garden directly, through glass or as a projected image. Journal of Environmental Psychology, 60, 116-121.

Tang, M. (2020). Analysis of Signage Using Eye-Tracking Technology. Interdisciplinary Journal of Signage and Wayfinding, 4(1), 61-72.

Thomas, N. D. A., Gardiner, J. D., Crompton, R. H., et al. (2020). Look out: An exploratory study assessing how gaze (eye angle and head angle) and gait speed are influenced by surface complexity. PeerJ, 8, 1-13.

Thwaites, K., Simpson, J., & Simkins, I. (2020). Transitional edges: A conceptual framework for socio-spatial understanding of urban street edges. Urban Design International, 25, 295–309.

Turner, A. (2017). Partners in the street ballet: An embodied process of person-space coupling in the built environment. Environment and Planning B: Urban Analytics and City Science, 44(2), 294-307.

Turner, A. & Penn, A. (2002). Encoding natural movement as an agent-based system: An investigation into human pedestrian behaviour in the built environment. Environment and Planning B: Planning and Design, 29(4), 473-490.

Uttley, J., Fotios, S., & Cheal, C. (2016). Measuring perceived safety after-dark – three alternatives to rating scales. 24th International Association of People-Environment Studies (IAPS) Conference. Lund, Sweden.

Uttley, J., Simpson, J., & Qasem, H. (2018). Eye-tracking in the real world: Insights about the urban environment. In: Handbook of Research on Perception-Driven Approaches to Urban Assessment and Design. IGI Global.

Wang, X., Koch, S., Holmqvist, K., et al. (2018). Tracking the gaze on objects in 3D: How do people really look at the bunny? ACM Transactions on Graphics, 37(6), 1-18.

Yang, P. P-J., Putra S. Y., & Li, W. (2007). Viewsphere: A GIS-based 3D visibility analysis for urban design evaluation. Environment and Planning B: Planning and Design, 34(6), 971-992.

Ye Y., Zeng W., Shen Q, et al. (2019) The visual quality of streets: A human-centred continuous measurement based on machine learning algorithms and street view images. Environment and Planning B: Urban Analytics and City Science 46(8), 1439-1457.