Elias Ruokanen

Traditional and Digital Artist

Imaginal neglect and the architecture of visual representation

Bachelor's thesis in Cognitive Science, supervised by Otto Lappi.

University of Helsinki. Faculty of Behavioural Sciences / Faculty of Arts. 2023.

Introduction

 

Spatial neglect is a neuropsychological disorder that is characterized by a deficit in shifting attention to space, most commonly to the left side of one’s visual field. A patient may, for example, be unable to consciously perceive one side of space, one side of objects or one side of their own body. The condition is particularly interesting due to the rich variety of internal dissociations it can present, and the clues those dissociations give to the underlying architecture and hierarchy of spatial representations in the human mind. In this thesis I will examine the evidence for imaginal (also called representational) neglect and whether the processes of perception and imagination have separate neural bases.

 

 

The diversity of neglect

 

Spatial neglect usually arises from damage to temporal-parietal cortical regions (the posterior parietal region has been implicated in particular) and usually affects the contralateral visual field. The most common cause is a stroke in the right hemisphere [Stone et al. (1993)]. People with spatial neglect do not necessarily suffer from perceptual disturbances per se, and their oculomotor functions may be almost entirely intact. Instead, they lack the ability to direct attention or visual search to the neglected side and fail to be aware of the content presented therein. Thalamo-cortical visual pathways may be entirely preserved, allowing for information processing in higher brain areas. Indeed, implicit processing of information in the neglected side is not an uncommon occurrence [Berti et al., 1992. Marshall & Halligan, 1988].

 

Neglect comes in many forms. Personal neglect refers to a disturbance in one’s body image and typically presents itself as a difficulty in touching the neglected side of one’s body. Hemispatial neglect refers to the neglect of a side of one’s visual field, relative to the centerline of the trunk, head, or eyes. In object-based neglect external physical objects are neglected relative to their major axes. Oliver Sacks (1985) describes a patient with damage to the “deeper and back portions of her right cerebral hemisphere”, in whom all three forms of neglect mentioned above are present: “She has totally lost the idea of ‘left’, both with regard to her own body and the world.” There is also evidence for a distinction of near and far neglect, in which neglect is only present in certain spatial distances or references [Halligan et al. (1991), Keller et al. (2005), Van der Stoep et al. (2013)]. These are usually referred to as peripersonal (within one’s reach) and extrapersonal neglect (farther than one’s reach). Imaginal neglect refers to neglect in imagined objects or scenes, of content in the mind’s eye, which can be present in the absence of any other forms of neglect [Bisiach and Luzzatti (1978), Guariglia et al. (1994), Coslett (1997)]. Imaginal neglect is more commonly referred to as representational neglect in the literature, though in this author’s view the latter term is not ideal, as it can confuse representational space with representational functions.

 

The observation that unilateral neglect may also affect representational space was first made by Bisiach and Luzzatti in a pioneering study in 1978. They presented two patients suffering unilateral neglect following a stroke, who not only neglected the left side of their visual fields, but also the left side of mental images. The patients were asked to imagine and describe a familiar scene, the Piazza del Duomo, the city square of Milan, from a certain perspective. The patients reported less landmarks that resided on the left side of their imagined view. This bias to report less left-sided landmarks, relative to the imagined viewpoint, remained when asked to imagine the scene from the opposite side of the square. The allocentric and featural information regarding the square’s layout and landmarks (usually termed as “cognitive maps”) were thus available to the patients, as long as the landmarks resided on the right side of the imagined egocentric viewpoint. The authors suggested in a later paper that imaginal neglect could arise as a defect in the generation or maintenance of the left side of mental images, where “the actual possibility of conceptualizing the existence of a left side is in fact precluded”, and that perception and imagery share a spatial representation system [Bisiach & Luzzatti (1978)].

 

An alternative interpretation was offered by Meador et al. (1987) in their study of a patient with unilateral perceptual and imaginal neglect. In a task assessing mental imagery the patient was asked to name items of an imagined scene. When the patient’s head was turned toward the left (neglected) side, he reported more items from that side than when his head was turned to the right. The researchers suggested that the imaginal neglect could be partly explained by an impairment in the ability to direct visual search to this portion of the scene. Thus the mental image is intact, but directing attention to it is not.

 

The first case of pure imaginal neglect, neglect restricted to visual imagery, an “impressive dissociation”, was reported by Guariglia et al. in 1993. They presented a 59-year-old patient who had suffered a stroke that left large lesions in the right frontal and anterior temporal lobe and the head of the caudate and anterior nuclei. The patient showed neglect for imagined scenes, but no evidence of neglect for external stimuli. The authors noted that this case study was at odds with neuropsychological findings that point to the parieto or temporo-occipital cortex as the location of mental imagery structures [Farah et al. (1989) and Kosslyn (1987, 1991)].

 

Several other cases of imaginal neglect have been reported since. Coslett (1997) reported on two patients who demonstrated a double dissociation of perceptual and imaginal neglect. One patient performed normally on standard visual tests, but failed to report items from the left side of an imagined scene. The other demonstrated substantial neglect on visual perceptual and visual attentional tasks, but had normal visual imagery. Beschin et al. (1997) presented the case of a 67-year-old man with imaginal neglect after a ischaemic stroke that damaged his right parietal lobe. Ortigue et al. (2001) reported on an 86-year-old patient with pure imaginal neglect following a right thalamic lesion. Palermo et al. (2010) presented two patients with imaginal neglect.

 

 

Working memory and navigational systems

 

Given the diverse symptomatology of neglect it is reasonable to ask whether these disorders can all be explained by a common mechanism or cause, or whether we are dealing with different processes that merely appear to be linked to one another on the behavioural level.

 

Berti & Rizzolatti (1994) presented a “unifying theory of neglect” which attempts to reconcile these different forms of neglect into a coherent whole, in which all forms are a disorder of spatial awareness caused by damage to perceptuomotor cortical and subcortical pragmatics maps (predominantly in the parietal lobe). These pragmatic maps are tied to different physical functions, such as head movements, arm movements and so on, and code for both space and movements toward the coded space. This model easily accounts for neglect dissociations, as localized brain damage will impair specific spatial “sectors” and also allows for implicit processing of information in cases of partial damage.

 

Imaginal neglect, however, poses some challenges to this model. How can damage to pragmatic maps present itself in one domain but not the other? To what extent do imagination and perception share neural bases? Several theories have been proposed in the past 30-or-so years to explain imaginal neglect, and they can be roughly divided into two groups: one focusing on working memory and attention, and the other on spatial cognition.

 

Baddeley (1981) proposed that neglect of representational space could be explained by defective visuospatial working memory, in which the “visual-spatial scratch pad” might be damaged so that “either that part of the screen was inoperative, or that the process of scanning the screen was defective”. Bisiach (1993) preferred the first alternative, deeming the second “less parsimonious, insofar as it posits two theoretical constructs – a screen and a scanning device”.

 

However, an analogue spatial representation system shared by visual perception and imagery cannot account for the dissociation between perceptual and imaginal neglect [Coslett (1997)]. Furthermore, the traditional hypothesis that working memory acts as a gateway to long-term memory runs into trouble in the presence of pure imaginal neglect; how can perceptual input “pass through” working memory correctly when said working memory is clearly impaired? A model in which perception directly activates long-term memory, the products of which are then held and manipulated in working memory, better accounts for the dissociation between perceptual and imaginal neglect [Beschin et al. (1997, 2005), Denis et al. (2002)].

 

Coslett (1997) posited that the dissociation might be explained by disruptions of forms of spatial cognition, which each compute their own spatial representation. A defective “on-line, real time” coordinate system that corresponds in part to motor or sensorimotor control would explain poor performance on visual perceptual and attentional tasks, whereas a preserved egocentric coordinate system, “a master map of space”, would allow for intact visual imagery. Ortigue et al. (2001), in their study of a patient with pure imaginal neglect, concluded that the “preservation of topographical knowledge directly indicates that representational neglect was not a result of memory impairment but rather a result of a disorder in mental imagery processes operating in a body-centered system”

 

Guariglia & Pizzamoto (2007) hypothesized two different types of space representation, “topograhical” and “non-topographical images”, that are functionally separated by their relation to navigational processes. Topographical images refer to representations of stimuli that the “subject can navigate in” and that can be “transformed into (or correspond to) mental maps of the environment”. Non-topographical images refer to representations of manipulatable objects or arrays of objects that “can never be navigated”.

 

Piccardi et al. (2008) provided evidence that damage to the cognitive system involved in coding and storing environmental information used for navigation could be the cause of some forms of imaginal neglect. Their patient showed pure imaginal neglect, but no deficits in spatial working memory “when evaluated with a traditional clinical test.” However, the patient did show “a peculiar deficit” in navigational tasks requiring re-orientation in a novel environment. The authors suggested that their patient showed damage to a “topological image system” that is devoted to mental representations of environments, as opposed to a “non-topological” system that represents static locations in the environment, such as objects.

 

This notion of topological and non-topological systems was explored by Palermo et al. (2010) in a study of two patients with imaginal neglect. The researchers subjected the patients to a battery of visual mental imagery tests and found a dissociation between environment and object mental images. The first patient, whose performance was asymmetrical on the O’Clock Test, performed poorly on tasks involving the mental generation, inspection and manipulation of objects, but showed no such deficits on tasks involving environments. The second patient, who had difficulties with the Familiar Squares Description Test, had similar problems with environments, but no difficulties with objects.

 

Further investigation into this topic was conducted by Guariglia et al. (2013), who submitted a group of 96 chronic, right brain-damaged patients to an extensive neuropsychological evaluation that included the Familiar Square Description Test and the O’Clock Test. Their results support a dissociation between topological and non-topological images, with pure imaginal neglect for non-topological images being rare, affecting about 3% of the sample of right brain-damaged patients.

 

 

The BBB model of spatial memory and imagery

 

An intriguing theory that largely falls in line with the above studies is the BBB model of spatial memory and imagery [Burgess et al. (2001), Byrne (2007)], which postulates the existence of processes of format transformation, the impairment of which results in imagery neglect. Under the BBB model both encoding and retrieval of spatial memory requires a translation between (parietal) egocentric and (medial temporal) allocentric representations. These processes of translation are mediated by posterior parietal and retrospenial areas.

 

According to the model, visual imagery on the products of retrieved information from memory and sensory perception both occur in the egocentric frame or “parietal window” [Byrne (2007)]. The hippocampus and surrounding medial temporal lobe structures index information of real or imagined locations and Papez’s circuit translates to imagery or from perception according to the direction of view.

 

Damage to these connections could explain difficulties in the Familiar Squares Description Test, as the stored allocentric information would not be correlated with the egocentric point of view. It also accounts for imaginal neglect in cases of anterior cortex [Guariglia (1994)] or thalamic [Ortigue et al. (2001)] lesions, as the retrosplenial cortex has plenty of connection with both. It predicts the effect of manipulating a patient’s perceived head direction on the retrieval of the spatial context of episodic memories [Meador et al. (1987)]. Pure perceptual neglect in the absence of imaginal neglect could be explained by “a lesion along the sensory or motor pathways projecting into and out of posterior parietal cortex”, while pathways to and from the medial temporal lobe remain intact. Pure imaginal neglect would have the opposite neuroanatomical configuration. Furthermore, the BBB model is more in line with the unifying theory of neglect, proposing clear neuroanatomical causes and not relying on more abstract concepts of working memory as Baddeley and Lieberman (1981) and Bisiach (1993) do.

 

Palermo et al. (2012) performed a study based on the BBB model in which patients with perceptual neglect and imaginal neglect had to memorize a novel environment (a hospital ward they had not explored before) and draw a map of it. In another task they had to learn a map of a convention center and then navigate inside the real building. The patients with imaginal neglect had very poor allocentric representations of the hospital ward, as showed by their drawings, which had few details. In the second task both perceptual and imaginal neglect patients had great difficulty navigating the environment, but perceptual neglect patients only made errors when left turns were required, whereas patients with imaginal neglect failed to reach their target when the perspective inside the environment did not match the orientation of the learned map, regardless of whether left or right turns were required. These difficulties with transformation from egocentric to allocentric and vice versa fit with the BBB model of spatial memory and imagery.

 

Boccia et al. (2018) investigated whether damage to white matter tracts in the parietal lobe would prevent the integration of egocentric and allocentric information and result in imaginal neglect for places. They examined 58 right brain damaged stroke patients with and without extrapersonal perceptual neglect and/or imaginal neglect for places using MRI scans. They found that patients with imaginal neglect “for places” showed a higher probability of damage to the posterior part of the arcuate fascilicus and the first branch of the superior longitudal fascilicus. Disconnections in different parts of these areas have been implicated in extrapersonal perceptual neglect [Thiebaut de Schotten et al. (2014)]. They also found that damage to sections of fronto-parietal u-shaped tract predicts imaginal neglect for places, even when extrapersonal neglect is taken into account, but caution that interpretation of its role "is difficult and deserves some caution”.

 

 

Conclusion

 

Spatial neglect provides an illuminating glimpse at the structures of perception and imagination and how mental representations are generated, maintained and investigated. The diverse internal dissociations have presented a conundrum that has taken decades to unravel into a promisingly coherent picture.

 

The separation of spatial representations into topological and non-topological systems appears to this author as a milestone, foregoing more abstract models of spatial working memory for two concrete, functional categories that fulfil different pragmatic goals (navigation of environments and manipulation of objects). The BBB model that is built on these spatial representation systems and the connections between them appears to explain the internal dissociations of neglect and provides neuroanatomical foundations for them.

 

However, the understanding of neglect is confounded by the fact that it is largely built on lesion studies, and it is the nature of lesions to not be confined to specific areas for the convenience of scientists. Multiple areas and functions of the brain are usually damaged, which precludes one from drawing straightforward conclusions about the underlying nature of these phenomena. The combination of transcranial magnetic stimulation and virtual reality might provide a way to study this phenomena in a more precise manner with healthy individuals. Both have already been used on their own to study neglect, but have never been combined [Burgess et al. (2001), Bjoertomt et al. (2002), Ricci et al. (2012)].

 

 

References

 

Baddeley, A. (1981). The concept of working memory: A view of its current state and probable future development. Cognition, 10 (1-3), 17-23.

 

Bisiach, E., & Luzzatti, C. (1978). Unilateral neglect of representational space. Cortex, 14(1), 129-133.

 

Bisiach, E. (1993). Mental representation in unilateral neglect and related disorders: the twentieth Bartlett Memorial Lecture. The Quarterly Journal of Experimental Psychology, 46(3), 435-461.

 

Berti, A., & Rizzolatti, G. (1992). Visual processing without awareness: Evidence from unilateral neglect. Journal of cognitive neuroscience, 4(4), 345-351.

 

Berti, A., & Rizzolatti, G. (1994). Is neglect a theoretically coherent unit?. Neuropsychological Rehabilitation, 4(2), 111-114.

 

Beschin, N., Cocchini, G., Della Sala, S., & Logie, R. H. (1997). What the eyes perceive, the brain ignores: A case of pure unilateral representational neglect. Cortex, 33(1), 3-26.

 

Beschin, N., Denis, M., Logie, R. H., & Della Sala, S. (2005). Dissociating mental transformations and visuo‐spatial storage in working memory: Evidence from representational neglect. Memory, 13(3-4), 430-434.

 

Bjoertomt, O., Cowey, A., & Walsh, V. (2002). Spatial neglect in near and far space investigated by repetitive transcranial magnetic stimulation. Brain, 125(9), 2012-2022.

 

Boccia, M., Di Vita, A., Palermo, L., Committeri, G., Piccardi, L., & Guariglia, C. (2018). The way to “left” Piazza del Popolo: damage to white matter tracts in representational neglect for places. Brain Imaging and Behavior, 12(6), 1720-1729.

 

Burgess, N., Becker, S., King, J. A., & O'Keefe, J. (2001). Memory for events and their spatial context: models and experiments. Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences, 356(1413), 1493-1503.

 

Byrne, P., Becker, S., & Burgess, N. (2007). Remembering the past and imagining the future: a neural model of spatial memory and imagery. Psychological review, 114(2), 340-375.

 

Coslett, H. B. (1997). Neglect in vision and visual imagery: a double dissociation. Brain: a journal of neurology, 120(7), 1163-1171.

 

Denis, M., Beschin, N., Logie, R. H., & Sala, S. D. (2002). Visual perception and verbal descriptions as sources for generating mental representations: Evidence from representational neglect. Cognitive Neuropsychology, 19(2), 97-112.

 

Farah, M. J., Wong, A. B., Monheit, M. A., & Morrow, L. A. (1989). Parietal lobe mechanisms of spatial attention: Modality-specific or supramodal?. Neuropsychologia, 27(4), 461-470.

 

Guariglia, C., Padovani, A., Pantano, P., & Pizzamiglio, L. (1993). Unilateral neglect restricted to visual imagery. Nature, 364(6434), 235-237.

 

Guariglia, C., Palermo, L., Piccardi, L., Iaria, G., & Incoccia, C. (2013). Neglecting the left side of a city square but not the left side of its clock: prevalence and characteristics of representational neglect. PLoS One, 8(7), e67390.

 

Guariglia, C. & Pizzamiglio, L. (2007). The role of imagery in navigation: neuropsychological evidence. In F. Mast, & L. Jäncke (Eds.). Spatial Processing in Navigation, Imagery and Perception pp. 17-28. Springer, Business Media, LLC

 

Halligan, P. W., & Marshall, J. C. (1991). Left neglect for near but not far space in man. Nature, 350(6318), 498-500.

 

Keller, I., Schindler, I., Kerkhoff, G., Von Rosen, F., & Golz, D. (2005). Visuospatial neglect in near and far space: dissociation between line bisection and letter cancellation. Neuropsychologia, 43(5), 724-731.

 

Marshall, J. C., & Halligan, P. W. (1988). Blindsight and insight in visuo-spatial neglect. Nature, 336(6201), 766-767.

 

Meador, K. J., Loring, D. W., Bowers, D., & Heilman, K. M. (1987). Remote memory and neglect syndrome. Neurology, 37(3), 522-522.

 

Ortigue, S., Viaud‐Delmon, I., Annoni, J. M., Landis, T., Michel, C., Blanke, O., ... & Mayer, E. (2001). Pure representational neglect after right thalamic lesion. Annals of Neurology: Official Journal of the American Neurological Association and the Child Neurology Society, 50(3), 401-404.

 

Palermo, L., Nori, R., Piccardi, L., Giusberti, F., & Guariglia, C. (2010). Environment and object mental images in patients with representational neglect: Two case reports. Journal of the International Neuropsychological Society: JINS, 16(5), 921.

 

Palermo, L., Ranieri, G., Nemmi, F., & Guariglia, C. (2012). Cognitive maps in imagery neglect. Neuropsychologia, 50(5), 904-912.

 

Piccardi, L., Bianchini, F., Zompanti, L., & Guariglia, C. (2008). Pure representational neglect and navigational deficits in a case with preserved visuo-spatial working memory. Neurocase, 14(4), 329-342.

 

Ricci, R., Salatino, A., Li, X., Funk, A., Logan, S., Mu, Q., ... & George, M. (2012). Imaging the neural mechanisms of TMS neglect-like bias in healthy volunteers with the interleaved TMS/fMRI technique: preliminary evidence. Frontiers in human neuroscience, 6, 326.

 

Sacks, O. (1985). The Man Who Mistook His Wife for a Hat and Other Clinical Tales. New York, NY: Simon & Schuster

 

Stone, S. P., Halligan, P. W., & Greenwood, R. J. (1993). The incidence of neglect phenomena and related disorders in patients with an acute right or left hemisphere stroke. Age and Ageing, 22(1), 46-52.

 

Thiebaut de Schotten, M., Tomaiuolo, F., Aiello, M., Merola, S., Silvetti, M., Lecce, F., ... & Doricchi, F. (2014). Damage to white matter pathways in subacute and chronic spatial neglect: a group study and 2 single-case studies with complete virtual “in vivo” tractography dissection. Cerebral cortex, 24(3), 691-706.

 

Van der Stoep, N., Visser-Meily, J. M., Kappelle, L. J., de Kort, P. L., Huisman, K. D., Eijsackers, A. L., ... & Nijboer, T. C. (2013). Exploring near and far regions of space: distance-specific visuospatial neglect after stroke. Journal of Clinical and Experimental Neuropsychology, 35(8), 799-811.