Salience (neuroscience)

Salience (also called saliency) is that property by which some thing stands out. Salient events are an attentional mechanism by which organisms learn and survive; those organisms can focus their limited perceptual and cognitive resources on the pertinent (that is, salient) subset of the sensory data available to them.

This article is about salience in cognitive neuroscience. For other uses, see Salience.

Saliency typically arises from contrasts between items and their neighborhood. They might be represented, for example, by a red dot surrounded by white dots, or by a flickering message indicator of an answering machine, or a loud noise in an otherwise quiet environment. Saliency detection is often studied in the context of the visual system, but similar mechanisms operate in other sensory systems. Just what is salient can be influenced by training: for example, for human subjects particular letters can become salient by training.[1][2] There can be a sequence of necessary events, each of which has to be salient, in turn, in order for successful training in the sequence; the alternative is a failure, as in an illustrated sequence when tying a bowline; in the list of illustrations, even the first illustration is a salient: the rope in the list must cross over, and not under the bitter end of the rope (which can remain fixed, and not free to move); failure to notice that the first salient has not been satisfied means the knot will fail to hold, even when the remaining salient events have been satisfied.

When attention deployment is driven by salient stimuli, it is considered to be bottom-up, memory-free, and reactive. Conversely, attention can also be guided by top-down, memory-dependent, or anticipatory mechanisms, such as when looking ahead of moving objects or sideways before crossing streets. Humans and other animals have difficulty paying attention to more than one item simultaneously, so they are faced with the challenge of continuously integrating and prioritizing different bottom-up and top-down influences.

Neuroanatomy

The brain component named the hippocampus helps with the assessment of salience and context by using past memories to filter new incoming stimuli, and placing those that are most important into long term memory. The entorhinal cortex is the pathway into and out of the hippocampus, and is an important part of the brain's memory network; research shows that it is a brain region that suffers damage early on in Alzheimer's disease,[3] one of the effects of which is altered (diminished) salience.[4]

The pulvinar nuclei (in the thalamus) modulate physical/perceptual salience in attentional selection.[5]

One group of neurons (i.e., D1-type medium spiny neurons) within the nucleus accumbens shell (NAcc shell) assigns appetitive motivational salience ("want" and "desire", which includes a motivational component), aka incentive salience, to rewarding stimuli, while another group of neurons (i.e., D2-type medium spiny neurons) within the NAcc shell assigns aversive motivational salience to aversive stimuli.[6][7]

The primary visual cortex (V1) generates a bottom-up saliency map[8][9] from visual inputs to guide reflexive attentional shifts or gaze shifts. According to V1 Saliency Hypothesis, the saliency of a location is higher when V1 neurons give higher responses to that location relative to V1 neurons' responses to other visual locations.[10] For example, a unique red item among green items, or a unique vertical bar among horizontal bars, is salient since it evokes higher V1 responses and attracts attention or gaze.[11] The V1 neural responses are sent to the superior colliculus to guide gaze shifts to the salient locations. A fingerprint of the saliency map in V1 is that attention or gaze can be captured by the location of an eye-of-origin singleton in visual inputs, e.g., a bar uniquely shown to the left eye in a background of many other bars shown to the right eye, even when observers cannot tell the difference between the singleton and the background bars.[12]

In psychology

The term is widely used in the study of perception and cognition to refer to any aspect of a stimulus that, for any of many reasons, stands out from the rest. Salience may be the result of emotional, motivational or cognitive factors and is not necessarily associated with physical factors such as intensity, clarity or size. Although salience is thought to determine attentional selection, salience associated with physical factors does not necessarily influence selection of a stimulus.[13]

Salience Bias Example: attention is drawn to the second image due to the more prominent color (red), as opposed to the less vivid color (light blue) of the first image, biased to the more salient stimulus.

Salience bias

Salience bias (also referred to as perceptual salience) is a cognitive bias that predisposes individuals to focus on or attend to items, information, or stimuli that are more prominent, visible,[14] or emotionally striking. This is as opposed to stimuli that are unremarkable, or less salient, even though this difference is often irrelevant by objective standards.[15] The American Psychological Association (APA) defines the salience hypothesis as a theory regarding perception where “motivationally significant” information is more readily perceived than information with little or less significant motivational importance.[16] Perceptual salience (salience bias) is linked to the vividness effect, whereby a more pronounced response is produced by a more vivid perception of a stimulus than the mere knowledge of the stimulus.[17] Salience bias assumes that more dynamic, conspicuous, or distinctive stimuli engage attention more than less prominent stimuli, disproportionately impacting decision making,[18] it is a bias which favors more salient information.[14]

Cognitive Psychology

Salience bias, like all other cognitive biases, is an applicable concept to various disciplines. For example, cognitive psychology investigates cognitive functions and processes, such as perception, attention, memory, problem solving, and decision making, all of which could be influenced by salience bias. Salience bias acts to combat cognitive overload by focusing attention on prominent stimuli, which affects how individuals perceive the world as other, less vivid stimuli that could add to or change this perception, are ignored. Human attention gravitates towards novel and relevant stimuli and unconsciously filters out less prominent information, demonstrating salience bias, which influences behavior as human behavior is affected by what is attended to.[19] Behavioral economists Tversky and Kahneman also suggest that the retrieval of instances is influenced by their salience, such as how witnessing or experiencing an event first-hand has a greater impact than when it is less salient, like if it were read about,[20] implying that memory is affected by salience.

Language

It is also relevant in language understanding and acquisition. Focusing on more salient phenomena allows people to detect language patterns and dialect variations more easily, making dialect categorization more efficient.[21]

Social Behavior

Furthermore, social behaviors and interactions can also be influenced by perceptual salience. Changes in the perceptual salience of an individual heavily influences their social behavior and subjective experience of their social interactions, confirming a “social salience effect”.[17] Social salience relates to how individuals perceive and respond to other people.

Behavioral Science

The connection between salience bias and other heuristics, like availability and representativeness, links it to the fields of behavioral science and behavioral economics. Salience bias is closely related to the availability heuristic in behavioral economics, based on the influence of information vividness and visibility, such as recency or frequency,[20] on judgements, for example:

Accessibility and salience are closely related to availability, and they are important as well. If you have personally experienced a serious earthquake, you’re more likely to believe that an earthquake is likely than if you read about it in a weekly magazine. Thus, vivid and easily imagined causes of death (for example, tornadoes) often receive inflated estimates of probability, and less-vivid causes (for example, asthma attacks) receive low estimates, even if they occur with a far greater frequency (here, by a factor of twenty). Timing counts too: more recent events have a greater impact on our behavior, and on our fears, than earlier ones.

— Richard H. Thaler, Nudge: Improving Decisions about Health, Wealth, and Happiness (2008-04-08)

Humans have bounded rationality, which refers to their limited ability to be rational in decision making, due to a limited capacity to process information and cognitive ability. Heuristics, such as availability, are employed to reduce the complexity of cognitive and social tasks or judgements,[18][20] in order to decrease the cognitive load that result from bounded rationality. Despite the effectiveness of heuristics in doing so, they are limited by systematic errors[20] that occur, often the result of influencing biases, such as salience. This can lead to misdirected or misinformed judgements, based on an overemphasis or overweighting of certain, more salient information. For example, the irrational behavior of procrastination occurs because costs in the present, like sacrificing free time, are disproportionately salient to future costs, because at that time they are more vivid.[22] The more prominent information is more readily available than the less salient information, and thus has a larger impact on decision making and behavior, resulting in errors in judgement.

Other fields such as philosophy, economics, finance, and political science have also investigated the effects of salience, such as in relation to taxes,[14] where salience bias is applied to real-world behaviors, affecting systems like the economy. The existence of salience bias in humans can make behavior more predictable and this bias can be leveraged to influence behavior, such as through nudges.

Evaluation

Salience bias is one of many explanations for why humans deviate from rational decision making: by being overly focused on or biased to the most visible data and ignoring other potentially important information that could result in a more reasonable judgment. As a concept it is supported in psychological and economic literature, through its relationship with the availability heuristic outlined by Tversky and Kahneman,[20] and its applicability to behaviors relevant to multiple disciplines, such as economics.

Despite this support, salience bias is limited for various reasons, one example being its difficulty in quantifying, operationalizing, and universally defining.[21] Salience is often confused with other terms in literature, for example, one article states that salience, which is defined as a cognitive bias referring to “visibility and prominence”, is often confused with terms like transparency and complexity in public finance literature.[14] This limits salience bias as the confusion negates its importance as an individual term, and therefore the influence it has on tax related behavior. Likewise, the APA definition of salience refers to motivational importance,[16] which is based on subjective judgement, adding to the difficulty. According to psychologist S. Taylor “some people are more salient than others” and these differences can further bias judgements.[18]

Biased judgements have far-reaching consequences, beyond poor decision making, such as overgeneralizing and stereotyping. Studies into solo status or token integration demonstrate this. The token is an individual in a group different to the other members in that social environment, like a female in an all-male workplace. The token is viewed as symbolic of their social group, whereby judgments made about the solo individual predict judgements of their social group, which can result in inaccurate perceptions of that group and potential stereotyping. The distinctiveness of the individual in that environment “fosters a salience bias”[18] and hence predisposes those generalized judgements, positive or negative.

In interaction design

Salience in design draws from the cognitive aspects of attention, and applies it to the making of 2D and 3D objects. When designing computer and screen interfaces, salience helps draw attention to certain objects like buttons and signify affordance, so designers can utilize this aspect of perception to guide users.[23]

There are several variables used to direct attention:

  • Color. Hue, saturation, and value can all be used to call attention to areas or objects within an interface, and de-emphasize others.
  • Size. Object size and proportion to surrounding elements creates visual hierarchy, both in interactive elements like buttons, but also within informative elements like text.
  • Position. An object's orientation or spatial arrangement in relation to the surrounding objects creates differentiation to invite action.

Accessibility

A consideration for salience in interaction design is accessibility. Many interfaces used today rely on visual salience for guiding user interaction, and people with disabilities like color-blindness may have trouble interacting with interfaces using color or contrast to create salience.[24]

Aberrant salience hypothesis of schizophrenia
Further information: Dopamine hypothesis of schizophrenia

Kapur (2003) proposed that a hyperdopaminergic state, at a "brain" level of description, leads to an aberrant assignment of salience to the elements of one's experience, at a "mind" level.[25] These aberrant salience attributions have been associated with altered activities in the mesolimbic system, including the striatum, the amygdala, the hippocampus, the parahippocampal gyrus.[26], the anterior cingulate cortex and the insula.[27] Dopamine mediates the conversion of the neural representation of an external stimulus from a neutral bit of information into an attractive or aversive entity, i.e. a salient event.[28] Symptoms of schizophrenia may arise out of 'the aberrant assignment of salience to external objects and internal representations', and antipsychotic medications reduce positive symptoms by attenuating aberrant motivational salience via blockade of the dopamine D2 receptors (Kapur, 2003).

Alternative areas of investigation include supplementary motor areas, frontal eye fields and parietal eye fields. These areas of the brain are involved with calculating predictions and visual salience. Changing expectations on where to look restructures these areas of the brain. This cognitive repatterning can result in some of the symptoms found in such disorders.

Visual saliency modeling

In the domain of psychology, efforts have been made in modeling the mechanism of human attention, including the learning of prioritizing the different bottom-up and top-down influences.[29]

In the domain of computer vision, efforts have been made in modeling the mechanism of human attention, especially the bottom-up attentional mechanism,[30] including both spatial and temporal attention. Such a process is also called visual saliency detection.[31]

Generally speaking, there are two kinds of models to mimic the bottom-up saliency mechanism. One way is based on the spatial contrast analysis: for example, a center-surround mechanism is used to define saliency across scales, which is inspired by the putative neural mechanism.[32] The other way is based on the frequency domain analysis.[33] While they used the amplitude spectrum to assign saliency to rarely occurring magnitudes, Guo et al. use the phase spectrum instead.[34] Recently, Li et al. introduced a system that uses both the amplitude and the phase information.[35]

A key limitation in many such approaches is their computational complexity leading to less than real-time performance, even on modern computer hardware.[32][34] Some recent work attempts to overcome these issues at the expense of saliency detection quality under some conditions.[36] Other work suggests that saliency and associated speed-accuracy phenomena may be a fundamental mechanisms determined during recognition through gradient descent, needing not be spatial in nature.[37]

See also

References
  1. Schneider W, Shiffrin RM (1977). "Controlled and automatic human information processing: I. Detection, search, and attention". Psychological Review. 84 (1): 1–66. doi:10.1037/0033-295x.84.1.1.
  2. Shiffrin RM, Schneider W (1977). "Controlled and automatic human information processing: II. Perceptual learning, automatic attending and a general theory". Psychological Review. 84 (2): 127–90. doi:10.1037/0033-295x.84.2.127.
  3. Khan UA, Liu L, Provenzano FA, Berman DE, Profaci CP, Sloan R, et al. (February 2014). "Molecular drivers and cortical spread of lateral entorhinal cortex dysfunction in preclinical Alzheimer's disease". Nature Neuroscience. 17 (2): 304–311. doi:10.1038/nn.3606. PMC 4044925. PMID 24362760.
  4. Balthazar ML, Pereira FR, Lopes TM, da Silva EL, Coan AC, Campos BM, et al. (April 2014). "Neuropsychiatric symptoms in Alzheimer's disease are related to functional connectivity alterations in the salience network". Human Brain Mapping. 35 (4): 1237–1246. doi:10.1002/hbm.22248. PMC 6868965. PMID 23418130.
  5. Snow JC, Allen HA, Rafal RD, Humphreys GW (March 2009). "Impaired attentional selection following lesions to human pulvinar: evidence for homology between human and monkey". Proceedings of the National Academy of Sciences of the United States of America. 106 (10): 4054–4059. Bibcode:2009PNAS..106.4054S. doi:10.1073/pnas.0810086106. JSTOR 40428498. PMC 2656203. PMID 19237580.
  6. Malenka RC, Nestler EJ, Hyman SE (2009). Sydor A, Brown RY (eds.). Molecular Neuropharmacology: A Foundation for Clinical Neuroscience (2nd ed.). New York: McGraw-Hill Medical. pp. 147–148, 367, 376. ISBN 978-0-07-148127-4. VTA DA neurons play a critical role in motivation, reward-related behavior (Chapter 15), attention, and multiple forms of memory. This organization of the DA system, wide projection from a limited number of cell bodies, permits coordinated responses to potent new rewards. Thus, acting in diverse terminal fields, dopamine confers motivational salience ("wanting") on the reward itself or associated cues (nucleus accumbens shell region), updates the value placed on different goals in light of this new experience (orbital prefrontal cortex), helps consolidate multiple forms of memory (amygdala and hippocampus), and encodes new motor programs that will facilitate obtaining this reward in the future (nucleus accumbens core region and dorsal striatum). In this example, dopamine modulates the processing of sensorimotor information in diverse neural circuits to maximize the ability of the organism to obtain future rewards. ...
    The brain reward circuitry that is targeted by addictive drugs normally mediates the pleasure and strengthening of behaviors associated with natural reinforcers, such as food, water, and sexual contact. Dopamine neurons in the VTA are activated by food and water, and dopamine release in the NAc is stimulated by the presence of natural reinforcers, such as food, water, or a sexual partner. ...
    The NAc and VTA are central components of the circuitry underlying reward and memory of reward. As previously mentioned, the activity of dopaminergic neurons in the VTA appears to be linked to reward prediction. The NAc is involved in learning associated with reinforcement and the modulation of motoric responses to stimuli that satisfy internal homeostatic needs. The shell of the NAc appears to be particularly important to initial drug actions within reward circuitry; addictive drugs appear to have a greater effect on dopamine release in the shell than in the core of the NAc.
  7. Baliki MN, Mansour A, Baria AT, Huang L, Berger SE, Fields HL, Apkarian AV (October 2013). "Parceling human accumbens into putative core and shell dissociates encoding of values for reward and pain". The Journal of Neuroscience. 33 (41): 16383–16393. doi:10.1523/JNEUROSCI.1731-13.2013. PMC 3792469. PMID 24107968.
  8. Li Z (January 2002). "A saliency map in primary visual cortex". Trends in Cognitive Sciences. 6 (1): 9–16. doi:10.1016/S1364-6613(00)01817-9. PMID 11849610. S2CID 13411369.
  9. Zhaoping, L. 2014, The V1 hypothesis—creating a bottom-up saliency map for pre-attentive selection and segmentation, https://www.oxfordscholarship.com/view/10.1093/acprof:oso/9780199564668.001.0001/acprof-9780199564668-chapter-5.
  10. Yan Y, Zhaoping L, Li W (October 2018). "Bottom-up saliency and top-down learning in the primary visual cortex of monkeys". Proceedings of the National Academy of Sciences of the United States of America. 115 (41): 10499–10504. Bibcode:2018PNAS..11510499Y. doi:10.1073/pnas.1803854115. PMC 6187116. PMID 30254154.
  11. Zhaoping L (2014). Understanding vision: theory, models, and data. UK: Oxford University Press. ISBN 9780199564668.
  12. Zhaoping L (May 2008). "Attention capture by eye of origin singletons even without awareness--a hallmark of a bottom-up saliency map in the primary visual cortex". Journal of Vision. 8 (5): 1.1–118. doi:10.1167/8.5.1. PMID 18842072.
  13. Tsakanikos E (2004). "Latent inhibition, visual pop-out and schizotypy: Is disruption of latent inhibition due to enhanced stimulus salience?". Personality and Individual Differences. 37 (7): 1347–58. doi:10.1016/j.paid.2004.01.005.
  14. Schenk, Deborah H. (2011). "Exploiting the salience bias in designing taxes". heinonline.org. Retrieved 2023-03-23.
  15. "Salience Bias - The Decision Lab". The Decision Lab. Archived from the original on 2019-05-28.
  16. "APA Dictionary of Psychology". dictionary.apa.org. Retrieved 2023-03-28.
  17. Inderbitzin, Martin P.; Betella, Alberto; Lanatá, Antonio; Scilingo, Enzo P.; Bernardet, Ulysses; Verschure, Paul F. M. J. (February 2013). "The social perceptual salience effect". Journal of Experimental Psychology: Human Perception and Performance. 39 (1): 62–74. doi:10.1037/a0028317. ISSN 1939-1277. PMID 22612058.
  18. Taylor, Shelley E. (1982), Tversky, Amos; Kahneman, Daniel; Slovic, Paul (eds.), "The availability bias in social perception and interaction", Judgment under Uncertainty: Heuristics and Biases, Cambridge: Cambridge University Press, pp. 190–200, ISBN 978-0-521-28414-1, retrieved 2023-03-28
  19. Dolan, P.; Hallsworth, M.; Halpern, D.; King, D.; Metcalfe, R.; Vlaev, I. (2012-02-01). "Influencing behaviour: The mindspace way". Journal of Economic Psychology. 33 (1): 264–277. doi:10.1016/j.joep.2011.10.009. ISSN 0167-4870.
  20. Tversky, Amos; Kahneman, Daniel (1974-09-27). "Judgment under Uncertainty: Heuristics and Biases: Biases in judgments reveal some heuristics of thinking under uncertainty". Science. 185 (4157): 1124–1131. doi:10.1126/science.185.4157.1124. ISSN 0036-8075. PMID 17835457. S2CID 6196452.
  21. MacLeod, Bethany (2015-01-01). "A critical evaluation of two approaches to defining perceptual salience". Ampersand. 2: 83–92. doi:10.1016/j.amper.2015.07.001. ISSN 2215-0390.
  22. Akerlof, George A. (1991). "Procrastination and Obedience". The American Economic Review. 81 (2): 1–19. ISSN 0002-8282. JSTOR 2006817.
  23. Leiva, Luis A.; Xue, Yunfei; Bansal, Avya; Tavakoli, Hamed R.; Köroðlu, Tuðçe; Du, Jingzhou; Dayama, Niraj R.; Oulasvirta, Antti (2020-10-05). "Understanding Visual Saliency in Mobile User Interfaces". 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services. Oldenburg Germany: ACM. pp. 1–12. arXiv:2101.09176. doi:10.1145/3379503.3403557. ISBN 978-1-4503-7516-0. S2CID 222081592.
  24. "WebAIM: Contrast and Color Accessibility - Understanding WCAG 2 Contrast and Color Requirements". webaim.org. Retrieved 2021-12-13.
  25. Kapur S (January 2003). "Psychosis as a state of aberrant salience: a framework linking biology, phenomenology, and pharmacology in schizophrenia". The American Journal of Psychiatry. 160 (1): 13–23. doi:10.1176/appi.ajp.160.1.13. PMID 12505794. S2CID 15910113.
  26. Lee SK, Chun JW, Lee JS, Park HJ, Jung YC, Seok JH, Kim JJ (2014). "Abnormal neural processing during emotional salience attribution of affective asymmetry in patients with schizophrenia". PLOS ONE. 9 (3): e90792. Bibcode:2014PLoSO...990792L. doi:10.1371/journal.pone.0090792. PMC 3949688. PMID 24619004.
  27. Kowalski J, Aleksandrowicz A, Dąbkowska M, Gawęda Ł (September 2021). "Neural Correlates of Aberrant Salience and Source Monitoring in Schizophrenia and At-Risk Mental States-A Systematic Review of fMRI Studies". Journal of Clinical Medicine. 10 (18): 4126. doi:10.3390/jcm10184126. PMC 8468329. PMID 34575237.
  28. Berridge KC, Robinson TE (December 1998). "What is the role of dopamine in reward: hedonic impact, reward learning, or incentive salience?". Brain Research. Brain Research Reviews. 28 (3): 309–369. doi:10.1016/s0165-0173(98)00019-8. PMID 9858756. S2CID 11959878.
  29. Gielen S, Heskes T, van de Laar P (August 1997). "Task-Dependent Learning of Attention". Neural Networks. 10 (6): 981–992. CiteSeerX 10.1.1.939.342. doi:10.1016/S0893-6080(97)00031-2. hdl:2066/24972. PMID 12662494. S2CID 206089701.
  30. Frintrop S, Rome E, Christensen HI (2010). "Computational visual attention systems and their cognitive foundations". ACM Transactions on Applied Perception. 7 (1): 1–46. doi:10.1145/1658349.1658355. S2CID 8620299.
  31. A. Maity (2015). "Improvised Salient Object Detection and Manipulation". arXiv:1511.02999 [cs.CV].
  32. Itti L, Koch C, Niebur E (1998). "A model of saliency-based visual attention for rapid scene analysis". IEEE Transactions on Pattern Analysis and Machine Intelligence. 20 (11): 1254–9. CiteSeerX 10.1.1.53.2366. doi:10.1109/34.730558. S2CID 3108956.
  33. Hou X, Zhang L (2007). "Saliency Detection: A Spectral Residual Approach". 2007 IEEE Conference on Computer Vision and Pattern Recognition. pp. 1–8. CiteSeerX 10.1.1.579.1650. doi:10.1109/CVPR.2007.383267. ISBN 978-1-4244-1179-5. S2CID 15611611.
  34. Guo C, Ma Q, Zhang L (2008). "Spatio-temporal Saliency detection using phase spectrum of quaternion fourier transform". 2008 IEEE Conference on Computer Vision and Pattern Recognition. pp. 1–8. CiteSeerX 10.1.1.408.2452. doi:10.1109/CVPR.2008.4587715. ISBN 978-1-4244-2242-5. S2CID 16493916.
  35. Li J, Levine MD, An X, Xu X, He H (April 2013). "Visual saliency based on scale-space analysis in the frequency domain". IEEE Transactions on Pattern Analysis and Machine Intelligence. 35 (4): 996–1010. arXiv:1605.01999. doi:10.1109/TPAMI.2012.147. PMID 22802112. S2CID 350786.
  36. Katramados I, Breckon TP (2011). "Real-time visual saliency by Division of Gaussians". 2011 18th IEEE International Conference on Image Processing. pp. 1701–4. CiteSeerX 10.1.1.227.7801. doi:10.1109/ICIP.2011.6115785. ISBN 978-1-4577-1303-3. S2CID 16438770.
  37. Achler T. (2013). "Supervised Generative Reconstruction: An Efficient Way To Flexibly Store and Recognize Patterns". arXiv:1112.2988 [cs.CV].
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.