Interesting letter from last year re acquired prosopagnosia and the uncanny valley

Editor’s pick: Excluded from the uncanny valley
From Bob Cockshott

New Scientist. Issue 3100. November 19th 2016. p.60.

https://www.newscientist.com/letter/mg23231002-500-1-editors-pick-excluded-from-the-uncanny-valley/

The experience described in the letter seems to suggest that there is more to face recognition than simple memory or faces, or could it be that there are aspects of the perception of faces in particular that make them especially memorable? Faces are easy to personify because they are usually found on people. Perhaps it is the ability to detect the person behind the face that has become amiss in the letter’s author following his stroke, and maybe this ability feeds into face memory? Such a relationship would explain the author’s inability to notice the uncanny valley, and it would also explain why a personifying synaesthete like myself is also a super-recognizer.

P.S.

https://www.newscientist.com/article/mg23230970-500-exploring-the-uncanny-valley-why-almosthuman-is-creepy/

I’ve had a read of the interesting article by Laura Spinney that this letter was a comment about, and I think the Perceptual Mismatch Theory of the Uncanny Valley Effect probably offers a more plausible explanation of my a prosopagnosic might be unable to detect the uncanny valley than the competing Category Uncertainty Theory. The article explained the two theories and evidence supporting them. To summarise, the CUT explains the UVE as the result of confusion about what type of thing one is looking at (for example robot or human?), while the PMT explains the UVE as resulting from unease or perceptual confusion when different features or parts of the thing or being viewed have dissimilar levels of human-like appearance (for example the face and skin look realistic but the eyes do not move like human eyes). I think the case of a prosopagnosic not detecting the UVE when people with normal face perception do is support for the PMT theory rather than the other because as far as I know, prosopagnosia does not involve inability to classify faces or bodies as human or non-human, while I believe there is evidence supporting the idea that prosopagnosia can be the result of not being able to perceptually integrate the features of the face as a whole that is recognizable as a unique or distinctive mix of many attributes and features. A non-prosopagnosic person should be able to perceive a face or body as a whole made up of parts, and notice if one or more elements has a level of humanity that does not match other parts, as in the PMT, while a prosopagnosic might not. Of course, research is needed to investigate my armchair speculations.

Thoughts sometimes turn to food with synaesthesia

Whenever I see the colours chocolate brown and forest green together, in any context, that makes me think of the taste and mouth-feel of chocolate with mint brittle or mint cracknel, as exemplified by the Peppermint Crisp bar:

https://en.wikipedia.org/w/index.php?title=Peppermint_Crisp&oldid=690240217

Whenever I see the colours forest green and white together, in any context, I think of Kool Mints which I believe were produced in those colours when I was a child. I can even get this effect through grapheme-colour synaesthesia triggered by numbers. For example, the street number of a house that I once lived in evokes the concept of Kool Mints.

Whenever is see one of those cute, rounded, new but retro-styled cars with perfect glossy paint in a brownish tint, it makes me think of flavoured rice-cream or some other flavoured milky desert in the applicable flavour for the colour, such as caramel ricecream, coffee cream desert, chocolate ricecream etc.

http://www.cbsnews.com/pictures/worlds-15-ugliest-cars/3/

On the odd occasion when I’m near a helicopter and hear its engine at close range, or hear one operating under a load, that sound makes me think of the uniquely wonderful smell of a steak and onion pie.

Helicopter

I wish, I wish…

I’d love to be reading and writing about fascinating and largely unexplored topics in neuroscience and psychology such as superagers, super-visualisers and aphantasia, but Christmas and all the associated this and that, and the everyday business of parenting in the summer holidays and housekeeping takes up my time.

Interesting to read that aphantasia was apparently first identified by Sir Francis Galton in 1880, even though it has only recently been given the name aphantasia and come to the attention of contemporary researchers. Galton was also one of the earliest researchers to describe various varieties of synaesthesia, before they were all named as such. Galton was one hell of a scientist, back in the days when a man of means could spend his days exploring vast unknown territories of psychology. Is research so different these days? Science is now a bit more open to women researchers, and there’s still much to explore.

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3541673/

https://www.newscientist.com/article/2112820-superagers-with-amazing-memories-have-alzheimers-brain-plaques/

https://www.newscientist.com/article/2104221-superagers-with-amazing-memories-have-shrink-resistant-brains/new

http://www.bbc.com/news/health-34039054

Zeman, A., Dewar, M., & Della Sala, S. Lives without imagery–Congenital aphantasia. Cortex, 3.
https://www.researchgate.net/profile/Adam_Zeman/publication/279234629_Lives_without_imagery_-_Congenital_aphantasia/links/573612f208ae9f741b29cd33.pdf

 

Interesting questions and serious concerns

Revell, Timothy Concerns as face recognition tech used to ‘identify’ criminals. New Scientist. December 1st 2016.

https://www.newscientist.com/article/2114900-concerns-as-face-recognition-tech-used-to-identify-criminals/

Garvie, Clare, Bedoya, Alvaro and Frankle, Jonathan The perpetual line-up: unregulated police face recognition in America. Center on Privacy & Technology at Georgetown Law. OCTOBER 18th 2016.

https://www.perpetuallineup.org/

Is there really a criminal face? I don’t think the research discussed in the New Scientist article settles the debate by any means, but at least the controversial idea is opened up for investigation. If there is one my guess is that it is a look that coincides with the Australian face (every race and nation has a distinctive averaged facial type, apparently). European colonisation of Australia began as a penal colony and thus a good part of the white genetics of Australians arrived in this country through people identified as criminals. My best guess is that the crim face has a large straight nose, thin lips and puffy, small eyes. I’d guess this unattractive face could in itself be a social and economic disadvantage, or could be symptomatic of a phenotype that includes some degree of intellectual impairment. I think if there is a crim face it might have little to do with personality but a lot to do with disadvantage, but this is all speculation.

I think it is worth noting that claims made in the print version of this article about supposed advantages of AI over humans in face recognition skills such as identifying age, gender, ethnicity and tiredness by looking at faces presumably only apply to humans of average face recognition ability who maybe are not as exhaustively trained in these skills as the AI systems have been. One cannot compare human ability with AI in face recognition until appropriately trained super-recognizers (representing the top end of human ability) have been pitted against machines. I’m guessing this hasn’t been done.

Perhaps the most important part of this article is right at the end; “…the majority of US police departments using face recognition do little to ensure that the software is accurate.” That certainly is not good enough. Human super-recognizers have abilities that have been proven in scientific testing and also in practice in policing in the UK. Why do so many people persist in the assumption that machines must be better than humans in visual processing, in the face of an abundance of evidence? The link in the New Scientist article to the website of the researchers who have criticized the use of face recognition technology in law enforcement in the United States of America is worth a look for sure.

Faces get all the attention but we are misled by them?

Eagerly anticipating this counter-intuitive book:

Face Value: The Irresistible Influence of First Impressions
Alexander Todorov
Hardcover | May 2017

http://press.princeton.edu/titles/10923.html

 

Surprising explanation for why face recognition matures unusually late in human development!

I didn’t expect to be reading this but I can recognize that this discovery seems to explain why face recognition is human cognitive ability that hits its peak surprisingly late in human development, and I’m now wondering how this fits into my theories about the relationship between my super-recognition and my synaesthesia, and that includes wondering how this discovery fits with my immune hypothesis of synaesthesia (which is all about pruning rather than proliferation), and of course I’m wondering how this fits in with what is known about super-recognizers. I guess I should just calm down and read the full text.

Coghlan, Andy Brain’s face recognition area grows much bigger as we get older. New Scientist. January 5th 2017.
https://www.newscientist.com/article/2117259-brains-face-recognition-area-grows-much-bigger-as-we-get-older/

Jesse Gomez, Michael A. Barnett, Vaidehi Natu, Aviv Mezer, Nicola Palomero-Gallagher, Kevin S. Weiner, Katrin Amunts, Karl Zilles, Kalanit Grill-Spector Microstructural proliferation in human cortex is coupled with the development of face processing. Science. January 6th 2017.

http://science.sciencemag.org/content/355/6320/68

 

Wouldn’t say it’s a positive or a negative experience

The experience of being a super-recognizer is often interesting. I wouldn’t say it is necessarily a positive experience or a negative experience. Like most human abilities it adds a layer of complexity to my life. There are occasionally some strange moments, like the time when I was chatting about our favourite hobby with a kind and humble foreign lady who I’d never met before and probably wont ever meet again, who had almost but not quite the same dentition as my late mother, who has been gone for something like four decades. And just the other day I was striding out of Kmart with an armful of unnecessary items and in the corner of my eye spotted a doppelganger of my late father. When I turned my head for a second glance the old buzzard wriggled uncomfortably in just the same way that Dad used to. We are all nothing more than twigs of the great tree of humanity. Please be kind and please be good in 2017.

Chinese technology company using facial recognition technology

I think it is worth noting that this article and a similar one in a November issue of New Scientist have announced the commencement of use of this technology, rather than reviewing the performance of it or reporting the proven effectiveness of it. I’m skeptical.

Vincent , James Baidu swaps tickets for facial recognition in historic Chinese ‘water town’. Verge. November 17th 2016.
http://www.theverge.com/2016/11/17/13663084/baidu-facial-recognition-park-wuzhen

 

True that skulls can be used to create recognizable faces

Wardrop, Ian and Neave, Richard I know that face. New Scientist. No 3101 November 26th 2016.
https://www.newscientist.com/topic/lastword/i-know-that-face/

 

Sound married to vision is the completely normal and sometimes entertaining way of perceiving the world

I’ve got to laugh on the odd time that I read a description of synaesthesia that makes it sound like some kind of mental disorder or abnormality of sensory perception. Sure enough, synaesthesia concurrents are perceptions of sensory experiences that are not triggered by things happening outside of the mind. They are experiences (not always sensory) triggered by activity happening within the mind (just like the meanderings of your normal constant train of thought). A synaesthete can experience sound as a synaesthesia concurrent triggered by a visual experience (the synaesthesia inducer), and might also experience a visual concurrent triggered by a sound inducer. Coloured music and visual animations that make sound are commonly-reported experiences in people who are, to borrow a phrase from Galton, “sane persons”. It might sound psychedelic to a non-synaesthete, but it is not far at all from normal perception, because life is full of events in which movement or some other visual stimuli is accompanied by a sound sensory stimuli: clapping hands, wind that rustles leaves, lips that speak, impacts that bang, or an explosion that is huge visually, sonically and physically. This pairing of sound and sight is so much a part of normal perception (in humans and other creatures) that it is commonly exploited in live entertainment.

I’ve had the opportunity to work in the past in the live entertainment industry and I also recently enjoyed the rehearsals of the Arcadia musical and special effects spectacular show currently at Elizabeth Quay in Perth. I know that there is a most startling loud roaring sound through the stage speakers that is typically created to coincide with a visual effect of an explosion of flames. It’s like some bloke presses a button somewhere and all hell breaks loose for a second or two. Arcadia uses this flame-roar sound to add sonic spectacle to the flame-thrower, and in the past while working I’ve also heard that sound used in complete isolation from music in a sound check of another spectacular stage show. At the risk of ruining the magic, I’m revealing that the sound that goes with the flames is an artistic artifice. I guess that any real sound that the flame effect makes has been judged to be not sufficiently loud and spectacular enough, and a suitably awesome sound (a recording of what I can only guess) was created to go along with the visual effect of flames from hell. I think this shows just how important crossmodal experiences are to live entertainment shows that are based on spectacular sensory experiences. The sound must equal the visual spectacle.

There are also many other ways in which sound and sight are linked in stage shows and special effects in entertainment. Musicolour lighting effects have been around since my Dad created disco equipment in our lounge using it back in the 1970s, and similar but much more developed lighting effects can be seen in the body of the Arcadia spider. Technology is not always required to artificially marry lighting and sound, as the amazing red and blue man electricity show features electrical discharges that look like tamed lightning that naturally give off a crackling sound along with the white light. But then again, I’m now wondering whether that sound is for real. Anyway, it’s wonderful, mad, sensory fun. I love it!

Postscript January 2017

I think the phenomenon of “quiet fireworks” adds more support to my point that spectacular public entertainment special effects often include the deliberate timing of sound and visual effects to happen at the same time to create a form of artistic synaesthesia, because while fireworks typically have bangs and flashes at the same time, the bang part of the spectacle is not essential or inseparable.

Arcadia Spider

Red man and blue man

Flaming Spider