Gurney Journey | category: Visual Perception


Gurney Journey

This daily weblog by Dinotopia creator James Gurney is for illustrators, plein-air painters, sketchers, comic artists, animators, art students, and writers. You'll find practical studio tips, insights into the making of the Dinotopia books, and first-hand reports from art schools and museums.

How Birds See Each Other

How Birds See Each Other

Many birds and insects have receptors for colors that we humans can't see. 

How Birds See Each Other

Starlings, for example, can see colors in reflected ultraviolet light that are beyond our human capacity. On the left is how starlings look to humans. On the right is how starlings may look to each other. 

How Birds See Each Other
Image credit: Klaus Schmitt 
According to Neringa Utaraitė: "Birds are tetrachromats, [so] they see four colors: UV, blue, green, and red, whereas we are trichromats and can only see three colors: blue, green, red. Bear in mind, that the magenta UV “color” shown here has been chosen to make it visible for us humans, it is a “false color”, as per definition UV light has no color."

Thanks, Massimo via Bored Panda

Does Language Constrain The Speed of Thought?

Does Language Constrain The Speed of Thought?
Here's a question: Are our thoughts limited by having to move at the speed of speech? 

And a bigger question: How is our mental life constrained by speech altogether?

These questions elicited a lot of lively discussion on my Instagram account. To the broader question, Rosemary reminded me of the truth and limitations of the Sapir-Whorf Hypothesis, also known as linguistic relativity, which argues that our thought is shaped by language we speak.

One problem with such a theory is that it tends to assume that all thought is verbal. Artists, musicians, architects, and engineers know otherwise. We can form purely visual or musical ideas which surely qualify as a form of thought or reasoning. If you've ever had an artistic encounter with another artist with whom you share no spoken language, you know that those visual ideas can be shared between people no matter what languages they speak.

Regarding the first question about the speed of thought, it occurs to me that when we are speaking, our language necessarily places upper limits on the pace at which we can roll out ideas, a problem for human-computer interfaces. An artificial intelligence can generate paragraphs in milliseconds, but it takes us a lot of time to type or say a series of ideas. 

Sometimes I have the opposite problem, where my brain works a little too slowly to articulate a sentence fluently, so the result almost sounds like aphasia. I believe that for most people, our receptive capacity for language by timing how fast you can read, or while listening to an audio book by doubling or tripling the normal speech velocity. You can demonstrate this on YouTube or your favorite podcast app by increasing the speed settings on audio playback. 

Certain non-linguistic modes of thought don't seem to be limited by velocity of expression. For example, the thought that goes into solving a Rubix cube seems almost like an instantaneous pattern recognition, and the act of puzzle solving appears to be limited only by the neuro-muscular action of the hands.

To me, the limitations of language become clearest when trying to translate a memory of a dream after awakening. Rendering a dream into words is like trying to taxidermy a jellyfish. The act of trying it makes me realize how words can do violence to certain kinds of non-logical ideas.

Bistable Percepts

Most people are familiar with the face / vase illusion (below). Psychologists refer to it as a "bistable percept." 

Bistable Percepts

A bistable percept is an image that can be perceived in two different ways. The perception can switch back and forth between the two interpretations, but you only see one at a time. 

Bistable Percepts
Another example of a bistable percept is the Necker cube which switches from appearing above you and projecting to the right, to appearing below you and projecting to the left.

One characteristic is that the duality, once perceived, can't be forgotten.

Ambiguous Images

Take a look at this picture. What do you see? When you look at it again, do you see something else?

Ambiguous Images
Image courtesy Steve Stuart Williams and Tim Urban

Most people see a man, off balance, running into a snowy forest. Then after looking again, they see a dog running toward us. Some people see the dog first and have a hard time seeing the human.

What's going on is that there are two opposite streams of information processing going on in your brain. One stream is like a camera. Light enters your eye and resolves into shapes and patterns that move to the back of the brain and up through the cerebral cortex to higher level processing. 

But while this is going on, the brain is constantly generating theories of what it's seeing and delivering those theories down the pipeline, optimizing what you're actually seeing to fit its dominant conception.

All along you're reality-checking the top-down theory against the information coming up the pipeline from the eyes.

If the first top-down reading doesn't continue to fit the bottom-up facts, you start generating new interpretations.

A similar process happens with auditory processing when you hear a gunshot...or was that a firecracker?...or was someone popping a paper bag? You can feel your adrenaline surge when you think it's a gunshot, and all that changes when you realize it isn't.

Weird Science of Visual Perception

This was a cover feature I proposed for ImagineFX Magazine . They never used it, but I still believe it would be an awesome subject for artists. 

Weird Science of Visual Perception

Birdman, oil. I used mainly four colors: viridian, permanent alizarin, yellow ochre, and cerulean.

Knowing about the science of eye-tracking, color vision, afterimages, and image processing helps us a lot as image-makers.

Read my previous posts on Visual Perception

The Role of Prediction in Perception

Stored Sunlight, 5 x 8 inches, watercolor and gouache

"The mind is a prediction engine, and nowhere is this more true than in visual perception." 

Comparison with photo taken after the fact

In his book "The Mind: Consciousness, Prediction, and the Brain," by E. Bruce Goldstein details current research about how the process of visual perception. 

What happens when we see is that the brain creates a top-down model of the world and continually checks it against the input coming from our senses.

"The mind encompasses everything we experience," he says, "and these experiences are created by the brain--often without our awareness. Experience is private; we can't know the minds of others. But we also don't know what is happening in our own minds."

This podcast interview with Goldstein lays out the issues well.

Attentional Spotlight

We bestow our visual attention very selectively, and that hierarchy of awareness is called the attentional (or foveal) spotlight. It's like exploring a pitch-black house at night with a narrow-beamed flashlight.

The fovea is the central spot of the retina, which is packed with photoreceptors, especially color receptors. In the peripheral retina there are fewer receptors, and they tend to be more responsive to tone and movement.

Attentional Spotlight
Robert Frederick Blum, Venetian Lacemakers, 1887, Cincinnati Museum

As I understand it, the attentional spotlight is more than just a structural feature of our photoreceptors. It also describes an aspect of our cognitive awareness of the world around us; some would say it's a central quality of consciousness itself. We focus our attention on elements of our world that match our conscious or unconscious search parameters, or distractions that pop up, competing for attention. 

Painters can capture the experience of the attentional spotlight, by helping the viewer know what's important, and downplaying the rest. It helps to darken, simplify, or blur areas that are less important. In the painting by Robert Blum, look at how much he downplays the peripheral areas in the foreground, and below the chairs, and keeps our attention within the circle of illuminated faces and hands.

Introduction to the attentional spotlight

Research Gate: Spotlight Model of Visual Attention 

Brain Scanners that Recognize What You Have Looked At.

In recent years, brain imaging studies have been able to recognize what image a person is looking at purely from brain activity. This is possible because the image maps onto the visual cortex almost like a blurry projection.

Brain Scanners that Recognize What You Have Looked At.
But now scientists have gone a step further. Researchers studying patterns of brain activity can correctly identify what image you have seen in the past, or even what image you're imagining, based on brain activity.

The research examines how you remember — and imagine— pictures that you've actually seen. It turns out that similar mechanisms come into play when you imagine something compared to how you process the real thing. 

The scanning system is still in its infancy, but it portends the kind of mind-reading device described by science fiction authors. "It's what you would actually use if you were going to build a functional brain-reading device," said Jack Gallant, a neuroscientist from the University of California, Berkeley.

CNN: Brain scans reveal what you've seen

Brain Inspired Podcast: Thomas Naselaris | Seeing vs. Imagining

How much data does the eye transmit?

Researchers estimate that the neural wiring from the retina transmits information to the brain at approximately the same rate as an Ethernet connection, about 10 million bits per second. That sounds like a lot, but it's not as much information as we think we're getting. 
How much data does the eye transmit?

"Much research on the basic science of vision asks what types of information the brain receives; this study instead asked how much. Using an intact retina from a guinea pig, the researchers recorded spikes of electrical impulses from ganglion cells using a miniature multi-electrode array. The investigators calculate that the human retina can transmit data at roughly 10 million bits per second."

"The retina is actually a piece of the brain that has grown into the eye and processes neural signals when it detects light. Ganglion cells carry information from the retina to the higher brain centers; other nerve cells within the retina perform the first stages of analysis of the visual world. The axons of the retinal ganglion cells, with the support of other types of cells, form the optic nerve and carry these signals to the brain."

As we've seen in previous posts, the impression we have of a highly detailed world don't come entirely from the eye, but also in a top-down fashion from in the form of predictive models from memory centers in the brain.

Read the article at Science Daily

How Birds See Each OtherDoes Language Constrain The Speed of Thought?Bistable PerceptsAmbiguous ImagesWeird Science of Visual PerceptionThe Role of Prediction in PerceptionAttentional SpotlightBrain Scanners that Recognize What You Have Looked At.Oscar Reutersvärd, Master of IllusionHow much data does the eye transmit?

Report "Gurney Journey"

Are you sure you want to report this post for ?