#Xdream evolving images for visual full#
#Xdream evolving images for visual code#

The result is that some neurons will respond most readily to things that we'd never see in the real world.

#Xdream evolving images for visual full#

'Your brain is probably full of neurons that are coding for things you never actually see, but they're coding for how things differ from everything else,' Livingstone says. Determining where a particular face falls between two extremes is an easier way for our brains to identify things. So that tells us that neurons are coding extremes, not typical things.' It hints that when our brains are picking out objects like faces, they do so not by storing an image of every single permutation of a human face, but instead simply encode for opposite ends of the face spectrum. 'Instead, it looks like a gnome, or a gargoyle, or a leprechaun. 'You might assume that a cell that’s going to care about faces, the optimum stimulus would look like a face,' she says.

#Xdream evolving images for visual code#

Livingstone says it reveals an important insight into how neurons code for, or recognize, objects. The features looked warped, though, a caricature of what a monkey or a human being looks like. The shapes depicted are messy, though recognizable traits emerge: what looks like a monkey face in one, the masked and gowned figure of a lab member in another. By the end of the experiment, published in Cell, the researchers had a set of images that had been evolved through many generations to depict what specific neurons or neuron groups like best. This went on for a few hundred rounds, or generations, depending on how long the macaques could be convinced to pay attention to the screen. The 10 that did the job best were kept and used to generate a new set of images. To get around the problem, the researchers turned to artificial intelligence. They showed macaques with electrodes implanted in their IT cortex a set of 40 randomly generated images showing abstract patterns and watched to see which stimulated their neurons the most. (Credit: Ponce Xiao and Schade et al./Cell) Machine Vision Perhaps some neurons are attuned to hands, but would respond even more strongly to an octopus - or even an image that doesn't occur in the real world.Īn image evolved by a macaque neuron with the help of artificial intelligence. But that assumption is based on educated guesses, as researchers are limited in the number of things they can 'show' to a neuron to see if it will react. Previous experiments have shown that cells, or clusters of cells, in the IT cortex respond strongly to things like faces or hands. By watching how individual neurons in the IT cortex responded to an image, the researchers could get a feel for what that specific neuron was attuned to. You have what's called an agnosia - a very selective loss of being able to recognize particular classes of objects,' said Margaret Livingstone, a Harvard neurobiologist and co-author of the paper. you can see, but you can't recognize things. This function has been known about for quite some time, actually, thanks to patients who've sustained damage to their IT cortex. The IT cortex comes into play toward the end of the visual processing assembly line, and its main job seems to be recognizing objects. They were working in a piece of the visual processing system called the inferior temporal cortex (IT cortex). So, to narrow down the problem, researchers from Harvard University and the Washington University School of Medicine, focused in as far as they could and looked at individual neurons. Exactly how this happens, though, is still a bit of a mystery.

As the neural signal for a particular image passes through these layers it is gradually sculpted into a coherent representation. What we do know is that our brains have multiple layers of neurons for visual processing, each with their own task. Scientists don't totally understand the process that turns incoming photons into coherent images in our minds. And the researchers say these renderings are even more potent than natural images in provoking monkey's brains to respond. Instead, the jumbled images might help make sense of the way our brains see the world around us. The goal was to create images specifically tuned to stimulate neurons in a monkey's visual cortex. It's not an attempt to create monkey-centric art. The pictures are the result of an experiment that paired artificial intelligence with primate intelligence. But to a macaque's brain cells, says a group of researchers, the images are fascinating. (Credit: Ponce, Xiao, and Schade et al./Cell) Impressionist art, or perhaps nightmare fuel - these images are a confusing mess to the human eye. An image being evolved over hundreds of trials as a monkey neuron selects what it likes best.