Seeing and Space: The Brain’s Visual Processing

Every time you reach for your phone, recognize a friend’s face, or parallel park a car, your brain is performing an extraordinary act of visual intelligence. It is not simply “seeing” – it is identifying, locating, and acting on visual information in fractions of a second. This capacity depends on two major neural systems that divide the work of vision in a surprisingly elegant way, and on a motor programming system that lets your body move before it even receives full sensory confirmation. Understanding how these systems work – and what happens when they break down – opens a fascinating window into the brain’s architecture.

The brain’s two visual highways
The ventral stream: the “what” pathway
The dorsal stream: the “where” and “how” pathway
When spatial vision breaks down: visuospatial neglect
Drawing tests as diagnostic windows
From seeing to moving: motor programming and anticipation
The role of anticipation in action
Sensory feedback and updating motor commands
Why this matters for understanding the brain

The brain’s two visual highways

The idea that vision is a single, unified process is a myth. Research on primate and human neuroscience has established that the cortical visual system is organized into two major processing streams: a ventral pathway and a dorsal pathway. These two routes handle fundamentally different questions – and they run in parallel.

Visual information leaving the primary visual cortex (V1) travels along these two distinct routes, each projecting to different cortical regions and supporting different cognitive functions. Together they make it possible for you to recognize what you’re looking at and know exactly where it is in space – simultaneously.

The ventral stream: the “what” pathway

The ventral stream runs from the primary visual cortex downward toward the temporal lobe. This pathway is often described as the “What” pathway because its primary role is object identification – recognizing shapes, faces, colors, and the meaningful identity of visual stimuli. When you look at an apple and immediately know it is an apple, you are relying on the ventral stream.

Visual perception as a whole involves multiple elemental abilities: distinguishing one shape from another, recognizing partially visible forms, recalling visual details after they’ve left the field of view, and identifying objects that appear in unfamiliar orientations or sizes. The ventral stream orchestrates much of this complex recognition work by processing fine detail, color, and object structure in progressively more abstract cortical areas as information moves from V1 toward the inferotemporal cortex.

The dorsal stream: the “where” and “how” pathway

The dorsal stream runs upward from V1 toward the parietal cortex. It was originally described as the “Where” pathway for its role in spatial localization, but more recent evidence has expanded this description considerably. The dorsal stream actually gives rise to three distinct major pathways – a parieto-prefrontal pathway, a parieto-premotor pathway, and a parieto-medial temporal pathway – which primarily support spatial working memory, visually guided action, and spatial navigation respectively.

This means the dorsal stream is not just telling the brain where something is – it is also helping calculate how to reach for it, how to grip it, how to navigate around it, and how to remember its spatial location for future use. Growing evidence further suggests that the dorsal pathway actively contributes to visual perception itself, processing visuospatial attributes like depth, orientation, and three-dimensional structure even when no action is being planned.

Research on hemispheric specialization has also shown that the two hemispheres process spatial information differently: the right hemisphere tends to favor metric (coordinate) spatial representations, while the left hemisphere tends to favor relative (categorical) ones. This distinction matters clinically, as damage to these regions can produce very different spatial processing deficits.

When spatial vision breaks down: visuospatial neglect

The most dramatic illustration of what the dorsal stream and parietal cortex do comes from what happens when they are damaged. Spatial neglect syndrome is a behavioral disorder classically presenting as non-dominant, often left-sided, spatial disorientation following damage to the right cerebral hemisphere – particularly the right posterior parietal cortex. It is not a blindness in the conventional sense. Rather, the brain fails to generate awareness of one side of space.

Visual neglect is considered a deficit of visual awareness: patients fail to orient, report, or respond to stimuli in the space contralateral to a cerebral lesion, despite having structurally intact visual pathways. The problem is fundamentally attentional, not sensory. Patients can, in many situations, still detect stimuli on the neglected side under certain conditions – but their brain does not spontaneously register that side of the world.

One particularly striking clinical feature is anosognosia – a lack of awareness of the deficit itself. The most challenging aspect of this condition is the frequent abnormal awareness patients have about their own impairment, as well as associated emotional dysfunction. Patients are not pretending not to see – they genuinely do not know they are missing anything.

Drawing tests as diagnostic windows

Neuropsychologists have long used drawing tasks to assess visuospatial function, and these tests reveal neglect with striking clarity. The Clock Drawing Test (CDT) is a widely used cognitive screening tool that assesses multiple domains simultaneously, including executive function, attention, and visuospatial skills. In the typical version, a patient is asked to draw a clock face and set the hands to a specified time.

Patients with right posterior lesions typically manifest spatial disorganization and neglect – for example, leaving numbers off the left side of the clock face or crowding all the numbers on the right side. This is not a memory error or a drawing skill problem in the ordinary sense – it is a direct signature of the brain’s failure to attend to left hemispace.

Drawing tasks are widely used diagnostically in hemispatial neglect because patients often fail to represent the leftward portion of objects or the left half of a multielement scene. Beyond the clock test, clinicians use cancellation tasks (crossing out targets on a page), line bisection tasks (marking the midpoint of a line), and figure-copying tasks. These neuropsychological batteries have been developed specifically to capture and quantify the degree of neglect in a standardized, comparable way.

The visuospatial abilities assessed by these tests are not confined to clinical populations. Visuospatial skills – the ability to represent, analyze, and mentally manipulate objects – are essential in everyday activities, from estimating distances when parking a car to mentally rotating an object to visualize it from a new angle. People vary considerably in their natural visuospatial ability, even without any neurological condition.

From seeing to moving: motor programming and anticipation

Visual perception does not terminate with recognition or localization – it drives action. The pathway from vision to movement is governed by a sophisticated system of motor programming, in which the brain does not passively wait for sensory signals but actively generates predictions about what those signals will say before they arrive.

The brain relies on internal models of the sensory consequences of its own actions to overcome sensorimotor delays, acquire new skills, and adapt to changing environments. These internal models – sometimes called forward models – allow the nervous system to compute a prediction error by comparing actual sensory feedback against the expected outcome of a movement. When expectations and reality match, movement proceeds smoothly. When they diverge, the brain triggers corrective adjustments.

The role of anticipation in action

Object lifting is a well-studied paradigm that illuminates motor prediction precisely. During the load phase of lifting, the brain normally scales the rate of force output to the predicted weight of the object – and simultaneously generates predictions about the sensory consequences of that motor output, including signals from contact events at the fingertips.

Consider picking up a carton of milk from the refrigerator. Before your fingers even make contact with it, your brain has already formed a prediction of how heavy it will be based on visual cues (size, shape) and prior experience with similar objects. It programs the grip force and lift force in advance. Lifting an opaque milk carton requires a prediction about its weight when there is no way of precisely knowing it until it is actually lifted – and the sensorimotor system uses an error minimization strategy, basing its motor commands on the mean weight of previous lifts with similar objects.

This is why you sometimes jerk an unexpectedly light object upward when you assumed it would be heavier – your brain programmed excess force based on an inaccurate prediction. Prediction is an essential characteristic of the human motor system because of the inherent time delays in sensorimotor processing: sensory information from the fingertips takes approximately 100 ms to produce meaningful adjustments, and visual information takes even longer – in excess of 200 ms – to translate into purposeful action. Without anticipatory motor programming, smooth, coordinated movement would be impossible.

Sensory feedback and updating motor commands

Anticipation and sensory feedback work as a team. The brain does not simply issue motor commands and ignore what follows – it continuously compares incoming sensory signals against its predictions. When predictability decreases due to external disturbances, the brain adapts by increasing muscle activation and enhancing the processing of incoming sensory inputs; when movement is predictable, fewer sensorimotor resources are required, and the system becomes more efficient.

The cerebellum plays a central coordinating role in this process. The cerebellum is hypothesized to use a predictive model that anticipates the expected outcome of motor commands in order to refine future movements – a type of computation often termed a “forward model” that uses a copy of the current motor command and current sensory information to estimate the immediate future. When the predicted outcome and the actual sensory consequence diverge, the cerebellum helps update the motor program so the next movement is more accurate.

Successful sensorimotor integration involves incorporating sensory inputs – visual, proprioceptive, and tactile – to generate the most efficient motor plan for a given task; and ongoing sensory feedback during movement continuously refines that plan to optimize both current and future performance. This is the brain not just reacting to the world but constantly modeling it, staying one step ahead so that actions remain fluid and adaptive.

Why this matters for understanding the brain

The “What” and “Where” pathways, visuospatial neglect, drawing assessments, and anticipatory motor control are not isolated topics – they are pieces of the same picture. The brain does not passively receive vision; it actively organizes space, anticipates action, and corrects itself in real time. When any part of this system is disrupted – whether by stroke damaging the parietal cortex or by errors in predictive motor models – the consequences reach into the most fundamental aspects of daily life: knowing where you are, recognizing what surrounds you, and acting on that knowledge fluidly and safely.

Visuospatial working memory, which is critically involved in remaining oriented in space and tracking the location of moving objects, shows early impairment in several neurodegenerative conditions including dementia with Lewy bodies. Understanding the architecture of visual and spatial processing – and how it connects to motor programming – is therefore central not only to basic neuroscience but to clinical assessment, rehabilitation, and the early detection of cognitive decline.

What do you think? When you make a small movement error – like misjudging the weight of an object – do you think your brain “learns” from that error immediately, or does correction build up gradually over multiple attempts? And considering how visuospatial neglect can make patients unaware of their own deficit, what does this suggest about how much of our perception of the world is constructed rather than simply received?

References

PDF 📄

Table of Contents

The brain’s two visual highways 🔗

The ventral stream: the “what” pathway 🔗

The dorsal stream: the “where” and “how” pathway 🔗

When spatial vision breaks down: visuospatial neglect 🔗

Drawing tests as diagnostic windows 🔗

From seeing to moving: motor programming and anticipation 🔗

The role of anticipation in action 🔗

Sensory feedback and updating motor commands 🔗

Why this matters for understanding the brain 🔗