Techniques for Measuring Conceptual Thinking in Psychological Assessments

Conceptual thinking – the ability to form, manipulate, and apply abstract ideas – sits at the heart of higher-order cognition. It’s what allows us to detect patterns, understand metaphors, generalize from specific examples, and adapt to new or changing situations. In psychological assessments, measuring conceptual thinking is essential for understanding how a person reasons, and for identifying disruptions caused by neurological conditions, emotional disturbances, or personality disorders. A range of specialized tests has been developed for this purpose, each targeting different facets of abstract thought. This post walks through the major techniques used in clinical and neuropsychological settings to measure conceptual thinking.

What is conceptual thinking – and why measure it?
Analogies: measuring relational reasoning
Proverb tests: assessing verbal abstraction
Performance sorting tests: categorization as cognition
Color sorting tests: a focused variant
The Halstead Category Test: pattern recognition and rule induction
What the HCT reveals clinically
The Wisconsin Card Sorting Test: flexibility and set-shifting
What WCST performance reveals
Why no single test is enough

What is conceptual thinking – and why measure it?

Conceptual thinking goes beyond recalling facts or following instructions. According to StatPearls (NCBI), abstract reasoning involves analyzing information, detecting patterns and relationships, and solving problems at a conceptual or theoretical level. When this capacity is impaired, it shows up as difficulty identifying relationships between dissimilar items or solving problems without prior direct knowledge.

Importantly, disruptions to conceptual thinking are not confined to neurological injury. Emotional disturbances and personality disorders can also compromise abstract reasoning, making these tests valuable in psychiatric as well as neurological evaluations. The NCBI’s overview of cognitive testing notes that general cognitive ability – including reasoning and problem-solving – is considered the most reliable predictor of occupational attainment, and that assessing it requires formal standardized psychometric tools rather than simple observation.

Tests of conceptual thinking broadly fall into verbal formats (analogies and proverbs), visual/performance formats (sorting tasks), and more structured neuropsychological batteries. Each approach illuminates a different dimension of how an individual processes and applies abstract information.

Analogies: measuring relational reasoning

Analogy tests are among the most widely used tools for assessing conceptual thinking. In a standard verbal analogy, individuals identify the relationship between two concepts and apply that same logic to a new pair – for example, recognizing that the relationship between “cat” and “kitten” mirrors that between “dog” and “puppy.” As complexity increases, analogies move from concrete to abstract, probing relationships between ideas like “growth and nurturing” or “justice and equality.”

Cognitive assessment guidelines from NCBI confirm that assessment of abstract reasoning commonly includes tasks requiring the interpretation of analogies, as these demand the detection of patterns and relational logic across varying contexts. Analogy items are embedded in several major assessments – the Raven’s Progressive Matrices uses pictorial analogies to measure fluid intelligence non-verbally, while the Stanford-Binet and Wechsler scales incorporate verbal analogy formats.

A systematic review published in PubMed that evaluated seven adult verbal abstract reasoning tools found that the WAIS-IV Similarities subtest – which essentially measures analogical reasoning through concept comparison – ranked highest in clinical utility, normative data quality, and psychometric validity among the instruments reviewed.

Proverb tests: assessing verbal abstraction

Proverb interpretation requires a qualitatively different kind of abstract reasoning. Proverbs are concrete statements that must be translated into their abstract, metaphorical meaning. When a participant is asked what “a stitch in time saves nine” means, they must move beyond the literal image of sewing and extract a general principle about preventive action. The depth and accuracy of that interpretation reveals their capacity for verbal abstraction.

According to Psychology Learners’ overview of conceptual thinking tests, proverb interpretation tasks are included in well-known assessments such as Gorham’s Proverbs Test, the Wechsler scales, the Stanford-Binet scales, and Mental Status Examinations. Scores in these tests reflect qualitative judgments about whether a response is abstract or concrete, apt or irrelevant.

Proverb tests are particularly sensitive to clinical conditions. Patients with focal brain lesions, diffuse neurological injury, or significant psychiatric disturbances tend to give concrete or idiosyncratic interpretations – responding, for instance, that “a stitch in time saves nine” is about sewing. This concreteness is itself a diagnostic marker. The test thus reveals not only what a person knows, but how they think.

Performance sorting tests: categorization as cognition

Sorting tasks take conceptual thinking out of the verbal domain and into the performance realm. In these tests, individuals are asked to group objects – blocks, tokens, cards, or other items – into categories based on shared attributes. Most sorting tests assess both the ability to use concepts and the ability to shift between them, making them sensitive measures of cognitive flexibility alongside basic concept formation.

Key instruments in this category include the Kasanin-Hanfmann Concept Formation Test (Vygotsky Test), designed to evaluate an individual’s ability to solve problems using abstract concepts and to reveal the level and style of their approach to abstraction. The Delis-Kaplan Executive Functioning System (D-KEFS) Sorting Test provides separate measures of initiation, concept formation, problem solving, cognitive flexibility, and perseverative responding.

Sorting tests are also sensitive to the qualitative nature of a person’s thinking. A patient who groups objects only by a single perceptual feature – color, shape, or size – and cannot shift to a higher-order conceptual grouping demonstrates what clinicians call “concrete thinking,” a hallmark feature in several psychiatric and neurological conditions.

Color sorting tests: a focused variant

Color sorting tasks are a specialized form of performance sorting where color serves as the primary or sole basis for categorization. Individuals are presented with colored objects or stimuli and must sort them according to increasingly complex color-based rules. As the task progresses, they must update their mental set to accommodate new constraints, revealing how flexibly they can generalize a concept across varying materials.

These tasks specifically tap into attentional flexibility – the ability to hold a rule in mind, apply it consistently, and then abandon it when required. When individuals struggle to shift from one sorting criterion to another, it points to rigidity in conceptual processing, which can be clinically significant in conditions involving frontal lobe dysfunction or executive impairment.

The Halstead Category Test: pattern recognition and rule induction

The Halstead Category Test (HCT) is a neuropsychological instrument that places concept formation and abstract reasoning at its center. As documented in Neuropsychology Review, the test was first described by Halstead and Settlage in 1943 and became a major component of the Halstead-Reitan Neuropsychological Battery – one of the most widely used neuropsychological batteries in clinical practice.

In the test, participants are shown a series of 208 pictures – geometric figures varying in shape, size, number, and position. For each image, they must decide which number from 1 to 4 best corresponds to the picture’s key feature, pressing a key for their response and receiving immediate auditory feedback – a chime for a correct response, a buzzer for an error. The images are organized into seven subtests, each with its own underlying rule that participants must infer and apply.

The power of the HCT lies in what it measures: the ability to extract an abstract rule from limited feedback and apply it correctly across a series of novel stimuli. NCBI’s overview of frequently used psychological tests describes the Category Test as essentially a processing test of abstraction and reasoning, and notes it is the most powerful component of the Halstead-Reitan battery for detecting brain dysfunction. A portable version – the Booklet Category Test (BCT) – is also available and has been validated for use in a wide range of clinical and rehabilitation settings.

What the HCT reveals clinically

Performance on the HCT is scored by total number of errors across all seven subtests. A high error count reflects difficulty in concept formation, poor use of feedback, and reduced cognitive flexibility – patterns commonly seen in brain injury, dementia, and certain psychiatric conditions. Research has specifically examined its use in schizophrenic disorders, where abstract concept formation is frequently impaired. Crucially, the HCT measures level of performance without providing localization information – for more specific mapping of impairment to brain regions, it is used alongside other instruments in the battery.

The Wisconsin Card Sorting Test: flexibility and set-shifting

The Wisconsin Card Sorting Test (WCST) is arguably the most widely used neuropsychological instrument for evaluating abstract reasoning and executive function. Originally developed in 1948 by David Grant and Esta Berg, it was designed to measure abstract reasoning and the ability to change problem-solving strategies in response to environmental feedback.

In the standard administration, participants are given two decks of 64 response cards each, plus four stimulus key cards. The response cards display shapes (crosses, circles, triangles, stars) in varying colors and numbers. Participants must sort the response cards to match one of the four key cards, but are not told the sorting rule – they must infer it from feedback given after each response. The correct principle – whether to sort by color, form, or number – must be inferred from the examiner’s feedback, and once a participant demonstrates consistent correct sorting, the rule changes without warning. The participant must then detect the shift and adopt the new sorting criterion.

According to PAR (Psychological Assessment Resources), the WCST has been used extensively in clinical and research applications across a broad range of diagnostic groups – including individuals with focal and diffuse brain damage, seizure disorders, Parkinson’s disease, multiple sclerosis, schizophrenia, and ADHD. It is particularly sensitive to frontal lobe dysfunction because it demands the kind of flexible, goal-directed behavior that the prefrontal cortex governs.

What WCST performance reveals

The WCST yields multiple informative scores: the number of categories completed, total errors, perseverative errors (continuing to sort by an old rule after the rule has changed), and failure to maintain a cognitive set. A PubMed study examining WCST performance in substance use disorders found that the test showed good discriminant validity and was sensitive to changes in cognitive flexibility and abstract reasoning – key features affected in those conditions. Perseverative errors in particular are a hallmark of frontal dysfunction and reflect an inability to inhibit a previously rewarded response when the cognitive demands shift.

It’s worth noting that a critical update published in Brain and Cognition has questioned the WCST’s specificity as a pure marker of frontal lobe dysfunction, with neuroimaging studies showing widespread activation across both frontal and non-frontal regions during task performance. This reinforces the standard clinical practice of using the WCST as part of a broader battery rather than as a standalone diagnostic tool.

Why no single test is enough

Each of the above tests taps a different aspect of conceptual thinking. Analogies probe relational logic; proverb tests reveal the depth of verbal abstraction; sorting tasks assess flexibility and concept formation; the HCT measures rule induction from feedback; the WCST evaluates set-shifting under changing conditions. As NCBI’s overview of psychological assessment emphasizes, agreements and discrepancies across multiple measures together enable a more comprehensive and clinically accurate understanding of the individual being assessed.

Clinicians also consider the mode of presentation. Patients with mild or modality-specific deficits may perform adequately on verbal conceptual tests but fail on non-verbal sorting tasks – or vice versa. This distinction matters diagnostically. A patient who gives concrete proverb interpretations but performs adequately on the WCST is showing a different cognitive profile from one who perseverates heavily on the card sorting task but handles verbal analogies well. The combination of verbal and performance-based tests of conceptual thinking is therefore standard practice in comprehensive neuropsychological evaluation.

The American Psychological Association’s Guidelines for Psychological Assessment and Evaluation emphasize that existing tests are continuously revised and new ones developed to improve accuracy and validity, reflecting how dynamic this field remains. Selecting the appropriate combination of conceptual thinking tests – matched to the referral question, the individual’s characteristics, and the clinical context – is itself an exercise in the kind of flexible, principled reasoning these tests are designed to measure.

What do you think? Given that conceptual thinking can be disrupted by both neurological and emotional factors, how might a clinician decide which combination of tests best captures a patient’s true cognitive profile? And do you think performance-based sorting tests reveal aspects of abstract reasoning that purely verbal tests like analogies and proverbs might miss?

References

PDF 📄

Table of Contents

What is conceptual thinking – and why measure it? 🔗

Analogies: measuring relational reasoning 🔗

Proverb tests: assessing verbal abstraction 🔗

Performance sorting tests: categorization as cognition 🔗

Color sorting tests: a focused variant 🔗

The Halstead Category Test: pattern recognition and rule induction 🔗

What the HCT reveals clinically 🔗

The Wisconsin Card Sorting Test: flexibility and set-shifting 🔗

What WCST performance reveals 🔗

Why no single test is enough 🔗