The construction of "critical thinking": Between how we think and what we believe

Affiliation.

  • 1 School of Philosophy, Psychology and Language Sciences.
  • PMID: 32191060
  • DOI: 10.1037/hop0000145

"Critical thinking" is widely regarded as important, but difficult to define. This article provides an historical perspective by describing how "critical thinking" emerged as an object of psychological study, how the forms it took were shaped by practical and social concerns, and how these related to "critical thinking" as something that results in certain conclusions, rather than as a process of coming to conclusions. "Critical thinking" became a scientific object when psychologists attempted to measure it. The original measurement treated "critical thinking" as both an ability and an attitude. It measured logical abilities, and consistency and extremity of views, but it avoided making assumptions about the correctness of specific real-world beliefs. The correctness of such beliefs was, as problems with other related tests showed, open to dispute. Subsequent tests increasingly focused on logical abilities, and attempted to minimize further the relevance of what people believed about the real world, though they continued to depend on there being correct answers to test items, which privileged the outcome over the process. While "critical thinking" was primarily the domain of philosophers, there was renewed psychological interest in the topic in the 1980s, which increasingly presented "critical thinking" as incompatible with certain real-world ("unscientific") beliefs. Such a view more explicitly privileged the outcome over the process. It is argued that a more reflective approach, though it may be more difficult to measure, is essential if we wish to understand not only what critical thinking has been, but also what it is now. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

GCFGlobal Logo

  • Get started with computers
  • Learn Microsoft Office
  • Apply for a job
  • Improve my work skills
  • Design nice-looking docs
  • Getting Started
  • Smartphones & Tablets
  • Typing Tutorial
  • Online Learning
  • Basic Internet Skills
  • Online Safety
  • Social Media
  • Zoom Basics
  • Google Docs
  • Google Sheets
  • Career Planning
  • Resume Writing
  • Cover Letters
  • Job Search and Networking
  • Business Communication
  • Entrepreneurship 101
  • Careers without College
  • Job Hunt for Today
  • 3D Printing
  • Freelancing 101
  • Personal Finance
  • Sharing Economy
  • Decision-Making
  • Graphic Design
  • Photography
  • Image Editing
  • Learning WordPress
  • Language Learning
  • Critical Thinking
  • For Educators
  • Translations
  • Staff Picks
  • English expand_more expand_less

Critical Thinking and Decision-Making  - What is Critical Thinking?

Critical thinking and decision-making  -, what is critical thinking, critical thinking and decision-making what is critical thinking.

GCFLearnFree Logo

Critical Thinking and Decision-Making: What is Critical Thinking?

Lesson 1: what is critical thinking, what is critical thinking.

Critical thinking is a term that gets thrown around a lot. You've probably heard it used often throughout the years whether it was in school, at work, or in everyday conversation. But when you stop to think about it, what exactly is critical thinking and how do you do it ?

Watch the video below to learn more about critical thinking.

Simply put, critical thinking is the act of deliberately analyzing information so that you can make better judgements and decisions . It involves using things like logic, reasoning, and creativity, to draw conclusions and generally understand things better.

illustration of the terms logic, reasoning, and creativity

This may sound like a pretty broad definition, and that's because critical thinking is a broad skill that can be applied to so many different situations. You can use it to prepare for a job interview, manage your time better, make decisions about purchasing things, and so much more.

The process

illustration of "thoughts" inside a human brain, with several being connected and "analyzed"

As humans, we are constantly thinking . It's something we can't turn off. But not all of it is critical thinking. No one thinks critically 100% of the time... that would be pretty exhausting! Instead, it's an intentional process , something that we consciously use when we're presented with difficult problems or important decisions.

Improving your critical thinking

illustration of the questions "What do I currently know?" and "How do I know this?"

In order to become a better critical thinker, it's important to ask questions when you're presented with a problem or decision, before jumping to any conclusions. You can start with simple ones like What do I currently know? and How do I know this? These can help to give you a better idea of what you're working with and, in some cases, simplify more complex issues.  

Real-world applications

illustration of a hand holding a smartphone displaying an article that reads, "Study: Cats are better than dogs"

Let's take a look at how we can use critical thinking to evaluate online information . Say a friend of yours posts a news article on social media and you're drawn to its headline. If you were to use your everyday automatic thinking, you might accept it as fact and move on. But if you were thinking critically, you would first analyze the available information and ask some questions :

  • What's the source of this article?
  • Is the headline potentially misleading?
  • What are my friend's general beliefs?
  • Do their beliefs inform why they might have shared this?

illustration of "Super Cat Blog" and "According to survery of cat owners" being highlighted from an article on a smartphone

After analyzing all of this information, you can draw a conclusion about whether or not you think the article is trustworthy.

Critical thinking has a wide range of real-world applications . It can help you to make better decisions, become more hireable, and generally better understand the world around you.

illustration of a lightbulb, a briefcase, and the world

/en/problem-solving-and-decision-making/why-is-it-so-hard-to-make-decisions/content/

Critical Thinking, Its Components and Assessment

In higher education and advanced education exemplified by graduate school education, demonstrating critical thinking skills is crucial to good scholarship. But what really is critical thinking? How is it demonstrated and how can professors measure such level of thinking?

In this article, I clarify critical thinking by exploring its definition, importance, components, and ways to develop this skill, among other things. This discussion considers the context of the world that gradually undergoes significant change due to artificial intelligence that gradually creep into our lives. We need to be discerning of what information is presented to us given the preponderance of erroneous information, misinformation, or simply the infodemic we face every day.

In general, how can we employ critical thinking to discern fact from fiction? How can we avoid being misled? Again, I highlight the important points in this discussion.

Let’s see our tool to survive the age of misinformation and disinformation.

Table of Contents

Introduction.

In a fast-paced world where information and data flood our daily lives, it is increasingly essential to navigate with discernment, clarity, and analytical acumen in both personal and professional spheres. This necessity is where the profound relevance of critical thinking becomes clear.

Encompassing components like analysis, interpretation, and self-regulation, critical thinking is a cognitive process that enriches decision-making, problem-solving, and quality management across varied sectors.

This discussion will delve into what critical thinking entails, why it holds utmost significance in today’s world, the integral skills and dispositions it comprises, and how it can be effectively developed and measured.

Defining Critical Thinking

Critical thinking defined.

Critical thinking refers to the ability to analyze information objectively and make a reasoned judgment . It involves the evaluation of sources, such as data, facts, observable phenomenon, and research findings.

Critical thinking refers to the ability to analyze information objectively and make a reasoned judgment. It involves the evaluation of sources, such as data, facts, observable phenomenon, and research findings.

Critical thinkers can separate facts from opinions, evaluate credibility, identify prejudice or bias , distinguish between relevant and irrelevant information, and ascertain the validity of the information. This involves clear, rational, open-minded, and informed thinking.

So, what is critical thinking exactly? It’s the capability to think in a clear and rational manner about what actions to take or beliefs to hold. It includes the ability to independently engage in reflective thinking .

A critical thinker is able to discern the logical connections between ideas, construct and evaluate arguments, detect inconsistencies and common mistakes in reasoning, solve problems systematically, recognize the relevance and significance of ideas, and reflect on the justification of their own beliefs and values.

The Critical Thinking Mindset

Beyond the very technical aspects, critical thinking fundamentally involves a mental discipline that calls for reflective mindfulness, a sense of skepticism, and intellectual humility . Balancing these qualities with curiosity, creativity, and an appreciation for complexity, this mindset becomes pivotal within the decision-making process.

Essentially, the adoption of a critical thinking mindset allows for a robust evaluation of different possibilities. This process is based on established criteria and standards that enable clear, rationale thought, thus unlocking more informed, evidence-based decision making.

The Importance of Critical Thinking

Critical thinking plays a crucial role in professional environments. It is integral in problem-solving and decision-making processes, enabling professionals to analyze issue-related data, consider alternate perspectives, and make informed decisions based on sound reasoning and evidence.

Within academic settings, critical thinking is vital for understanding and interpreting complex theories or concepts. It fosters independent thinking, encourages intellectual curiosity, and prepares students to navigate the complexities of real-world scenarios, by enabling them to assess the value or validity of claims and arguments presented to them.

critical thinking

Critical thinking is often assessed through various assignments, presentations, class discussions, and project-based activities. The purpose of these tasks is not only to measure a student’s ability to process and synthesize information but also their ability to draw connections between different concepts and build up well-reasoned arguments.

In science, for example, critical thinking helps researchers design experiments, interpret data, and derive conclusions. In business, critical thinking assists organizations in strategic planning, problem-solving, decision-making, and innovation. In education, critical thinking is crucial in developing skills in reading, writing, and learning.

In personal decision-making, critical thinking can significantly improve the quality of life. It aids in making sound financial decisions, solving day-to-day problems effectively, and choosing the most optimal course of action in various situations.

Furthermore, critical thinking can foster creativity by necessitating the exploration of multiple viewpoints and solutions, it can enhance communication by promoting clarity, accuracy, and relevance in the exchange of ideas, and promote social harmony by encouraging open and objective discussions.

Critical thinking is a vital skill in today’s world, as it allows individuals to process information more effectively and make well-informed decisions. Rather than merely accepting information as presented, a critical thinker will question, analyze, and often challenge that information. This process helps to avoid faulty reasoning, cognitive biases, and manipulation.

6 Components of Critical Thinking

Critical thinking includes specific components such as analysis, interpretation, inference, explanation, and self-regulation.

1. Analysis

This involves examining information in detail in order to understand it better and to draw conclusions. It could be data , a concept , or a process .

Analysis is a key component of critical thinking. It involves breaking down complex problems or arguments into parts to better understand their nature and relationship.

This can include questioning assumptions, recognizing patterns, identifying underlying causes, and pursuing relevant evidence. For example, in a heated political debate, a critical thinker might analyze the validity of each party’s claims, their supporting facts, and the implications of their proposals.

2. Interpretation

This is the act of explaining the meaning of information . Critical thinkers deeply focus on a topic or issue, questioning and analyzing it from multiple perspectives.

Interpretation refers to the ability to understand and express the meaning or significance of a wide variety of experiences, situations, data, events, judgments, conventions, and criteria. It also involves making inferences — drawing out unseen implications from the information given.

For instance, someone using interpretation during a political debate will not only understand what the speakers say but draw insights about their political ideologies, plans, or biases.

3. Inference

It is the act of deriving logical conclusions from premises known or assumed to be true. Inferences can be accurate or inaccurate, logical or illogical, justified or unjustified.

4. Explanation

Here, the critical thinker tries to make something clear or easy to understand with detailed and observable facts. They clarify the cause-a nd-effect relationships surrounding an event or situation.

5. Evaluation

Evaluation in critical thinking refers to the process of determining the credibility and relevance of the information. This involves assessing the evidence supporting a claim, determining its source’s reliability, and judging the logical consistency of arguments.

Returning to the political debate example, evaluating might involve checking the sources of factual claims or judging whether the proposed solutions are feasible given the present socio-political conditions.

6. Self-Regulation

This is the process where the thinker examines his or her own cognitive processes to make decisions about how to think and draw conclusions. This skill ensures that the thinking process is effective, efficient, and yields the intended results.

Dispositional Elements of Critical Thinking

Dispositional elements refer to the attitudes or mindsets conducive to critical thinking. These include open-mindedness, intellectual humility, skepticism, and intellectual courage.

Open-mindedness

Open-mindedness involves being receptive to new ideas or conflicting perspectives. It implies the willingness to revise pre-existing beliefs based on new evidence or understandings. This characteristic helps critical thinkers avoid biases, consider all available evidence, and make fair judgments.

Intellectual Humility

Intellectual humility refers to recognizing that one’s own knowledge has limits . This disposition helps establish an unbiased view and a continuing interest in acquiring new knowledge.

Being skeptical involves questioning the authenticity and credibility of the information rather than accepting it at face value. Skeptics seek to validate information through evidence, logic, and rational arguments.

Intellectual Courage

Intellectual courage refers to the willingness to evaluate all ideas and beliefs, even those that conflict with one’s own. Challenging comfortable assumptions in pursuit of truth is essential for critical thinking.

How to Develop Critical Thinking Skills

1. pursue continuous learning.

To hone your critical thinking skills, continuous learning is of paramount importance. This includes opening oneself up to an array of experiences and environments, entertaining diverse viewpoints and actively seeking opportunities to challenge your pre-existing beliefs.

As mentioned in the previous discussion, open-mindedness is an element of critical thinking. It’s not too late to learn something new. Old dogs can learn new tricks with perseverance. You are not too old to learn how to use Moodle in your online classes .

Anyone who stops learning is old, whether at twenty or eighty. Anyone who keeps learning stays young.

– Henry Ford

critical thinking skills

2. Challenge the Status Quo

Being a critical thinker also involves questioning the accepted norms and challenging the traditional wisdom. Instead of simply accepting things as they are, delve deeper to understand the reasons behind their existence.

3. Understand Diverse Perspectives

The essence of critical thinking lies in viewing situations from various perspectives . This requires understanding others’ viewpoints, even if they are contradictory to your personal beliefs. This varied understanding can help you make more informed decisions.

4. Embrace Calculated Risks

Developing your critical thinking skills may entail taking calculated risks. This includes stepping out of your comfort zone to experience new things and ideas that might challenge your previous assumptions. This involves a careful analysis of the pros and cons before making an informed decision based on your findings.

5. Promote Open-Mindedness

Critical thinkers are often open-minded individuals. They are open to new ideas and different perspectives. Developing this trait involves embracing diversity, understanding others’ experiences, and actively participating in challenging conversations.

6. Keep a Reflective Journal

Maintaining a reflective journal helps you document your thought process over time. You can analyze your experiences, thoughts, and decisions made. Writing down your thoughts offers a chance to critically analyze your actions, understand why you made certain decisions, and thereby foster self-awareness and critical thinking.

Measuring Critical Thinking

Critical thinking can fundamentally be described as one’s aptitude to assess, conceptualize, apply, and critically examine information gathered or produced through various means, such as observation, dialogue, reflection, or reasoning. This intellectual process encourages making well-reasoned judgments based on solid evidence and logic rather than accepting arguments and conclusions at face value.

How we measure critical thinking, however, can vary. While these capabilities may sound subjective, there are objective ways on how to measure critical thinking. I enumerate some of them in the next section.

1. Standardized Tests to Measure Critical Thinking

Typically, standardized testing is utilized to gauge a person’s critical thinking competence. Such tests, like the Watson-Glaser Critical Thinking Appraisal or the Cornell Critical Thinking Test , evaluate areas such as inference, recognition of assumptions, interpretation, deduction, and evaluation of arguments.

The Ennis-Weir Critical Thinking Essay Test measures the ability of students to reason through a problem and to express their reasoning in writing. This type of measurement tool is used mainly in educational settings, but it offers valuable insight into individual critical thinking skills.

2. Performance Assessments

Beyond standard testing, another metric involves practical performance assessments . These involve the observation of how an individual tackles a complex problem.

Specific critical thinking aspects might be identified and evaluated using rubrics – criteria set to ascertain a person’s ability to identify, summarize, and offer solutions to problems while also taking various perspectives into account.

3. Self and Peer Evaluations

In addition to the aforementioned, self and peer evaluations provide another measure of critical thinking. These require individuals to introspect on their cognitive processes or inspect the same in their peers.

Interpreting The Results

Interpretation of these tests depends largely on the benchmarks set by the individual administering the exam. As a rule, the results of such evaluations should always be interpreted in the context of all available data from the assessment of the individual’s cognitive abilities and academic skills.

Overall, the measurement of critical thinking provides invaluable insight into one’s ability to reason, make judgments, solve problems, and make decisions. These abilities are of immense importance in both personal and professional realms.

critical thinking measurement

Key Takeaways

As we stand in an era of information overload, the value of critical thinking in deciphering truth from noise cannot be overstated. It enhances our ability to analyze, interpret, evaluate, and take calculated risks in various facets of life, ensuring we make informed, intelligent decisions.

Furthermore, it fosters a culture of curiosity, open-mindedness, and intellectual courage, promoting better communication and fostering social harmony.

As effortlessly as it might seem to come for some, critical thinking, like any other skill, can be cultivated and honed over time with dedication and the right strategies. These skills can be measured with tools like the Watson-Glaser Critical Thinking Appraisal, leading to a more informed understanding of an individual’s critical thinking capabilities.

Therefore, investing in the development and assessment of critical thinking skills is an investment in a more discerning, informed, and intellectual society.

In conclusion, critical thinking is not only a valuable but a crucial life skill. In today’s information-rich world, the ability to analyze data and make swift, efficient decisions is vital. Thus, understanding critical thinking and its significance, and knowing how it is measured and can be improved, is key to personal and professional growth.

Related Posts

The what and the why of obe.

Free Writing: Five Benefits to Perk You Up to Write Again

Free Writing: Five Benefits to Perk You Up to Write Again

How to apply suggestopedia as a method of teaching, about the author, patrick regoniel.

Dr. Regoniel, a faculty member of the graduate school, served as consultant to various environmental research and development projects covering issues and concerns on climate change, coral reef resources and management, economic valuation of environmental and natural resources, mining, and waste management and pollution. He has extensive experience on applied statistics, systems modelling and analysis, an avid practitioner of LaTeX, and a multidisciplinary web developer. He leverages pioneering AI-powered content creation tools to produce unique and comprehensive articles in this website.

SimplyEducate.Me Privacy Policy

7.1 What Is Cognition?

Learning objectives.

By the end of this section, you will be able to:

  • Describe cognition
  • Distinguish concepts and prototypes
  • Explain the difference between natural and artificial concepts
  • Describe how schemata are organized and constructed

Imagine all of your thoughts as if they were physical entities, swirling rapidly inside your mind. How is it possible that the brain is able to move from one thought to the next in an organized, orderly fashion? The brain is endlessly perceiving, processing, planning, organizing, and remembering—it is always active. Yet, you don’t notice most of your brain’s activity as you move throughout your daily routine. This is only one facet of the complex processes involved in cognition. Simply put, cognition is thinking, and it encompasses the processes associated with perception, knowledge, problem solving, judgment, language, and memory. Scientists who study cognition are searching for ways to understand how we integrate, organize, and utilize our conscious cognitive experiences without being aware of all of the unconscious work that our brains are doing (for example, Kahneman, 2011).

Upon waking each morning, you begin thinking—contemplating the tasks that you must complete that day. In what order should you run your errands? Should you go to the bank, the cleaners, or the grocery store first? Can you get these things done before you head to class or will they need to wait until school is done? These thoughts are one example of cognition at work. Exceptionally complex, cognition is an essential feature of human consciousness, yet not all aspects of cognition are consciously experienced.

Cognitive psychology is the field of psychology dedicated to examining how people think. It attempts to explain how and why we think the way we do by studying the interactions among human thinking, emotion, creativity, language, and problem solving, in addition to other cognitive processes. Cognitive psychologists strive to determine and measure different types of intelligence, why some people are better at problem solving than others, and how emotional intelligence affects success in the workplace, among countless other topics. They also sometimes focus on how we organize thoughts and information gathered from our environments into meaningful categories of thought, which will be discussed later.

Concepts and Prototypes

The human nervous system is capable of handling endless streams of information. The senses serve as the interface between the mind and the external environment, receiving stimuli and translating it into nervous impulses that are transmitted to the brain. The brain then processes this information and uses the relevant pieces to create thoughts, which can then be expressed through language or stored in memory for future use. To make this process more complex, the brain does not gather information from external environments only. When thoughts are formed, the mind synthesizes information from emotions and memories ( Figure 7.2 ). Emotion and memory are powerful influences on both our thoughts and behaviors.

In order to organize this staggering amount of information, the mind has developed a "file cabinet" of sorts. The different files stored in the file cabinet are called concepts. Concepts are categories or groupings of linguistic information, images, ideas, or memories, such as life experiences. Concepts are, in many ways, big ideas that are generated by observing details, and categorizing and combining these details into cognitive structures. You use concepts to see the relationships among the different elements of your experiences and to keep the information in your mind organized and accessible.

Concepts are informed by our semantic memory (you will learn more about semantic memory in a later chapter) and are present in every aspect of our lives; however, one of the easiest places to notice concepts is inside a classroom, where they are discussed explicitly. When you study United States history, for example, you learn about more than just individual events that have happened in America’s past. You absorb a large quantity of information by listening to and participating in discussions, examining maps, and reading first-hand accounts of people’s lives. Your brain analyzes these details and develops an overall understanding of American history. In the process, your brain gathers details that inform and refine your understanding of related concepts such as war, the judicial system, and voting rights and laws.

Concepts can be complex and abstract, like justice, or more concrete, like types of birds. In psychology, for example, Piaget’s stages of development are abstract concepts. Some concepts, like tolerance, are agreed upon by many people, because they have been used in various ways over many years. Other concepts, like the characteristics of your ideal friend or your family’s birthday traditions, are personal and individualized. In this way, concepts touch every aspect of our lives, from our many daily routines to the guiding principles behind the way governments function.

Another technique used by your brain to organize information is the identification of prototypes for the concepts you have developed. A prototype is the best example or representation of a concept. For example, what comes to your mind when you think of a dog? Most likely your early experiences with dogs will shape what you imagine. If your first pet was a Golden Retriever, there is a good chance that this would be your prototype for the category of dogs.

Natural and Artificial Concepts

In psychology, concepts can be divided into two categories, natural and artificial. Natural concepts are created “naturally” through your experiences and can be developed from either direct or indirect experiences. For example, if you live in Essex Junction, Vermont, you have probably had a lot of direct experience with snow. You’ve watched it fall from the sky, you’ve seen lightly falling snow that barely covers the windshield of your car, and you’ve shoveled out 18 inches of fluffy white snow as you’ve thought, “This is perfect for skiing.” You’ve thrown snowballs at your best friend and gone sledding down the steepest hill in town. In short, you know snow. You know what it looks like, smells like, tastes like, and feels like. If, however, you’ve lived your whole life on the island of Saint Vincent in the Caribbean, you may never actually have seen snow, much less tasted, smelled, or touched it. You know snow from the indirect experience of seeing pictures of falling snow—or from watching films that feature snow as part of the setting. Either way, snow is a natural concept because you can construct an understanding of it through direct observations, experiences with snow, or indirect knowledge (such as from films or books) ( Figure 7.3 ).

An artificial concept , on the other hand, is a concept that is defined by a specific set of characteristics. Various properties of geometric shapes, like squares and triangles, serve as useful examples of artificial concepts. A triangle always has three angles and three sides. A square always has four equal sides and four right angles. Mathematical formulas, like the equation for area (length × width) are artificial concepts defined by specific sets of characteristics that are always the same. Artificial concepts can enhance the understanding of a topic by building on one another. For example, before learning the concept of “area of a square” (and the formula to find it), you must understand what a square is. Once the concept of “area of a square” is understood, an understanding of area for other geometric shapes can be built upon the original understanding of area. The use of artificial concepts to define an idea is crucial to communicating with others and engaging in complex thought. According to Goldstone and Kersten (2003), concepts act as building blocks and can be connected in countless combinations to create complex thoughts.

A schema is a mental construct consisting of a cluster or collection of related concepts (Bartlett, 1932). There are many different types of schemata, and they all have one thing in common: schemata are a method of organizing information that allows the brain to work more efficiently. When a schema is activated, the brain makes immediate assumptions about the person or object being observed.

There are several types of schemata. A role schema makes assumptions about how individuals in certain roles will behave (Callero, 1994). For example, imagine you meet someone who introduces himself as a firefighter. When this happens, your brain automatically activates the “firefighter schema” and begins making assumptions that this person is brave, selfless, and community-oriented. Despite not knowing this person, already you have unknowingly made judgments about them. Schemata also help you fill in gaps in the information you receive from the world around you. While schemata allow for more efficient information processing, there can be problems with schemata, regardless of whether they are accurate: Perhaps this particular firefighter is not brave, they just work as a firefighter to pay the bills while studying to become a children’s librarian.

An event schema , also known as a cognitive script , is a set of behaviors that can feel like a routine. Think about what you do when you walk into an elevator ( Figure 7.4 ). First, the doors open and you wait to let exiting passengers leave the elevator car. Then, you step into the elevator and turn around to face the doors, looking for the correct button to push. You never face the back of the elevator, do you? And when you’re riding in a crowded elevator and you can’t face the front, it feels uncomfortable, doesn’t it? Interestingly, event schemata can vary widely among different cultures and countries. For example, while it is quite common for people to greet one another with a handshake in the United States, in Tibet, you greet someone by sticking your tongue out at them, and in Belize, you bump fists (Cairns Regional Council, n.d.)

Because event schemata are automatic, they can be difficult to change. Imagine that you are driving home from work or school. This event schema involves getting in the car, shutting the door, and buckling your seatbelt before putting the key in the ignition. You might perform this script two or three times each day. As you drive home, you hear your phone’s ring tone. Typically, the event schema that occurs when you hear your phone ringing involves locating the phone and answering it or responding to your latest text message. So without thinking, you reach for your phone, which could be in your pocket, in your bag, or on the passenger seat of the car. This powerful event schema is informed by your pattern of behavior and the pleasurable stimulation that a phone call or text message gives your brain. Because it is a schema, it is extremely challenging for us to stop reaching for the phone, even though we know that we endanger our own lives and the lives of others while we do it (Neyfakh, 2013) ( Figure 7.5 ).

Remember the elevator? It feels almost impossible to walk in and not face the door. Our powerful event schema dictates our behavior in the elevator, and it is no different with our phones. Current research suggests that it is the habit, or event schema, of checking our phones in many different situations that makes refraining from checking them while driving especially difficult (Bayer & Campbell, 2012). Because texting and driving has become a dangerous epidemic in recent years, psychologists are looking at ways to help people interrupt the “phone schema” while driving. Event schemata like these are the reason why many habits are difficult to break once they have been acquired. As we continue to examine thinking, keep in mind how powerful the forces of concepts and schemata are to our understanding of the world.

As an Amazon Associate we earn from qualifying purchases.

This book may not be used in the training of large language models or otherwise be ingested into large language models or generative AI offerings without OpenStax's permission.

Want to cite, share, or modify this book? This book uses the Creative Commons Attribution License and you must attribute OpenStax.

Access for free at https://openstax.org/books/psychology-2e/pages/1-introduction
  • Authors: Rose M. Spielman, William J. Jenkins, Marilyn D. Lovett
  • Publisher/website: OpenStax
  • Book title: Psychology 2e
  • Publication date: Apr 22, 2020
  • Location: Houston, Texas
  • Book URL: https://openstax.org/books/psychology-2e/pages/1-introduction
  • Section URL: https://openstax.org/books/psychology-2e/pages/7-1-what-is-cognition

© Jan 6, 2024 OpenStax. Textbook content produced by OpenStax is licensed under a Creative Commons Attribution License . The OpenStax name, OpenStax logo, OpenStax book covers, OpenStax CNX name, and OpenStax CNX logo are not subject to the Creative Commons license and may not be reproduced without the prior and express written consent of Rice University.

Logo for OPENPRESS.USASK.CA

Want to create or adapt books like this? Learn more about how Pressbooks supports open publishing practices.

Chapter 9. Intelligence and Language

9.1 Defining and Measuring Intelligence

Charles Stangor and Jennifer Walinga

Learning Objectives

  • Define intelligence and list the different types of intelligences psychologists study.
  • Summarize the characteristics of a scientifically valid intelligence test.
  • Outline the biological and environmental determinants of intelligence.

Psychologists have long debated how to best conceptualize and measure intelligence (Sternberg, 2003). These questions include how many types of intelligence there are, the role of nature versus nurture in intelligence, how intelligence is represented in the brain, and the meaning of group differences in intelligence.

General (g) versus Specific (s) Intelligences

In the early 1900s, the French psychologist Alfred Binet (1857-1914) and his colleague Henri Simon (1872-1961) began working in Paris to develop a measure that would differentiate students who were expected to be better learners from students who were expected to be slower learners. The goal was to help teachers better educate these two groups of students. Binet and Simon developed what most psychologists today regard as the first intelligence test (Figure 9.1, “Intelligence Tests in Schools”), which consisted of a wide variety of questions that included the ability to name objects, define words, draw pictures, complete sentences, compare items, and construct sentences.

Binet and Simon (Binet, Simon, & Town, 1915; Siegler, 1992) believed that the questions they asked their students, even though they were on the surface dissimilar, all assessed the basic abilities to understand, reason, and make judgments. And it turned out that the correlations among these different types of measures were in fact all positive; students who got one item correct were more likely to also get other items correct, even though the questions themselves were very different.

what is critical thinking and how to measure its ability in cognitive psychology

On the basis of these results, the psychologist Charles Spearman (1863-1945) hypothesized that there must be a single underlying construct that all of these items measure. He called the construct that the different abilities and skills measured on intelligence tests have in common the general intelligence factor (g). Virtually all psychologists now believe that there is a generalized intelligence factor, g, that relates to abstract thinking and that includes the abilities to acquire knowledge, to reason abstractly, to adapt to novel situations, and to benefit from instruction and experience (Gottfredson, 1997; Sternberg, 2003). People with higher general intelligence learn faster.

Soon after Binet and Simon introduced their test, the American psychologist Lewis Terman (1877-1956) developed an American version of Binet’s test that became known as the Stanford-Binet Intelligence Test . The Stanford-Binet is a measure of general intelligence made up of a wide variety of tasks including vocabulary, memory for pictures, naming of familiar objects, repeating sentences, and following commands .

Although there is general agreement among psychologists that g exists, there is also evidence for specific intelligence (s), a measure of specific skills in narrow domains . One empirical result in support of the idea of s comes from intelligence tests themselves. Although the different types of questions do correlate with each other, some items correlate more highly with each other than do other items; they form clusters or clumps of intelligences.

One distinction is between fluid intelligence , which refers to the capacity to learn new ways of solving problems and performing activities , and crystallized intelligence , which refers to the accumulated knowledge of the world we have acquired throughout our lives (Salthouse, 2004). These intelligences must be different because crystallized intelligence increases with age — older adults are as good as or better than young people in solving crossword puzzles — whereas fluid intelligence tends to decrease with age (Horn, Donaldson, & Engstrom, 1981; Salthouse, 2004).

Other researchers have proposed even more types of intelligences. L. L. Thurstone (1938) proposed that there were seven clusters of primary mental abilities , made up of word fluency, verbal comprehension, spatial ability, perceptual speed, numerical ability, inductive reasoning, and memory . But even these dimensions tend to be at least somewhat correlated, showing again the importance of g.

One advocate of the idea of multiple intelligences is the psychologist Robert Sternberg. Sternberg has proposed a triarchic (three-part) theory of intelligence that proposes that people may display more or less analytical intelligence, creative intelligence, and practical intelligence . Sternberg (1985, 2003) argued that traditional intelligence tests assess analytical intelligence, the ability to answer problems with a single right answer, but that they do not well assess creativity (the ability to adapt to new situations and create new ideas) or practicality (e.g., the ability to write good memos or to effectively delegate responsibility).

As Sternberg proposed, research has found that creativity is not highly correlated with analytical intelligence (Furnham & Bachtiar, 2008), and exceptionally creative scientists, artists, mathematicians, and engineers do not score higher on intelligence than do their less creative peers (Simonton, 2000). Furthermore, the brain areas that are associated with convergent thinking , thinking that is directed toward finding the correct answer to a given problem , are different from those associated with divergent thinking , the ability to generate many different ideas for or solutions to a single problem (Tarasova, Volf, & Razoumnikova, 2010), as suggested by Figure 9.2, “Test Your Divergent Thinking.” On the other hand, being creative often takes some of the basic abilities measured by g, including the abilities to learn from experience, to remember information, and to think abstractly (Bink & Marsh, 2000).

what is critical thinking and how to measure its ability in cognitive psychology

Studies of creative people suggest at least five components that are likely to be important for creativity:

  • Expertise . Creative people have carefully studied and know a lot about the topic that they are working in. Creativity comes with a lot of hard work (Ericsson, 1998; Weisberg, 2006).
  • Imaginative thinking . Creative people often view a problem in a visual way, allowing them to see it from a new and different point of view.
  • Risk taking . Creative people are willing to take on new but potentially risky approaches.
  • Intrinsic interest . Creative people tend to work on projects because they love doing them, not because they are paid for them. In fact, research has found that people who are paid to be creative are often less creative than those who are not (Hennessey & Amabile, 2010).
  • Working in a creative environment . Creativity is in part a social phenomenon. Simonton (1992) found that the most creative people were supported, aided, and challenged by other people working on similar projects.

The last aspect of the triarchic model, practical intelligence, refers primarily to intelligence that cannot be gained from books or formal learning. Practical intelligence represents a type of street smarts or common sense that is learned from life experiences. Although a number of tests have been devised to measure practical intelligence (Sternberg, Wagner, & Okagaki, 1993; Wagner & Sternberg, 1985), research has not found much evidence that practical intelligence is distinct from g or that it is predictive of success at any particular tasks (Gottfredson, 2003). Practical intelligence may include, at least in part, certain abilities that help people perform well at specific jobs, and these abilities may not always be highly correlated with general intelligence (Sternberg, Wagner, & Okagaki, 1993). On the other hand, these abilities or skills are very specific to particular occupations and thus do not seem to represent the broader idea of intelligence.

Another champion of the idea of multiple intelligences is the psychologist Howard Gardner (1983, 1999). Gardner argued that it would be evolutionarily functional for different people to have different talents and skills, and proposed that there are eight intelligences that can be differentiated from each other (Table 9.1, “Howard Gardner’s Eight Specific Intelligences”). Gardner noted that some evidence for multiple intelligences comes from the abilities of autistic savants , people who score low on intelligence tests overall but who nevertheless may have exceptional skills in a given domain, such as math, music, art, or in being able to recite statistics in a given sport (Treffert & Wallace, 2004).

what is critical thinking and how to measure its ability in cognitive psychology

The idea of multiple intelligences has been influential in the field of education, and teachers have used these ideas to try to teach differently to different students (Figure 9.3, “Intelligence”). For instance, to teach math problems to students who have particularly good kinesthetic intelligence, a teacher might encourage the students to move their bodies or hands according to the numbers. On the other hand, some have argued that these intelligences sometimes seem more like abilities or talents rather than real intelligence. And there is no clear conclusion about how many intelligences there are. Are sense of humour, artistic skills, dramatic skills, and so forth also separate intelligences? Furthermore, and again demonstrating the underlying power of a single intelligence, the many different intelligences are in fact correlated and thus represent, in part, g (Brody, 2003).

Measuring Intelligence: Standardization and the Intelligence Quotient

The goal of most intelligence tests is to measure g, the general intelligence factor. Good intelligence tests are reliable , meaning that they are consistent over time , and also demonstrate construct validity , meaning that they actually measure intelligence rather than something else . Because intelligence is such an important individual difference dimension, psychologists have invested substantial effort in creating and improving measures of intelligence, and these tests are now the most accurate of all psychological tests. In fact, the ability to accurately assess intelligence is one of the most important contributions of psychology to everyday public life.

Intelligence changes with age. A three-year-old who could accurately multiply 183 by 39 would certainly be intelligent, but a 25-year-old who could not do so would be seen as unintelligent. Thus understanding intelligence requires that we know the norms or standards in a given population of people at a given age. The standardization of a test involves giving it to a large number of people at different ages and computing the average score on the test at each age level .

It is important that intelligence tests be standardized on a regular basis because the overall level of intelligence in a population may change over time. The Flynn effect refers to the observation that scores on intelligence tests worldwide have increased substantially over the past decades (Flynn, 1999). Although the increase varies somewhat from country to country, the average increase is about three intelligence (IQ) points every 10 years. There are many explanations for the Flynn effect, including better nutrition, increased access to information, and more familiarity with multiple-choice tests (Neisser, 1998). But whether people are actually getting smarter is debatable (Neisser, 1997).

Once the standardization has been accomplished, we have a picture of the average abilities of people at different ages and can calculate a person’s mental age , which is the age at which a person is performing intellectually . If we compare the mental age of a person to the person’s chronological age, the result is the IQ , a measure of intelligence that is adjusted for age . A simple way to calculate IQ is by using the following formula:

IQ = mental age ÷ chronological age × 100.

Thus a 10-year-old child who does as well as the average 10-year-old child has an IQ of 100 (10 ÷ 10 × 100), whereas an eight-year-old child who does as well as the average 10-year-old child would have an IQ of 125 (10 ÷ 8 × 100). Most modern intelligence tests are based the relative position of a person’s score among people of the same age, rather than on the basis of this formula, but the idea of an intelligence ratio or quotient provides a good description of the score’s meaning.

A number of scales are based on the IQ. The Wechsler Adult lntelligence Scale (WAIS) is the most widely used intelligence test for adults (Watkins, Campbell, Nieberding, & Hallmark, 1995). The current version of the WAIS, the WAIS-IV, was standardized on 2,200 people ranging from 16 to 90 years of age. It consists of 15 different tasks, each designed to assess intelligence, including working memory, arithmetic ability, spatial ability, and general knowledge about the world (see Figure 9.4, “Sample Items from the Wechsler Adult Intelligence Scale (WAIS)”). The WAIS-IV yields scores on four domains: verbal, perceptual, working memory, and processing speed. The reliability of the test is high (more than 0.95), and it shows substantial construct validity. The WAIS-IV is correlated highly with other IQ tests such as the Stanford-Binet, as well as with criteria of academic and life success, including grades, measures of work performance, and occupational level. It also shows significant correlations with measures of everyday functioning among the intellectually disabled.

The Wechsler scale has also been adapted for preschool children in the form of the Wechsler Primary and Preschool Scale of Intelligence (WPPSI-III) and for older children and adolescents in the form of the Wechsler Intelligence Scale for Children (WISC-IV) .

what is critical thinking and how to measure its ability in cognitive psychology

The intelligence tests that you may be most familiar with are aptitude tests , which are designed to measure one’s ability to perform a given task , such as doing well in undergraduate, graduate, or post-graduate training. Canadian post-secondary institutions request official high school transcripts demonstrating minimum grade admission requirements, while most American colleges and universities require students to take the Scholastic Assessment Test (SAT) or the American College Test (ACT). Post-graduate schools in both countries require the Graduate Record Examination (GRE), Graduate Management Admission Test (GMAT), Medical College Admissions Test (MCAT), or the Law School Admission Test (LSAT). These tests are useful for selecting students because they predict success in the programs that they are designed for, particularly in the first year of the program (Kuncel, Hezlett, & Ones, 2010). These aptitude tests also measure, in part, intelligence. Frey and Detterman (2004) found that the SAT correlated highly (between about r = .7 and r = .8) with standard measures of intelligence.

Intelligence tests are also used by industrial and organizational psychologists in the process of personnel selection . Personnel selection is the use of structured tests to select people who are likely to perform well at given jobs (Schmidt & Hunter, 1998). The psychologists begin by conducting a job analysis in which they determine what knowledge, skills, abilities, and personal characteristics (KSAPs) are required for a given job . This is normally accomplished by surveying and/or interviewing current workers and their supervisors. Based on the results of the job analysis, the psychologists choose selection methods that are most likely to be predictive of job performance. Measures include tests of cognitive and physical ability and job knowledge tests, as well as measures of IQ and personality.

The Biology of Intelligence

The brain processes underlying intelligence are not completely understood, but current research has focused on four potential factors: brain size, sensory ability, speed and efficiency of neural transmission, and working memory capacity.

There is at least some truth to the idea that smarter people have bigger brains. Studies that have measured brain volume using neuroimaging techniques find that larger brain size is correlated with intelligence (McDaniel, 2005), and intelligence has also been found to be correlated with the number of neurons in the brain and with the thickness of the cortex (Haier, 2004; Shaw et al., 2006). It is important to remember that these correlational findings do not mean that having more brain volume causes higher intelligence. It is possible that growing up in a stimulating environment that rewards thinking and learning may lead to greater brain growth (Garlick, 2003), and it is also possible that a third variable, such as better nutrition, causes both brain volume and intelligence.

Another possibility is that the brains of more intelligent people operate faster or more efficiently than the brains of the less intelligent. Some evidence supporting this idea comes from data showing that people who are more intelligent frequently show less brain activity (suggesting that they need to use less capacity) than those with lower intelligence when they work on a task (Haier, Siegel, Tang, & Abel, 1992). And the brains of more intelligent people also seem to run faster than the brains of the less intelligent. Research has found that the speed with which people can perform simple tasks — such as determining which of two lines is longer or pressing, as quickly as possible, one of eight buttons that is lighted — is predictive of intelligence (Deary, Der, & Ford, 2001). Intelligence scores also correlate at about r = .5 with measures of working memory (Ackerman, Beier, & Boyle, 2005), and working memory is now used as a measure of intelligence on many tests.

Although intelligence is not located in a specific part of the brain, it is more prevalent in some brain areas than others. Duncan et al. (2000) administered a variety of intelligence tasks and observed the places in the cortex that were most active. Although different tests created different patterns of activation, as you can see in Figure 9.5, “Where Is Intelligence?”, these activated areas were primarily in the outer parts of the cortex, the area of the brain most involved in planning, executive control, and short-term memory.

""

Is Intelligence Nature or Nurture?

Intelligence has both genetic and environmental causes, and these have been systematically studied through a large number of twin and adoption studies (Neisser et al., 1996; Plomin, 2003). These studies have found that between 40% and 80% of the variability in IQ is due to genetics, meaning that overall, genetics plays a bigger role than environment does in creating IQ differences among individuals (Plomin & Spinath, 2004). The IQs of identical twins correlate very highly ( r = .86), much higher than do the scores of fraternal twins who are less genetically similar ( r = .60). And the correlations between the IQs of parents and their biological children ( r = .42) is significantly greater than the correlation between parents and adopted children ( r = .19). The role of genetics gets stronger as children get older. The intelligence of very young children (less than 3 years old) does not predict adult intelligence, but by age 7 it does, and IQ scores remain very stable in adulthood (Deary, Whiteman, Starr, Whalley, & Fox, 2004).

But there is also evidence for the role of nurture, indicating that individuals are not born with fixed, unchangeable levels of intelligence. Twins raised together in the same home have more similar IQs than do twins who are raised in different homes, and fraternal twins have more similar IQs than do nontwin siblings, which is likely due to the fact that they are treated more similarly than nontwin siblings are.

The fact that intelligence becomes more stable as we get older provides evidence that early environmental experiences matter more than later ones. Environmental factors also explain a greater proportion of the variance in intelligence for children from lower-class households than they do for children from upper-class households (Turkheimer, Haley, Waldron, D’Onofrio, & Gottesman, 2003). This is because most upper-class households tend to provide a safe, nutritious, and supporting environment for children, whereas these factors are more variable in lower-class households.

Social and economic deprivation can adversely affect IQ. Children from households in poverty have lower IQs than do children from households with more resources even when other factors such as education, race, and parenting are controlled (Brooks-Gunn & Duncan, 1997). Poverty may lead to diets that are undernourishing or lacking in appropriate vitamins, and poor children may also be more likely to be exposed to toxins such as lead in drinking water, dust, or paint chips (Bellinger & Needleman, 2003). Both of these factors can slow brain development and reduce intelligence.

If impoverished environments can harm intelligence, we might wonder whether enriched environments can improve it. Government-funded after-school programs such as Head Start are designed to help children learn. Research has found that attending such programs may increase intelligence for a short time, but these increases rarely last after the programs end (McLoyd, 1998; Perkins & Grotzer, 1997). But other studies suggest that Head Start and similar programs may improve emotional intelligence and reduce the likelihood that children will drop out of school or be held back a grade (Reynolds, Temple, Robertson, & Mann 2001).

Intelligence is improved by education; the number of years a person has spent in school correlates at about r = .6 with IQ (Ceci, 1991). In part this correlation may be due to the fact that people with higher IQ scores enjoy taking classes more than people with low IQ scores, and thus they are more likely to stay in school. But education also has a causal effect on IQ. Comparisons between children who are almost exactly the same age but who just do or just do not make a deadline for entering school in a given school year show that those who enter school a year earlier have higher IQ than those who have to wait until the next year to begin school (Baltes & Reinert, 1969; Ceci & Williams, 1997). Children’s IQs tend to drop significantly during summer vacations (Huttenlocher, Levine, & Vevea, 1998), a finding that suggests that a longer school year, as is used in Europe and East Asia, is beneficial.

It is important to remember that the relative roles of nature and nurture can never be completely separated. A child who has higher than average intelligence will be treated differently than a child who has lower than average intelligence, and these differences in behaviours will likely amplify initial differences. This means that modest genetic differences can be multiplied into big differences over time.

Psychology in Everyday Life: Emotional Intelligence

Although most psychologists have considered intelligence a cognitive ability, people also use their emotions to help them solve problems and relate effectively to others. Emotional intelligence refers to the ability to accurately identify, assess, and understand emotions, as well as to effectively control one’s own emotions (Feldman-Barrett & Salovey, 2002; Mayer, Salovey, & Caruso, 2000).

The idea of emotional intelligence is seen in Howard Gardner’s interpersonal intelligence ( the capacity to understand the emotions, intentions, motivations, and desires of other people ) and intrapersonal intelligence ( the capacity to understand oneself, including one’s emotions ). Public interest in, and research on, emotional intellgence became widely prevalent following the publication of Daniel Goleman’s best-selling book,  Working with emotional intelligence (1998).

There are a variety of measures of emotional intelligence (Mayer, Salovey, & Caruso, 2008; Petrides & Furnham, 2000). One popular measure, the Mayer-Salovey-Caruso Emotional Intelligence Test ( http://www.emotionaliq.org ), includes items about the ability to understand, experience, and manage emotions, such as these:

  • What mood(s) might be helpful to feel when meeting in-laws for the very first time?
  • Tom felt anxious and became a bit stressed when he thought about all the work he needed to do. When his supervisor brought him an additional project, he felt ____ (fill in the blank).
  • anger and fear
  • fear and surprise
  • disgust and anger
  • surprise and disgust
  • Action 1: She started to make a list of things at home that she needed to do.
  • Action 2: She began thinking about where and when she would go on her next vacation.
  • Action 3: She decided it was best to ignore the feeling since it wouldn’t last anyway.

One problem with emotional intelligence tests is that they often do not show a great deal of reliability or construct validity (Føllesdal & Hagtvet, 2009). Although it has been found that people with higher emotional intelligence are also healthier (Martins, Ramalho, & Morin, 2010), findings are mixed about whether emotional intelligence predicts life success — for instance, job performance (Harms & Credé, 2010). Furthermore, other researchers have questioned the construct validity of the measures, arguing that emotional intelligence really measures knowledge about what emotions are, but not necessarily how to use those emotions (Brody, 2004), and that emotional intelligence is actually a personality trait, a part of g, or a skill that can be applied in some specific work situations — for instance, academic and work situations (Landy, 2005).

Although measures of the ability to understand, experience, and manage emotions may not predict effective behaviours, another important aspect of emotional intelligence —  emotion regulation  — does. Emotion regulation refers to the ability to control and productively use one’s emotions . Research has found that people who are better able to override their impulses to seek immediate gratification and who are less impulsive also have higher cognitive and social intelligence. They have better test scores, are rated by their friends as more socially adept, and cope with frustration and stress better than those with less skill at emotion regulation (Ayduk et al., 2000; Eigsti et al., 2006; Mischel & Ayduk, 2004).

Because emotional intelligence seems so important, many school systems have designed programs to teach it to their students. However, the effectiveness of these programs has not been rigorously tested, and we do not yet know whether emotional intelligence can be taught, or if learning it would improve the quality of people’s lives (Mayer & Cobb, 2000).

Key Takeaways

  • Intelligence is the ability to think, to learn from experience, to solve problems, and to adapt to new situations. Intelligence is important because it has an impact on many human behaviours.
  • Psychologists believe that there is a construct, known as general intelligence (g), that accounts for the overall differences in intelligence among people.
  • There is also evidence for specific intelligences (s), which are measures of specific skills in narrow domains, including creativity and practical intelligence.
  • The intelligence quotient (IQ) is a measure of intelligence that is adjusted for age. The Wechsler Adult lntelligence Scale (WAIS) is the most widely used IQ test for adults.
  • Brain volume, speed of neural transmission, and working memory capacity are related to IQ.
  • Between 40% and 80% of the variability in IQ is due to genetics, meaning that overall genetics plays a bigger role than environment does in creating IQ differences among individuals.
  • Intelligence is improved by education and may be hindered by environmental factors such as poverty.
  • Emotional intelligence refers to the ability to identify, assess, manage, and control one’s emotions. People who are better able to regulate their behaviours and emotions are also more successful in their personal and social encounters.

Exercises and Critical Thinking

  • Consider your own IQ. Are you smarter than the average person? What specific intelligences do you think you excel in?
  • Did your parents try to improve your intelligence? Do you think their efforts were successful?
  • Consider the meaning of the Flynn effect. Do you think people are really getting smarter?
  • Give some examples of how emotional intelligence (or the lack of it) influences your everyday life and the lives of other people you know.

Image Attributions

Figure 9.1: “ The school-boy doing his homework ” by Moonsun1981 (http://commons.wikimedia.org/wiki/File:Az-Writing_boy_e-citizen.jpg) is licensed under CC BY-SA 3.0 license (http://creativecommons.org/licenses/by-sa/3.0/deed.en).

Figure 9.2: “ paper clip ” by Hawyih (http://en.wikipedia.org/wiki/File:Wanzijia.jpg) is in the public domain .

Figure 9.3: “ Women heptathlon ” by Marie-Lan Nguyen (http://en.wikipedia.org/wiki/File:Women_heptathlon_LJ_French_Athletics_Championships_2013_t144221.jpg) is licensed under CC-BY 3.0 license (http://creativecommons.org/licenses/by/3.0/). “ Street Painter ” by Pedro Ribeiro Simões (http://www.flickr.com/photos/pedrosimoes7/190673196/) is licensed under CC BY 2.0 license (http://creativecommons.org/licenses/by/2.0/deed.en_CA). “ Vardan Mamikonyan Armenian pianist ” by Chaojoker (http://commons.wikimedia.org/wiki/File:Vardan_Mamikonyan_Armenian_pianist.JPG) is licensed under CC BY-SA 3.0 license (http://creativecommons.org/licenses/by-sa/3.0/deed.en). “ Teacher at Chalkboard ” by cybrarian77 (http://www.flickr.com/photos/cybrarian77/6284181389/) is licensed under CC BY-NC 2.0 license (http://creativecommons.org/licenses/by-nc/2.0/deed.en_CA). “ Klutz the Clown ” by Herald Post (http://www.flickr.com/photos/heraldpost/3771785750/) is licensed under CC BY-NC 2.0 license (http://creativecommons.org/licenses/by-nc/2.0/deed.en_CA)

Figure 9.4: Adapted from Thorndike & Hagen (1997).

Figure 9.5: Adapted from Duncan, et al. (2000).

Ackerman, P. L., Beier, M. E., & Boyle, M. O. (2005). Working memory and intelligence: The same or different constructs?  Psychological Bulletin, 131 (1), 30–60.

Ayduk, O., Mendoza-Denton, R., Mischel, W., Downey, G., Peake, P. K., & Rodriguez, M. (2000). Regulating the interpersonal self: Strategic self-regulation for coping with rejection sensitivity.  Journal of Personality and Social Psychology, 79 (5), 776–792.

Baltes, P. B., & Reinert, G. (1969). Cohort effects in cognitive development of children as revealed by cross-sectional sequences.  Developmental Psychology, 1 (2), 169–177.

Bellinger, D. C., & Needleman, H. L. (2003). Intellectual impairment and blood lead levels [Letter to the editor].  The New England Journal of Medicine, 349 (5), 500.

Binet, A., Simon, T., & Town, C. H. (1915).  A method of measuring the development of the intelligence of young children  (3rd ed.) Chicago, IL: Chicago Medical Book.

Bink, M. L., & Marsh, R. L. (2000). Cognitive regularities in creative activity.  Review of General Psychology, 4 (1), 59–78.

Brody, N. (2003). Construct validation of the Sternberg Triarchic abilities test: Comment and reanalysis.  Intelligence, 31 (4), 319–329.

Brody, N. (2004). What cognitive intelligence is and what emotional intelligence is not.  Psychological Inquiry, 15,  234–238.

Brooks-Gunn, J., & Duncan, G. J. (1997). The effects of poverty on children.  The Future of Children, 7 (2), 55–71.

Ceci, S. J. (1991). How much does schooling influence general intelligence and its cognitive components? A reassessment of the evidence.  Developmental Psychology, 27 (5), 703–722.

Ceci, S. J., & Williams, W. M. (1997). Schooling, intelligence, and income.  American Psychologist, 52 (10), 1051–1058.

Deary, I. J., Der, G., & Ford, G. (2001). Reaction times and intelligence differences: A population-based cohort study.  Intelligence, 29 (5), 389–399.

Deary, I. J., Whiteman, M. C., Starr, J. M., Whalley, L. J., & Fox, H. C. (2004). The impact of childhood intelligence on later life: Following up the Scottish mental surveys of 1932 and 1947.  Journal of Personality and Social Psychology, 86 (1), 130–147.

Duncan, J., Seitz, R. J., Kolodny, J., Bor, D., Herzog, H., Ahmed, A.,…Emslie, H. (2000). A neural basis for general intelligence.  Science, 289 (5478), 457–460.

Eigsti, I.-M., Zayas, V., Mischel, W., Shoda, Y., Ayduk, O., Dadlani, M. B.,…Casey, B. J. (2006). Predicting cognitive control from preschool to late adolescence and young adulthood.  Psychological Science, 17 (6), 478–484.

Ericsson, K. (1998). The scientific study of expert levels of performance: General implications for optimal learning and creativity.  High Ability Studies, 9 (1), 75–100.

Feldman-Barrett, L., & Salovey, P. (Eds.). (2002).  The wisdom in feeling: Psychological processes in emotional intelligence.  New York, NY: Guilford Press.

Flynn, J. R. (1999). Searching for justice: The discovery of IQ gains over time.  American Psychologist, 54 (1), 5–20.

Føllesdal, H., & Hagtvet, K. A. (2009). Emotional intelligence: The MSCEIT from the perspective of generalizability theory.  Intelligence, 37 (1), 94–105.

Frey, M. C., & Detterman, D. K. (2004). Scholastic assessment or g? The relationship between the scholastic assessment test and general cognitive ability.  Psychological Science, 15 (6), 373–378.

Furnham, A., & Bachtiar, V. (2008). Personality and intelligence as predictors of creativity.  Personality and Individual Differences, 45 (7), 613–617.

Gardner, H. (1983).  Frames of mind: The theory of multiple intelligences . New York, NY: Basic Books.

Gardner, H. (1999).  Intelligence reframed: Multiple intelligences for the 21st century . New York, NY: Basic Books.

Garlick, D. (2003). Integrating brain science research with intelligence research.  Current Directions in Psychological Science, 12 (5), 185–189.

Goleman, D. (1998).  Working with emotional intelligence.  New York, NY: Bantam Books.

Gottfredson, L. S. (1997). Mainstream science on intelligence: An editorial with 52 signatories, history and bibliography.  Intelligence, 24 (1), 13–23.

Gottfredson, L. S. (2003). Dissecting practical intelligence theory: Its claims and evidence.  Intelligence, 31 (4), 343–397.

Haier, R. J. (2004). Brain imaging studies of personality: The slow revolution. In R. M. Stelmack (Ed.),  On the psychobiology of personality: Essays in honor of Marvin Zuckerman  (pp. 329–340). New York, NY: Elsevier Science.

Haier, R. J., Siegel, B. V., Tang, C., & Abel, L. (1992). Intelligence and changes in regional cerebral glucose metabolic rate following learning.  Intelligence, 16 (3–4), 415–426.

Harms, P. D., & Credé, M. (2010). Emotional intelligence and transformational and transactional leadership: A meta-analysis.  Journal of Leadership & Organizational Studies, 17 (1), 5–17.

Hennessey, B. A., & Amabile, T. M. (2010). Creativity.  Annual Review of Psychology, 61 , 569–598.

Horn, J. L., Donaldson, G., & Engstrom, R. (1981). Apprehension, memory, and fluid intelligence decline in adulthood.  Research on Aging, 3 (1), 33–84.

Huttenlocher, J., Levine, S., & Vevea, J. (1998). Environmental input and cognitive growth: A study using time-period comparisons.  Child Development, 69 (4), 1012–1029.

Kuncel, N. R., Hezlett, S. A., & Ones, D. S. (2010). A comprehensive meta-analysis of the predictive validity of the graduate record examinations: Implications for graduate student selection and performance.  Psychological Bulletin, 127 (1), 162–181.

Landy, F. J. (2005). Some historical and scientific issues related to research on emotional intelligence.  Journal of Organizational Behavior, 26 , 411–424.

Martins, A., Ramalho, N., & Morin, E. (2010). A comprehensive meta-analysis of the relationship between emotional intelligence and health.  Personality and Individual Differences, 49 (6), 554–564.

Mayer, J. D., & Cobb, C. D. (2000). Educational policy on emotional intelligence: Does it make sense?  Educational Psychology Review, 12 (2), 163–183.

Mayer, J. D., Salovey, P., & Caruso, D. (2000). Models of emotional intelligence. In R. J. Sternberg (Ed.),  Handbook of intelligence  (pp. 396–420). New York, NY: Cambridge University Press.

Mayer, J. D., Salovey, P., & Caruso, D. R. (2008). Emotional intelligence: New ability or eclectic traits.  American Psychologist, 63 (6), 503–517.

McDaniel, M. A. (2005). Big-brained people are smarter: A meta-analysis of the relationship between in vivo brain volume and intelligence.  Intelligence, 33 (4), 337–346.

McLoyd, V. C. (1998). Children in poverty: Development, public policy and practice. In W. Damon, I. E. Sigel, & K. A. Renninger (Eds.),  Handbook of child psychology: Child psychology in practice  (5th ed., Vol. 4, pp. 135–208). Hoboken, NJ: John Wiley & Sons.

Mischel, W., & Ayduk, O. (Eds.). (2004).  Willpower in a cognitive-affective processing system: The dynamics of delay of gratification . New York, NY: Guilford Press.

Neisser, U. (1997). Rising scores on intelligence tests.  American Scientist, 85 , 440–447.

Neisser, U. (Ed.). (1998).  The rising curve . Washington, DC: American Psychological Association.

Neisser, U., Boodoo, G., Bouchard, T. J., Jr., Boykin, A. W., Brody, N., Ceci, S. J.,…Urbina, S. (1996). Intelligence: Knowns and unknowns.  American Psychologist, 51 (2), 77–101.

Perkins, D. N., & Grotzer, T. A. (1997). Teaching intelligence.  American Psychologist, 52 (10), 1125–1133.

Petrides, K. V., & Furnham, A. (2000). On the dimensional structure of emotional intelligence.  Personality and Individual Differences, 29,  313–320.

Plomin, R. (2003). General cognitive ability. In R. Plomin, J. C. DeFries, I. W. Craig, & P. McGuffin (Eds.),  Behavioral genetics in the postgenomic era  (pp. 183–201). Washington, DC: American Psychological Association.

Plomin, R., & Spinath, F. M. (2004). Intelligence: Genetics, genes, and genomics.  Journal of Personality and Social Psychology, 86 (1), 112–129.

Reynolds, A. J., Temple, J. A., Robertson, D. L., & Mann, E. A. (2001). Long-term effects of an early childhood intervention on educational achievement and juvenile arrest: A 15-year follow-up of low-income children in public schools.  Journal of the American Medical Association, 285 (18), 2339–2346.

Salthouse, T. A. (2004). What and when of cognitive aging.  Current Directions in Psychological Science, 13 (4), 140–144.

Schmidt, F. L., & Hunter, J. E. (1998). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings.  Psychological Bulletin, 124 , 262–274.

Shaw, P., Greenstein, D., Lerch, J., Clasen, L., Lenroot, R., Gogtay, N.,…Giedd, J. (2006). Intellectual ability and cortical development in children and adolescents.  Nature, 440 (7084), 676–679.

Siegler, R. S. (1992). The other Alfred Binet.  Developmental Psychology, 28 (2), 179–190.

Simonton, D. K. (1992). The social context of career success and course for 2,026 scientists and inventors.  Personality and Social Psychology Bulletin, 18 (4), 452–463.

Simonton, D. K. (2000). Creativity: Cognitive, personal, developmental, and social aspects.  American Psychologist, 55 (1), 151–158.

Sternberg, R. J. (1985).  Beyond IQ: A triarchic theory of human intelligence . New York, NY: Cambridge University Press. Sternberg, R. J. (2003). Our research program validating the triarchic theory of successful intelligence: Reply to Gottfredson.  Intelligence, 31 (4), 399–413.

Sternberg, R. J. (2003). Contemporary theories of intelligence. In W. M. Reynolds & G. E. Miller (Eds.),  Handbook of psychology: Educational psychology  (Vol. 7, pp. 23–45). Hoboken, NJ: John Wiley & Sons.

Sternberg, R. J., Wagner, R. K., & Okagaki, L. (1993). Practical intelligence: The nature and role of tacit knowledge in work and at school. In J. M. Puckett & H. W. Reese (Eds.),  Mechanisms of everyday cognition  (pp. 205–227). Hillsdale, NJ: Lawrence Erlbaum Associates.

Tarasova, I. V., Volf, N. V., & Razoumnikova, O. M. (2010). Parameters of cortical interactions in subjects with high and low levels of verbal creativity.  Human Physiology, 36 (1), 80–85.

Thorndike, R. L., & Hagen, E. P. (1997). Cognitive Abilities Test (Form 5): Research handbook . Chicago, IL: Riverside Publishing.

Thurstone, L. L. (1938). Primary mental abilities.  Psychometric Monographs, No. 1 . Chicago, IL: University of Chicago Press.

Treffert, D. A., & Wallace, G. L. (2004, January 1). Islands of genius.[PDF] Scientific American , 14–23. Retrieved from http://gordonresearch.com/articles_autism/SciAm-Islands_of_Genius.pdf

Turkheimer, E., Haley, A., Waldron, M., D’Onofrio, B., & Gottesman, I. I. (2003). Socioeconomic status modifies heritability of IQ in young children.  Psychological Science, 14 (6), 623–628.

Wagner, R., & Sternberg, R. (1985). Practical intelligence in real-world pursuits: The role of tacit knowledge.  Journal of Personality and Social Psychology, 49 (2), 436–458.

Watkins, C. E., Campbell, V. L., Nieberding, R., & Hallmark, R. (1995). Contemporary practice of psychological assessment by clinical psychologists.  Professional Psychology: Research and Practice, 26 (1), 54–60.

Weisberg, R. (2006).  Creativity: Understanding innovation in problem solving, science, invention, and the arts.  Hoboken, NJ: John Wiley & Sons.

Long Descirption

Figure 9.4 long description:

  • What day of the year is Independence Day?
  • If eggs cost 60 cents a dozen, what does 1 egg cost?
  • Tell me the meaning of “corrupt.”
  • Why do people buy fire insurance?
  • Say the following numbers after me: 7 3 4 1 8 6
  • Say the following numbers backwards: 3 8 4 1 6

The last two questions involve making pictures out of blocks.

Introduction to Psychology Copyright © 2019 by Charles Stangor and Jennifer Walinga is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License , except where otherwise noted.

Share This Book

Barbara Koltuska-Haskin, Ph.D.

Creativity and the Brain: How to Be a Creative Thinker

What do we know from research on brain activity involved in creative thought.

Posted April 30, 2024 | Reviewed by Michelle Quirk

  • The book "The Creative Act" argues that creativity is a skill we can all use daily.
  • Creativity is complex and involves multiple brain regions.
  • Research shows that there are several ways to improve our creative thinking.

This post is part 2 of a series.

In my previous post, I wrote that, after being inspired by Rick Rubin’s book, The Creative Act: A Way of Being, I decided to find out what is going on in the human brain that results in creativity. It turned out to be a very complex and complicated subject. That is mainly because it is difficult to clearly define creativity, and there are many different kinds of creative processes, such as visual art, music, creative thinking , etc.

Coming from the field of cognitive processes, I decided that I would concentrate on research related to brain activity involved in creative thought processes. Most of the time, cognitive creativity involves testing the person’s divergent thinking (generating possible solutions to the problem) or convergent thinking (finding a single, correct solution to the problem).

The review of research papers indicated that creative thinking (convergent and divergent thinking) requires the coordination of multiple brain regions, mainly the executive control network (simply speaking involves planning, organizing, problem-solving, and decision-making ), default mode network (areas of the brain that are activated when we are letting our minds wander at rest), and salience network (a network that is involved in the awareness of the feelings associated with rewards). But, obviously, other parts of the brain are also involved, and this depends on the specific goal/outcome that we want to achieve.

I also promised my readers that I would try to find answers to the question of how to be a creative thinker. There are many suggestions on the internet, but let’s see what the research says.

Source: Pete Linforth / Pixabay

You can learn how to meditate and practice it daily.

It may come as a surprise to many people, but the majority of the research papers in that area point to the daily practice of meditation as a way to improve creative thinking. It is not a surprise to me because I am a believer in meditation and do it daily. I also encourage all my patients to try to do it daily.

In a Chinese study (Ding, X. et al. 2014), 40 Chinese undergraduate students were assigned to three groups, a meditation group (30 minutes daily for 7 days), a relaxation training group, and a control group. Creativity performance was assessed by the Torrance Test of Creative Thinking (TTCT). The results indicated that the subjects in the meditation group improved their creativity performance on the divergent thinking tasks.

Research studies on meditation also indicate that it helps improve attention/ concentration skills and emotional regulation and reduces stress and anxiety , so it looks like a good daily habit to start.

You can read aloud and do arithmetic calculations.

In a Taiwan study (Lin, WL. et al. 2018), 50 junior high students were divided into a training group or a control group. The training group was reading aloud and performing arithmetic calculations for 20 sessions. The control group played the game Tetris (a puzzle video game). The results indicated that the participants in the training group outperformed the control group in thinking and creative abilities.

You can do neurofeedback.

Neurofeedback is a computer-guided, noninvasive brain-function training based on electroencephalography (EEG) feedback. Neurofeedback is also called neurotherapy, neurobiofeedback, or EEG biofeedback, and it helps control involuntary processes such as muscle tension and heart rate. Usually, the person is responding to a computer display of her/his own electrical activity of the brain, but it may also simply be a sound stimulation. The most important factor is that neurofeedback focuses on helping a person train himself/herself to regulate brain functions.

In an Italian study (Agnoli, S. et al. 2018), 80 female students from the University of Bologna got three neurofeedback training sessions. The researchers also measured the participants’ lifetime creative achievement by using the Creative Activity and Accomplishment Checklist. The results were measured with the divergent thinking tasks (producing original and effective ideas). The results indicated an increase in both originality and fluency. The increase was particularly evident in participants with an initial low creative achievement level.

This is good news for people who believe that they are not that creative. You may get better with neurofeedback training sessions. Artists and athletes do this nowadays to enhance their performance.

You can do overinclusive thinking training.

Overinclusive thinking can be described as increased generalization and/or considering concepts that most people consider unrelated to certain categories, which provides an increased number of options. In a Taiwan study (Chiu, F.C. 2015), the researcher examined the effect of overinclusive thinking on creativity. Four experiments were designed, and the subjects were undergraduate students who were randomly assigned to an overinclusive thinking training group or a control group. The training group did better on the overinclusive thinking that is related to creativity. The fluency and originality performance were higher than in the control group and the insight problem-solving was also better than in the control group.

what is critical thinking and how to measure its ability in cognitive psychology

So, if you would like to be a creative thinker, you can try some of the ideas described above. Good luck on the road to creativity!

Rick Rubin. The Creative Act: A Way of Being . Penguin Press, NY 2023.

Ding, X. et al. “Improving creativity performance by short-term meditation” Behavioral and Brain Functions. Vol. 10, 2014.

Lin, WL. et al. “ Improving junior high students’ thinking and creative abilities with an executive function training program” Thinking Skills and Creativity . Vol. 29, Sept. 2018.

Agnoli, S. et al. “Enhancing creative cognition with a rapid right-parietal neurofeedback procedure.” Neuropsychologia, Vol. 118, Part A Sept. 2018.

Chiu, F.C. “ Improving your creative potential without awareness: Overinclusive thinking training.” Thinking Skills and Creativity . Vol 15. March 2015.

Barbara Koltuska-Haskin, Ph.D.

Barbara Koltuska-Haskin, Ph.D., is a neuropsychologist in Albuquerque, New Mexico and the author of How My Brain Works.

  • Find a Therapist
  • Find a Treatment Center
  • Find a Psychiatrist
  • Find a Support Group
  • Find Online Therapy
  • United States
  • Brooklyn, NY
  • Chicago, IL
  • Houston, TX
  • Los Angeles, CA
  • New York, NY
  • Portland, OR
  • San Diego, CA
  • San Francisco, CA
  • Seattle, WA
  • Washington, DC
  • Asperger's
  • Bipolar Disorder
  • Chronic Pain
  • Eating Disorders
  • Passive Aggression
  • Personality
  • Goal Setting
  • Positive Psychology
  • Stopping Smoking
  • Low Sexual Desire
  • Relationships
  • Child Development
  • Therapy Center NEW
  • Diagnosis Dictionary
  • Types of Therapy

March 2024 magazine cover

Understanding what emotional intelligence looks like and the steps needed to improve it could light a path to a more emotionally adept world.

  • Emotional Intelligence
  • Gaslighting
  • Affective Forecasting
  • Neuroscience

IMAGES

  1. Critical Thinking Definition, Skills, and Examples

    what is critical thinking and how to measure its ability in cognitive psychology

  2. Unleashing Potential: How STEM Education Enhances Critical Thinking Skills

    what is critical thinking and how to measure its ability in cognitive psychology

  3. 10 Essential Critical Thinking Skills (And How to Improve Them

    what is critical thinking and how to measure its ability in cognitive psychology

  4. Critical Thinking Skills

    what is critical thinking and how to measure its ability in cognitive psychology

  5. Critical_Thinking_Skills_Diagram_svg

    what is critical thinking and how to measure its ability in cognitive psychology

  6. Critical Thinking Skills: Definitions, Examples, and How to Improve

    what is critical thinking and how to measure its ability in cognitive psychology

VIDEO

  1. You think you are smart? Answer this! #shorts #viralshort #iqtest #ytshorts #challenge

  2. You think you are smart? Answer this! #shorts #viralshort #iqtest #ytshorts #challenge

  3. You think you are smart? Answer this! #shorts #viralshort #iqtest #ytshorts #challenge

  4. You think you are smart? Answer this! #shorts #viralshort #iqtest #ytshorts #challenge

  5. Cognitive Psychology

  6. Critical Thinking for Children

COMMENTS

  1. The Disposition Toward Critical Thinking: Its Character, Measurement, and Relationship to Critical Thinking Skill

    It encompasses two parts: critical thinking disposition and critical thinking skills (Facione, 2000). Critical thinking skills encompass six core cognitive abilities: interpretation, analysis ...

  2. What Is Critical Thinking?

    Critical thinking is the ability to effectively analyze information and form a judgment. To think critically, you must be aware of your own biases and assumptions when encountering information, and apply consistent standards when evaluating sources. Critical thinking skills help you to: Identify credible sources. Evaluate and respond to arguments.

  3. Chapter 12

    Owing to its cognitive ease, the uncritical thinking of System 1 operates by default. When the stakes are sufficiently high, we can engage in more critical thinking. We conceptualize critical thinking as scientific reasoning, an array of human inventions specifically designed to overcome the limitations and biases inherent to the efficient but ...

  4. The construction of "critical thinking": Between how we think ...

    The original measurement treated "critical thinking" as both an ability and an attitude. It measured logical abilities, and consistency and extremity of views, but it avoided making assumptions about the correctness of specific real-world beliefs. The correctness of such beliefs was, as problems with other related tests showed, open to dispute.

  5. What is critical thinking?

    Critical thinking is a kind of thinking in which you question, analyse, interpret , evaluate and make a judgement about what you read, hear, say, or write. The term critical comes from the Greek word kritikos meaning "able to judge or discern". Good critical thinking is about making reliable judgements based on reliable information.

  6. Critical Thinking and Decision-Making

    Simply put, critical thinking is the act of deliberately analyzing information so that you can make better judgements and decisions. It involves using things like logic, reasoning, and creativity, to draw conclusions and generally understand things better. This may sound like a pretty broad definition, and that's because critical thinking is a ...

  7. Critical Thinking: 5 Components and Its Assessment

    6 Components of Critical Thinking. Critical thinking includes specific components such as analysis, interpretation, inference, explanation, and self-regulation. 1. Analysis. This involves examining information in detail in order to understand it better and to draw conclusions. It could be data, a concept, or a process.

  8. Using Standardized Test Scores to Include General Cognitive Ability in

    Both of these findings on "brain games" and a "critical thinking measure" align with Spearman's idea of the "indifference of the indicator" given these were measures not designed or intended to measure g, but likely do in some capacity. Table 1 is a conversion table that can be used to interpolate average SATs for non-U.S. schools

  9. 7.1 What Is Cognition?

    Critical Thinking Questions; Personal Application Questions; 14 Stress, Lifestyle, and Health. ... Cognitive psychology is the field of psychology dedicated to examining how people think. It attempts to explain how and why we think the way we do by studying the interactions among human thinking, emotion, creativity, language, and problem ...

  10. a guide to creative and critical thinking

    The open step goes on to outline some of the critical thinking processes that tie into the definitions we've seen. These critical thinking skills include: Analysing and weighing up arguments. Evaluating evidence that has been presented. Distinguishing between fact and opinion.

  11. Cognition

    Metacognition is the act of thinking about one's own mental processes. Metacognitive awareness allows people to identify, monitor, and uproot negative self-talk and self-limiting beliefs, and to ...

  12. 9.1 Defining and Measuring Intelligence

    Binet and Simon developed what most psychologists today regard as the first intelligence test (Figure 9.1, "Intelligence Tests in Schools"), which consisted of a wide variety of questions that included the ability to name objects, define words, draw pictures, complete sentences, compare items, and construct sentences.

  13. Creativity and the Brain: How to Be a Creative Thinker

    The book "The Creative Act" argues that creativity is a skill we can all use daily. Creativity is complex and involves multiple brain regions. Research shows that there are several ways to improve ...