To join the conversation, sign up to Aeon now.

Follow us:
Conversations

Sort:    Popular Latest

Avatar placeholder 1595e26c68347a14a51c9a5bcc34c6a26e97ff5218ce74c79db21df9fb808210
June 02, 2015 12:21

Stuart Ritchie

“IQ tests just measure how good you are at doing IQ tests”. We’ve all heard this argument: it’s almost always made when intelligence testing is mentioned. It’s often made by people who are, otherwise, highly scientifically literate: you wouldn’t catch them arguing that climate change is a myth or that vaccines might cause autism. But saying that IQ tests are useless is just as wrong as these notions: in fact, decades of well-replicated research point to IQ tests as some of the most reliable and valid instruments in all of psychological science.

So what does an IQ test—which might consist, for example, of shape-based puzzles, timings of how quickly you can check through lists of meaningless symbols, memory tests, and vocabulary measures—actually tell you? The strongest relation is perhaps unsurprising: an IQ score is highly predictive of how people will do in school. One huge study found that IQ scores at age 11 correlated .8 (on a scale of -1 to 1) with school grades at age 16. Surely this gives us some basis for calling these measures ‘intelligence tests’. But that’s just the beginning: higher IQ scores are predictive of more occupational success, higher income, and better physical and mental health. Perhaps the most arresting finding is that IQ scores taken in childhood are predictive of mortality: smarter people live longer, and this association is still there after controlling for social class. So much for “just how good you are at IQ tests”.

Neuroscientists and geneticists have also made good progress in understanding human intelligence. Meta-analyses of hundreds of studies confirm that people with larger brains tend to get higher scores on IQ tests, and research on more specific brain regions and features continues apace. We know from studies of twins, and from studies done directly on DNA, that intelligence test scores are heritable: that is, many of the intelligence differences between people are due to genetics. We’ve just begun to find some of the specific genes that might be responsible for these differences.

Because it has been linked to genetic and neural features, and because it seems highly stable across the lifespan, people make the mistake of assuming intelligence is immutable. Your IQ score, they think, is set in stone, condemning you to a poorer life if it’s below-average. But this is a mistake: there’s nothing in principle to suggest we can’t raise people’s IQ scores, at least to a degree (though many recent attempts to do so have been non-starters). Indeed, IQ scores have been rising inexorably across the years, in a process called the Flynn Effect, for (non-genetic) reasons that aren’t yet clear. Another mistake is to think that anyone has ever claimed that an IQ score ‘sums up’ a person; this is another falsehood, since all IQ researchers would readily admit that personality, motivation, and a host of other factors—including luck—are all critical for success in life.

It would be foolish to deny that there are any skeletons in IQ testing’s closet. Many (though by no means all) of the originators of the tests were involved with the eugenics movement in the early 20th Century, and it’s absolutely reasonable to be appalled at some of the uses to which IQ tests were originally put. But these concerns are irrelevant to the main question of whether an IQ score, taken today, can tell you anything about a person: facts are facts, and the validity of intelligence test scores is amply backed by voluminous evidence.

As all the studies linked above show, IQ tests are useful in a wide variety of situations, from education to medicine to the world of work. We need IQ tests to help us understand how the brain ages, and how we might be able to help it do so more healthily. We need IQ tests to help us work out how to boost people’s intelligence, and thus to boost their productivity. Perhaps above all, IQ tests are one of the tools with which psychologists can dissect and examine human intelligence: we’d be extremely unwise to continue to ignore their insights.

You can read more about the science of intelligence and IQ in my new book, Intelligence: All That Matters, published on June 18 by Hodder & Stoughton.

Please sign in or sign up to respond to this question

June 02, 2015 12:29

One of the historical wrinkles about the early years of IQ testing that I really love: Alfred Binet’s (as in the Stanford-Binet test) second career as a writer of horror plays for the Grand Guignol theatre.

Please sign in or sign up to respond to this question

June 02, 2015 14:40

…highly stable across the lifespan…

Although wasn’t it originally a measure of ‘mental age’?

Please sign in or sign up to respond to this question

June 02, 2015 19:20

I think it was originally just a rough guide to how much remedial schooling students might need. Possibly the mental age thing is connected with the concepts of development and retardation, which were pretty big in 1920s psychometrics.

Please sign in or sign up to respond to this question

June 03, 2015 08:48

Quite so. The ‘mental age’ idea was used in the early days of IQ testing, but was changed to a point scale based on previously-collected, representative samples due to the influence of Robert Yerkes and David Wechsler.

Please sign in or sign up to respond to this question

June 03, 2015 01:29

I’ll bet there’s an inverse correlation between IQ scores and the maligning of IQ tests.

Please sign in or sign up to respond to this question

June 09, 2015 23:50

And I would bet there’s a direct correlation between IQ scores and the praising of IQ tests.

What is your point?

Please sign in or sign up to respond to this question

June 10, 2015 16:04

A cheap shot, Bradford. SH is more on the ball. Those who do well at IQ tests get understandably upset when their achievement is rubbished.

Please sign in or sign up to respond to this question

June 03, 2015 06:29

The argument “IQ tests as some of the most reliable and valid instruments in all of psychological science.” assumes psychology is a science, which is disputable. Therefore the rest of the argument is fundamentally questionabl

Please sign in or sign up to respond to this question

June 03, 2015 08:43

Would be very interested to hear why you think the peer-reviewed journal articles linked above (from, e.g. Nature Reviews Neuroscience, International Journal of Epidemiology, and Molecular Psychiatry) don’t count as science.

Please sign in or sign up to respond to this question

June 03, 2015 16:08

Dear Stuat,

one of the arguments commonly used to question Psychology’s scientific status is its repeated inability to accurately define what its instruments are measuring. In your article you seem to imply that IQ measures “intelligence” ( whatever that is, could you define?), while others have shown that it measure other “personality parameters” such as “motivation” or “self-discipline ”. Meanwhile these internal controversies are solved it seems your comusions are difficult to support. Please see an interesting discussion in Science online (link)

Please sign in or sign up to respond to this question

June 04, 2015 08:48

Long before we had the kinetic theory of gases (and thus an accurate definition of what was being measured), thermometers were making useful, valid, and reliable measurements of temperature. I see a similar situation for IQ testing.

Please sign in or sign up to respond to this question

June 09, 2015 23:40

I see your point, but this is an inaccurate analogy.

Temperature could be defined as what is to be read from a standard thermometer (especially since measurments are repeatable). That definition is, for all intents and purposes, 100% correlated with the statistical mechanics’ definition (kinetic theory of gases) of the derivative of internal energy with respect to entropy.

Do you wish to imply that IQ tests ought to be used to define intelligence until we have another, more reductive theory for it?

Please sign in or sign up to respond to this question

June 04, 2015 01:45

Very good piece, I’ll definitely get a copy of your book soon. It’s amazing that despite the amount of evidence that continues to demostrate that it is a real property that has consequences for life outcome, non-specialists continue to dismiss it altogether.

On the question of whether or not intelligence can be defined or not, this was my attempt at doing so:

http://stateexempt.com/wordpress/2014/10/20/a-practical-definition-of-intelligence-as-measured-by-iq/

Are there more recent or “official” definitions that are now commonly used by psychometricians?

Please sign in or sign up to respond to this question

June 04, 2015 08:50

Very kind of you to say - thank you! I like your definition, but as I argue in my comment below, I don’t think a definition is even strictly necessary.

Please sign in or sign up to respond to this question

June 04, 2015 11:16

If it would be true that you can define and objective parameter called :intelligence" and then you could use IQ as instrument to measure variations in it (both questionable but still fair assumptions), you propose that predictive associations between IQ scores and later-life outcomes may be interpreted as estimates or even predictors of the effect of intellectual ability on academic, professional, and social life outcomes.

This paper in Proceedings of the National Academy of Sciences USA (PNAS) provides evidence against both arguments, and therefore seriously questions your statement that “ IQ tests as some of the most reliable and valid instruments in all of psychological science”

Role of test motivation in intelligence testing.

Duckworth AL, Quinn PD, Lynam DR, Loeber R, Stouthamer-Loeber M.

Proc Natl Acad Sci U S A. 2011 May 10;108(19):7716-20.


Please sign in or sign up to respond to this question

June 04, 2015 15:08

You should be aware that the effect in the meta-analysis you cite is driven by a couple of outlier studies, which were done by a researcher who was later found out to have fabricated some of his papers. Details (and more) here: https://menghublog.wordpress.com/2012/07/04/angela-l-duckworths-iq-motivation-study-another-bad-apple/

Please sign in or sign up to respond to this question

June 04, 2015 18:38

Oh, of course, there is a lot of (pseudo) scientific gosiping on the internet, and although i am not a fervent supporter of peer review as is, the Duckworth study is published in a highly recognized peer reviewer journal, which editors and reviewers should have detected the methodological flaws you suggest, which seem to be published in some blog. If it wouldn’t be so, the scientifically responsible attitude from your side would be to contact the editors and ask for retraction. As this has not happened yet far as i know. Thus, me, as member of the readership, have to assume that the data and analysis are still valid, and so is my argument against your statemen

Please sign in or sign up to respond to this question

June 04, 2015 23:27

Well that’s as good an argument from authority as one’s ever likely to see. I think this debate is over.

Please sign in or sign up to respond to this question

June 10, 2015 16:08

You choose not to mention that early pioneers of IQ tests often fabricated their research. More importantly, IQ test scores can be raised with practice, which demonstrates that they do not measure anything innate. That also means that those with pushy parents can expect to be elevated above their peers.

Please sign in or sign up to respond to this question

June 12, 2015 09:57

Actually, I do criticise the early pioneers of IQ tests in the penultimate paragraph, though not necessarily for fabrication (for which there is a dwindling amount of evidence, see e.g.: http://www.sciencedirect.com/science/article/pii/S0160289614001731).

With regard to your ‘more important’ argument, I also say in the piece that “there’s nothing in principle to suggest we can’t raise people’s IQ scores, at least to a degree”. Perhaps you missed it.

Please sign in or sign up to respond to this question

June 12, 2015 10:39

Okay, but is there any evidence that being good at IQ tests is a transferable skill? Not so long ago Sudoku was very popular among older people who imagined it kept their brains active . All that happened is they became very good at Sudoku. So while someone might enjoy raising their IQ, in much the same way they might enjoy getting better at Sudoku, it probably has no wider benefit.

Please sign in or sign up to respond to this question

June 12, 2015 03:43

It would seem having a good memory, attention to details,

ability to see connections and the ability to make quick accurate

decisions would be useful on IQ tests.

Weren’t IQ tests tailored to make sure that those thought to be the

brightest scored highest ?

Please sign in or sign up to respond to this question

July 05, 2015 23:37

I imagine IQ tests measure something usefully described as “intelligence.” (I get high IQ scores.)

Also think politicians’ and other opinion-entrepreneurs’ assertions that government could influence our behaviors so as to improve climate change for humanity a myth (never even mind what those behaviors would cost).

A very profitable myth both for such people AND their “scientist” clientele to promote.

Please sign in or sign up to respond to this question

Avatar placeholder 1595e26c68347a14a51c9a5bcc34c6a26e97ff5218ce74c79db21df9fb808210
June 03, 2015 19:40

George Watson

In terms of an IQ test, why is the amount of time you have on the test

so important ?

After all, if I can reach the correct conclusion after five minues of thought

and you cannot reach it after two hours, does that not say something about my abilities. But why should someone who solves it or guesses

it after three minutes be given full credit and I, because I ran out of time

be given no credit.

The SAT Exam in America is notoriously time driven.

Each part of the exam is timed so if you dawdle you are lost.

Yet does that not meant that those who provide quickly thought out

answers do better than those who ponder the answer.

In short does our modern Stock Market where quickness is rewarded

with massive amounts of short-term gains endanger the economy ?

Whatever happened to investing for the long run and for dividends ?

Please sign in or sign up to respond to this question

June 09, 2015 23:42

I agree completely.

Please sign in or sign up to respond to this question

June 10, 2015 17:53

S H

The desire to have quick answers to deep questions plagues us

in business and politics. If the President or Presidential Aspirant

does not answer with 10 seconds the media goes crazy. Then, sadly,

once a decision has been made it is almost impossible to change it

no matter how badly the situation is turning out.

Please sign in or sign up to respond to this question

June 11, 2015 02:10

I’m in academia, and I often stop, look at the people around me, and reflect: What the hell is all the rush for? Who/what is making us rush and stress? Is that really conducive to discovery and innovation?

Well, the same people who prescribe for our kids to rush are the same ones rushing us. The elites and owners of our economy are, no doubt, the ones that profit the most from all this shallow rushing. It’s just capitalism, I guess. I say this without a moral judgement, though I certainly do not like the way things are.

As you noted, the virus has even reached our elections; a time where serious thought and meaningful presentations should be the norm. Instead we get commercials selling candidates and posturing during “debates”.

Please sign in or sign up to respond to this question

June 11, 2015 02:19

You would think, if anyone, Academics would take care

to explore all possible avenues before writing a

“definitive” report.

Please sign in or sign up to respond to this question

Thumb ronbest
June 01, 2015 20:39

Ron Bell

Ed, if it were, I’d be labeled, like Motivation Speaker Les Brown was during his youth, “educable, mentally retarded.” I soared in some areas–and tests–and crashed and burned in others. Acceptance of weaknesses(and failings) is one of the keys to wisdom.

Please sign in or sign up to respond to this question

June 01, 2015 20:53

Oh interesting. Was there a pattern to the areas you found easier and more difficult?

Please sign in or sign up to respond to this question

Avatar placeholder 1595e26c68347a14a51c9a5bcc34c6a26e97ff5218ce74c79db21df9fb808210
June 04, 2015 11:40

Terrance Stuart

I am a member of MENSA, so by my acions I implicitedly believe there is something to IQ. Those with higher IQ’s tend to process information more rapidly and reason more clearly. This however has nothing to do with wisdom, which is a whole different issue. Each person has differing capacities to learn and retain and like RAM in a computer—actively hold and use their intelligence. IQ tests are the most reliable means of imperfectly measuring this.

Please sign in or sign up to respond to this question

Thumb fune
June 01, 2015 15:26

Casey Oneti

It seems to correlate with high intelligence.

I doubt that a good IQ test can be questioned on its ability to find smart or gifted individuals, especially with the accuracy they have shown.

Please sign in or sign up to respond to this question

Card essay marilyn nyc17585

Essay

The libido crash

Female sex drive has plummeted in our stressed-out world, but can we fix an epidemic of lost desire with drugs?

by Katherine Rowland

Card truth about dishonesty main

Video

Why it’s so easy to cheat without feeling dishonest

11 minutes

Card essay vincent van gogh   wheatfield under thunderclouds   vgm f778

Essay

I feel therefore I am

How exactly did consciousness become a problem? And why, after years off the table, is it a hot research subject now?

by Margaret Wertheim

Card american renaissance main

Video

Freedom, fantasy, family – the sundry allures of the American renaissance faire

9 minutes