Amazon.com Widgets

Skeptical Thinking: Do Your Own Research

I was just reading the book "Blink" by Malcolm Gladwell. It is quite interesting in that it examines the human ability to make [relatively] accurate snap judgements with only a tiny "thin slice" of information. Our subconscious mind picks up on related bits of information and assists the conscious mind in making a decision even though we might not fully understand why. The result of this is the much articulated "gut feeling" about something.

A section within "Blink" that discusses "priming" caught my attention. Psychological researchers have fun putting subjects through tests that have secret agendas. For example, you may take a simple test that asks you to make sentences out of groups of words. What you don't know though, is that a certain tone is generated by key words sprinkled throughout the test.

Subjects coming away from these test have been primed for behavior according to the wishes of the researchers. For example, half the subjects may be exposed to words that evoke aggressive behavior while the other half deals with calming, peaceful words. When given a subsequent task, the two groups will manifest the behavior type indicated by their word groups. This effect has been witnessed and documented time and again.

The book highlights one particular priming study conducted by Clause Steele and Joshua Aronson in 1995 (*). Steele and Aronson found that African American college students performed worse than expected if they were told that the test would measure their cognitive abilities. Steele and Aronson labeled this phenomenon as "Stereotype Threat". Simply being asked to identify their race before the test cut their performance in half!

Sounds amazing right? Could this really be true? Malcolm Gladwell then proceeds to ask hypothetical questions about whether standardized tests really are reliable indicators of the test takers knowledge and intelligence. Could this explain the so-called race gap in standardized tests? These results seemed too amazing and too politically correct for me, so my skeptical red flag was raised. I proceeded to do additional research.

Right away I discovered a web site that apparently has been created as a direct result of the Steele, Aronson research: http://reducingstereotypethreat.org/. That makes sense. Certain groups would certainly welcome these results in lending ammunition to their cause.

Further investigation revealed a published paper called "On interpreting stereotype threat as accounting for African American-White differences on cognitive tests" by Sackett PR, Hardison CM, Cullen MJ. Here is the abstract of that paper:

C. M. Steele and J. Aronson (1995) showed that making race salient when taking a difficult test affected the performance of high-ability African American students, a phenomenon they termed stereotype threat. The authors document that this research is widely misinterpreted in both popular and scholarly publications as showing that eliminating stereotype threat eliminates the African American-White difference in test performance. In fact, scores were statistically adjusted for differences in students' prior SAT performance, and thus, Steele and Aronson's findings actually showed that absent stereotype threat, the two groups differ to the degree that would be expected based on differences in prior SAT scores. The authors caution against interpreting the Steele and Aronson experiment as evidence that stereotype threat is the primary cause of African American-White differences in test performance.

Ah ha! Isn't that interesting. I knew the Steele, Aronson results (as reported in "Blink") were too convenient.

In short order, I ran across the website http://www.debatingracialpreference.org that discusses the issue in depth. Included on that website are excerpts from popular media that widely and politically correctly reported the results of the Steele, Aronson research:

(From "Secrets of the SAT," written by M. Chandler, broadcast 10/4/99, Boston: WGBH.)

At Stanford University, psychology professor Claude Steele has spent several years investigating the 150-point score gap between Whites and Blacks on standardized tests. Was the cause class difference, lower incomes, poorer schools, or something else?... In research conducted at Stanford, Steele administered a difficult version of the Graduate Record Exam, a standardized test like the SAT. To one set of Black and White sophomores, he indicated that the test was an unimportant research tool, to other groups that the test was an accurate measure of their verbal and reasoning ability. Blacks who believed the test was merely a research tool did the same as Whites. But Blacks who believed the test measured their abilities did half as well. Steele calls the effect "stereotype threat."

(Newsweek, 11/6/95, p 82)

In another experiment, when Blacks were told that they were taking a test that would evaluate their intellectual skills, they scored below Whites. Blacks who were told that the test was a laboratory problem-solving task that was not diagnostic of ability scored about the same as Whites.

And even in scientific journals:

(Wolfe, C.T. & Spencer, S.J. (1996). "Stereotypes and Prejudice: Their Overt and Subtle Influence in the Classroom," American Behavioral Scientist 40, 176-185)

Steele and Aronson (1995) found that when African American and white college students were given a difficult test of verbal ability presented as a diagnostic test of intellectual ability, African Americans performed more poorly on the tests than Whites. However, in another condition, when the exact same test was presented as simply a laboratory problem-solving exercise, African Americans performed equally as well as Whites on the test. One simple adjustment to the situation (changing the description of the test) eliminated the performance differences between Whites and African Americans.

But is all of this really true? It turns out, no.

As reported in popular media, these cursory descriptions of the research findings leave out an extremely important piece of information. All three quotes above misinterpret the results in an incorrect way, and they are all completely erroneous.

In fact, the black students in the control group did NOT perform "the same as Whites". They did NOT perform "equally as well as Whites on the test". In fact, the black students not subjected to Stereotype Threat performed "the same", meaning "as expected" according to their previously recorded SAT scores. The previously recorded verbal SAT scores of the test subjects averaged 603 for the blacks and 655 for the whites. The gap remains.

Yes, Steele and Aronson demonstrated that Stereotype Threat can widen the performance gap, but the absence of that threat certainly does not eliminate the gap as was widely reported in the media.

The purpose of this blog post is not racial in nature. It is to illustrate the idea that what you read may not be as true as you think. If you care about real knowledge and real truth, it pays to activate your skeptical eye and do your own research as necessary.

(*) Steele, C. M., & Aronson, J. (1995). Stereotype threat and the intellectual test performance of African-Americans

Brass Monkey: Differences in Metal Expansion

Be careful what you accept as truth!

In typical web-surfing fashion, I stumbled upon something interesting today. I have recently acquired a cast metal puzzle called "NEWS" by Hanayama.

Although it is rated as one of their toughest puzzles, I was able to solve it last night in just a few hours. To be fair, I could tell just by looking at it how it might be solved, because I've seen other puzzles that use the same mechanic. This one, however, *does* have it's own special trick.

But back to the main point. So I was browsing around looking for additional puzzles of this type. I found one that looked like a small brass cannon. Googling for the best price led me to an article about "brass monkeys" and cannon balls. I read it out of curiosity and it was quite interesting.

Being quite interested in etymology, I always find the historical origin of phrases to be extremely entertaining reading. I almost always come away with a feeling of "wow, I just uncovered something I never knew". This experience was no different.

Although I only have a very cursory knowledge of the phrase "freezing the balls off a brass monkey", it was still interesting to learn of its origin. Apparently stacks of cannon balls on sailing ships were stored in pyramids contained and bordered by a brass square with indentations for the outermost balls. This metal square, apparently called a "monkey", would allow the stack to be built and prevent its collapse.

The cannon balls were made of iron and the "monkey" was made of brass. In the article, it was explained the the difference in the coefficient of linear expansion between iron and brass caused the brass to shrink more than the iron in very cold weather. So much so that the cannon balls could pop out of the brass bracket, causing the stack to collapse and cannon balls to go rolling about.

After reading this I felt, "wow, I now have some new knowledge." I was prepared to accept this information as outright fact for two reasons:

  1. It seemed to make sense. I have a good understanding of physics and the properties of matter. I have experience with shrinking and expanding metal with respect to temperature.
  2. I happen to know that a huge number of common (and uncommon) phrases in the English language have nautical origins. This merely seemed like another one in the library.

Shortly after reading the "brass monkey" article, I was thankful to learn that if I had chosen to believe this story I would have been absolutely wrong. This is the link that saved me from the all too common folly of believing what we read without question.

I looked up the coefficient of linear expansion and found similar numbers as those given in the link above. The coefficient for brass appears to be 10.4 x 10-6 inches per degree Fahrenheit. The coefficient for iron appears to be 6 x 10-6 inches per degree Fahrenheit. If the temperature dropped 100 degrees Fahrenheit, the difference in expansion of the metals is something like 1 hundredth of an inch at most.

So please, even if something "seems right", it may not be. If you want to have true knowledge, you really need to verify the claims for yourself to the best of your ability We need to focus more on teaching our children HOW to think rather than WHAT to think. Critical thinking is the goal.

Is Television Really That Bad?

It is currently very fashionable to shun television.  I constantly hear or read about people bragging that their family has been without a television for X months or years.  We are supposed to be impressed by this.  We are supposed to think, "How bold of them!  How can they live without a television?  Maybe I should try that."

More often though, you will hear the same sentiment expressed like this: "I'm really not a TV person, I hardly ever watch it."

To which I say, "Yeah right."  I used to say this myself... all the time.  Then I began to realize how greatly I underestimated my viewing.  Everybody underestimates their viewing, but that's not really my point.  My point is that there is nothing inherently wrong with television!  Just like anything... excessive television, and the wrong kind of television is the problem.  We tend to forget this.

Parents who brag about not having a TV are allowing their children to miss incredible shows like these:

Curious George - teaches Math, Science and Logic
Zula Patrol - teaches Science, Astronomy, and Non-Violent Conflict Resolution
Cyberchase - teaches Problem Solving and Logic
Arthur - teaches Social Skills

These parents are, frankly, retarded idiots.  These parents are "typical Americans" who would rather act on what "They Say" (as in "they say TV is bad for your kids") rather than trying to think for themselves and come to their own conclusions.  Turning off the TV for the sake of turning off the TV is not a sound justification for the action.  That time must be replaced with something more valuable than good television.  The command to "go play" isn't necessarily more valuable.  However, "go read a book" is vastly better.  No argument there.

This post was prompted by something I read on a boardgame website that I frequent.  Some guy's kid's school is having a "Turn Off the Television Week", so he was asking for boardgame recommendations to play with his family that week.  Boardgames are great and you can learn a lot about problem solving, logic, and social interaction by playing them.  But are they really a more valuable teaching tool than good television?  And just like television, the content and company is what matters.  You might have to stretch your brain to play Caylus, but your mind will be numbed by playing Hungry Hungry Hippos.

Somehow "face-to-face interaction" is surpassing "learning and understanding" on the "List of Important Things For Our Children".  This is the main reason why video games get a bad rap.  Good video games in moderation can hone the mind.  Sitting around the table chatting with friends may be entertaining, and may yield some social comfort, but will rarely contribute anything to your Knowledge and Understanding.  Most people are ignorant and will gladly fill your ears with urban mythology, hearsay, and 4th-hand information.

Allergic to Animals: Hair vs. Fur

I'm allergic to dogs and cats.  I've had a lot of people tell me that I can have a dog if I find a species that has "hair" instead of "fur".  I can't tell you how many times I've heard that.  It's a myth.

"Hair" and "fur" are the same thing.  A defining characteristic of mammals is the presence of hair on the body.  The word "fur" is simply a term used to define hair on non-human mammals.


Raymond Camden's BlogCFC version 5.8.001