How to compute the odds that claims of extraterrestrial life discovery are real and reliable

The Search for Extra-Terrestrial Intelligence (SETI) has to be the most interesting field of science that lacks a subject to study. Yet. Keep searching. In the meantime, is there some metric we can apply to calculating the probability and impact of claims of such a discovery? There is.

In January, 2011 the Philosophical Transactions of the Royal Society published 17 articles addressing the matter of “The Detection of Extra-Terrestial Life and the Consequences for Science and Society,” including one by Iván Almár from the Hungarian Academy of Sciences and Margaret S. Race from the SETI Institute, introducing a metric “to provide a scalar assessment of the scientific importance, validity and potential risks associated with putative evidence of ET life discovered on Earth, on nearby bodies in the Solar System or in our Galaxy.” Such scaling is common in science—the Celsius scale for temperature, the Beaufort scale for wind speed, the Saffir-Simpson scale for hurricane strength, and the Richter scale for earthquake magnitude. But these scales, Almár and Race argue, fail to take into account “the relative position of the observer or recipient of information.” The effects of a 7.1 earthquake, for example, depends on the proximity of its epicenter to human habitations.

An improvement may be found in the Torino Scale that computes the likelihood of an asteroid impact and the risk of its potential damage—from 1, a near miss with no danger, to 10, certain impact with catastrophic consequences. But Almár and Race note that “the scale does not include any consideration of the observations’ reliability.” Building on SETI’s Rio Scale for evaluating the effect on society of an ET discovery, Almár and Race propose the London Scale that multiplies Q x δ, where Q (scientific importance) is the sum of four parameters:

• life form (1–5, from Earth-similar life to completely alien),
• nature of evidence (1-6, from indirect biomarkers
  to obviously organized complex life),
• type of method of discovery (1–5, from remote sensing
  to return mission sample), and
• distance (1–4, from beyond the Solar System to on Earth).

This sum is then multiplied by δ (a reliability factor) ranging from 0.1–0.5, from probably not real to highly reliable. The maximum Q can be is 20 x .5 = 10.

For example, Almár and Race compute the odds that the Allan Hills 84001 Martian meteorite contains alien life as (2+2+4+4)0.3 = 3.6 for scientific importance and credibility, noting that “several scientific counter-arguments have been published and the discovery has not been generally accepted.” I would assess the recent claim of arsenic-based life in Mono Lake as (2+1+4+4)0.2 = 2.2, fairly low by comparison.

Such scientific scales attempt to bring some rigor and reliability to estimates of events that are highly improbable or uncertain. The process also reveals why most scientists do not take seriously UFO claims. Although the first two categories would yield a 5 and a 6 (completely alien and complex life) and its distance is zero (4, on Earth), the method of discovery is highly subjective (perceptual, psychological) and open to alternative explanation (1, other aerial phenomena) and the reliability factor δ is either obviously fake or fraudulent (0) or probably not real (0.1), and so Q = (5+6+1+4)0.1 = 1.6 (or 0 if δ = 0).

The Phoenix lights UFO claim, for example, was a real aerial phenomena witnessed by thousands on the evening of March 13, 1997. UFOlogists (and even Arizona governor Fife Symington) claim it was extraterrestrial, but what is δ for this event? It turns out that there were two independent aerial events that night, the first a group of planes flying in a “V” formation at 8:30 that started a UFO hysteria and brought people outdoors with video cameras, which then recorded a string of lights at 10:00 that slowly sank until they disappeared behind a nearby mountain range. These turned out to be flares dropped by the Air National Guard on a training mission. Ever since, people have conflated the two events and thereby transmogrified two IFOs into one UFO. So δ = 0 and Q shifts from 1.6 to 0, which is how much confidence I have in UFOlogists until they produce actual physical evidence, the sine qua non of science.

Michael Shermer discusses his book “The Believing Brain,” which explains how people form beliefs first, then filter data to reinforce them. (Source)

Why science is the only way out of the trap
of belief-dependent realism

WAS PRESIDENT BARACK OBAMA BORN IN HAWAII? I find the question so absurd, not to mention possibly racist in its motivation, that when I am confronted with “birthers” who believe otherwise, I find it diffcult to even focus on their arguments about the difference between a birth certificate and a certificate of live birth. The reason is because once I formed an opinion on the subject, it became a belief, subject to a host of cognitive biases to ensure its verisimilitude. Am I being irrational? Possibly. In fact, this is how most belief systems work for most of us most of the time.

We form our beliefs for a variety of subjective, emotional and psychological reasons in the context of environments created by family, friends, colleagues, culture and society at large. After forming our beliefs, we then defend, justify and rationalize them with a host of intellectual reasons, cogent arguments and rational explanations. Beliefs come first; explanations for beliefs follow. In my new book The Believing Brain (Holt, 2011), I call this process, wherein our perceptions about reality are dependent on the beliefs that we hold about it, belief-dependent realism. Reality exists independent of human minds, but our understanding of it depends on the beliefs we hold at any given time. (continue reading…)

An attempted ambush interview turns
into a lesson in patternicity and numerology

On Friday, June 17, a film crew came by the Skeptics Society office to interview me for a documentary that I was told was on arguments for and against God. The producer of the film, Alan Shaikhin, sent me the following email, which I reprint here in its entirety so that readers can see that there is not a hint of what was to come in what turned out to be an attempted ambush interview with me about Islam, the Quran, and the number 19:

Dear Michael!

I am the director of a film crew hired by a non-profit organization, Izgi Amal, from Kazakhstan, which has no connection with the American brat, Borat. We have been working on a documentary film on modern philosophical and scientific arguments for and against God for almost a year. We have been taking shots and interviewed theologians, philosophers and scientists in England, Netherlands, USA, Turkey, and Egypt.

We are planning to finish the film by the end of this year and participate in major film festivals, including Cannes. We will allocate some of the funds to distribute thousands of copies of the film for free, especially to libraries and colleges.

Our crew will once again visit the United States and will spend the rest of June interviewing various people, from layman to artists, from academicians to activists.

Though we are far out there, we know your work and we think that it contributes greatly to the quality of this perpetual philosophical debate. We would like to include perspective and voice in this discussion. We would appreciate if you let us know what days in JUNE would be the best dates to meet you and interview you for this engaging and fascinating documentary film.

Since we are planning to interview about 10 scholars and experts of diverse positions such as atheism, agnosticism, deism, monotheism, and polytheism, it is important to learn all available days in this month of June.

Please feel free to contact us via email or our cell phone numbers, below. If you respond via email and please let us know the best phone number and times to reach you.

Peace,
Alan Shaikhi

In hindsight perhaps I should have picked up on his admission that “we are far out there,” which in fact they turned out to be. Present were Mr. Shaikhin, another gentleman named Edip Yuksel, a couple of film crew hands, and a woman videographer who was setting up all the lighting and equipment. Before we began Shaikhin explained that they were actually filming two projects, and that his colleague (Mr. Yuksel) would be interviewing me after he, Shaikhin, was finished. Yuksel, in fact, was very fidgety and throughout the interview with Shaikhin I could see him out of the corner of my eye feverishly taking notes and fiddling around with books whose titles I could not see.

Shaikhin’s interview, in fact, included mostly standard faire questions for such documentaries: Do I think there’s a conflict between science and religion?, What do I think about this and that argument for God’s existence?, Why do I think people believe in God?, etc. He was unfailingly polite and professional. Toward the end he did make some vague reference to Islam and our cover story of Skeptic on myths about the Islamic religion (the myth of the Middle East Madman, the myth of the 72 virgins, etc.), but I begged off answering anything about Islam because I haven’t studied it much nor have I read the Quran.

My first clue that the interview was about to take a sharp right turn came when Shaikhin acted shocked that I would edit an issue of Skeptic on Islam without myself having read the Quran. I explained that I write very few articles in Skeptic and that my job as editor is to find writers who are experts on a subject, which was, in fact, the case with this issue when our Senior Editor Frank Miele interviewed the University of California at Santa Barbara Islamic scholar R. Stephen Humphreys. Nonetheless, Shaikhin continued to act surprised, repeating “you mean to tell me that you edited a special issue of Skeptic on Islam and haven’t read the Quran?” I again explained that editors of magazines are not always (or ever) the world’s leading expert on the topics they publish, which is the very reason for contracting with experts to write the articles for magazines.

With this first part of the interview completed, Edip Yuksel leaped up out of his chair like a WWF wrestler charging into the ring for his big match. He grabbed a chair and pulled it over next to mine, asked for a bottle of water for the match, and instructed the videographer to widen the shot to include him in the interview. Only it wasn’t an interview. It was a monologue, with Yuksel launching into a mini-history of how he wrote Carl Sagan back in 1992 about the number 19 (he didn’t say if Sagan ever wrote back), how Carl had written about the deep significance of the number π (pi) in his science fiction novel Contact, how he is a philosopher and a college professor who teaches his students how to think critically, and that he is a great admirer of my work. However (you knew this was coming, right?), there is one thing we should not be skeptical about, and that is the remarkable properties of the number 19 and the Quran.

At this point I had a vague flashback memory of the Million Man March in Washington, D.C. and Louis Farrakhan’s musings about the magical properties of the number 19. The transcript from that speech confirmed my memory. Here are a few of the numerological observations by Farrakhan that day in October, 1995:

There, in the middle of this mall is the Washington Monument, 555 feet high. But if we put a one in front of that 555 feet, we get 1555, the year that our first fathers landed on the shores of Jamestown, Virginia as slaves.

In the background is the Jefferson and Lincoln Memorial, each one of these monuments is 19 feet high.

Abraham Lincoln, the sixteenth president. Thomas Jefferson, the third president, and 16 and three make 19 again. What is so deep about this number 19? Why are we standing on the Capitol steps today? That number 19—when you have a nine you have a womb that is pregnant. And when you have a one standing by the nine, it means that there’s something secret that has to be unfolded.

I want to take one last look at the word atonement.

The first four letters of the word form the foundation; “a-t-o-n” … “a-ton”, “a-ton”. Since this obelisk in front of us is representative of Egypt. In the 18th dynasty, a Pharaoh named Akhenaton, was the first man of this history period to destroy the pantheon of many gods and bring the people to the worship of one god. And that one god was symboled by a sun disk with 19 rays coming out of that sun with hands holding the Egyptian Ankh – the cross of life. A-ton. The name for the one god in ancient Egypt. A-ton, the one god. 19 rays.

This is a splendid example of what I call patternicity: the tendency to find meaningful patterns in both meaningful and meaningless noise. And Edip Yuksel launched into a nonstop example of patternicity when he pulled out his book entitled Nineteen: God’s Signature in Nature and Scripture (2011, Brainbow Press; see also www.19.org) and began to quote from it. To wit…

• The number of Arabic letters in the opening statement of the Quran, BiSMi ALLaĤi AL-RaĤMaNi AL-RaĤYM (1:1) 19
• Every word in Bismillah… is found in the Quran in multiples of 19
• The frequency of the first word, Name (Ism) 19
• The frequency of the second word, God (Allah) 19 x 142
• The frequency of the third word, Gracious (Raĥman) 19 x 3
• The fourth word, Compassionate (Raĥym) 19 x 6
• Out of more than hundred attributes of God, only four has numerical values of multiple of 19
• The number of chapters in the Quran 19 x 6
• Despite its conspicuous absence from Chapter 9, Bismillah occurs twice in Chapter 27, making its frequency in the Quran 19 x 6
• Number of chapters from the missing Ch. 9 to the extra in Ch. 27. 19 x 1
• The total number of all verses in the Quran, including the 112 unnumbered Bismillah 19 x 334
• Frequency of the letter Q in two chapters it initializes 19 x 6
• The number of all different numbers mentioned in the Quran 19 x 2
• The number of all numbers repeated in the Quran 19 x 16
• The sum of all whole numbers mentioned in the Quran 19 x 8534

This goes on and on for 620 pages which, when divided by the number of chapters in the book (31) equals 20, which is one more than 19; since 1 is the cosmic number for unity, the first nonzero natural number, and according to the rock group Three Dog Night the loneliest number, we subtract 1 from 20 to once again see the power of 19. In fact, 19 is a prime number, it is the atomic number for potassium (flip that “p” to the left and you get a 9), in the Baha’i faith there were 19 disciples of Baha’u’llah and their calendar year consists of 19 months of 19 days each (361 days), and it’s the last year you can be a teenager and the last hole in golf that is actually the clubhouse bar. In point of fact we can find meaningful patterns with almost any number:

• 99: names of Allah; atomic number for Einsteinium; Agent 99 on TV series Get Smart
• 40: 40 days and 40 nights of rain; Hebrews lived 40 years in the desert, Muhammad’s age when he received the first revelation from the Archangel Gabriel and the number of days he spent in the desert and days he spent fasting in a cave
• 23: The 23 enigma: the belief that most incidents and events are directly connected to the number 23
• 11: sunspot cycle in years, the number of Jesus’s disciples after Judas defected
• 7: 7 deadly sins and 7 heavenly virtues; Shakespeare’s 7 ages of man, Harry Potter’s most magical number
• 3: number of dimensions; number of sides of a triangle, the 3 of clubs—the forced pick in one of Penn & Teller’s favorite card tricks
• 1: unity; the first non-zero natural number, it’s own factorial and it’s own square; the atomic number of hydrogen; the most abundant element in the universe; Three Dog Night’s song about the loneliest number
• π (pi): a mathematical constant whose value is the ratio of a circle’s circumference to its diameter, or 3.14159…. Make of this what you will, but Carl Sagan did elevate π to significance at the end of Contact:

The universe was made on purpose, the circle said. In whatever galaxy you happen to find yourself, you take the circumference of a circle, divide it by its diameter, measure closely enough, and uncover a miracle—another circle, drawn kilometers downstream of the decimal point. In the fabric of space and in the nature of matter, as in a great work of art, there is, written small, the artist’s signature. Standing over humans, gods, and demons, subsuming Caretakers and Tunnel builders, there is an intelligence that antedates the universe.

At this point in the filming process I interrupted Yuksel and told Shaikhin that the interview was over, that he could use the footage from the first part of the interview but not this monologue mini-lecture that was an undisguised attempt to convince me of the miraculous properties of the number 19. I didn’t sign any waiver or permission to use any of the footage shot that day, but just in case I was relieved when the videographer came to me in private to apologize and explain that she had nothing to do with the rest of the crew, that she was just hired to do the filming, and that after I had put an end to the interview she stopped filming.

At some point I asked Edip why he felt so compelled to convince me of the meaningfulness of the number 19 in the Quran, when I told him that I haven’t read the Quran and hold that all such numerological searches are nothing more than patternicity. The impression I got was that if he could convince a professional skeptic then there must be something to the claim. I asked him what other Islamic scholars who have read the Quran think of his claims for the number 19, and he told me that they consider him a heretic. He said it as a point of pride, as if to say “the fact that the experts denounce me means that I must be on to something.”

P.S. Edip Yuksel did strike me as a likable enough fellow who seemed genuinely passionate about his beliefs, but there was something a bit off about him that I couldn’t quite place until I was escorting him out of the office and he said, “I see you are a very athletic fellow. Can I show you something that I learned in a Turkish prison?” With scenes from Midnight Express flashing through my mind, I muttered “Uhhhhhh… No.”

Patternicity Challenge to Readers

As a test—of sorts—I would like to hereby issue a challenge to all readers to employ their own patternicity skills at finding meaningful patterns in both meaningful and meaningless noise with such numbers and numerical relationships, both serious and lighthearted, related to the number 19 or any other number that strikes your fancy. Post them here and we shall publish them in a later feature-length article I shall write on this topic.

On June 9, 2011, the Center for Inquiry (New York City) and NYC Skeptics hosted noted skeptic and bestselling author Michael Shermer for a talk about his new book, The Believing Brain: From Ghosts and Gods to Politics and Conspiracies—How We Construct Beliefs and Reinforce Them as Truths. The event was held at the Auditorium on Broadway. Full lecture, followed by Q&A.