ProPublica, This American Life and acetaminophen: $750,000 to state the obvious

ProPublica and This American Life, both which I love, are making some waves for a story highlighting the risks of taking too much acetaminophen (known as paracetamol in the UK). They found that “taken over several days, as little as 25 percent above the maximum dosage – or just two additional extra strength pills a day – has been reported to cause liver damage”.

In a more than 10,000 word piece, they say that over the past decade 1,500 people have died from accidental overdoses of the drug in the US. The story is very critical of “McNeil Consumer Healthcare, the unit of Johnson & Johnson that has built Tylenol [the brand name of the drug in the US] into a billion-dollar brand and the leader in acetaminophen sales”. The story claims that:

McNeil opposed even a modest government campaign to educate the public about acetaminophen’s risks, in part because it would harm Tylenol sales.

They also criticise the FDA, the US drugs regulator for not taking tougher action, but the agency said:

FDA officials said the agency saw the benefits of keeping acetaminophen widely available as outweighing the “relatively rare” risk of liver damage or death. Some patients cannot tolerate drugs such as ibuprofen, and for them acetaminophen may be the best option, said one agency official.

I do appreciate that the story gave a bit of context in quoting the figures for accidental deaths of ibuprofen, another non-prescription pain killer. The article says deaths due to ibuprofen overdose are negligible.

Massive coverup? Hardly

But is the fact that acetaminophen can cause liver damage being hidden by an avaricious company with complete disregard for public safety or by an over-stretched US drugs regulator? Hardly. Google “acetaminophen risk”. The first result in the US is WebMD. See risks:

When taken incorrectly, however, acetaminophen can cause liver damage. And your risk of liver damage may be increased if you drink more than three alcoholic drinks every day, take more than the recommended dose (overdose), or if you take any additional drugs that also contain acetaminophen at the same time.

Read a little further along under the next subhead, How to Use Acetaminophen Safely.

Make sure to use the correct dosage. Don’t take more acetaminophen than directed or take it more often than directed. Taking more than recommended can damage your liver — and won’t provide any more pain relief.

We’ve got a couple of bottles of acetaminophen that we have bought in the US. One bottle from US pharmacy Walgreens says, “See New Warnings Information”. It has a specific liver damage warning. It has in bold: “Overdose warning: Taking more than the recommended dose (overdose) may cause liver damage.” Both bottles warn not to take with other drugs that contain acetaminophen or if you drink three or more alcoholic drinks per day.

Ok, I thought. Maybe McNeil is trying to protect their brand, Tylenol, as the story says over and over again. I went to the Tylenol site, the official site for McNeil’s acetaminophen brand, and at the bottom of the page, granted not prominently displayed but there, is a link called: Tylenol labeling change.

New Dosing Instructions: Beginning Fall 2011
Acetaminophen, the active ingredient in TYLENOL®, can be found in more than 600 over-the-counter (OTC) and prescription medications, such as TYLENOL®, SUDAFED® Triple Action™, NyQuil®, Percocet® and Vicodin®.* Acetaminophen is safe when used as directed, but when too much is taken (overdose), it can cause liver damage. Some people accidentally exceed the recommended dose when taking multiple products at the same time, often without realizing they contain acetaminophen or by not reading and following the dosing instructions.

To help encourage appropriate acetaminophen use, the makers of Extra Strength TYLENOL® have implemented new dosing instructions lowering the maximum daily dose for single-ingredient Extra Strength TYLENOL® (acetaminophen) products sold in the U.S. from 8 pills per day (4,000 mg) to 6 pills per day (3,000 mg). The dosing interval has also changed from 2 pills every 4 – 6 hours to 2 pills every 6 hours.

Emphasis mine. Was McNeil against educating the public because they worried about damaging sales of their flagship brand? It would seem not.

Education Campaign: Get Relief Responsibly™
In addition to the new dosing instructions on the OTC label, the makers of TYLENOL® launched Get Relief Responsibly™, an initiative designed to educate consumers about the appropriate use of OTC and prescription medications, particularly those containing acetaminophen, and the importance of reading and following medication labels. As a part of this initiative, the makers of TYLENOL® have created a new website www.getreliefresponsibly.com. The site includes an interactive Acetaminophen Finder tool to help consumers identify products that contain acetaminophen and build a personal acetaminophen medication list to share with their healthcare provider or pharmacist.

I don’t know how prominent the campaign was, as I live in the UK. And I thought that maybe they launched this quietly in response to the ProPublica investigation. Nope, the date on the page is autumn 2011. This would be consistent with the “See New Warnings Information” label on our bottle of Walgreen’s Pain Reliever PM. It undermines all the assertions in the investigation that McNeil has resisted efforts to reduce dosages or engage in public education.

Stating the obvious in thousands of words

These are facts hidden in plain view: Don’t take too much acetaminophen, especially with alcohol. Taking more than recommended won’t do you any good, and it could wreck your liver. As a matter of fact, we’re going to recommend taking less of our flagship product.

It took me 30 seconds to find the relevant info on WebMD, and another 30 seconds to quickly scan the Tylenol site. How long did it take ProPublica and This American Life? TWO YEARS AND $750,000. 

As an editor, I keep saying to myself: Where’s the story here? The headline, anodyne even by American standards, is “Use Only as Directed”. My response: No shit. I mean, really? If you use a drug above the recommended dosage, there is a risk. If McNeil has ruthlessly tried to cover up the idea that if you take too much of the drug it will wreck your liver, they’re doing a really poor job.

Labelling on US acetaminophen bottles undermine repeated assertions in the investigation that the FDA has resisted calls for clearly labelling about overdose risks, especially with respect to liver damage. It is clearly listed under Warnings, in bold, on both bottles of acetaminophen we have.

Where is the breaking news? Has the FDA covered up the fact that if you take too much of the drug you can die? No, it hasn’t. Easily available information, both online and on the packaging, is clear about the risks of taking an overdose. But the key thing is that if you take too much of anything, even water, it can kill you. In technical terms it’s called LD50, the median lethal dose.

Whist Pro Publica’s piece does remind the reader to be more careful about taking other medications that might have acetaminophen and to more carefully monitor dosage, it isn’t revealing any new information, nor is it exposing a cover-up.

The story includes a clock, counting how long it has been since the FDA created an expert panel to evaluate the safety of over-the-counter pain relievers. The agency has not yet completed its work. This is about as damning as the revelations gets:

From 2001 to 2010, annual acetaminophen-related deaths amounted to about twice the number attributed to all other over-the-counter pain relievers combined, according to the poison control data.

In 2010, only 15 deaths were reported for the entire class of pain relievers, both prescription and over-the-counter, that includes ibuprofen, data from the CDC shows.

If acetaminophen, at roughly 150 deaths per year, is twice the number of all other over-the-counter and prescription pain relievers combined, then doesn’t this undermine the entire assertion that the there is a pressing need for the FDA to have this expert panel deliver its findings? It doesn’t seem that pain killers as a class of drug are particularly dangerous at all.

Back to acetaminophen, in 2010, the last year the article has figures for fatal accidental acetaminophen poisoning, 166 Americans died. The CDC reported that 2,468,435 Americans died that year. The number who died from acetaminophen poisoning is 0.007 percent of total deaths in the entire country. Tragic? Yes. Common? Hardly. Ibruprofen deaths are negligible, especially compared with the 32,788 Americans who died in road traffic accidents. Journalists are incredibly poor at communicating relative risk, and this over-the-top investigation only serves to reinforce that. What pressing public health crisis has been identified at a cost of $750,000?

I don’t mean to dismiss the suffering of the nearly 150 people who died or of their friends and loved ones, and I think that this story is worth reporting, but in the right terms. For stories like this, I can even see the need to remind people every few years, just to drive home the point that taking too much acetaminophen is risky, especially if you drink a lot. However, I don’t think this story comes even close to rising to the standard of a two-year investigation costing hundreds of thousands of dollars.

Opportunity costs

Peter Osnos at The Atlantic praises the story and asks who will pay for expensive, investigative coverage. The piece seems to be equating the cost with impact. To me, as I said in a comment on the piece, this is not a piece for which we should be getting out our “yay investigative journalism” pom-poms. It proves that investigative journalism can be expensive, yes, but is it going to have an impact? This story will have no more impact than a run-of-the-mill public service piece that could have been bashed out in an afternoon.

Not all investigations lead to publication, and I know that some investigations take time to develop, but I cannot see why this story took two years and three-quarters of a million dollars to reveal information that can be found with a quick search online. As a journalist and editor, I have to ask what is the opportunity cost? The opportunity cost is:

The cost of an alternative that must be forgone in order to pursue a certain action. Put another way, the benefits you could have received by taking an alternative action.

In this era of scarce resources, it is even more important to ask what opportunities are foregone because resources are deploying elsewhere. It’s Econ 101, but it is an incredibly important question that we need to ask. Two years and three-quarters of a million dollars is a huge investment. It’s the kind of resource that most journalists would give their spare kidney for, but if we’re going to sink that kind of time and precious coin into a story, that story better be worth it.

When I started this post, I thought this was simply about an overly expensive investigation. It took me almost no time at all to undermine the core elements of this story with basic online research. McNeil, if they trying to bully the FDA into inaction, appear to have failed. If a minimal bit of online research calls into question key elements of this story, there are even bigger problems than the excessive cost and time.

UPDATE: I did originally post this under the headline “30 seconds to debunk”, which in retrospect is a bit harsh. ProPublica has meticulously documented their points to the point where I think they completely diluted the impact of the piece. If as a journalist, you want to draw attention to the dangers of the drug, the piece should have been much, much shorter, highlighted the low margin for error in taking more than the recommended dose, especially with alcohol and been done with it. The story has problems, and one of the biggest is that it is incredibly self-indulgent. It fails the most basic commandment of a good piece of journalism: Get to the point.

UPDATE 2: To clarify, the $750,000 is only the amount that ProPublica spent. I was just listening through the The American Life (TAL) report thoroughly, and ProPublica and TAL found that 86 percent of Americans know that acetaminophen can cause severe liver damage and two-thirds know that it can kill you. Yet, Ira Glass said that although many of his listeners already knew this, they were still going to spend an hour on the story.

How to spot a web hoax

Every journalist learns (or should learn) how to evaluate sources and, as the web increasingly becomes a source for stories, we need to know whether the things that we stumble across there would make a good source. The internet has been an important part of my job as a journalist almost since I took my first full-time journalism job in 1994. Internet journalists have their own investigative skills, skills that will have to become more widespread as the internet becomes part of every journalist’s job.

I mention this in the wake of a hoax last week by Alex Hilton, aka the British political blogger Recess Monkey. For background, I’ll refer to the Guardian, my day job:

Been following the ding-dong over Tory MP Chris Grayling comparing parts of “Broken Britain” to Baltimore, the crime-ridden city shown in The Wire? What about the riposte from Baltimore mayor Sheila Dixon, who has hit back stating that comparing The Wire to the real Baltimore was “as pointless as boasting that Baltimore has a per capita homicide rate a fraction of that in the popular UK television show Midsomer Murders.” If only.

The British press, and to be fair the hometown Baltimore Sun, reported that the mayor of Baltimore rose to the defence of her fair city. The only problem is that she didn’t. The Guardian was one of the British newspapers that fell for the hoax.

I have to take my hat off to Alex. I’ve never had the pleasure of meeting him, but the hoax was very well executed. Alex created a Twitter account to promote the site. He created a YouTube channel and a video.

To create the site, he simply copied the underlying code from a web page from the official Mayor of Baltimore’s site and changed some of the content. This retained all of the links to the official site and the images were simply pulled from the official server. It’s an immaculate hack. He didn’t have to break into anyone’s server, just copy a web page and add his own content.

It’s a similar trick to phishing scams. It looks like Amazon.com or your bank, but you’ve actually just been sent to some mobsters’ site in Russia or a naked IP address. (I don’t mean to disparage the good people of Russia, but a helluva lot of phishing scams are .ru.) You have to be pay attention to the web address to notice that you’ve suddenly been teleported somewhere else on the web.

Alex explains his motivations and the clues that he left to tip anyone off that it was a joke:

So what else did I do to make sure this wasn’t seen as the true views of the Mayor of Baltimore or an attempt to deceive anyone or to smear Chris Grayling? I registered the mayorofbaltimore.org domain in my own name. I squirrelled in the English spelling of “dishonoured” as a clue. I put at the bottom of the page, “Copyright R Monkee Esq” and linked it to my currently decrepit Recess Monkey website. I put the following message on Recess Monkey for anyone who cared to follow the link:

Sorry, RecessMonkey is on holiday in Maryland. Right mouse button click view source (but not on this website) R Monkee Esq.

If you had looked at the source on the site, you would have found this:

OK, so I’m just having a bit of fun at Chris Grayling’s expense. Sitting in the office on a hot August afternoon, I was fantasising that I was Mayor of Baltimore and how annoyed I would be. I hope you very quickly picked up that this was a spoof. Didn’t mean to break any laws or ethical mores – please don’t extradite me if I have unwittingly done so. Hope you appreciate the humour, Alex Hilton, alexhilton@gmail.com – 07985 384 859

Alex expected journalists to spot the humour and the hoax, but it was reported as fact. He rang the Guardian switchboard and was put through to me. He was trying to ratchet down the media furore. The Guardian media desk wrote a brief story about the hoax, and I alerted the news desk so the correction process could begin.

So, what gives a hoax like this away? Here’s your three point guide to spotting when someone’s pulling your leg.

  1. Pay attention to the URL
    When a colleague sent me the website address, I spotted the hoax immediately. I didn’t even need to see the site to know it was a fake. How? The URL was mayorofbaltimore.org, not .gov or .md.us. In a UK context, that’s similar to a fake Downing Street site with the address www.number10.org.uk instead of www.number10.gov.uk. Org addresses are for non-profits not for governmental websites.
  2. Who owns the site?
    Finding out who owns a site is easy. Do a WHOIS lookup, and you’ll find out not only who owns the site, but sometimes even their contact details. Most of the time this is corporate information that won’t give you a person to ring, but as Alex says, he registered the site in his own name.
  3. Hover over the links
    Why? If you hover over the links, you would have seen they went to a different address, not mayorofbaltimore.org. It could save you from a phishing scam and it could have prevented journalists from falling for this hoax.
  4. Be wary of a Twitter account with only one update
    Alex created a fake Twitter account, and the only update linked to his fake press release. That’s a big warning sign to me.

Alex also hid a huge clue in the source code, including his mobile phone number and his e-mail address. To see the underlying code of a web page in Firefox, go to the View menu and scroll down to Source. For Internet Explorer, go to Page on the menu bar and scroll down to Page Source. UPDATE: A commenter on Twitter admitted she probably wouldn’t have thought to look at the source code of the page. I looked at the code because I wanted to see how Alex had cloned the page. When things look fishy, the code can reveal a lot. Alex also made it clear on Recess Monkey that there was an Easter Egg hidden there as well.

Much of what I have described were once specialist skills that only web geeks needed to know, but as the web becomes more of every journalists’ job, having these relatively simple skills might be the thing that prevents you from falling for the next hoax. These are not technical skills anymore. They are skills you need to evaluate a source on the web, conduct an investigation and protect your credibility as a journalist.