Thursday 16 January 2014

Health statistics - can they be bad for your health ?

How health statistics can misinform - 

We hear of and we see many headlines concerning health issues, and most of them are both bad news and very dramatic. 
They can be very misleading and they can exaggerate what they intend to show. The methods of exaggeration always involve the use of percentages, rather than what  are usually called raw data, ordinary numbers.


Example 1:

About 800,000 people die each year in the UK.


Let us suppose that 8 of  these people die by being stung by a bee or a wasp. This would be an annual death rate of 1 in 100,000.

Let us suppose that in the following year 16 people die from the same cause. This is a death rate of 2 in 100,000.

How is it best to describe this increase in death rate?

First and most simple, there is an increase of 8 per year in the UK. 

But we need to generalise to allow comparisons between other countries, comparisons within different parts of the UK, and comparisons with other years.

And so we describe the increase as 1 in 100,000 per year, from 1 to 2  per 100,000 in this example. We can also express it as an absolute increase of 0.001% of population.

These expressions of increase would not create headlines or induce panic among the population. In order to achieve this, the increase must be presented in a much more dramatic way.

Increasing 8 to 16, or even from 1 to 2 is doubling. This sounds good, quite impressive.

“Twice as many people died from bee and wasp stings this year compared to last year”. Now we are moving into headline news. It is starting to sound dangerous.

But is it twice a big number or twice a little number? This is important in translating risk or benefit to an individual or to a community. Twice something small, like a cent or a penny, is not worth worrying about. Twice something big like £100 or $100 is worth attention!

When a number doubles, the change can be expressed as a 100% increase. 100% of one is one, added to one gives two, a 100% increase.

Once again the question must be asked (but rarely is), 100% of what? Something big or some things small?

In this example what do you think is the most useful and meaningful way of presenting the increase:
100% increase or 0.001% increase (1 in 100,000)?
You would probably agree with me that the latter expression is most useful, giving a reasonable assessment of risk.

Example 2:

We are informed that if you are admitted to a UK hospital on a Saturday or Sunday, you will have a 16% increased risk of death during the following 30 days compared to if you had been admitted on a week-day.

Dramatic and worrying. Big headlines in the national press. Questions in Parliament. “Something must be done!” “Consultants must spend more time in the hospitals at the weekends.” 

Olfactarithmetic (recent New Scientist) - does the data “smell” right, or does it smell fishy? Is it really true (as the politicians and newspaper immediately assumed) that for 100 deaths following hospital admission on Monday to Friday, there are 116 deaths for those admitted on Saturdays and Sundays?

It is indeed dramatic but it smells fishy. There appears to be a major mortality effect and it should be obvious. The important but missing information is: how many deaths are we talking about? What are the numbers?

The study that led to this identification of 16% was based on approximately 14,217,640 (14.2 million) people admitted to hospital in the UK between April 1st 2009 and March 31st 2010. By 30 days after hospital admission there had been 187,337 in-patient deaths. The proportion dying in hospital was therefore:

187,337 / 14,217,640   =  1 /  75.9  =  0.013   =  1.3%

Now we can apply the 16% because now we know the answer to “16% of what?” :  it is 1.3%.

16% of 1.3 = 0.21

So in reality the chance of dying in hospital within 30 days of admission is only 0.21% greater if admitted at a weekend compared to a weekday.

The study also reports on 30-day mortality whether dying in hospital or following discharge home. There is now a total of 284,852 deaths. 

284,852 / 14,217,640   =  1 /  49.9 =  0.02   =  2% deaths of those admitted.

An excess of deaths for those admitted at the weekend would be 16% higher, which means 0.32% greater than weekday admissions.

Another way of looking at this, is that a weekday admission gives a 98% chance of survival 30 days, compared to 97.68% following a weekend admission. Not a significant difference.

This clearly not going to make newspaper headlines or lead to a parliamentary debate.

But what is the best way of expressing this increased risk? Is it 16% increase or is it 0.32% increase? I suggest the latter, but I have no interest in headlines. The absolute increase, 0.32% is most realistic and it conveys the most useful message to the public.

(I thank Dr Steve McCabe from Portree, Skye, for drawing my attention to this) 

Data source:
Journal of the Royal Society of Medicine. 2012 February; 105: 74–84.
Weekend hospitalization and additional risk of death: An analysis of inpatient data.
N Freemantle, et al.


What is the benefit of statins?

We have seen this in an earlier post but it is another example of how statistics can, in this case, exaggerate benefit.

A clinical trial of statin therapy was conducted in the West of Scotland and published in 1994 (is was called WOSCOPS). It studied men aged between 55 and 65, with high cholesterol levels. They had the world’s highest incidence of death from coronary heart disease (CHD, heart attack). Half were given a statin every day for 5 years and the other half acted as controls, being given a dummy placebo tablet.

The five-year death rate in the controls (untreated) was 4.2%, and in the controls it was 3.1%.
This looks like a death rate reduction of 1.1%  (ie 4.2-3.1)
This looks rather undramatic, but it means that 100 at-risk men must take a statin tablet every day for 5 years to prevent (delay) one death. Not very good.

How can we amplify the effect and make it look better?

1.1 is approximately one quarter of 4.1, in other words 25%.

So the advertising of statins tells us that they reduce death rate from CHD by 25%.

This is much more impressive and leads to big sales. But it still means that 100 high-risk men must take a statin for 5 years to delay one death.

There remains the question: 25% of what?

It was more than 20 years ago that the study was performed. Since then the death rate from coronary heart disease has gone down by a factor of 40, from 800 to 20 per 100,000 per year. Therefore it will now require 4000 men (40 x 100) to take a statin for five years to delay one death. This is however kept quiet, the information has been hidden. 

We are still told of the 25% reduction of deaths, but not that it is now 25% of something only one fortieth of what it was 20 years ago. Is it worthwhile?

Beware statistics when expressed as percentages. 
Remember to use olfactorarithmetic - does it smell right?



Saturday 4 January 2014

Is this the beginning of the end of the Cholesterol story?

Everyone knows about cholesterol. Everyone “knows” that it is the cause of heart attacks - because that is what they have been told. Everyone knows that cholesterol comes from fatty food. Everyone knows that fat and cholesterol containing foods must be avoided, the ones that taste so good - why is it that the television cookery programmes are all about cream, eggs and butter?

Everyone knows that we should have our blood cholesterol levels measured, and we expect that if it is “high” then we should take statin tablets to lower it. What we do not know is that “high” means total cholesterol greater than 5.2 mmol/L (200mg/100ml), and that this includes about 85% of the adult population. 

25% of the over 70s in the West Midlands of the UK take statins and 10% of those below the age of 50. It is also suggested “Statins for all by the age of 50” This is all based on the cholesterol-heart story, that cholesterol in the blood causes the arteries to become “furred-up”, thus becoming blocked and precipitating heat attacks, a serious and incorrect oversimplification.

In recent years we have been in the era of “routine” cholesterol measurements, performed on people who are under the impression that they are normal but who turn out to have a condition called “high cholesterol”  (hypercholesterolaemia is the medical term). They are given long-term statin medication and this is the basis of primary prevention of deaths from coronary heart disease.

Change in the USA

But things have suddenly changed, surprisingly in the USA where cholesterol sceptics have not been very obvious and where the diet-cholesterol-heart hypothesis has been most strong.

The new US “Guideline on the Treatment of Blood Cholesterol to Reduce Atherosclerotic Cardiovascular Risk in Adults” moves away from blood cholesterol concentrations as the basis for prevention! This is a dramatic change and a departure from the first guideline published in 1988, which introduced the 200mg/100ml (5.2mmol/L) threshold, now refined as LDL-cholesterol greater than 190mg/100ml (5mmol/L).

It was obvious from the early clinical trials that the benefit of statins was small but definite. One out of every hundred high risk men treated for five years with a statin each day would have his life prolonged for an uncertain time. But several trials have shown that benefit from statins is not related to either the initial blood level of cholesterol or the degree by which cholesterol is lowered. 

The point is that the benefit of statins appears to be independent of the cholesterol-lowering property, probably an anti-inflammatory action. Statin effect extends well beyond reducing risk of death from heart attack (myocardial infarction, MI), with some anti-cancer properties. 

These clear points  have been avoided in the past years, effectively suppressed by the evangelists of the diet-cholesterol-heart hypothesis, many of whom had considerable vested interests. It looks as though the gravy train is slowing down.

The American College of Cardiology and the American Heart Association are behind this move away from cholesterol, suggesting that prevention of coronary deaths should now be targeted at those at particularly high risk and not at blood levels of cholesterol.

This is a courageous move away from the flawed dogma of the past half-century. It effectively means the beginning of the end of the cholesterol-heart hypothesis. The diet component had been quietly dropped a few years ago: diet is not the cause of heart disease.

And now it is starting to be acknowledged, neither is cholesterol. It is time for medical science to consider what might be the real cause of the epidemic of coronary heart disease.

Cholesterol is involved in the development of coronary heart disease but it is nothing to do with cholesterol in the blood. Cholesterol (as LDL) is part of the tissue inflammatory defensive process and it is in this way that it builds up in the walls of the arteries, probably a response to infection.

Change in the UK ?

How long this change in coronary prevention away from blood cholesterol will take to cross the Atlantic to the UK and Europe remains to be seen.

We know that at the present time the death rate from coronary heart disease has dropped dramatically, the epidemic being almost over about 90 years since it started. The reduction of deaths in the UK has been so great that it will be difficult to identify high risk individuals in the future. The prevention of one coronary death by statins has become very expensive.

It is however a great sense of relief to read of the US change and the dropping of cholesterol screening of the general population. Hopefully things will change soon on the UK, but there will be considerable resistance from the pharmaceutical industry, and those individuals and departments who benefit. 

The wind of change approaches.


http://www.bmj.com/content/347/bmj.f7110