polls

Projection: SNP Majority of 13, surprise gains for Lib Dems and UKIP

feb 16 survation

SNP: 71
Labour: 24
Conservative: 16
Lib Dem: 7
Green: 7
UKIP: 4

Survation 16 February 2016

NB: if tables and charts don’t show, refresh page.

From now until the Scottish Parliament election in May, this blog will feature analysis of opinion polls and projections as to the result. These projections, I believe, are the most sophisticated presently in public circulation (see below for an explanation as to why).

The headline figures have been widely publicised and contain few surprises, save for the strong performance by UKIP in the regional vote share. The SNP leads Labour by 53% to 22% in constituency voting intention. The regional list voting intention see the SNP on 45%, Labour on 18%, the Conservatives on 15%, the Greens on 9%, with the Lib Dems and UKIP on 6% each.

However, some of the most surprising data is in the regional subsets. The Liberal Democrats show signs of recovery in key regions – Highlands and Islands, Lothians, and South of Scotland – formerly strong areas for the party. Perhaps unsurprisingly the Greens show their greatest growth in the Lothians (which once returned two Green MSPs), but the party also sees significant growth in Central Scotland (a seat in which eluded the Greens even at their 2003 high water mark). The Conservatives show modest growth, possibly suffering somewhat from the surprisingly strong numbers for UKIP in regions where the Tories would expect to poll more strongly.

The SNP’s seemingly interminable advance in the polls appears to have been halted in the South of Scotland, with Survation showing a decline in both parties’ shares, but no swing whatsoever from the SNP to Labour. Surprisingly, the Tories also show a sizeable drop in support in South of Scotland, possibly explained by the strong showing by UKIP in the Survation poll.

Projected into seats, it comes as little surprise that this represents a near clean-sweep for the SNP. Elaine Murray narrowly retains Dumfriesshire for Labour, and would be Labour’s sole constituency representative in May. On the basis of this poll, Labour isn’t even within 10% of the SNP in any other seat. The Conservatives, by contrast, win three constituencies, though not the three that they won in 2011. On the basis of the Survation data, the Tories lose both Ayr and Galloway and West Dumfries, but gain Eastwood and Edinburgh Pentlands. It’s worth noting that Eastwood will almost certainly be a three-way dogfight, and the Conservative candidate in Pentlands will not be the late and widely-liked David McLetchie. Liam McArthur loses Orkney to the SNP, but the Lib Dems are compensated with a seat on the Highlands and Islands list, meaning a return for erstwhile retired MSP Jamie Stone.

Overall regionally, Labour goes from seven to four in Glasgow and West of Scotland, and six to four in Central Scotland. Labour loses a further two seats in Mid Scotland and Fife, and one each in Highlands and Islands, Lothians, and North East Scotland. The Greens repeat their 2003 feat of two seats in Lothians, and a seat each in a further five regions. UKIP wins seats in four regions, including sneaking the last seat in Glasgow. If David Coburn is looking for the best place to run for the Scottish Parliament, at the moment that looks like either the Highlands and Islands or Mid Scotland and Fife.

A note on methodology

Over the past few months I have developed a complex system for translating opinion polls into seat projections. A system which, I believe, is far more accurate than the existing publicly available seat-forecasters. This is largely because my system uses the data subsets from opinion polls to forecast every seat, both constituency and regional, individually. This is, I believe, a far superior method for a number of reasons.

First, we can see in the polls and recent elections that the most stark shifts in voting intention have been in Central Scotland and Glasgow.  In the above Survation poll the regional list swing from Labour to the SNP is in the order of 10%. By contrast, the regional list swing in the Lothians is 2%, and in South of Scotland is zero. Psephologists will always point out the hazards in placing too much faith in uniform national swings, but the variations this time are so stark as to render national figures alone far more questionable than in previous elections. On this basis, using the constituency voting intention regional data subsets provides a better picture than a uniform national swing.

Second, national figures severely distort projections with respect to smaller parties. 4% of the vote spread evenly across the eight regions will see a party return no MSPs whatsoever. However, 6% of the vote in half of the regions would see a party return four MSPs.

Third, the most crucial seat in every region, and also the most difficult to forecast, is the last one. In 2011, the SNP succeeded in poaching the final seat in five of the eight regions, in most cases by slim margins. Had four of those five seats gone the other way the SNP would have never won a parliamentary majority. By the time the final seat in a region has been allocated, the main parties’ votes could well have been divided by denominators as large as 11, presenting a uniquely welcoming environment for minor parties to secure a seat. While projecting those eight last seats is extremely difficult, the only way to do so with even a modicum of accuracy is to compute each region individually, rather than on a national basis.

I do not pretend that for a minute that the projections I will be sharing are a perfectly accurate forecast. In some instances, the polling subsets for particular regions (such as the Highlands and Islands) are so small that the likelihood of error is significant. This is a flaw in the underlying polling, and not the system I use for projecting seats. Furthermore, though regional variations are easy to detect and project, the polling data suggest that similarly stark variations exist amongst socio-economic groupings. While it would be possible to project socio-economic variations out of the polls onto individual seats, I am possessed of neither the raw data (broken down by constituency and region), nor the time, to make such projections. From this blog, regional variations are, for the time being, as good as it gets.

In defence of polling and why Labour really is doing terribly

chris leslie cat smith

Critic: “Labour’s doing terribly in the polls, isn’t it?”

Corbynista: “Look how badly wrong the polls got the last election – you can’t rely on polls.”

This is the stock reply of the loyal Jeremy Corbyn follower whenever someone points out that Labour is doing abysmally in the polls. This week’s Daily Politics saw one of Jeremy Corbyn’s biggest critics – Chris Leslie – square off with one of Corbyn’s true believers – Cat Smith – who used the exact defence above.

The fact that polling companies did not accurately predict the outcome of the 2015 election is now being used by Corbynistas to justify burying their heads in the sand. It’s true that polling companies weren’t entirely accurate – they never are. They are, however, a good deal better than political instinct, “what I’m hearing on the doorstep”, or “a feeling in my water”. Polls may not be perfect, but they’re not nothing – and they’re better than any other measure of political success, save for actual votes.

Polls can usually identify when one party has a commanding lead over another. Labour’s political dominance in the years following the 1992 election therefore made predicting the winner of an election a fairly easy exercise. In the run up to 2015 the narrative that the two main parties were neck-and-neck was borne out by the polls – with the polling average for both parties from the start of April through to election day being exactly the same: 33.6%. As it transpired, the polls were doing what they almost always do and overstating Labour and understating the Conservatives.

So the Corbyistas are right – the polls are probably wrong. The trouble for Labour is that the polls are very seldom wrong against Labour. Since 1959, Labour has only ever been understated in election polls twice: in February 1974 by 0.7%; and in 2010 by 1.6% (which could, in part, be explained by the ‘Cleggmania’ phenomenon).

elections polls

From 1992-2010, the average error (that is to say, the average difference between Labour and the Conservatives election-polling average and the actual result) is 2.6%. In 2015, that error was 3.3% – above average, but still lower than the 3.6% error in 2001 or the 4.7% error in 1992. Excluding the 2010 election, the average error is 3.1% ­– which places the 2015 polls well within the range of normal. In the past six general elections, election polls have, on average, understated the Conservatives by 2.1% and overstated Labour by 3.1%. The standard deviation in both the Conservative and Labour figures (the error in the error, if you like) is 1.8% and 2.7% respectively – which is quite low. In other words, though the polls are usually wrong, they’re usually quite consistently wrong. Save for 2010 – where the polls understated Labour by 1.6% ­– the polls in the run up to all other elections polls have overstated Labour by at least 2%.

So Cat Smith is right – the polls probably are wrong. But what she and the Corbynistas seem to forget is that they’re far more likely to be overstating Labour than understating. Labour’s 7.5% polling deficit in the polls probably isn’t right – but the true deficit is a lot more likely to be 12.5% than 2.5%.