How’d we do? 2010 edition

November 5, 2010 by Sam Wang

The near-final outcome of the 2010 elections is Senate 53D, House ~243R. What an event – the largest Republican majority in six decades. Yet a clear majority for Democrats in the Senate. This should be an interesting two years.

So how’d we do? As I wrote before, Senate poll medians did well, with Nevada as one glaring exception, leading to a 1-seat deviation from the 95% CI. There’s been talk about Hispanic voter turnout in Nevada, but I believe that’s not supported by exit polling data. It’s more likely that undecideds simply made a last-minute decision to stay with Reid.

In the House, we were off by about 13 seats, much more than the nominal error, +/-2 seats. Therefore there’s a systematic error. One possibility is bad time sampling – at the district level, polls are more spaced in time. However, we did just about as well as the famous guy, Nate Silver. In my case the tools were the Pollster database and a sheet of paper. By including national polls one could do better, not to mention other sources. Using these, a better topline (total # of seats) estimate than either of us came from Stochastic Democracy.

If you like district-level predictions, go read Stochastic Democracy. David Shor’s model that is theoretically fairly solidly based, enough to give true probabilities (for instance, House takeover 98%). His r^2 value for exact district-level vote share was much better than FiveThirtyEight. He needs to write all that up!

I have more to say about the subject of “snapshots,” “forecasts,” how they’re fundamentally the same thing, and what they’re good for. I have had interesting conversations with David (who is visiting Princeton this year) as well as correspondence with Andrew Gelman and Nate Silver. I am digesting it all, and will comment in a few days.

Topics:

7 Comments

Boris Shor says:

The problem with Shor’s website — funny to write this as I’m also a Shor — is that it is very user unfriendly, and therefore was difficult to get race-by-race predictions. So his good results get obscured by technology. I realize he’s just an academic, but there should be better tools out there for us to use to transmit our findings.

Arvid says:

Now that we’re in the swing of elections again it would be nice to see some more posts on this blog, perhaps along with some more recommendations for close races as we get closer to November.

D. Lyons says:

Is there a chart that shows which races you think are in play? I want to donate to those senate candidates.
Thanks

Sam Wang says:

Right column, Power Of Your Vote. Then over to the ActBlue or NRSC at left, depending on your party.

rosh hashanah says:

Is there a chart that shows which races you think are in play? I want to donate to those senate candidates.
Thanks

Sam Wang says:

At the left, see the ActBlue page (for Democrats) and the NRSC (for Republicans).

Tuesday Reads: Who Will Win Control of the U.S. Senate? | Sky Dancing says:

[…] has consistently matched or outperformed his own calls since he came onto the scene (see 2008, 2010, and […]

Leave a Reply

Your email address will not be published. Required fields are marked *