Now he's going into conference with the news not just of Mark Reckless MP's defection to UKIP but the resignation of the Conservative Minister for Civil Society, Brooks Newmark MP, who has been caught sending explicit photos of himself to women on the internet.
Let's spare a thought for poor Dave having to tell the party faithful tomorrow that they've lost another MP to UKIP and a Minister has had to resign because of a sex scandal. It's not easy being the most unpopular Conservative Party leader since Margaret Thatcher.