Might be bigger pain than looks at first
On my work machine I regularly trip up on sites which Chrome tells me has failed to prove its identity and is insecure. What it really means is that I don't have a root certificate installed from WhateverCA Inc. I then click "OK go ahead anyway". Sometimes however Chrome refuses to let you continue to that site at all, which I think is called certificate pinning.
I certainly could not cope with an increase in this kind of behaviour, which would be the logical consequence if all sites used SSL.