@Tom I don't think it's as simple as that. The problem is that those who voted to leave had a huge variety of reasons for doing so and are therefore a disparate group. They wanted everything from "soft Brexit" based possibly on the Norwegian or Swiss models through to the hardest possible Brexit severing absolutely every kind of tie with the EU and setting up deals (eventually) with every individual nation in the world. There was also everything in-between. Those of us who voted to say had a pretty consistent view by contrast.
Given the huge range of views of the Brexiteers how do you possibly negotiate? Which particular constituency do you try to please? Go too soft and you'll alienate the hard liners, go too hard and you'll alienate the soft Bexiteers.