I was going to make the gun-control argument as well but I think it's not the same. The difference is that there's really one use for guns (especially in the UK which is really too densely populated for hunting with guns, except shotguns, to be a thing), which is killing people. Really bad people will still have guns of course, but you can vastly reduce the prevalence of the killing-people problem by just heavily restricting gun ownership.
But drones aren't like that at all: they're not single-purpose devices at all. So I don't think the argument is straightforward. Drones are more like cars than guns, I think.