Re: the above problems point to one root cause
Zoning is what creates the problem.
It was a good idea 100years ago to stop slum landlords building houses against the walls of the United Asbestos, Arsenic and Cyanide factory - but it's crap when it doesn't let you build mixed office and apartment blocks in city centers or allow incubator office space in the suburbs.