If you're used to cross-compiling code, playing with exotic architectures, and are patient, then you've probably had a smooth journey.
The problem isn't really cross-compiling. The toolchains for this across x86, x86_64 and ARM v7 and v8 are pretty well-established. And if the target market is large scale then compile-time tweaks are less of an issue than ease of deployment and power consumption. The bigger problem that has held ARM back in data centre is about drivers, which can't just be cross-compiled.