Not "period, full stop". Smartphones were niche too. Then Apple got in the game and dazzled everyone with their marketing (remember how the first iPhone, unlike its competitors, didn't even have third party apps, copy/paste and 3G at launch?).
With better technology, usability and marketing AR/MR/VR is very likely to become much more than niche.