The display technology is only part of the equation
Its the power. Not in terms of battery - though that obviously matters for weight - but in terms of heat. A phone may only dissipate a few watts but do it long enough and it'll get warm to the touch - maybe even hot for some phones. I suppose that might be nice during winter if you're outdoors, but the rest of the time you aren't going to want something trying to dissipate several watts of excess heat into your skull.