ATMs are generally
supported by a specific team unrelated to "normal" desktops
supported by an outsourcer/generic ATM provider (even in India) outside the bank entirely
have peculiar change control processes that make fixes difficult to apply.
are remote so when something goes wrong a physical visit is required
However I would support the position that they need to get sorted out eventually. Simply abandoning them does not seem an appropriate management tactic!