Re: There are an estimated 4.6 million contractors in the UK.
Re: "Could you clarify this?"
It sounds like the umbrella company is conflating IR35 with the SDC (Supervision, Direction, or Control) rules which came into force from April 2016. Under the latter, you can't claim travel expenses if you're a fake contractor.