I do not disagree with the premise that Antifa and even Black Lives Matter are also groups that are less than perfect in their respect for the law and the rights of others.
But when someone peacefully protesting against racism is murdered, to claim that "both sides" are somehow to blame for what happened does seem objectionable.
It looks like the political battle that is going on is this:
One side believes that it's as inappropriate to have statues of Confederate generals still standing in this day and age in the South as it would be to have statues of German generals during World War II standing in Germany. Both fought to defend systems that caused immense suffering to members of a particular ethnic group which those systems disdained.
Another side - which includes a lot of Americans who aren't members of any neo-Nazi or white supremacist organizations - believes that the appropriate course of action after the end of the Civil War was the one that was largely taken in fact - one of reconciliation and not triumphalism. One that extended respect to the defeated South.
This is why, even in this day and age, removing statues of Confederate generals wherever they may still stand is not a completely non-controversial no-brainer in the United States.
And so Donald Trump's comments, clumsy as they were, are seen by some as resulting from a legitimate and appropriate goal: not to allow the government to be manipulated by the death of Heather Heyer into upsetting a balance that helped the nation heal the wounds of the Civil War, into denying the defeated South its self-respect.
My personal position on this is that such a position would make perfect sense, if black Americans did not exist (perhaps they could have all moved to Liberia?), but because they do exist, it doesn't, and there's nothing wrong with "manipulating" the government into doing what should have been done more than a hundred years ago. But blindness is not the same thing as hate.