Comets
Slight correction: It's not Sol's heat that sublimes off bits of comets to form the tail, it's the solar wind, that constant stream of highly energetic particles from which the Earth's magnetic field largely protects we humble Terrans. This is why, regardless of direction of travel of the body, the tail will always point away from the local star.
Biting the hand that feeds IT
