Collisions of comet nuclei and asteroids with Earth are rare events

If collisions of comet nuclei and asteroids with Earth are rare events, why should we be concerned about the possibility of such a collision? Explain