Because, for centuries, they were, for most people, they only source of music in their life, other than a live performance. Over the last few decades, they are used exclusively to create a creepy atmosphere in horror and thriller films.

Same thing with clowns and dolls

It’s the association