AI models can produce poems that rate well on certain ‘metrics’. But the event of reading poetry is not one in which we arrive at standardised outcomes.
Our findings suggest that participants employed shared yet flawed heuristics to differentiate AI from human poetry: the simplicity of AI-generated poems may be easier for non-experts to understand, leading them to prefer AI-generated poetry and misinterpret the complexity of human poems as incoherence generated by AI.
From the paper: