There is a way to know where the punchline starts. It’s after the question. The trick is to read the first sentence before the second sentence. That way you don’t get spoiled before you read the setup.