• @booly
    link
    English
    -41 month ago

    I don’t think you understand the type of multiple choice questions involved. Here’s a real question:

    A father lived with his son, who was an alcoholic. When drunk, the son often became violent and physically abused his father. As a result, the father always lived in fear. One night, the father heard his son on the front stoop making loud obscene remarks. The father was certain that his son was drunk and was terrified that he would be physically beaten again. In his fear, he bolted the front door and took out a revolver. When the son discovered that the door was bolted, he kicked it down. As the son burst through the front door, his father shot him four times in the chest, killing him. In fact, the son was not under the influence of alcohol or any drug and did not intend to harm his father.

    At trial, the father presented the above facts and asked the judge to instruct the jury on self-defense.

    How should the judge instruct the jury with respect to self-defense?

    (A) Give the self-defense instruction, because it expresses the defense’s theory of the case.

    (B) Give the self-defense instruction, because the evidence is sufficient to raise the defense.

    © Deny the self-defense instruction, because the father was not in imminent danger from his son.

    (D) Deny the self-defense instruction, because the father used excessive force.

    Memorizing the book itself doesn’t teach how to answer this type of question. It requires actual application of concepts to the new facts being given.

    • @[email protected]
      link
      fedilink
      English
      14
      edit-2
      1 month ago

      Yes that is indeed the sort of question I was expecting. But anyway good thing the LLM didn’t have just one book, but oodles of books and expert opinion and past exam data at its disposal! Oh wait it didn’t help and the machine especially made to give correct answers failed to give correct answers :(

      • @booly
        link
        English
        11 month ago

        I guess I don’t understand how one would expect an LLM or other system like that (to include human brains) to be able to answer 100% of these questions, just because it’s ingested every book about a topic.

        It’s inherently an exercise in applying a bunch of rules in a probabilistic manner, so expecting 100% accuracy would be unreasonable, even of a person or system who did successfully memorize every single rule.

    • @[email protected]
      link
      fedilink
      English
      111 month ago

      thanks for posting this long, pointless shit twice in this thread for no discernible reason

    • @[email protected]
      link
      fedilink
      English
      91 month ago

      Lol, it literally takes 5s to search for this, come up with the book and read

      The defendant has offered evidence of having acted in self-defense.

      as the first sentence. How could you claim having that memorised wouldn’t help?