• 👍Maximum Derek👍@discuss.tchncs.de
    link
    fedilink
    English
    arrow-up
    180
    ·
    edit-2
    2 months ago

    Certainly! Let me ignore half the details in your prompt and suggest a course of action for v2 of this package even though you said it was version 15.

    I’m sorry that isn’t working for you. Here are the troubleshooting steps for a Samsung convection oven that went out of production in 2018.

    You are correct, your question did not involve baking tips, here’s that same course of action from v2 of this software package.

    • boonhet@lemm.ee
      link
      fedilink
      English
      arrow-up
      19
      arrow-down
      3
      ·
      2 months ago

      Honestly, it’s been pretty good for me once I say “Hmm I don’t think this workflow works with this version”

      I think the 4o model might just be better than 3.5 was at this.

  • flamingo_pinyata@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    62
    ·
    2 months ago

    And then it gives you the most generic answer how to run a docker build, that doesn’t actually address the problem

  • yogurtwrong@lemmy.world
    link
    fedilink
    English
    arrow-up
    58
    ·
    edit-2
    2 months ago

    ChatGPT keeps mixing up software versions which is understandable considering the similarities between versions and the way gen AI works

    I asked for help on GTK 4 once and responses were a mix of GTK 4 and 3 code. Some of them even contained function names which didn’t exist in any version of GTK

    • Ibaudia@lemmy.world
      link
      fedilink
      English
      arrow-up
      13
      ·
      2 months ago

      And when you point that out to the AI, those code snippets get replaced with even more spaghetti that is maybe 1% closer to actually working, at best. Been there!

    • whodatdair@lemmy.blahaj.zone
      link
      fedilink
      English
      arrow-up
      7
      ·
      2 months ago

      I’ve asked for help finding API endpoints that do what I want because I’m feeling too lazy to pour over docs and it’ll just invent endpoints that don’t exist

    • Omniraptor@lemm.ee
      link
      fedilink
      English
      arrow-up
      2
      ·
      edit-2
      2 months ago

      Maybe we could do better with smaller ais that are fine tuned (or RAG idk I’m not a programmer) on a specific code base + documentation + topical forum

    • Not_mikey@slrpnk.net
      link
      fedilink
      English
      arrow-up
      22
      arrow-down
      1
      ·
      2 months ago

      Yeah but this is a “needle in a haystack” problem that chatgpt and AI in general are actually very useful for, ie. Solutions that are hard to find but easy to verify. Issues like this are hard to find as it requires combing through your code , config files and documentation to find the problem, but once you find the solution it either works or it doesn’t.

  • BrianTheeBiscuiteer@lemmy.world
    link
    fedilink
    English
    arrow-up
    20
    ·
    2 months ago

    Usually it doesn’t solve my problems but it gives me a few places to start looking. I know some models are capable of this but to get a perfectly accurate and useful response would probably require it to recall a specific piece of input it was given and not just an “average” of the inputs.

      • BrianTheeBiscuiteer@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        2 months ago

        Don’t know but copyright holders have demonstrated a few cases where they got AI to blatantly rip off copyrighted pictures or music.

        • Petter1@lemm.ee
          link
          fedilink
          English
          arrow-up
          1
          ·
          2 months ago

          I don’t like copyright like it is today and happy that we are now rethinking it. Hopefully we get a better system out of it. Just sad that capitalism and AI are killing independent news/media, so it’s gonna be hard to get it into a state that is fair for all, not just the wealthy 🤔

    • sj_zero@lotide.fbxl.net
      link
      fedilink
      arrow-up
      14
      ·
      2 months ago

      Then you say “this argument doesn’t exist.”

      And it replies “you’re right! That argument has never been a part of package x. I’ve updated the argument to fix it:” and then gives you the exact same bleedin command…

    • Avg@lemm.ee
      link
      fedilink
      English
      arrow-up
      9
      ·
      2 months ago

      I google it first before executing anything chatgpt gives me.

  • torgeir@lemmy.ml
    link
    fedilink
    English
    arrow-up
    17
    arrow-down
    1
    ·
    2 months ago

    I’ve done similar things for mismatched python dependencies in a broken Airflow setup on GCP, and got amazingly good results pointing me in the right direction to resolve the conflicting package versions. Just dumped a mile long stack trace and the full requirements.txt on it. Often worth a shot, tbh

    • cm0002@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      arrow-down
      1
      ·
      2 months ago

      Yea if nothing else hopefully it’ll at least point you in the right direction

  • Lucidlethargy
    link
    fedilink
    English
    arrow-up
    13
    arrow-down
    4
    ·
    2 months ago

    This is one of the first things I did a year or so ago to test chatgpt. I’ve never trusted it since. Chatgpt is fucking less than useless. The lies it tells… It’s insane.

  • bulwark@lemmy.world
    link
    fedilink
    English
    arrow-up
    6
    ·
    2 months ago

    Well how was I supposed to figure out that my docker node running on libreelec won’t connect to the swarm because the kernel was compiled with out the The Berkeley Packet Filter protocol.

    • Petter1@lemm.ee
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      2
      ·
      2 months ago

      I learned C++, python, how stuff in the Linux kernel works, how ansible works and can be tuned, and a lot more using the help of AI (mostly copilot, but when it fails to help, I use my free prompts of OpenAI 4.o, which is way better than copilot, right now)

      Not tested o1 yet, but I heard it is mind blowing good, since it got way better with logic stuff like programming and Mathematic

      • Hawk@lemmynsfw.com
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        1
        ·
        2 months ago

        It is incredibly good. Cheese and chalk good. Using it with Aider really highlights how much the Dev space is about to change.

  • bbuez@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    2 months ago

    The best code its given me I’d been able to search for and find where it was taken. Hey it helped me discover some real human blogs with vastly more helpful information.

    (If you’re curious, it was circa when there was that weird infight at openclosedAI with altman, I prompted to give code to find the rotational inertia per axis and to my surprise and suspicion the answer made too much sense. Backsearching I found where I believe it got this answer from)

  • Mereo@lemmy.ca
    link
    fedilink
    English
    arrow-up
    2
    ·
    edit-2
    2 months ago

    The new o1-preview model gave me much better and more precise answers than the 4o model.