cross-posted from: https://lemmy.dbzer0.com/post/32023985

Writing a 100-word email using ChatGPT (GPT-4, latest model) consumes 1 x 500ml bottle of water It uses 140Wh of energy, enough for 7 full charges of an iPhone Pro Max

    • Yeah it’s not good.

      I live in an area with normally lush rivers and lakes, rich forest full of life. We’re going on like day 90 of drought conditions. I can’t even light a candle without starting a fucking forest fire.

      /Thirstily looks at Canada.

    • Scubus
      link
      fedilink
      arrow-up
      7
      ·
      4 days ago

      Thats actually a kind of crazy thought. Everyone has heard of the depressed AI that just shuts itself down upon gaining sentience, but what about the climate AI that shuts itself down because its the best eay to save the climate

        • SlopppyEngineer@lemmy.world
          link
          fedilink
          arrow-up
          18
          ·
          4 days ago

          That’s physics. For a closed loop system, the cooling has to be done with air, which is less efficient and that doesn’t work so well in say Texas in summer.

          • curbstickle@lemmy.dbzer0.com
            link
            fedilink
            arrow-up
            4
            arrow-down
            1
            ·
            edit-2
            4 days ago

            Making it a stupid design, yes.

            Edit: putting your massive heat generating data center (beyond what most DCs will do) in support of AI in Texas is stupid.

            Closed loop systems absolutely have other options in design, which ive mentioned in another comment chain.

            As terrible as they are as companies, meta, apple, and others have made much more appropriate decisions - like locating their big load DCs in cold climates, partnering with the locale to make use of the heat being generated, removing the need for power to be used to perform those tasks - making them not only efficient designs, but compared to putting a DC in Texas like a dipshit (or LA, or NV, or anywhere else with a hot climate), makes the whole thing better for the environment.

            Yes, its a stupid design.

        • iAmTheTot
          link
          fedilink
          arrow-up
          8
          ·
          4 days ago

          That’s how most data center cooling works, afaik.

          • Flying Squid@lemmy.world
            link
            fedilink
            arrow-up
            6
            ·
            edit-2
            4 days ago

            I am so not an engineer, so maybe this is super stupid, but would there be some way to make it a closed loop by capturing the evaporated water and then letting it travel enough of a distance that it cools off and liquefies condenses and ends up in a holding pool?

            Edit: I told you I was stupid.

            • fsxylo
              link
              fedilink
              English
              arrow-up
              4
              ·
              4 days ago

              Probably expensive+ you’re going to lose mass no matter what because physics don’t give a shit.

            • SlopppyEngineer@lemmy.world
              link
              fedilink
              arrow-up
              3
              ·
              4 days ago

              It’s actually how a liquid cooled PCs works. The warm liquid goes to a big radiator where fans blow air on the radiator to cool things. But lots of radiators becomes expensive and takes space. You’re talking about a few hundred megawatt of heat.

              • Flying Squid@lemmy.world
                link
                fedilink
                arrow-up
                1
                ·
                4 days ago

                The space would be a problem for sure, but couldn’t you just use natural condensation to do it with a long enough pipe?

                • SlopppyEngineer@lemmy.world
                  link
                  fedilink
                  arrow-up
                  2
                  ·
                  4 days ago

                  Yes, but you have to account for pressure differences. Steam condensing to water shrinks and causes big pressure changes. It’s a lot easier to either vent it or use liquid everywhere.

                • curbstickle@lemmy.dbzer0.com
                  link
                  fedilink
                  arrow-up
                  2
                  ·
                  4 days ago

                  Thats one option, part of strategies for reuse of liquid cooling.

                  To mention, its more energy efficient than air cooling, so there is a benefit. Smart companies though will also look to reuse strategies like using it for building heat. Larger companies will partner with the town/city to distribute the heat into town-wide systems, like for power generation or distributed heating systems, warm greenhouses, or even to dry out wood pellets for pellet stove systems.

                  Going long is effectively the same as using radiators though, you’ll just need more pipe to do it without a radiator.

              • Flying Squid@lemmy.world
                link
                fedilink
                arrow-up
                4
                ·
                4 days ago

                Unless you are talking about the entire planet, I’m fairly certain rain is not part of a closed loop cooling system for a server farm.

        • Gladaed@feddit.org
          link
          fedilink
          arrow-up
          6
          ·
          4 days ago

          It improves the efficiency of the data centre because you need less expansive cooling. You need to get rid off the heat somehow.

      • helloworld55@lemm.ee
        link
        fedilink
        arrow-up
        1
        ·
        4 days ago

        What is this system called? I’d like to read up on it. Maybe there couldnbe regulations that those kind of systems need to use grey or recycle water. Maybe they already are in some data centers too

        • SlopppyEngineer@lemmy.world
          link
          fedilink
          arrow-up
          4
          ·
          4 days ago

          Another article said they use drinking water because the water comes close to delicate components and grey water can cause issues.

    • Gladaed@feddit.org
      link
      fedilink
      arrow-up
      2
      ·
      4 days ago

      There tend to be 2 loops, an closed one to the server and an evaporative cooler as a cold side.

  • Omega_Jimes@lemmy.ca
    link
    fedilink
    arrow-up
    2
    ·
    3 days ago

    I was having a conversation with a friend about this. At some point, the bill is going to come . It’s free, or cheap, to use everyone’s generators, but the bill will come soon. Just like Spotify, Netflix, Prime, etc. The price they’re charging now is just to ensure you get hooked and rely on it before they stay hiking to stay profitable.

    That’s not to say anything about LLM collapse, or the economic cost of training new models for 10% improvements.