sh.itjust.works
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
Lee Duna@lemmy.nz to Technology@lemmy.worldEnglish · 2 years ago

Apple Develops Breakthrough Method for Running LLMs on iPhones

www.macrumors.com

external-link
message-square
27
link
fedilink
58
external-link

Apple Develops Breakthrough Method for Running LLMs on iPhones

www.macrumors.com

Lee Duna@lemmy.nz to Technology@lemmy.worldEnglish · 2 years ago
message-square
27
link
fedilink
Apple GPT in your pocket? It could be a reality sooner than you think. Apple AI researchers say they have made a key breakthrough in deploying large...
alert-triangle
You must log in or register to comment.
  • Ace! _SL/S@ani.social
    link
    fedilink
    English
    arrow-up
    68
    arrow-down
    12
    ·
    edit-2
    2 years ago

    This comment sums it up pretty nicely:

    LOL innovative invention of swapping memory to storage…… maybe they can call it something cool like “cache”.

    Apple being “innovative” my ass, lmao

    • cheese_greater@lemmy.world
      link
      fedilink
      English
      arrow-up
      17
      ·
      2 years ago

      Cache u inside

      • jcg@halubilo.social
        link
        fedilink
        English
        arrow-up
        2
        ·
        2 years ago

        How bow dat?

    • lemmylommy@lemmy.world
      link
      fedilink
      English
      arrow-up
      14
      arrow-down
      2
      ·
      2 years ago

      Well, if that commenter had more than just a vague idea of caching and/or swapping, they would know that the right algorithm can make or break performance.

      That paper is not “we invented caching”, but “this is how we make some certain models work well despite constraints imposed by RAM and flash storage.”

      It’s a worthy job for an engineer or researcher. Not quite as innovative as the invention of the wheel, but still enough to write a paper on (and read it, if you can manage to understand it).

    • Hegar@kbin.social
      cake
      link
      fedilink
      arrow-up
      12
      arrow-down
      3
      ·
      2 years ago

      The easiest way to tell that something’s not really innovative is if the person describing it uses the word innovative.

      • HeartyBeast@kbin.social
        link
        fedilink
        arrow-up
        4
        ·
        2 years ago

        Can you give an example of something that actually was innovative, that no-one called innovative?

        • Hegar@kbin.social
          cake
          link
          fedilink
          arrow-up
          5
          arrow-down
          1
          ·
          2 years ago

          The spoked wheel.

          • HeartyBeast@kbin.social
            link
            fedilink
            arrow-up
            2
            arrow-down
            2
            ·
            2 years ago

            Interestingly, it looks as if nothing was really called innovative before 1960, with usage peaking in 2000, and its now in decline

            https://www.etymonline.com/word/innovative

            • Hegar@kbin.social
              cake
              link
              fedilink
              arrow-up
              1
              ·
              2 years ago

              Peaking in 2000 seems odd - I see or hear that word daily and that definitely wasn’t the case back in 2000. Interesting!

        • GluWu@lemm.ee
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          1
          ·
          2 years ago

          Corndogs

    • 4am@lemm.ee
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      4
      ·
      2 years ago

      35 upvotes in the technology community…man you guys really are just all knee-jerk reactionaries and it really knowledgeable tech at all. git gud

  • guitarsarereal
    link
    fedilink
    English
    arrow-up
    28
    ·
    edit-2
    1 year ago

    deleted by creator

    • cybersandwich@lemmy.world
      link
      fedilink
      English
      arrow-up
      10
      ·
      2 years ago

      deleted by creator

  • cheese_greater@lemmy.world
    link
    fedilink
    English
    arrow-up
    16
    arrow-down
    1
    ·
    2 years ago

    Make Siri Great For Once

    • LazaroFilm@lemmy.world
      link
      fedilink
      English
      arrow-up
      19
      ·
      2 years ago

      Huhum…?

      Still working on that…

      I’m sorry, try again later.

      • cheese_greater@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        ·
        2 years ago

        You’re triggering me lol

        • coolmojo@lemmy.world
          link
          fedilink
          English
          arrow-up
          6
          ·
          2 years ago

          Found the following websites about you’re triggering me lol.

          • cheese_greater@lemmy.world
            link
            fedilink
            English
            arrow-up
            4
            ·
            2 years ago

            Sigh! [unzips] Go ahead…

    • Xatolos@reddthat.com
      link
      fedilink
      English
      arrow-up
      4
      ·
      2 years ago

      deleted by creator

  • fruitycoder
    link
    fedilink
    English
    arrow-up
    3
    ·
    2 years ago

    Tbh I’m more excited to see someone do use webnn, webgpu and petals together. Building smaller tighter models is good too.

  • wizzor@sopuli.xyz
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 years ago

    I don’t understand the innovation, I already run LLMs and stable diffusion on a laptop from 2011.

    I have no doubt it could be run on my Android phone.

  • Lophostemon@aussie.zone
    link
    fedilink
    English
    arrow-up
    17
    arrow-down
    30
    ·
    2 years ago

    Why the hell do we want to encourage people running MLMS on our phones?!! I don’t want to be part of some stupid pyramid scheme nonsense.

    • LazaroFilm@lemmy.world
      link
      fedilink
      English
      arrow-up
      10
      ·
      edit-2
      2 years ago

      dōTERRA Phone

      • Tronn4@lemmy.world
        link
        fedilink
        English
        arrow-up
        7
        ·
        2 years ago

        HerbaLife Galaxy S30

    • flooppoolf@lemmy.world
      link
      fedilink
      English
      arrow-up
      8
      arrow-down
      1
      ·
      edit-2
      1 year ago

      deleted by creator

    • Josh
      link
      fedilink
      English
      arrow-up
      5
      ·
      2 years ago

      😭

    • /home/pineapplelover@lemm.ee
      link
      fedilink
      English
      arrow-up
      4
      ·
      edit-2
      2 years ago

      LLM≠MLM

      • Lophostemon@aussie.zone
        link
        fedilink
        English
        arrow-up
        1
        ·
        2 years ago

        https://youtu.be/8N_tupPBtWQ?si=bDNpaip3U5tDk0h5

    • 4am@lemm.ee
      link
      fedilink
      English
      arrow-up
      3
      ·
      2 years ago

      Siri could suck an order of magnetize less and work offline, for starters

    • Tja@programming.dev
      link
      fedilink
      English
      arrow-up
      3
      ·
      2 years ago

      Here, you dropped this: /s

      • Lophostemon@aussie.zone
        link
        fedilink
        English
        arrow-up
        2
        ·
        2 years ago

        /s is for weaklings.

        HEAR ME ROAR.

Technology@lemmy.world

technology@lemmy.world

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: [email protected]

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


  • @[email protected]
  • @[email protected]
  • @[email protected]
  • @[email protected]
Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 4.09K users / day
  • 10.1K users / week
  • 17.6K users / month
  • 38.1K users / 6 months
  • 2.61K local subscribers
  • 71.8K subscribers
  • 15.2K Posts
  • 647K Comments
  • Modlog
  • mods:
  • L3s@lemmy.world
  • enu@lemmy.world
  • Technopagan@lemmy.world
  • L4sBot@lemmy.world
  • L3s@hackingne.ws
  • L4s@hackingne.ws
  • BE: 0.19.11
  • Modlog
  • Legal
  • Instances
  • Docs
  • Code
  • join-lemmy.org