• Artyom@lemm.ee
    link
    fedilink
    English
    arrow-up
    72
    arrow-down
    5
    ·
    1 year ago

    The idea that any scientist is doing data analysis in Excel is honestly terrifying on every level.

    • griffinsklow@feddit.de
      link
      fedilink
      English
      arrow-up
      21
      arrow-down
      1
      ·
      1 year ago

      I remember when a biologist asked us for help - Excel crashed on processing his 700MB tables. Took some time and Chatgpt to convince him to do the analysis in R. It worked out in the end and he is now recommending this solution to his colleagues, which is nice.

    • Blackmist@feddit.uk
      link
      fedilink
      English
      arrow-up
      5
      ·
      1 year ago

      Flashback to the time the UK government lost 16,000 positive COVID patients because Excel has a 1 million row limit.

      If only there were better ways of storing large amounts of records with a fixed structure. Maybe the future will provide such technology…

    • Evotech@lemmy.world
      link
      fedilink
      English
      arrow-up
      12
      arrow-down
      8
      ·
      1 year ago

      Excel is excellent at data analysis… Python integrations and everything

        • filcuk@lemmy.zip
          link
          fedilink
          English
          arrow-up
          12
          arrow-down
          1
          ·
          edit-2
          1 year ago

          Because every scientist is also a programmer?
          Especially if they struggle to use Excel properly, no chance.

          • cabron_offsets@lemmy.world
            link
            fedilink
            English
            arrow-up
            2
            ·
            1 year ago

            I’d be embarrassed to call myself a scientist if I didn’t know how to at least script basic shit and effortlessly reproduce data analyses. The bar for entry into every single stage of academic science is too fucking low. 95% of this literature is irreproducible shit, in part because fuckwits don’t know how to code. Scientists don’t need to be software engineers, but yes, they need to be able to program. It wasn’t this way 20 years ago, but it most certainly is nowadays.

      • cabron_offsets@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 year ago

        Excel sucks open ass. At storing data, at displaying data, at analyzing data. Scientists, of all people, should understand how to use an RDBMS and a data processing framework like R.

    • Wooshock@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      11
      ·
      1 year ago

      What the hell else is there? Good luck getting universities using OpenOffice

      • asdfasdfasdf@lemmy.world
        link
        fedilink
        English
        arrow-up
        18
        arrow-down
        5
        ·
        edit-2
        1 year ago

        Scientists should be using programming languages like R or Python. They are both extremely popular in this field, much more than Excel.

          • Hawk@lemmynsfw.com
            link
            fedilink
            English
            arrow-up
            8
            arrow-down
            5
            ·
            1 year ago

            Except every scientist and analyst. Stats, data sci and ML is done in R and Python, be it astro, health data or genomics.

            If someone has been taught stats in spreadsheet software, they have have been taught wrong, period.

            Also, programming is a very strong term. we’re talking about stats in a scripting language, not software development in CPP.

          • isles@lemmy.world
            link
            fedilink
            English
            arrow-up
            4
            arrow-down
            3
            ·
            1 year ago

            Research projects almost exclusively have more than one person working on them.

          • atzanteol
            link
            fedilink
            English
            arrow-up
            2
            arrow-down
            1
            ·
            1 year ago

            They should be if they’re doing data analysis like this.

              • atzanteol
                link
                fedilink
                English
                arrow-up
                2
                arrow-down
                1
                ·
                1 year ago

                Programming in R or Python isn’t a lot harder than learning how to get Excel to do what you want. I’d wager it’s easier since you don’t have to fight your tools.

                Excel has its place for simple quick calculations. But at some point it’s simply the wrong tool.