• @[email protected]
    link
    fedilink
    English
    679 months ago

    The idea that any scientist is doing data analysis in Excel is honestly terrifying on every level.

    • @[email protected]
      link
      fedilink
      English
      209 months ago

      I remember when a biologist asked us for help - Excel crashed on processing his 700MB tables. Took some time and Chatgpt to convince him to do the analysis in R. It worked out in the end and he is now recommending this solution to his colleagues, which is nice.

    • @[email protected]
      link
      fedilink
      English
      59 months ago

      Flashback to the time the UK government lost 16,000 positive COVID patients because Excel has a 1 million row limit.

      If only there were better ways of storing large amounts of records with a fixed structure. Maybe the future will provide such technology…

        • @[email protected]
          link
          fedilink
          English
          11
          edit-2
          9 months ago

          Because every scientist is also a programmer?
          Especially if they struggle to use Excel properly, no chance.

          • @[email protected]
            link
            fedilink
            English
            29 months ago

            I’d be embarrassed to call myself a scientist if I didn’t know how to at least script basic shit and effortlessly reproduce data analyses. The bar for entry into every single stage of academic science is too fucking low. 95% of this literature is irreproducible shit, in part because fuckwits don’t know how to code. Scientists don’t need to be software engineers, but yes, they need to be able to program. It wasn’t this way 20 years ago, but it most certainly is nowadays.

      • @[email protected]
        link
        fedilink
        English
        19 months ago

        Excel sucks open ass. At storing data, at displaying data, at analyzing data. Scientists, of all people, should understand how to use an RDBMS and a data processing framework like R.

      • @[email protected]
        link
        fedilink
        English
        13
        edit-2
        9 months ago

        Scientists should be using programming languages like R or Python. They are both extremely popular in this field, much more than Excel.

          • @[email protected]
            link
            fedilink
            English
            39 months ago

            Except every scientist and analyst. Stats, data sci and ML is done in R and Python, be it astro, health data or genomics.

            If someone has been taught stats in spreadsheet software, they have have been taught wrong, period.

            Also, programming is a very strong term. we’re talking about stats in a scripting language, not software development in CPP.

          • @atzanteol
            link
            English
            19 months ago

            They should be if they’re doing data analysis like this.

              • @atzanteol
                link
                English
                19 months ago

                Programming in R or Python isn’t a lot harder than learning how to get Excel to do what you want. I’d wager it’s easier since you don’t have to fight your tools.

                Excel has its place for simple quick calculations. But at some point it’s simply the wrong tool.