• @gigachad
    link
    English
    51 month ago

    I guess it’s more of a critique of how bad CSV is for storing large data than pandas being inefficient

    • @[email protected]
      link
      fedilink
      English
      131 month ago

      CSV is not optimal, but then someone shows up and gives you 60GB of JSON instead of 600MB of CSV.

      • @naught
        link
        English
        31 month ago

        Or they dump their entire 6gb SQL database, customer info and all, into a SQL file that you have to load into a mariadb docker container when you just needed a subset that you were going to turn into csv anyway ☺️