• yeahiknow3@lemmings.world
    link
    fedilink
    English
    arrow-up
    3
    arrow-down
    2
    ·
    edit-2
    13 hours ago

    Where’s the critique coming from? The Wiki seems to have nothing but positive things to say. Might be an error. Ironic.

    Scientific studies[23] using its ratings note that ratings from Media Bias/Fact Check show high agreement with an independent fact checking dataset from 2017,[8] with NewsGuard[9] and with BuzzFeed journalists.[10] When MBFC factualness ratings of ‘mostly factual’ or higher were compared to an independent fact checking dataset’s ‘verified’ and ‘suspicious’ news sources, the two datasets showed “almost perfect” inter-rater reliability.

    • PhilipTheBucket@ponder.cat
      link
      fedilink
      English
      arrow-up
      11
      arrow-down
      1
      ·
      12 hours ago

      It’s from https://en.m.wikipedia.org/wiki/Wikipedia:Reliable_sources/Perennial_sources#Media_Bias/Fact_Check

      There is consensus that Media Bias/Fact Check is generally unreliable, as it is self-published. Editors have questioned the methodology of the site’s ratings.

      I think the perennial sources list gets a lot more attention than the wiki page for MBFC itself, and probably the standards for judging it reliable are higher.

      • yeahiknow3@lemmings.world
        link
        fedilink
        English
        arrow-up
        6
        arrow-down
        3
        ·
        edit-2
        12 hours ago

        I read that. My best guess is that this is either an error that hasn’t been updated in light of empirical studies corroborating MBFC’s reliability, or more likely any self-published list gets the “unreliable” sticker automatically.

        Also, making claims about “a consensus” without sourcing these claims is mighty suspicious. Disappointed.

        • goferking0@lemmy.sdf.org
          link
          fedilink
          English
          arrow-up
          1
          ·
          32 minutes ago

          They’re saying the parts mbfc uses other data from is fine, like the fact checking matching others as they all use the same source. But the rest like bias can’t be trusted as it’s just their own unscientific methods.

          • PhilipTheBucket@ponder.cat
            link
            fedilink
            English
            arrow-up
            2
            ·
            15 minutes ago

            They’re not saying that. How did you summarize 23 words using 39 words, and get the summary wrong?

            They’re saying that there is no external professional vouching for MBFC’s conclusions, which is their usual gold standard for things being “reliable.” And that, on top of that, people within Wikipedia have specifically pointed out flaws with how MBFC does things, without any of the qualifications and categories that you added.

        • PhilipTheBucket@ponder.cat
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          2
          ·
          3 hours ago

          Tell me you have no idea how Wikipedia works, without telling me you have no idea.

          You’re putting trust in the stuff that doesn’t mean very much, and "best guess"ing that the stuff that is dependable is not.