But the local version is not supposed to be censored…? I’ve asked it questions about human rights in China and got a fully detailed answer, very critical of the government, something that I could not get on the web version. Are you sure you were running it locally?
Nah, it’s just fewer parameters. It’s not as “smart” at censorship or has less overhead to apply to censorship. This came up on Ed Zitron’s podcast, Better Offline.
IIUC it isn’t censored per se. Not like the web service that will retract a “bad” response. But the training data is heavily biased. And there may be some explicit training towards refusing answers to those questions.
But the local version is not supposed to be censored…? I’ve asked it questions about human rights in China and got a fully detailed answer, very critical of the government, something that I could not get on the web version. Are you sure you were running it locally?
Nah, it’s just fewer parameters. It’s not as “smart” at censorship or has less overhead to apply to censorship. This came up on Ed Zitron’s podcast, Better Offline.
IIUC it isn’t censored per se. Not like the web service that will retract a “bad” response. But the training data is heavily biased. And there may be some explicit training towards refusing answers to those questions.
I downloaded the model with Alpaca so it should be