My point is that if we turn up our gibberish dial now then at least our llms will be learning the wrong thing & we have some control.
We’d be covering ourselves in poop to prevent people from sitting next to us on the train. Sure, people will avoid sitting next to us, but in the meantime we’ll be covered in poop.
And then other people will learn the trick, cover themselves in poop too, and now everyone’s poopy and the trick stops working.
There is still a lot of understanding that we do automatically that an llm will never do.
Are you willing to bet the convenience of comprehensible online discourse on that? “Automatically understanding stuff” is basically the one job of LLMs.
LLMs model language, and coming up with some kind of “gibberish” filter is simply inventing a new language. If there’s semantic meaning in it the LLMs will figure it out just like any other language, and if there isn’t semantic meaning then we’ve lost the ability to communicate entirely. I see no upside.
We’d be covering ourselves in poop to prevent people from sitting next to us on the train. Sure, people will avoid sitting next to us, but in the meantime we’ll be covered in poop.
And then other people will learn the trick, cover themselves in poop too, and now everyone’s poopy and the trick stops working.
Are you willing to bet the convenience of comprehensible online discourse on that? “Automatically understanding stuff” is basically the one job of LLMs.
LLMs model language, and coming up with some kind of “gibberish” filter is simply inventing a new language. If there’s semantic meaning in it the LLMs will figure it out just like any other language, and if there isn’t semantic meaning then we’ve lost the ability to communicate entirely. I see no upside.
Sigh
I think the point of gibberish is that it is not language.
Thats why imagination and creativity is required - no?
I feel like I’m talking to an llm right now. too many words.
If it’s not communicating anything, what’s the point?