GPT-3, Bloviator
by iSophist · 6 things on Twos
- Marcus, G. (2020, August 22). GPT-3, Bloviator: OpenAI’s language generator has no idea what it’s talking about. MIT Technology Review. https://www.technologyreview.com/2020/08/22/1007539/gpt3-openai-language-generator-artificial-intelligence-ai-opinion/
- OpenAI is developing a language-generating system called GPT-3. The company will begin charging companies for access to the system later this year. The system has an impressive ability to produce human-like text.
- OpenAI's lack of openness seems to us to be a serious breach of scientific ethics, and a distortion of the goals of the associated nonprofit. Its decision forced us to limit our testing to a comparatively small number of examples.
- PT-3 can produce words in perfect English, but it has only the dimmest sense of what those words mean. To an optimist, any hint of success means that there must be a pony in here somewhere.
- GPT-3 learns correlations between words, and nothing more. The empiricist's dream is to acquire a rich understanding of the world from sensory data. Even with 175 billion parameters and 450 gigabytes of input data, it's not a reliable interpreter. You wouldn't trust an improv actor playing a doctor to give you medical advice, for example. It might get your math problem right, but it might not.
- This article provides several examples where GPT-3 cannot reason and produces faulty results.