Hey ChatGPT, do you remember stuff you learned?
- VC Ramesh
- Dec 6, 2022
- 2 min read
Does ChatGPT remember stuff it has learned? I have a hard time understanding why ChatGPT can't answer basic questions pertaining to pizza ordering. So, I asked ChatGPT. Here is what it kept saying. Not convinced.
Me: I asked ChatGPT to act like a pizza ordering bot. However, it couldn't answer basic questions like "What type of crust is available?" or "What are my choices for toppings?". ChatGPT kept saying "I don't have access to that information. I'm not able to browse the internet or access any external databases". Why doesn't ChatGPT have such basic information that is widely available and common knowledge?
ChatGPT: As a language model, ChatGPT is not designed to have access to external information or databases. It is trained to generate human-like text based on the input it receives, but it does not have the ability to browse the internet or access external information on its own. This means that it is not able to provide information on specific topics unless that information has been explicitly provided to it as part of the input. In the case of a pizza ordering bot, ChatGPT would need to be provided with information about the types of crust and toppings available in order to generate a response to questions about them.
Me: But wasn't ChatGPT trained with a large corpus of data that I am sure would have included such basic information about pizzas?
ChatGPT: As a large language model, ChatGPT is trained on a massive corpus of text data, but this does not necessarily mean that it has specific knowledge about every topic that might be mentioned in that data. The goal of language modeling is to generate human-like text, not to provide information on specific topics. In order to do the latter, the model would need to be trained in a very different way, and it would need to have access to external information sources.
Me: But ChatGPT is able to simulate a pizza ordering bot. I mean, ChatGPT must have memorized some of this basic information about pizzas as part of its large training dataset.
ChatGPT: While it is true that ChatGPT is able to generate text that resembles a conversation with a pizza ordering bot, this does not necessarily mean that it has specific knowledge about the types of crust and toppings available for pizzas. As a language model, ChatGPT is primarily trained to generate text that sounds like it was written by a human, not to provide specific information about particular topics. In order to do the latter, the model would need to be trained in a very different way, and it would need to have access to external information sources.
Comments