top of page
Search

Hey ChatGPT, do you remember stuff you learned?

  • Writer: VC Ramesh
    VC Ramesh
  • Dec 6, 2022
  • 2 min read

Does ChatGPT remember stuff it has learned? I have a hard time understanding why ChatGPT can't answer basic questions pertaining to pizza ordering. So, I asked ChatGPT. Here is what it kept saying. Not convinced.


Me: I asked ChatGPT to act like a pizza ordering bot. However, it couldn't answer basic questions like "What type of crust is available?" or "What are my choices for toppings?". ChatGPT kept saying "I don't have access to that information. I'm not able to browse the internet or access any external databases". Why doesn't ChatGPT have such basic information that is widely available and common knowledge?


ChatGPT: As a language model, ChatGPT is not designed to have access to external information or databases. It is trained to generate human-like text based on the input it receives, but it does not have the ability to browse the internet or access external information on its own. This means that it is not able to provide information on specific topics unless that information has been explicitly provided to it as part of the input. In the case of a pizza ordering bot, ChatGPT would need to be provided with information about the types of crust and toppings available in order to generate a response to questions about them.


Me: But wasn't ChatGPT trained with a large corpus of data that I am sure would have included such basic information about pizzas?


ChatGPT: As a large language model, ChatGPT is trained on a massive corpus of text data, but this does not necessarily mean that it has specific knowledge about every topic that might be mentioned in that data. The goal of language modeling is to generate human-like text, not to provide information on specific topics. In order to do the latter, the model would need to be trained in a very different way, and it would need to have access to external information sources.


Me: But ChatGPT is able to simulate a pizza ordering bot. I mean, ChatGPT must have memorized some of this basic information about pizzas as part of its large training dataset.


ChatGPT: While it is true that ChatGPT is able to generate text that resembles a conversation with a pizza ordering bot, this does not necessarily mean that it has specific knowledge about the types of crust and toppings available for pizzas. As a language model, ChatGPT is primarily trained to generate text that sounds like it was written by a human, not to provide specific information about particular topics. In order to do the latter, the model would need to be trained in a very different way, and it would need to have access to external information sources.

 
 
 

Recent Posts

See All
Look Ma, No RLHF!

Superficial Alignment Hypothesis: A model’s knowledge and capabilities are learnt almost entirely during pretraining, while alignment...

 
 
 
Ask ChatGPT: Seq2Seq vs Causal LLM

I am not sure what to make of this conversation with ChatGPT. Is this what they mean by a "stochastic parrot"? :-) Choosing LLM...

 
 
 
Chatbots in the fast food industry

https://finance.yahoo.com/news/ai-making-name-itself-fast-162303086.html https://finance.yahoo.com/news/ordering-fast-food-robot-may-1100...

 
 
 

Comments


©2023 by vcrsoft.

bottom of page