Facebook's BlenderBot 2.0 Has Long Term Memory

Facebook's BlenderBot 2.0 Has Long Term Memory
Photo by Alex Haney / Unsplash

Read the full article here.

GPT3 Generated Summary:

  • BlenderBot 2.0 is a chatbot that can build long-term memory while searching the internet for up-to-date information.
  • It remembers the context of previous discussions.
  • Facebook is releasing its code and data publicly.
  • BlenderBot 2.0 is an improvement over BlenderBot 1.0, which was released a year ago.
  • BlenderBot 2.0 can query the internet using any search engine for movies, TV shows, and more and both read and write to its long-term local memory store.
  • Multisession dataset was used to train BlenderBot 2.0 to store relevant information in long-term memory
  • Blended Skill Talk dataset was used to give BlenderBot 2.0 a personality
  • Wizard of the Internet dataset was used to train BlenderBot 2.0 to generate relevant search engine queries and create responses based on the search results
  • The model is not perfect, but it is better than previous models
  • The model is open source, and Facebook has released all the data they used to train it.
  • The model still makes mistakes.
  • The model still has hallucinations, but significantly less than its predecessor.
  • The model still has biases.