Public
- Public
- Network
- Groups
- Popular
- People

Conversation

Notices

Drew Kadel (drewkadel@social.coop)'s status on Tuesday, 25-Jul-2023 00:54:34 UTC Drew Kadel

My daughter, who has had a degree in computer science for 25 years, posted this observation about ChatGPT on Facebook. It's the best description I've seen:
In conversation about a year ago from social.coop permalink
Attachments
1. Something that seems fundamental to me about ChatGPT, which gets lost over and over again: When you enter text into it, you're asking "What would a response to this sound like?" If you put in a scientific question, and it comes back with a response citing a non-existent paper with a plausible title, using a real journal name and an author name who's written things related to your question, it's not being tricky or telling lies or doing anything at all surprising! This is what a response to that question would sound like! It did the thing! But people keep wanting the "say something that sounds like an answer" machine to be doing something else, and believing it *is* doing something else. It's good at generating things that sound like responses to being told it was wrong, so people think that it's engaging in introspection or looking up more information or something, but it's not, it's only, ever, saying something that sounds like the next bit of the conversation.
  https://social-coop-media.ams3.cdn.digitaloceanspaces.com/media_attachments/files/110/154/047/429/526/830/original/e9ea19f47428b37b.png
- Annika Backstrom (annika@xoxo.zone)'s status on Tuesday, 25-Jul-2023 00:54:33 UTC Annika Backstrom
  in reply to
  
  @DrewKadel I saw an article lamenting that the LLM couldn't reliably explain its "reasoning," and it's just such a fundamentally flawed idea about what ChatGPT is doing :(
  
  In conversation about a year ago permalink
  
  Santa Claes 🇸🇪🇭🇰🎅 likes this.
- rob🕊️🇺🇦🌍🌎🌏✊:blobcatadorable: (robookwus@fosstodon.org)'s status on Tuesday, 25-Jul-2023 00:54:40 UTC rob🕊️🇺🇦🌍🌎🌏✊:blobcatadorable:
  in reply to
  
  @DrewKadel totally true and right observation. I'm about to graduate with a master's in data science with NLP specialization, so I guess I also have some pedigree to judge this 🤣
  
  In conversation about a year ago permalink
  
  Santa Claes 🇸🇪🇭🇰🎅 likes this.

Public

Conversation

Notices

Feeds