• 0 Posts
  • 260 Comments
Joined 1 year ago
cake
Cake day: June 12th, 2023

help-circle

  • It has access to a python interpreter and can use that to do math, but it shows you that this is happening, and it did not when i asked it.

    That’s not what I meant.

    You have access to a dictionary, that doesn’t prove you’re incapable of spelling simple words on your own, like goddamn people what’s with the hate boners for ai around here

    ??? You just don’t understand the difference between a LLM and a chat application using many different tools.



  • If you fine tune a LLM on math equations, odds are it won’t actually learn how to reliably solve novel problems. Just the same as it won’t become a subject matter expert on any topic, but it’s a lot harder to write simple math that “looks, but is not, correct” than it is to waffle vaguely about a topic. The idea of a LLM creating a robust model of the semantics of the text it’s trained on is, at face value, plausible; it just doesn’t seem to actually happen in practice.