Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

We do the same thing.

We have long term memory and short term.

Context is short term.

The still long and expensive training phase embeds the long term memory.



Hmm, interesting.

One of the problems programmers have is loading a problem into working memory. It can take an hour. An interruption, a phone call, or a meeting can mean that you have to start over (or, if not completely over, you still have to redo part of it). This is a standard programmer complaint about interruptions.

It's interesting that LLMs may have a similar issue.


We do not do the same thing.

Right now inference doesn't cascade into training.

In biology, inference and training are not so decoupled.


What we do may be analogous but absolutely not the same


Yes if course after all ML and LLM are not made out of brain.

But do I really have to say colloquial?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: