@mitchazj
@ctjlewis
Capabilities it didn't have at step 0, learned at step 10 and exercised at step 50 are learned capabilities.
1
0
10
Replies
alright, *specifically* what intellectual tasks can a 4-year-old do that GPT-4 cannot?
773
30
1K
@ctjlewis
actually learn?
4 year olds will modify their behaviour in real time based on feedback, and eventually become 5 year olds
LLMs are frozen in time; they can’t genuinely learn things yet
14
2
512
@mitchazj
the chat models are obv constrained in that each time step is a new message, so it isn’t very high resolution input, but it is literally “real time”
and it can only age from a 0-chat context to an N-chat context, but it does in fact update on feedback in that time
11
0
59
@ctjlewis
> and it can only age from a 0-chat context to an N-chat context, but it does in fact update on feedback in that time
Do you mean the slightly longer input with each Nth message, up to the context window limit? That's not really learning new capabilities; just prompting up to…
2
0
37
@LiamPaulGotch
@mitchazj
@ctjlewis
These aren’t new capabilities, it’s rote memorization. If you gave a four year old a blue crayon, they would draw blue pictures, but they didn’t learn anything about how color works.
2
0
4