Really cool perspective on why next token prediction might be enough to reach AGI. In this snippet from the @dwarkesh_sp podcast, Ilya argues that great next-token prediction requires a profound level of understanding of underlying concepts to accomplish. This is in stark… Tweet added by Zain Hasan @ZainHasan6

Zain Hasan

6 months

Really cool perspective on why next token prediction might be enough to reach AGI. In this snippet from the @dwarkesh_sp podcast, Ilya argues that great next-token prediction requires a profound level of understanding of underlying concepts to accomplish. This is in stark…

2

13

86

Rajesh / Raj

@rkarmani

6 months

@ZainHasan6 @dwarkesh_sp Is that from 8 months ago?

1

0

2

Zain Hasan

@ZainHasan6

6 months

@rkarmani @dwarkesh_sp Yep

1

0

Brando

@brandnarb

6 months

@ZainHasan6 @dwarkesh_sp I wonder if his views have changed over time or if he thinks there's a way to get a transformer to correctly go out of distribution without putting the answer in the prompt.

0

1

Replies