I smell new datasets Tweet added by Alignment Lab AI @alignment_lab

Alignment Lab AI

@alignment_lab

7 months

I smell new datasets

Bindu Reddy

@bindureddy

7 months

Yay!!! Google is finally in the arena. They just announced Gemini, and it has some impressive benchmark scores 👏👏 Gemini beats GPT4 in several benchmarks except HellaSwag. Interestingly, top open-source models score around 87-88 on HellaSwag. The 4-pt MMLU beat is…

32

92

457

4

1

34

Lewis Tunstall

@_lewtun

7 months

@alignment_lab And new judge LLMs :)

0

Ralph Brooks AI Artisan

@ralphbrooks

7 months

@alignment_lab It will be interesting to see if synthetic data from advanced models like Gemini makes its way into open source models. More interesting also to see if the time from model release to open source "clone" gets reduced over time.

Ralph Brooks AI Artisan

@ralphbrooks

7 months

It looks like Gemini has advanced capabilities in responding to multimodal input.

56

257

1K

0

1

Mbongeni Ndlovu

@Mbounge_

7 months

@alignment_lab same - synthetic too

0

Replies