Rosanne Liu @savvyRL Twitter profile

Last Seen Profiles

@LiamPayne

@korkichii

@LoShearing

@lb_southwark

@iampbiswal

@sirotetyou

@aiftv1

@dino999z

@Apexerkarma

@RoyCasagranda

@Incendium_GG

@_tago_ago

@iPoriel

@blitz_crystal

@haobunnie

@NatsukiSaika

@xd_ider__

@studybuddhism

@SawboTownFC

@BewitchedInk

@USConcarneau

@865Mixtapes

@N9TWD

@newbluegirl

@Lia_3D

@dvxja

@JimotoSaiko

@m_dolceduce

@Sundog512

@aliceyou_know

@vege_itoen

@PrgCont

@Schreids

@jordannovet

@LT7_FPS

@kevinyamamura

Rosanne Liu

@savvyRL

2 years

A quick thread on "How DALL-E 2, Imagen and Parti Architectures Differ" with breakdown into comparable modules, annotated with size 🧵 #dalle2 #imagen #parti * figures taken from corresponding papers with slight modification * parts used for training only are greyed out

23

504

2K

Rosanne Liu

@savvyRL

1 year

Fixed.

Gautam Kamath

@thegautamkamath

1 year

@savvyRL Impostor syndrome definitely implies that one isn't a subset of the other

1

108

48

231

1K

Rosanne Liu

@savvyRL

3 years

In 2020, my life was turned upside down -- I was encountering failure after failure and in deep depression. But that also turned out to be the most enlightening period. In October I was invited to give a talk at Google (thanks to @orf_bnw ). It's out today:

27

205

1K

Rosanne Liu

@savvyRL

2 years

ML conferences should be award shows, with categories like "Best paper" "Best first author" "Best supporting author" "Best Figure 1" "Best appendix" Or creative categories like "I can't believe this worked" "I can't believe this didn't scale" "a theory so beautiful I cried"

36

107

1K

Rosanne Liu

@savvyRL

1 year

80

196

1K

Rosanne Liu

@savvyRL

1 year

70+lbs of GPUs in one suitcase... Wish me luck at the airport tomorrow 🥲 #NeurIPS2022

34

21

1K

Rosanne Liu

@savvyRL

7 months

[PAPER POLICE AT WORK] Pretty cool vis, and solid paper, but do we really have to blow it up as to say LLMs "learn a world model"?? The result basically says all similar words (wrt location or time) are well clustered in the latent space—a finding already known from word2vec.

Wes Gurnee

@wesg52

7 months

Do language models have an internal world model? A sense of time? At multiple spatiotemporal scales? In a new paper with @tegmark we provide evidence that they do by finding a literal map of the world inside the activations of Llama-2!

183

1K

6K

16

111

932

Rosanne Liu

@savvyRL

2 years

I am meeting ML researchers all the time. There are two worlds. One world's problem is "should I go to Google or Deepmind next summer" and the other is "a small opportunity, however small, please." All problems are valid. But my heart sinks at this chilling, disorienting divide.

22

49

748

Rosanne Liu

@savvyRL

3 years

Decision tree on “Do I seriously want to get a PhD” by @huanchenzhang via 知乎

20

110

708

Rosanne Liu

@savvyRL

1 year

Could it be that RLHF finetuning works not because it's RL, not because it's HF, not even because it's finetuning, but just that it's *rating full sentences* instead of next token? Could it be that in the end, it's just a change of training objectives that made the difference?

39

56

667

Rosanne Liu

@savvyRL

1 year

A personal update: I just joined Google Deepmind

Demis Hassabis

@demishassabis

1 year

The phenomenal teams from Google Research’s Brain and @DeepMind have made many of the seminal research advances that underpin modern AI, from Deep RL to Transformers. Now we’re joining forces as a single unit, Google DeepMind, which I’m thrilled to lead!

157

655

4K

28

10

614

Rosanne Liu

@savvyRL

1 year

Dear #reviewer2 : Thank you for your comments like "the amount of work in this paper is more like a course project, instead of a paper at CVPR" "the contribution is not enough to reach the bar of CVPR publication" But we'd like to point out that this is a submission to #ICCV

22

13

575

Rosanne Liu

@savvyRL

8 months

OKAYYY finally have a first version of slides ready, 18h before my talk! Here's a sneak peek. See you tomorrow for those that are at #DeepLearningIndaba #DLI2023

18

94

537

Rosanne Liu

@savvyRL

3 years

I joined @GoogleAI 6 months ago. Today I went to the office for the first time, and ate lunch in a cafeteria. Easily my happiest day of the year. Easily.

4

5

504

Rosanne Liu

@savvyRL

1 year

Thoughts?

33

30

468

Rosanne Liu

@savvyRL

1 year

Anyone who's played with generative models knows that *THEY CAN'T SPELL* (at least not until they reach a certain scale). Well turns out there's a simple fix! Check out our paper that carefully benchmarks and investigates "the spelling miracle"

Character-Aware Models Improve Visual Text Rendering

Current image generation models struggle to reliably produce well-formed visual text. In this paper, we investigate a key contributing factor: popular text-to-image models lack character-level...

arxiv.org

Noah Constant

@noahconst

1 year

Want your image generation model to stop misspelling everything? Try giving it access to character-level input features!

14

107

754

6

69

441

Rosanne Liu

@savvyRL

2 years

No one from OpenAI is even pretending to celebrate scientific breakthroughs from places other than OpenAI. Beware of the culture (or just simply, "vibe") when you consider joining a place.

13

18

394

Rosanne Liu

@savvyRL

4 years

Over the past 5 months we’ve been experimenting how to steer a mammoth without training it. Here is how.

6

108

394

Rosanne Liu

@savvyRL

1 year

"Tiny Papers, a DEI initiative" Submit a 2-page paper to ICLR!

14

77

382

Rosanne Liu

@savvyRL

2 years

Months of hard work culminated at a good event: 4 likes Stupid ReLU joke: 300 likes is the biggest alignment problem this platform has

17

7

379

Rosanne Liu

@savvyRL

1 year

Some had a baby in 2022. Some published a book. Some got a promotion or landed a dream job. But those are their lives, not yours. Remember achievements need to be normalized by circumstances. And you've done great on your own measures. Happy new year's, my beautiful outsiders.

3

24

364

Rosanne Liu

@savvyRL

8 months

. @OpenAI is providing 1 YEAR of ChatGPT plus access to all @DeepIndaba attendees!! Woohoo! #Indaba2023 #DLI

17

51

340

Rosanne Liu

@savvyRL

2 years

Now that ML is so much about scaling up on all fronts, and so little about ideas, scientific awards (e.g. "NeurIPS oral") should be resource normalized. Student and independent researcher led research should NOT be evaluated the same way as industry-backed research. Period.

12

32

340

Rosanne Liu

@savvyRL

7 months

Potentially hiring Student Researchers to work on fundamental research from studying small-scale transformers to better understand training, to operating brain surgery on existing LLMs. Apply, and get in touch! BS/MS: PhD:

9

65

322

Rosanne Liu

@savvyRL

3 years

Just discovered a whole new world of model names: just replace "nut" to "net" in your favorite nuts CocoNet HazelNet WalNet PeaNet ChestNet

19

17

331

Rosanne Liu

@savvyRL

7 months

This is my 3rd year being a DEI chair for ICLR, and a DIA chair for NeurIPS. The emotional toll is immense. Seeing daily requests for difficulties I have 0 power to help with: 99% around visa appointments & rejections, is dispiriting. You realize how fxxking unfair everything is.

4

37

321

Rosanne Liu

@savvyRL

2 years

Repeat after me: I am not falling behind; I am just walking a different path.

15

17

311

Rosanne Liu

@savvyRL

2 years

A new year gift to myself 🎶

8

2

306

Rosanne Liu

@savvyRL

2 years

ReLU(I'M SAD)

Cliff Pickover

@pickover

2 years

This is a mathematics joke, widely circulating on the Web.

28

237

2K

10

23

300

Rosanne Liu

@savvyRL

2 years

A year ago today I was hitting rock bottom of my mental health that my only hope was time. I placed a calendar invite a year from then, asking myself if I'd feel better. Today I get to answer yes to that question. I know time might not be your best bet, but it's a reliable one.

9

5

302

Rosanne Liu

@savvyRL

5 months

My partner's one-line intro of me to new friends met at a wedding: "She's pretty big in the AI circle pre-2022, before ChatGPT."

9

4

291

Rosanne Liu

@savvyRL

1 year

Wow, not laid off (for now) AND an ICLR accept! I might have used up my luck for the year.

Rosanne Liu

@savvyRL

1 year

Layoff news AND iclr decision on the same day?

6

5

89

11

2

291

Rosanne Liu

@savvyRL

6 months

Sorry for dunking on your special day and DEI policing. But all these images are so sad. It's Twenty-Twenty-freaking-Three! What are we doing??

Piotr Padlewski

@PiotrPadlewski

6 months

Today was my last day at Google Brain/Deepmind. Really grateful for amazing colleagues. Learned so much from closely working on Pathways, ViT-22B, PaLI, NaViT and Gemini with @m__dehghani , @neilhoulsby , @_basilM , Xi and others. The team terminated me pretty well today :)

18

4

493

904

24

285

Rosanne Liu

@savvyRL

3 years

First day of #ICLR2021 ! My fav conf and its 2nd year running virtually. Excited to share that I joined Google Brain as a research scientist. It’s a wonderful feeling to start a new job without quitting the old: I will continue to serve as executive director of @ml_collective 1/

25

4

261

Rosanne Liu

@savvyRL

2 years

WARNING: a large influx of "ICLR accepted" posts coming to your timeline in the next few hours. Do what you need to do for your sanity, people

6

5

259

Rosanne Liu

@savvyRL

1 month

8 years later, I'm still having nightmares about failing grad school—unable to find an internship, unable to publish. So relieved this morning waking up to the universe that I've already graduated, got a job and everything. But, is the dream me still stuck in the hell universe?

20

5

255

Rosanne Liu

@savvyRL

2 years

Feeling grumpy today so I’m just gonna say it: it’s a business deal; they paid you, you did some labeling. Lots of business value. Almost zero social impact. A great paper, a wonderful language model, but why making it sound like a bunch of heros just saved the humankind?

Alexandr Wang

@alexandr_wang

2 years

Very proud of the @scale_AI team to have worked with @OpenAI on these new results in alignment. Long-term, human-AI alignment is one of our time's most important problems as AI becomes more powerful, and enabling alignment and is a fundamental long-term mission of Scale.

1

22

157

16

13

247

Rosanne Liu

@savvyRL

1 year

Hi ML twitter, what's the current state of model distillation? Roughly how many fold compression can we achieve within the same architecture? What about across architectures, e.g. training a transformer and distilling to an MLP?

18

21

245

Rosanne Liu

@savvyRL

1 year

While everywhere else in the world AI == ChatGPT, in this small oasis of #ICLR we are seeing the vast variety of topics. Turns out you have to come to AI conferences to escape AI hype.

4

13

246

Rosanne Liu

@savvyRL

11 months

I've been hearing from people that it's a very challenging year for AI/CS grad school application. A few words: First, I'm sorry many of you have to live through this; it's never fun receiving rejections. Second, I don't expect the situation to improve in foreseeable future.

6

17

237

Rosanne Liu

@savvyRL

3 years

Earlier this summer Krystal and I are appointed as ICLR 2022 DEI chairs. Right away we started planning something tangible and actionable to *really* help broaden the ICLR participation pool. Hence the birth of CoSubmitting Summer (CSS) program: 1/

4

76

231

Rosanne Liu

@savvyRL

3 years

If you are on a high-impact paper/project/idea, it has more to do w/ your privilege & luck than your talent & hard work. You absolutely need the latter, but the former plays an outsized effect—and we downplay it. It's this single realization that led to @ml_collective last year.

5

15

228

Rosanne Liu

@savvyRL

2 years

Feels like one of those important moments 😳

10

1

222

Rosanne Liu

@savvyRL

2 years

Almost there! #NeurIPS2022

4

6

219

Rosanne Liu

@savvyRL

2 years

Years ago we used to pretrain each layer of a network before stacking them together. Then "end-to-end" became a big term. Now a model is so big/modular that we again have to pretrain different parts: text encoder, image tokenizer, etc. before assembly. Fashion is a circle 🔁

7

13

210

Rosanne Liu

@savvyRL

3 years

I'm happy to promote your #ICLR2021 *rejections* if you believe your (or others') work is of value, and simply didn't won the lottery this time. I will 1) read and tweet 2) discuss them at our reading group. Send your work in!

3

19

209

Rosanne Liu

@savvyRL

2 years

Me 10mins into most paper talks 😐

Peyman Milanfar

@docmilanfar

2 years

machine learning paper explaining advanced mathematics

55

355

2K

4

14

204

Rosanne Liu

@savvyRL

3 years

Sounds about right 😂

6

24

206

Rosanne Liu

@savvyRL

2 months

One thing people might be missing with the Gemma Open Models release is the section announcing grants given to academics that can help push the boundaries of LLM research. Apply before April 17! All academics (universities + non-profits / independent labs) are applicable!

3

50

205

Rosanne Liu

@savvyRL

2 years

It's totally okay to not have any research ideas that excite you from time to time. Instead of having a structure that rewards continuous publication of mediocre ideas, researchers should be allowed to have "downtime," where they teach, mentor, write, and freely think.

4

12

204

Rosanne Liu

@savvyRL

11 months

We are told that this video is not viewed/liked enough, and hence blocks us from releasing more episodes 😥 We have lots of amazing interviews in stock, w/ e.g. @_beenkim @mc_mozer @hardmaru @hugo_larochelle Pls watch & like to help us release more!

Research Retrospectives: an interview with Zoubin Ghahramani, VP of...

In this episode of Research Retrospectives, Research Engineer Katherine Lee and Research Scientist Rosanne Liu interview Zoubin Ghahramani - the VP of Google...

www.youtube.com

11

41

199

Rosanne Liu

@savvyRL

2 years

Today marks one year of me joining Google Brain. That's it. That's the whole tweet. There won't be a long thread of me thanking and tagging everyone. That's uncool.

3

0

198

Rosanne Liu

@savvyRL

1 year

My grandma, 94, passed away in Wuhan, China last Tue. There has since been heaviness that clouds my days, but I haven't been able to take a break. I don't know how, when there are talks that I've committed to give, rec letters I've agreed to write, and unmovable paper deadlines.

18

1

200

Rosanne Liu

@savvyRL

1 year

Merry Christmas ❄️

6

3

194

Rosanne Liu

@savvyRL

2 years

The outcome of research might seem clean and cute, but the process is always messy. Normalize this. What are some of your cringe-making coding or experimenting habits? I'll start. Sometimes I write if xxx: (50 functions) else: (same 50 functions but with small changes)

24

11

192

Rosanne Liu

@savvyRL

7 months

What's the real difference between "pre-training" and "finetuning" these days? It used to be that the 2 phases have totally different objectives, tasks, data, and even modifications of model (new heads). But in LLMs it seems to mean just new data? Why not call it "more training"?

33

7

189

Rosanne Liu

@savvyRL

2 years

You know a field is progressing fast when the first paragraph of introduction has almost 100% of citations less than 2 years old (2021 & 2022), except for the very first diffusion paper (2015) #imagenvideo ...and followed with 4 pages of figures.

5

10

186

Rosanne Liu

@savvyRL

2 years

I don't attend @RealAAAI but what's going on with their registration policy?? 1. $600 for a virtual conference? 2. "Author with Publication" costs 2x "Co-Author" or "Non-Author"? 3. Is it necessary to add a late penalty when everything is, again, VIRTUAL??

12

26

187

Rosanne Liu

@savvyRL

3 years

Not unlike BatchNorm, I want anyone entering @ml_collective to go through these normalizations: - normalize failure ("I got rejected") - normalize goodwill ("I'm just here to help") - normalize imperfection ("this may be stupid") - normalize difficulty ("research is hard!")

1

10

184

Rosanne Liu

@savvyRL

4 years

"We’ve tended to breed the same style of researchers over and over again—people who come from similar backgrounds, have similar interests, read the same books as kids, learn from the same thought leaders, and ultimately do the same kinds of research." - @orussakovsky

5

19

175

Rosanne Liu

@savvyRL

2 years

BIG-bench was the single biggest reason I joined @jaschasd 's team at Google a year ago! Not only is it ground-breaking science—evaluating 200+ diverse tasks on 30+ LMs, it is also a revolutionary way of doing science: inviting the entirely community to join from the very start.

2

15

171

Rosanne Liu

@savvyRL

3 years

I'm beyond grateful to be appointed as ICLR 2022 DEI co-chair with the lovely @kammitama . We are working on something really exciting, a summer program to help underrepresented researchers not just attend, but work on, submit to, and hopefully publish at ICLR 2022! Stay tuned!

9

15

171

Rosanne Liu

@savvyRL

1 year

Who wrote this? 😂 (source: )

8

11

170

Rosanne Liu

@savvyRL

4 months

⚠️Emergency Reviewers⚠️ needed for #ICLR2024TinyPapers We are approaching the end of reviewing period, but sadly <50% reviewers have completed they assignment. We need emergency reviewers to review tiny (2-page!!) papers! Please reach out to iclr.dei.2023 @gmail if interested!

35

39

170

Rosanne Liu

@savvyRL

2 years

As the AI/ML social society starts to mimic show biz, to stand out one can consider taking on an identity. You can be the "scaling guy," the "spicy takes person," the "generalization god" or "gossip king." Turns out I'm suited as a receiver of "horrible stories in ML." Honored.

6

8

169

Rosanne Liu

@savvyRL

3 years

Recent paper titles: "Hey, that's not an ODE" () "Oops I took a gradient" () Predicted next: "Ahh I made it work" "Wow GANs can do this" "Bah turns out they can't" "Duh that's obvious" ...

Oops I Took A Gradient: Scalable Sampling for Discrete Distributions

We propose a general and scalable approximate sampling strategy for probabilistic models with discrete variables. Our approach uses gradients of the likelihood function with respect to its...

arxiv.org

5

11

167

Rosanne Liu

@savvyRL

2 years

Grandpa turns 90 today! 🎂

8

2

168

Rosanne Liu

@savvyRL

3 years

Glad someone did this! We are indeed entering an era where “the field is in danger of being drowned by noise” hence lit survey, benchmarking, cross-validation, and distillation work are more valuable than proposing new methods!

Frank Schneider

@frankstefansch1

3 years

📣 #ICML 2021 Paper 📣 Overwhelmed by the flood of optimizers for deep learning? We felt the same and performed an extensive benchmark. Joint work with @robinschmidt_ & @PhilippHennig5 . Paper: Results: Video:

16

180

787

5

24

167

Rosanne Liu

@savvyRL

2 years

Remember the world is bigger than your ICLR reviews

2

9

168

Rosanne Liu

@savvyRL

3 years

No need to apologize for not replying to emails/texts, no need to apologize for making mistakes, no need to feel bad for dropping tasks, for overcommitting and under-delivering, for disappearing. You are a human. This is the most challenging time ever. I understand. I understand.

2

11

166

Rosanne Liu

@savvyRL

1 year

Now that we can write Tiny Papers @iclr_conf , what should we write about? I'd like to invite all established researchers to contribute Tiny Ideas as inspirations, seeds for discussions & future collaborations! #TinyIdeasForTinyPapers I'll start. Note: bad ideas == good starts.

5

22

166

Rosanne Liu

@savvyRL

1 year

Congrats to everyone involved in one of the big announcements today! 🎉 To those who are not: remember that your value is NOT whether you find yourself in one of the few in-groups. A healthy scientific field is not supposed to make you feel left out. You are doing great 🌞

1

11

162

Rosanne Liu

@savvyRL

2 years

Forget about catching up with ml papers, catching up with who's where doing what now is much harder. Someone start an "ml gossips" newsletter and I'll subscribe

8

4

159

Rosanne Liu

@savvyRL

4 years

Our deep learning reading group is *fully virtual* and *open to all* this year! Join us every Friday noon to hear a live discussion of ideas. And nominate your favorite speaker too; I'll do my best to have them come present (no guarantee of success🤪)

Sara Hooker

@sarahookr

4 years

This was so much fun. I also uncovered that @savvyRL has been hosting a regular ml reading group since 2018. It is currently remote hosted virtually, so a great thing to join if you want to take a social break for an hour and chat about research.

1

3

15

3

37

158

Rosanne Liu

@savvyRL

6 months

Was opening YouTube to find some 10m thing to watch before going to bed, and ended up watching this new talk in full: Good teaching as usual! @karpathy

[1hr Talk] Intro to Large Language Models

This is a 1 hour general-audience introduction to Large Language Models: the core technical component behind systems like ChatGPT, Claude, and Bard. What the...

www.youtube.com

5

13

153

Rosanne Liu

@savvyRL

3 years

Computer crashed due to too many Chrome tabs with unread PDFs 🥺

15

2

154

Rosanne Liu

@savvyRL

2 years

I am on a Midwest (so beautiful this time of year🍂🍁🍃) tour, giving talks first at @jcjohnss 's lab at @UMich , then at @WisconsinCS on the kind invitation of @SharonYixuanLi Slides here for those who can't make it:

5

16

152

Rosanne Liu

@savvyRL

3 years

Wow, 3k views in 24h! Thank you -- every one of you. DLCT in 20 minutes! 😂 We are talking about "Simple, Fast, and Flexible Framework for Matrix Completion with Infinite Width Neural Networks" today.

Simple, Fast, and Flexible Framework for Matrix Completion with...

Matrix completion problems arise in many applications including recommendation systems, computer vision, and genomics. Increasingly larger neural networks have been successful in many of these...

arxiv.org

4

15

144

Rosanne Liu

@savvyRL

2 years

The @ml_collective research jam, merely 1 year and 5 instances old, has resulted in 5 papers: The power of...just giving people a stage and let 'em shine?

2

16

145

Rosanne Liu

@savvyRL

2 years

So somewhere between 3B and 20B #parti models acquire the ability to spell. Cross-checking with model that can't seem to spell ( #dalle2 ) and that can ( #imagen ): Imagen: 4.6B text enc + 2B text-to-image + 1B super-res DALL-E 2: 250M (?) text enc + 600M image enc + 3.5B dec

hardmaru

@hardmaru

2 years

#Parti paper has some really interesting results where they show the improvements in image quality as the number of model parameters is scaled up from 350M to 20B. You see visible quality enhancement for the hipster kangaroo, and accurate text rendering!

17

105

467

5

26

145

Rosanne Liu

@savvyRL

8 months

Indaba left me shaken. Before going I thought I'd gotten pretty jaded in conferences; yes meeting people is nice but it had started to feel like just another business trip. But INDABA IS MAGIC. Thanks to all the wonderful people that made this happen! @DeepIndaba

ML Collective

@ml_collective

8 months

We had an impromptu hangout at @DeepIndaba ! This is us: ~30 Nigerian students (who rode a 20h bus to Accra) with @savvyRL all shouting "M-L-C!!" (which turns out to work better than "cheese") #Indaba2023 @abrahamowos @_busayo_awobade

1

16

69

4

18

140

Rosanne Liu

@savvyRL

3 years

My favorite paper of the year! Why training *one* NN when you can train *a subspace* of infinite number of NNs? Thinking of instead of moving one dot across the loss landscape, move a line, an area, a cube... so that the whole space contains trained NNs! Congrats @Mitchnw et. al

Mitchell Wortsman

@Mitchnw

3 years

Sharing some takeaways from Learning Neural Network Subspaces, a fun project we learned a lot from and hopefully you can too. (1/n) tldr: We train lines, curves, and simplexes of neural networks from scratch arxiv: code: #ICML2021

7

72

331

1

18

140

Rosanne Liu

@savvyRL

1 year

Thanks for all the attention! The GPUs and I have successfully made it to #NeurIPS2022 , and have so far dodged crypto miner robbery. Time for our week-long GPU Giveaway! We will be seeking volunteers to help send them all over the globe. Watch @ml_collective for more details!

Rosanne Liu

@savvyRL

1 year

70+lbs of GPUs in one suitcase... Wish me luck at the airport tomorrow 🥲 #NeurIPS2022

34

21

1K

4

140

Rosanne Liu

@savvyRL

3 years

Favorite #NeurIPS2020 presentations and posters this year PS: heavily biased by what I happened to catch and whom I happened to talk to PPS: still catching up on talks so the list is rather incomplete and I'd hope to grow PPPS: with contributions from @ml_collective members

2

22

140

Rosanne Liu

@savvyRL

7 months

Good day! Average researcher here going through thousands of NeurIPS financial aid applications trying to roll out all decisions by Monday. (Some of you should have already received decisions; others: thanks for your patience!)

7

17

137

Rosanne Liu

@savvyRL

2 years

Now you just have to be friends with me 🙃

7

0

136

Rosanne Liu

@savvyRL

3 years

This Friday (since everyone is busy with ICML and I'm pathetically free) I am giving a talk at *my own* reading group -- extreme nepotism or what? 😬 Title: "Unconventional ways of training neural networks and what they teach us about model capacity"

3

16

135

Rosanne Liu

@savvyRL

1 year

Glee for a GPU-free flight tomorrow!! No one say "GPU" to me for 3 months please 😵‍💫

Sara Hooker

@sarahookr

1 year

“I’m freeeee!” @savvyRL finds homes for all the gpus.

0

78

4

2

134

Rosanne Liu

@savvyRL

6 months

I'm not saying I'm offering this but if you wanna come join a *real* nonprofit we can talk

7

132

Rosanne Liu

@savvyRL

2 years

I know how you feel. I know twitter seems brutal right now. I know the more "we're hiring..." "a great opportunity..." "happy to announce..." posts you see, the worse you feel. I know why all the "great opportunities" only make you feel inadequate and why you skip all of them.

2

6

132

Rosanne Liu

@savvyRL

1 year

High five Kigali! You've done a great job. #ICLR ends today, but my African adventure is just starting!

0

3

132

Rosanne Liu

@savvyRL

1 year

Top tweet content at NeurIPS: 1. Workboat 2. JAX building sign 3. "Just don't build AGI" swag 4. How to get into that party when registration is full 5. Playing with GPT-3.5 and ChatGPT in the hallway

5

4

130

Rosanne Liu

@savvyRL

3 years

A high schooler reached out wanting to do research with @ml_collective . In lieu of interviews I asked him to pick a topic and give a tutorial about it. He picked "continuous hopfield networks" and did a great job. In my mind he's a proper researcher by the end of the talk. 1/2

1

0

129

Rosanne Liu

@savvyRL

6 months

ICLR reviewers: I know you are all distracted and spending way too much time scrolling here -- it would be massively healing for your soul if you could instead engage with paper authors today and tomorrow! 🥰

2

22

124

Rosanne Liu

@savvyRL

1 year

We are losing money this year running ICLR in Africa, because many sponsors pulled out. Only 6 company booths were set up, compared to the usual 25-30. Hope it improves in future years, now that we see the overwhelmingly positive turnout!

@[email protected] on Mastodon

@timnitGebru

1 year

That’s also another advantage to having it in the African continent. There’s a self selection of who will attend and who will be notably absent.

1

7

68

5

8

128

Rosanne Liu

@savvyRL

3 years

Just some ml ladies ICML’ing @stephxsher @KerenGu @sarahookr @ledell @me_develops @chipro Who’s ready for WiML tomorrow? 🙌

4

1

127

Rosanne Liu

@savvyRL

1 year

Find me at MY TABLE at the WiML Mentorship #NeurIPS2022 ! Will be there for a few hours to chat about mental health and grad school struggles

1

6

125

Rosanne Liu

@savvyRL

1 year

Let's goooooo! ML conferences are experiencing an identity crisis — they are all the same. Same people, same papers, same talks. What's distinct about this year's ICLR is that the special location will present the most different demographic from all other ML confs. 🧶 1/5

Abdoulaye Diack

@A__Diack

1 year

Akagera National Park, Rwanda, 2009. Add that to your #ICLR2023 to do list.

1

5

62

2

8

125