Jenn Wortman Vaughan @jennwvaughan Twitter profile

Pinned Tweet

Jenn Wortman Vaughan

11 months

New paper to share! 📣 @QVeraLiao and I lay out our vision of a human-centered research roadmap for “AI Transparency in the Age of LLMs.” 🧵

AI Transparency in the Age of LLMs: A Human-Centered Research Roadmap

The rise of powerful large language models (LLMs) brings about tremendous opportunities for innovation but also looming risks for individuals and society at large. We have reached a pivotal moment...

arxiv.org

2

32

152

Last Seen Profiles

@jacquiver

@passthereplay

@LeeSaunders72

@MrTaker22

@The_short_nurse

@catase3x2

@FallerCards

@namiaru

@pakkanaatu

@phantom_ict

@gopherhockeysi

@murofes

@OHitup

@ahmedezzarab

@MindoSCP

@noventafc_

@SeeSpringVic

@Vanpatriota

@tycav34

@Mochalattefox

@residentlemonj

@JeffConawayTFA

@sa3leye

@bade_UTD

@ernestdove

@jamesjackerman

@noway4u_sir

@LongBranchMike

@nastynobvious

@quizcapriccio

@noway4u_sir

@HaagseInsider

@HELIX_es

@Golf_Saudi

@LimaTacii

@_Kenet_

Jenn Wortman Vaughan

@jennwvaughan

2 years

I want to talk about burnout. A brief 🧵... I was well aware I was burnt out in the fall, but it's hard to fully appreciate the impact of burnout in the moment. After 2 weeks of vacation and a month of aggressively blocking daily focus time, the impact has become more clear:

10

156

1K

Jenn Wortman Vaughan

@jennwvaughan

4 years

Got back reviews complaining our paper lacked novelty and didn't engage with the literature because we didn't cite... the arXiv preprint of the same paper. This is a new one for me.

29

42

1K

Jenn Wortman Vaughan

@jennwvaughan

3 years

The NYU AI School is a FREE week-long winter school on AI and ML open to undergrads from any major—programming experience helpful but not required. There will be hands-on labs and introductory lectures. I will speak on Responsible AI. Check it out!

7

179

571

Jenn Wortman Vaughan

@jennwvaughan

3 years

I've seen several tweets this week suggesting that newcomers stay away from ML research unless they already have a killer idea. Please don't take this advice. Almost no one starts PhD research with a clear idea of what they'll do, and those who do often change directions. (1/3)

6

73

539

Jenn Wortman Vaughan

@jennwvaughan

4 years

Ok, people! Are you looking for something to read at the intersection of machine learning and HCI? Three new papers posted online today that you should check out, all with my amazing colleague/BFF @hannawallach ! Ready? I'm gonna try a thread!

6

80

359

Jenn Wortman Vaughan

@jennwvaughan

2 years

I'm partway through reading the latest @NIST report on managing bias in AI and already my neck is starting to ache from the amount of vigorous head nodding I've done. So far, it is really, really good—and covers so much more than bias mitigation. Read it!

4

79

317

Jenn Wortman Vaughan

@jennwvaughan

3 years

Key dates posted for #NeurIPS2021 ! 📣 Paper submission deadline: May 26 (Abstracts May 19) Full CFP coming soon!

0

95

316

Jenn Wortman Vaughan

@jennwvaughan

3 years

My fully-vaccinated husband came down with a fever on Friday. On Saturday he tested positive for COVID. The past few days he's had headaches, muscle aches, fatigue, appetite loss, a cough... the whole gamut of COVID symptoms. But it could be worse. [1/n]

15

37

308

Jenn Wortman Vaughan

@jennwvaughan

5 months

A Ph.D. student collaborator of mine with a degree in CS just asked me what emacs is and I nearly fell out of my chair. I have never felt so old in my life! I still have tears in my eyes. 😭😂

27

7

288

Jenn Wortman Vaughan

@jennwvaughan

3 years

Only 15 months after our scheduled March 2020 move-in date, I am sitting at my desk at the new home of @MSFTResearch NYC!

11

3

286

Jenn Wortman Vaughan

@jennwvaughan

5 years

Calling all PhD candidates interested in fairness, accountability, transparency, and ethics of AI! Come work with me, @hannawallach , @katecrawford , @haldaume3 , Miro Dudik, and the rest of the Microsoft Research NYC FATE group this summer! Apply now:

8

145

273

Jenn Wortman Vaughan

@jennwvaughan

2 years

This week marks my 10-year anniversary at @MSFTResearch NYC. I've been trying not to get all sentimental, but in terms of major life decisions, well, joining MSR was a good one.

8

3

277

Jenn Wortman Vaughan

@jennwvaughan

3 years

The FATE group at @MSFTResearch NYC is hiring research interns! 🥳🎉 Come work with me, @s010n , @sulin_blodgett , @katecrawford , @haldaume3 , Miro Dudik, @mmadaio , @o_saja , and @hannawallach in an interdisciplinary and collaborative research environment.

5

68

263

Jenn Wortman Vaughan

@jennwvaughan

5 years

#NeurIPS2019 workshop decisions just went out! Want to hear how decisions were made and see a preliminary list of accepted workshops? @MarzyehGhassemi , @shakir_za , Bob Williamson, and I wrote a blog post all about the selection process!

Behind the Selection of the NeurIPS 2019 Workshops

NeurIPS 2019 workshop decisions just went out! Read on to hear all about the review process and see a preliminary list of workshops.

neuripsconf.medium.com

7

81

261

Jenn Wortman Vaughan

@jennwvaughan

2 years

Why am I sharing this? We're still in a pandemic. The pace of tech—particularly AI—is relentless. Everyone's overextended. I'm not the only one who's been burnt out. We need to recognize the impact on ourselves and our colleagues and find a way to make space to recover. (5/5)

7

16

256

Jenn Wortman Vaughan

@jennwvaughan

3 years

As a researcher in responsible AI in industry, I have enormous respect and admiration for @timnitGebru , @mmitchell_ai , and their colleagues—for asking important questions, the diverse team they've built, and their perseverance in pushing for impact (e.g., with model cards). 1/2

2

20

247

Jenn Wortman Vaughan

@jennwvaughan

2 years

It's that time of year! The FATE group at @MSFTResearch NYC is now accepting applications for 2023 interns. Internships this year will be IN PERSON again at last! 🥳🎉 For full consideration, apply by December 1 and don't forget your cover letter.

2

70

247

Jenn Wortman Vaughan

@jennwvaughan

4 years

My 2010s: became mom to 2 incredible daughters bought a home started faculty job; hated it; quit started real dream job mentored awesome people wrote a bunch of papers ran 4 half marathons took up yoga lost 2 cats shifted research focus/methods gained confidence; spoke up more

4

1

243

Jenn Wortman Vaughan

@jennwvaughan

2 years

- I am less angry. This is huge. - I feel less like every situation is adversarial, more willing to give people the benefit of the doubt. - I feel less threatened by other people's actions, more in control of my own outcomes. - I feel optimistic about those outcomes. (2/n)

3

242

Jenn Wortman Vaughan

@jennwvaughan

5 years

Missed the #NeurIPS2018 tutorials today? Watch them online now!

4

90

221

Jenn Wortman Vaughan

@jennwvaughan

2 years

Submitting to #NeurIPS2022 ? Want to include a thoughtful reflection on the limitations of your work but not sure how to begin? We designed REAL ML, a set of guided activities to help ML researchers recognize, explore, and articulate limitations that arise in their research.

1

56

216

Jenn Wortman Vaughan

@jennwvaughan

3 years

My favorite part of #NeurIPS is catching up with old friends over drinks in hotel bars followed by long, drawn-out dinners. Ducking out mid-tutorial to cook and put my kids to bed is somehow not the same experience.

3

1

214

Jenn Wortman Vaughan

@jennwvaughan

4 years

I hope your managers are telling you this, but it's ok to be distracted from work right now. We're all distracted from work. I would worry about you if you were not distracted from work. Nobody is going to look back on this week in US history and regret not just doing their job.

0

31

211

Jenn Wortman Vaughan

@jennwvaughan

4 years

I’ve been silent because it’s not clear that America needs to hear from another white lady, but it also feels cowardly to say nothing. Black lives matter. I am listening, continuing to learn, figuring out how to make donations count most, and trying my best to offer support.

1

14

205

Jenn Wortman Vaughan

@jennwvaughan

2 years

Mark your calendar now!! On top of eight keynotes, #NeurIPS2021 will feature three plenary panels: - The Consequences of Massive Scaling in ML - The Role of Benchmarks in the Scientific Progress of ML - How Should an ML Researcher Think about AI Ethics?

0

39

204

Jenn Wortman Vaughan

@jennwvaughan

2 years

I'm chronically behind on paper reading, but trying to catch up on recent lit on human-AI decision making—complementarity, under/overreliance, explanations, all that. There is SO MUCH happening in this space, so help! What are favorite recent papers I should definitely not miss?

15

17

198

Jenn Wortman Vaughan

@jennwvaughan

3 years

I failed to block my calendar for #CHI2021 and have proved once again that I am incapable of attending virtual conferences without marking myself out of office, cancelling all my meetings, and making a serious mental commitment in advance to go all in. How do people do it?

21

2

199

Jenn Wortman Vaughan

@jennwvaughan

3 years

Spread the word! 📣 We are conducting a paid study on the societal impacts of assumptions in machine learning research! Looking for ML researchers, ML practitioners, HCI researchers who work with ML, or experts in the implications of ML. Sign up here:

2

121

193

Jenn Wortman Vaughan

@jennwvaughan

4 years

My husband gave me every introvert parent's pandemic dream gift of 2 nights out of town, alone, with nobody I have to talk to, no remote school days, and nobody to look after but myself. I have never needed solitude so badly in my life and it exceeded my wildest expectations.

3

1

193

Jenn Wortman Vaughan

@jennwvaughan

6 months

It's that time of year again! The FATE group at @MSFTResearch NYC is accepting applications for 2024 interns. 🥳🎉 We'll begin reviewing applications in early December. Cover letter required; see the posting for details.

7

49

189

Jenn Wortman Vaughan

@jennwvaughan

4 years

I’ve hit a whole new level of burnout and exhaustion the past few weeks. I try to stay strong all the time but sometimes I’m not sure how we are going to get through this.

8

4

182

Jenn Wortman Vaughan

@jennwvaughan

4 years

Seeing lots of industry research internship talk. Yes, you can email researchers you want to work with! To stand out, demonstrate you've taken the time to understand what they do, and lay out how what you bring to the table is relevant to them. Generic emails get you nowhere.

1

28

182

Jenn Wortman Vaughan

@jennwvaughan

2 years

So excited I can FINALLY share our new work on machine learning practitioners' data documentation perceptions, needs, challenges, and desiderata, which will appear in #CSCW2022 ! Joint work w/ @AmyHeger , @lizbmarquis , @mihaela_v , and @hannawallach 1/n

Understanding Machine Learning Practitioners' Data...

Data is central to the development and evaluation of machine learning (ML) models. However, the use of problematic or inappropriate datasets can result in harms when the resulting models are...

arxiv.org

5

38

177

Jenn Wortman Vaughan

@jennwvaughan

3 years

I don't want a future in which the only people entering ML are those with the hubris to think they've got it all figured out. I'd rather encourage newcomers who have the patience, grit, and humility to approach an active field with an open mind and willingness to learn. (2/3)

4

11

173

Jenn Wortman Vaughan

@jennwvaughan

2 years

2022 marks a decade since I quit a (particularly toxic) tenure-track position and moved to industry. It is no exaggeration to say that in that decade I have never once felt even a momentary hint of regret about that decision—nothing but sheer, unadulterated relief.

2

166

Jenn Wortman Vaughan

@jennwvaughan

6 years

I've shared a transcript of my #wiml2017 opening remarks: Nine things I wish I had known the first time I came to NIPS @wimlworkshop

Nine things I wish I had known the first time I came to NIPS

(This is an approximate transcript of my opening remarks at WiML 2017.)

medium.com

2

74

162

Jenn Wortman Vaughan

@jennwvaughan

6 years

For anyone who missed the #NIPS2017 tutorials, all of the videos are now up!

2

89

160

Jenn Wortman Vaughan

@jennwvaughan

2 years

- I can see paths forward where there were only roadblocks before. - I can brainstorm and get excited about ideas. - I can focus on what people are saying in meetings and feel less of a need to (poorly) multitask. - As a result, I'm more interested in talking to people. (3/n)

1

3

160

Jenn Wortman Vaughan

@jennwvaughan

4 years

Interested in learning about multi-armed bandits? My @MSFTResearch colleague Alex Slivkins just published an introductory book and the whole thing is available for free on arXiv.

Introduction to Multi-Armed Bandits

Multi-armed bandits a simple but very powerful framework for algorithms that make decisions over time under uncertainty. An enormous body of work has accumulated over the years, covered in several...

arxiv.org

1

42

155

Jenn Wortman Vaughan

@jennwvaughan

3 years

Yesterday I saw my (fully vaccinated) parents for the first time since 2019, and this morning I booked an appointment for my own vaccine! 🥳🎊🎉 I'd forgotten what it's like to feel hopeful.

2

0

151

Jenn Wortman Vaughan

@jennwvaughan

3 years

The FATE group at @MSFTResearch NYC is hiring interns for summer 2022. 📢📢📢 Come join us!

4

46

151

Jenn Wortman Vaughan

@jennwvaughan

1 year

This year one of my goals is to clear out my "research debt" (a term I learned from @hannawallach ) — those lingering projects that I believe in and want to get out in the world, but are stalled for various reasons (usually "more urgent" priorities of mine/my collaborators). (1/4)

4

9

146

Jenn Wortman Vaughan

@jennwvaughan

2 years

. @MSFTResearch NYC is hiring a postdoc whose work bridges machine learning and any of our other focus areas: FATE, computational social science, econ-CS, or AI for systems. 📢📢📢 Is that you? Come work with us! (FATE-specific postdoc ad coming soon)

4

64

148

Jenn Wortman Vaughan

@jennwvaughan

5 years

Reposting for those headed to #NeurIPS2018 Nine things I wish I had known the first time I came to NIPS (my opening remarks from #WiML2017 )

Nine things I wish I had known the first time I came to NIPS

(This is an approximate transcript of my opening remarks at WiML 2017.)

medium.com

0

47

143

Jenn Wortman Vaughan

@jennwvaughan

3 years

I do agree that now is a great time to get into interdisciplinary work though! There is so much demand for ML + health, ML + biology, ML + social sciences, and on and on. These are exciting areas and are only going to grow. (3/3)

4

13

143

Jenn Wortman Vaughan

@jennwvaughan

4 years

More opportunities to join us! 🥳🎉🎊 @MSFTResearch NYC is hiring a postdoc in machine learning/AI. Applications due November 29.

2

47

137

Jenn Wortman Vaughan

@jennwvaughan

3 years

In case you missed it, my #TrustworthyML seminar talk on intelligibility throughout the machine learning life cycle is now up on youtube.

TrustML Seminar: Jenn Wortman Vaughan on Intelligibility Throughout...

0:01 -- Chirag introduces seminar format3:22 -- Jenn's talk starts43:34 -- Technical Q&A54:17 -- Jenn talks about her journey through research As part of the...

www.youtube.com

0

31

137

Jenn Wortman Vaughan

@jennwvaughan

4 years

YES! Coming from an ML theory background, I can't emphasize enough how eye-opening I've found it to collaborate with and learn from researchers trained in qualitative methods. It's changed my view of not just how we should solve problems but WHICH problems we should solve. (1/3)

3

23

134

Jenn Wortman Vaughan

@jennwvaughan

3 years

Sometimes there's that one project you just love, the one you go to first when someone asks what you're working on, the one you find a way to mention in every talk you give, the one you believe in deeply regardless of what any reviewer or skeptic might say. 1/6

3

12

137

Jenn Wortman Vaughan

@jennwvaughan

2 years

I recently received an email from someone who had made a Wikipedia page about me for a class project. I know I should play it cool and tons of researchers and academics are on there and it's no big deal, but at the same time... THIS IS SO COOL! 😍😍😍

Jennifer Wortman Vaughan - Wikipedia

en.wikipedia.org

1

0

137

Jenn Wortman Vaughan

@jennwvaughan

5 years

For the past few years I've kept a list of everything (talks, committees, events, etc.) I've said no to. Looking back, there's not a single one I regret. But I regret having committed to do things all the time. I need to keep reminding myself of this and up how much I say no.

7

11

133

Jenn Wortman Vaughan

@jennwvaughan

2 years

Today @Microsoft shared the Responsible AI Standard, our internal playbook for developing and deploying AI systems. This was a multi-year collaboration involving SO MANY people across roles, disciplines, and teams. While it's still evolving, I'm proud of how far we've come.

Brad Smith

@BradSmi

2 years

Microsoft is advancing AI with ethical principles that put people first. Our Responsible AI Standard takes a thoughtful approach, moving from principles to practices and collaborating with industry, academia and regulators for meaningful progress.

0

50

123

1

24

132

Jenn Wortman Vaughan

@jennwvaughan

4 years

More opportunities to join us at MSR NYC! Our interdisciplinary lab is hiring researchers and postdocs in FATE, computational social science, economics & computation, systems, and ML. Check out our postings! (And potential interns, check back soon!)

Microsoft Research Lab - New York City - Microsoft Research

Apply for a research position at Microsoft Research New York & collaborate with academia to advance economics research, prediction markets & ML.

www.microsoft.com

2

45

133

Jenn Wortman Vaughan

@jennwvaughan

3 years

But I want people to know that breakthrough infections are real. And without collecting the data, we can't know how widespread they are. Let's not pretend that things are normal, because they're not. Please stay safe and give your loved ones an extra hug. [8/8]

11

8

122

Jenn Wortman Vaughan

@jennwvaughan

4 years

Wow! This is big news! I'm proud of @Microsoft for stepping up, and grateful to @jovialjoy , @timnitGebru , @rajiinio , and the many others who have been speaking out on this topic for years!

Microsoft won’t sell police its facial-recognition technology, following similar moves by Amazon...

Microsoft will ban police use of its controversial facial-recognition systems, as the company awaits regulatory rules for how law enforcement agencies deploy the technology.

www.washingtonpost.com

1

27

124

Jenn Wortman Vaughan

@jennwvaughan

4 years

Spread the word! 📢 The @MSFTResearch Undergraduate Research Internship program is accepting applicants! 🎊🎉 MSR is looking for candidates who are passionate about technology, offer diverse perspectives, and want to work on state-of-the-art research.

Undergraduate Research Internship – Computing - Microsoft Research

Accepting applications for 12-week summer research internships for juniors & senior undergrads w/ demonstrated leadership in diversity.

www.microsoft.com

3

85

122

Jenn Wortman Vaughan

@jennwvaughan

3 years

Help us spread the word! 📢 @mihaela_v , Rich Caruana, and I are looking for a *virtual* summer intern with experience in visualization + machine learning interpretability. Still time to apply! We'll be reviewing applications through early January.

5

60

119

Jenn Wortman Vaughan

@jennwvaughan

4 years

Suggested New Years resolutions: - Say no more often, especially to things you're only doing for a CV line/to impress people. - Use your (relative) power to pull others up the ladder behind you. - Speak up for people in less privileged positions whenever you can.

0

17

119

Jenn Wortman Vaughan

@jennwvaughan

1 year

I'm planning a 12-week sabbatical late summer/early fall and plan to disconnect from work as fully as possible. Sharing because 1) it makes me more likely to do it, and 2) taking so much time off is scary since I don't see examples of people doing it. Maybe I can be that example.

3

5

116

Jenn Wortman Vaughan

@jennwvaughan

2 years

It's been 5 months since I tweeted about burnout. I'm happy to say I've kept my burnout level low. 🥂 Since my original thread seemed to resonate, I thought I'd share some things that have made a difference for me, acknowledging I'm lucky to have an unusually flexible job. (1/n)

Jenn Wortman Vaughan

@jennwvaughan

2 years

I want to talk about burnout. A brief 🧵... I was well aware I was burnt out in the fall, but it's hard to fully appreciate the impact of burnout in the moment. After 2 weeks of vacation and a month of aggressively blocking daily focus time, the impact has become more clear:

10

156

1K

2

13

112

Jenn Wortman Vaughan

@jennwvaughan

6 years

Woohoo! My survey on crowdsourcing for an ML audience is finally out in JMLR! Check it out if you're interested in incorporating crowdsourcing into your own research. Making Better Use of the Crowd: How Crowdsourcing Can Advance Machine Learning Research

0

33

114

Jenn Wortman Vaughan

@jennwvaughan

6 years

Ok, machine learning people, what are the topics you would be most excited to see covered in a #nips2018 tutorial?

48

36

110

Jenn Wortman Vaughan

@jennwvaughan

4 years

Just since Friday 3 people have independently emailed me to compliment my work. It feels like I’ve entered an alternate academic universe where people are REALLY NICE, and I like it. Let’s all be nice. Is there a paper or talk you’ve learned a lot from lately? Tell the authors!

1

12

111

Jenn Wortman Vaughan

@jennwvaughan

2 years

- My priorities have become more clear. - Day-to-day tasks like writing have become easier to accomplish and do well. - Because of all these things, and because I'm generally less overwhelmed, I'm better able to provide support for my collaborators and mentees. (4/n)

1

110

Jenn Wortman Vaughan

@jennwvaughan

2 years

I first attended #NeurIPS during the second year of my PhD. I've considered it my home conference ever since. This surprises people because it's not the conference I've published at most and much of the research I've done over the years hasn't been pure ML (or ML at all). 1/n

3

7

110

Jenn Wortman Vaughan

@jennwvaughan

4 years

A tip for postdoc/intern hiring season: If you're emailing someone about a position, dozens of others are too. To stand out, show that you've taken the time to understand the person/lab you're emailing. Explain why you're excited and how working together would benefit you both.

1

20

108

Jenn Wortman Vaughan

@jennwvaughan

4 years

As an American who's worked in the US in STEM my whole career, I can't think of a single colleague who's ever suggested we'd be better off without our students, mentors, and collaborators from around the world. It is their presence that makes our community vibrant and innovative.

1

107

Jenn Wortman Vaughan

@jennwvaughan

3 years

The past month I've aggressively said no to meetings and put that time into wrapping up lingering old projects. It has been everything I dreamed it could be. ❤️ After spending summer/fall in back-to-back calls broken up only by extra pandemic childcare, I can't do it anymore.

1

3

106

Jenn Wortman Vaughan

@jennwvaughan

9 months

Ok, people, it's happening! My sabbatical starts end of next week!!!!!! 🤯🍾🙌 I plan to be as close as possible to 100% away from work. As a first step, I'm starting my social media hiatus TODAY. See you all in a few months if this site still exists?? 👋

Jenn Wortman Vaughan

@jennwvaughan

1 year

I'm planning a 12-week sabbatical late summer/early fall and plan to disconnect from work as fully as possible. Sharing because 1) it makes me more likely to do it, and 2) taking so much time off is scary since I don't see examples of people doing it. Maybe I can be that example.

3

5

116

3

0

97

Jenn Wortman Vaughan

@jennwvaughan

4 years

@hannawallach @harmankkaur #3 Our CHI paper on "Co-Designing Checklists to Understand Organizational Challenges and Opportunities around Fairness in AI" Checklists: Putting AI ethics principles into practice or just checking the boxes? With @mmadaio , @luke_stark , @hannawallach

4

20

99

Jenn Wortman Vaughan

@jennwvaughan

3 years

Everyone on my street is cheering and honking horns and oh my god IT’S HAPPENING!!!!!! 🥂

3

0

96

Jenn Wortman Vaughan

@jennwvaughan

3 years

One of the things I've been most grateful for during the pandemic is having supportive colleagues who get that there's more to life than work, that people have responsibilities outside their jobs, and that number of hours worked is not a particularly useful measure of anything.

0

2

95

Jenn Wortman Vaughan

@jennwvaughan

6 years

Microsoft Research NYC is now hiring research interns for the spring! Interested in fairness in ML and have a background running human subject experiments or user studies? Come work with me and @hannawallach ! Tell your best PhD students to apply!

8

52

94

Jenn Wortman Vaughan

@jennwvaughan

5 years

So excited to finally be able to share a working draft of our paper on industry practitioners' needs around fairness in ML systems! Feedback welcome! We're prepping the final version for #CHI2019 . with @d19fe8 , @haldaume3 , Miro Dudik, and @hannawallach

Improving fairness in machine learning systems: What do industry...

The potential for machine learning (ML) systems to amplify social inequities and unfairness is receiving increasing popular and academic attention. A surge of recent work has focused on the...

arxiv.org

1

27

94

Jenn Wortman Vaughan

@jennwvaughan

3 years

I'm passionate about research and get excited over new ideas, but how good/bad I feel about work on a day-to-day basis is more connected to the quality of my interactions with colleagues. Are they kind? Are they listening to me? Do they value my opinions, even if they disagree?

1

93

Jenn Wortman Vaughan

@jennwvaughan

4 years

@hannawallach #2 Our CHI 2020 paper on "Interpreting Interpretability" Developing interpretability tools is not enough! Why user-centric evaluation of interpretability tools is necessary... With @harmankkaur , @hannawallach , and other awesome non-twitter people.

3

20

94

Jenn Wortman Vaughan

@jennwvaughan

4 years

Hey PhD students working at the intersection of AI and HCI! MSR is hiring multiple interns for this upcoming SPRING! Work with Saleema Amershi, @ecekamar , @besanushi , @hannawallach , myself, and other awesome people on human-AI interaction.

1

44

91

Jenn Wortman Vaughan

@jennwvaughan

4 years

It’s been a decade since I finished my PhD but I had a visceral reaction to this post. I have strong memories of how depressing the holidays were when I was in my late 20s and still a student. I wish I’d stopped comparing myself to others and enjoyed the end of the PhD more.

Jen Heemstra

@jenheemstra

4 years

Grad students, this time of year can mean extra intense comparison to friends or family your age who took jobs right out of college. Remember that their path is not your path. Stay focused on your long-term goals and the things that you are proud of having accomplished. #PhDchat

31

580

3K

4

7

91

Jenn Wortman Vaughan

@jennwvaughan

3 years

Assessing AI systems for performance disparities between groups is harder than it seems. In new work to appear at #AIES2021 , we dig into the choices that must be made when designing disaggregated evaluations, and the impact of these choices. Draft here:

2

15

90

Jenn Wortman Vaughan

@jennwvaughan

1 year

Yesterday, quite unexpectedly and without planning, I broke my half personal record by almost four minutes. At age 43. There may have been some tears at the finish line. When I think of Central Park I'll think of this. 🏃‍♀️ (Six months til @nycmarathon !) #womenruntheworld @nyrr

4

0

91

Jenn Wortman Vaughan

@jennwvaughan

4 years

Ok, so this is full-on shameless self promotion, but I love the way that this blog post tells the story behind the work that @hannawallach and I have been doing with our FATE/Aether colleagues for the past few years. It makes me feel energized all over again!

Microsoft Research

@MSFTResearch

4 years

For @jennwvaughan and @hannawallach , responsible AI means putting people first. In two #CHI2020 papers, they and their co-authors aim to support developers with a fairness checklist and study of the use and perception of interpretability tools: #MSBuild

7

162

1K

0

7

92

Jenn Wortman Vaughan

@jennwvaughan

3 years

I don’t know the details of this story, but I know @timnitGebru has always been a force of nature driving change in the ML community and in responsible AI practice. I'm grateful for her research contributions, community leadership, and tireless efforts to do the right thing.

@[email protected] on Mastodon

@timnitGebru

3 years

I was fired by @JeffDean for my email to Brain women and Allies. My corp account has been cutoff. So I've been immediately fired :-)

392

1K

7K

0

4

91

Jenn Wortman Vaughan

@jennwvaughan

4 years

The FATE group at MSR-NYC still has a couple summer intern openings for PhD students with an interest in responsible AI and experience with semi-structured interviews, co-design, and HCI methods generally. Interested? Email me and @hannawallach with your research background!

3

38

89

Jenn Wortman Vaughan

@jennwvaughan

2 years

Impulse-purchased in a rare moment of optimism in anticipation of tomorrow’s pop-up COVID vaccination clinic at the kids’ school.

5

0

90

Jenn Wortman Vaughan

@jennwvaughan

6 months

Well! That was one of the most exhilarating, inspiring, and truly magical days of my life. Nobody puts on a party like NYC. ❤️ Grateful to everyone who made this experience possible — particularly the throngs of strangers screaming my name miles 24–25 in Central Park. 🏃‍♀️🏃‍♂️🎉🙌

3

1

90

Jenn Wortman Vaughan

@jennwvaughan

3 years

Thanks for the support. My husband's fever lingered 4–5 days, but that and other symptoms have now faded. I can't imagine how terrifying this all would be if he were unvaccinated. Kids and I tested negative again yesterday. Too soon to declare victory, but for now we're ok.

Jenn Wortman Vaughan

@jennwvaughan

3 years

My fully-vaccinated husband came down with a fever on Friday. On Saturday he tested positive for COVID. The past few days he's had headaches, muscle aches, fatigue, appetite loss, a cough... the whole gamut of COVID symptoms. But it could be worse. [1/n]

15

37

308

6

0

88

Jenn Wortman Vaughan

@jennwvaughan

4 years

I'd hoped conferences/seminars going remote would lead to more speaker variety since people (e.g., with kids) who can't travel much can give more talks online. Now I'm worried it will lead to less variety, since "rock stars" can be at multiple events at once. What are you seeing?

8

14

86

Jenn Wortman Vaughan

@jennwvaughan

4 years

My daughter's 2nd grade class devoted the first week of math to replacing fixed mindset thoughts with growth mindset statements. As a PhD in a mathematical field with a daughter with stubborn perfectionism LIKE MYSELF, I'd like to high-five whoever came up with this curriculum.

2

87

Jenn Wortman Vaughan

@jennwvaughan

4 years

People always ask me if I like Twitter and I always say no without thinking. This certainly used to be true. I don't like being bombarded with everyone's achievements, especially the rich-get-richer 37-under-37 popularity contests. I don't need a reminder I'm not popular. (1/4)

3

4

86

Jenn Wortman Vaughan

@jennwvaughan

4 years

Useful perspective for research. Novelty is overrated; refining, communicating, and validating ideas are underrated. Researcher evaluations in industry labs get at some of this—impact is often as/more important than publications. Would like to see more incentive for scholarship.

Daniel Lemire

@lemire

4 years

Research should not stop with the research paper

6

54

150

0

16

83

Jenn Wortman Vaughan

@jennwvaughan

2 years

Follow-up: @o_saja & others brought up that it can take more than vacation and focus time to recover. 💯 I'm not fully recovered now, and I've had other burnout periods that required major life changes (like leaving academia a decade ago). But I do think these things help...

2

1

84

Jenn Wortman Vaughan

@jennwvaughan

3 years

Second dose done! 💉💪🎉

0

82

Jenn Wortman Vaughan

@jennwvaughan

2 years

This week at #HCOMP2021 , @elmelis presents our paper "From Human Explanation to Model Interpretability: A Framework Based on Weight of Evidence" (w/ @harmankkaur , @haldaume3 , @hannawallach ). We wanted to develop explanations for ML predictions that are meaningful to humans. 1/n

1

13

83

Jenn Wortman Vaughan

@jennwvaughan

2 years

Hooray, hooray, the FATE group at @MSFTResearch NYC is hiring a postdoc! Come work with us!

Hal Daumé III

@haldaume3

2 years

🚨🚨🚨 The FATE group at @MSFTResearch NYC is hiring a postdoc whose work focuses on the societal implications of AI&ML! 📢📢📢 Does that sound like you? Come join us! Group: Job Ad: Happy to answer any questions you may have!

3

35

112

1

21

79

Jenn Wortman Vaughan

@jennwvaughan

4 years

Sad I won't be in Hawaii next week for #CHI2020 , but excited that the Fair & Responsible AI Workshop has moved online and the list of short papers looks phenomenal!

1

18

79

Jenn Wortman Vaughan

@jennwvaughan

3 years

I'm struggling to make sense of what is happening at Google. I keep thinking I must be missing some key piece of the story because it just doesn't add up. But I know that @timnitGebru and @mmitchell_ai will land on their feet and come out of this stronger. 2/2

2

5

80

Jenn Wortman Vaughan

@jennwvaughan

4 years

Anecdotally I've found women in tech say yes to too much service, partly to prove we're part of communities where it's hard to gain acceptance. After severe service burnout I'm stepping way back starting this month and it's amazing. I have so much more time. Why do we do this?

3

8

80

Jenn Wortman Vaughan

@jennwvaughan

1 year

Friends in the tech industry, this is such a tumultuous and dizzying time. There's momentum and pressure to charge ahead, but sometimes what you need is a few hours/days to step back and breathe. (I've been needing extra sleep just to process thoughts.) Hope you all are doing ok.

2

3

77

Jenn Wortman Vaughan

@jennwvaughan

3 years

One shot down, one to go! I can’t stop smiling today. 💉🎉🥂

3

1

77