fraser @Fraser Twitter profile

Pinned Tweet

fraser

1 year

After leading product at OpenAI for two and a half years I’ve made the decision to move on. I’ll be telling the story of modern AI and investing in OpenAI alumni and other remarkable founders. More in the thread below and at:

About - Entropy

The story of modern AI and those building the future. Click to read Entropy, by Fraser, a Substack publication with thousands of subscribers.

www.moreentropy.com

38

80

1K

Last Seen Profiles

@and22LyL

@yossport1

@dunemovie

@KurehaKurono

@tamarachennai

@st9rdoll

@KellieGaymer

@mybabyhwd

@Pivarnicus

@DAMIADENUGA

@NFLFLAG

@KubaSnopek

@Rob14228677228

@lynn_carne

@billboardcharts

@ApplePodcasts

@MarcRatnerUFC

@Heisoans_

@USCCA

@bharing3

@FBINewark

@prodAbsono

@CodyBillings5

@baptisttexan

@tx_xmo

@FiveToolHI

@RealEDM__

@Marcus_cel

@rustyyy_92

@WowFactorNation

@HN_JAD

@H_T_V_

@Halyrab

@NCAFutures

@EntySec

@JayMinz

fraser

@Fraser

10 months

Our car window was smashed and my backpack stolen. Men rolled up in a car wearing ski masks and jumped out. Us and our four kids a few feet away. Laptop, phone, etc all gone. The city is suffering. This is not normal and we should demand better.

231

85

1K

fraser

@Fraser

1 year

text-davinci-003 ChatGPT Whisper v2 Busy week.

13

57

797

fraser

@Fraser

11 months

In March 2021 I contemplated leaving @OpenAI to start a company around the ideas that open source and open research were going to win. I decided it was too early but obviously that's no longer the case. Here was my thinking at the time. Who is building this? I Want to help them.

104

51

712

fraser

@Fraser

1 year

On the one hand, I feel for @ylecun and Meta/Google researchers. Not seeing your research released in usable products due to big tech bureaucratic bs would be hard to stomach. Yet what they have released has been so fumbled it suggests a profound ignorance about shipping product

21

41

649

fraser

@Fraser

1 year

@ylecun This wasn't meant to be controversial. I'm saying the same thing as LeCun: "It's nothing revolutionary, although that's the way it's perceived in the public," the computer scientist said. "It's just that, you know, it's well put together, it's nicely done."

29

61

602

fraser

@Fraser

2 years

Where do AI optimists hang out?

172

42

557

fraser

@Fraser

11 months

If you're an eng or researcher who wants to work on the forefront of AI, I want to help. I know everyone at @openai , Spark has invested in @AnthropicAI , @AdeptAILabs and others. I am an angel in @trychroma , @perplexity_ai , @dust4ai , @contextualai , etc. DM me

25

37

554

fraser

@Fraser

11 months

While building ChatGPT at @OpenAI I was repeatedly told by our internal teams that our corporate docs were the "Crown Jewels" of the business. I get it. Nobody trusts AI. That's why Spark is excited to support in building the security layer for AI

Credal | Build Secure AI apps with your data

Credal is a platform with workflow assistants, enterprise search, and AI chat. Gain security, access controls and compliance in one place.

www.credal.ai

10

40

343

fraser

@Fraser

3 years

The Financial Times wrote that "OpenAI ranks as one of the most unusual organizations on the planet". I’ve been here just over a year and I must agree! Here’s a thread.

4

41

309

fraser

@Fraser

7 months

I believe strongly that: 1) The best products that will emerge from this moment are “full stack”, with teams training their own models, and the models & UI informing one another. 2) This requires researchers who care deeply about what’s best for the product, including data

21

24

275

fraser

@Fraser

1 year

I joined Spark two weeks ago and wired my first investment today. I love entrepreneurship and technology. I love that a small team can ship and change the world. As a former founder, I’m excited to support founders building remarkable products

Kate Clark

@KateClarkTweets

1 year

Spark Capital hires OpenAI’s former head of product in AI push:

0

3

31

10

6

159

fraser

@Fraser

5 months

Working closely with @gdb was a joy. Talented, kind people want to work with him not only because he's one of the most talented technologists alive but because he helps great people deliver what they're capable of -- the opposite of creating a hostile work environment.

0

7

158

fraser

@Fraser

5 months

In the summer I heard from about ~500 people because of the note below and helped many of them. In the next few weeks, I'd like to connect with more engineers and researchers looking to work on the frontier of AI. If you are interested in @OpenAI @AnthropicAI @AdeptAILabs …

fraser

@Fraser

11 months

If you're an eng or researcher who wants to work on the forefront of AI, I want to help. I know everyone at @openai , Spark has invested in @AnthropicAI , @AdeptAILabs and others. I am an angel in @trychroma , @perplexity_ai , @dust4ai , @contextualai , etc. DM me

25

37

554

6

20

144

fraser

@Fraser

5 months

nothing but love for @sama and @gdb and all that they’ve built. they’ve changed the trajectory of the world for the better

1

2

130

fraser

@Fraser

1 year

Here are some of my thoughts on the future of AI, in response to the leaked google memo: The case for open ai tl;dr: there will be an oligopoly and a vibrant open ecosystem.

The case for open AI

The memo that leaked from Google (which is real) makes the case for an open future for AI. I have increasing conviction that aspects of this future will unfold but I disagree with the conclusion. I...

www.moreentropy.com

6

20

125

fraser

@Fraser

1 year

I just used ChatGPT to interpret ultrasound results for my son (all is well) and it felt utterly remarkable. It is hard to even comprehend how much better our lives are going to be because of AI.

4

6

121

fraser

@Fraser

6 days

Profluent has successfully edited human DNA with an AI designed gene editor. Remarkable for many reasons, particularly the future it points to: one where AI designs specifically what’s needed to cure diseases. Coverage from @nytimes below in thread.

5

16

125

fraser

@Fraser

11 months

@OpenAI I did not foresee that the champions of this movement would be Facebook. Rather wild! But we can thank @GuillaumeLample , @ylecun , and others

7

2

117

fraser

@Fraser

10 months

Appreciate the kind words. We are all OK. Kids range from confused to shaken. I’m troubled that I have become so desensitized to the ills of the city that my immediate response was a resigned sigh at the nuisance this was going to create for us.

7

3

118

fraser

@Fraser

2 years

But we’re at the earliest stages of a technology wave that will make the world dramatically better, in countless ways

7

6

111

fraser

@Fraser

1 year

Congratulations to all of my friends at OpenAI! Many chapters will be written in the years ahead about the ingenuity that went into building GPT-4. They won't say it, but I can: this is a truly remarkable accomplishment by a team unlike any other in the world.

1

2

108

fraser

@Fraser

1 month

Proud to share that Spark Capital is leading a $35m round in Profluent. We’ve seen what happens when the scaling hypothesis is applied to language and are excited for a future where AI makes biology programmable.

4

8

105

fraser

@Fraser

1 year

We’re now entering the era of AI-first products and the world is changing in beautiful ways. I’ll be exploring this change with something new, telling the story of modern ai, and investing in OpenAI alumni and other remarkable founders. Follow along

About - Entropy

The story of modern AI and those building the future. Click to read Entropy, by Fraser, a Substack publication with thousands of subscribers.

www.moreentropy.com

9

4

108

fraser

@Fraser

4 years

Yesterday was my last day at @airbnb , which marks the end of the six year Koko story, from startup through sale. On Monday I start at @openai and am excited beyond belief about this next adventure.

19

2

104

fraser

@Fraser

11 months

This is such a stunningly good post: AI systems focused on specific high-value use-cases are already emerging

6

12

102

fraser

@Fraser

1 year

@ylecun “It’s just… well put together,” is doing a lot of work in that sentence 😉

4

0

91

fraser

@Fraser

2 years

And I’d like to be closer to people who share this view and who are building to this

7

0

85

fraser

@Fraser

2 years

"A badass sheep wearing a lab coat in a science lab, 1980s Miami vibe, digital art"

4

7

85

fraser

@Fraser

7 months

Awe inspiring magic.

5

7

77

fraser

@Fraser

2 months

New funds, same love for founders and those who build.

Spark Capital

@sparkcapital

2 months

The Spark Capital team is thrilled to share that we have raised $2.3 billion in aggregate commitments for our new early-stage and venture-growth funds: Spark Capital VIII & Spark Growth V.

13

8

185

9

0

67

fraser

@Fraser

1 year

2022 was especially sweet for me. From leading the DALLE product release to building and leading the team that launched ChatGPT — all while relocating a family of 6 to the Bay Area — it was a fun year (albeit busy).

1

69

fraser

@Fraser

2 years

Maybe it’s because I came into AI accidentally, using it to help scale a product that supported people at risk of self harm and suicide, and later applied it to help Airbnb provide safer experiences for their hosts and guests

2

1

62

fraser

@Fraser

4 months

What a fabulous year. Thank you to everyone at @sparkcapital and the many friends at @OpenAI who helped make this possible. And thank you to the many founders I’ve gotten to know and get to work with.

3

1

55

fraser

@Fraser

11 months

@dece @stevesi @sama The challenge in the proposal is defining a compute threshold. Every time one has been set in recent years based on “danger” we’ve quickly learned the risks were ~zero. GPT-2 was deemed too dangerous to release. Evidence to date suggests a lack of credibility in forecasting risk

4

5

56

fraser

@Fraser

1 year

The best way to understand is to build. To tinker. To push up against the fringes of a new technology. Come build with me and others at Spark:

5

6

55

fraser

@Fraser

1 year

In summer 2020 many couldn’t appreciate why I’d join a research lab. After selling our AI startup to Airbnb in 2018 I realized that the AI world had changed because of the transformer and that soon AI would change the world.

2

3

54

fraser

@Fraser

4 months

@finbarrtimbers Stakeholders gotta stake hold. And that’s the real super alignment effort of our time

1

55

fraser

@Fraser

6 months

Congrats to all my friends at @openai - what a day! Clearly so much grinding to make it happen

3

0

48

fraser

@Fraser

2 years

We're introducing DALL-E 2 today, AI that generates images from text. It's delightful, fun, and feels completely magical.

Fraser × DALL·E 2 | Vibrant portrait painting of Salvador Dalí with a robotic half face

Created with DALL·E, an AI system by OpenAI

labs.openai.com

3

47

fraser

@Fraser

3 years

In January, we introduced DALL-E, AI that generates images from text, and one of the most delightful pieces of technology I’ve ever used.

OpenAI debuts DALL-E for generating images from text

OpenAI today introduced DALL-E for generating images from text, and CLIP, a network trained on 400 million pairs of images and text.

venturebeat.com

1

5

44

fraser

@Fraser

1 year

It’s been enjoyable to help the world’s most ambitious research lab embrace product development. When I wrote the first product roadmap for OpenAI a lot of discussion focused on answering why product was important. The culture has come a long way!

1

2

42

fraser

@Fraser

9 months

When people are comfortable saying on popular AI podcasts that they’d much rather people go on a shooting spree than to pursue an open source strategy for AI, it’s clear the real AI risk is violence from cult-like groups and their disciples. Troubling, to say the least.

2

30

fraser

@Fraser

5 months

Set up a Lindy that gets cc'd, looks at my schedule, and replies with times to meet. Once confirmed, the Lindy delegates creating the calendar event to another Lindy, which informs the original Lindy once done so it can reply to the thread. Magic from @Altimor and team.

2

1

40

fraser

@Fraser

3 years

If you love building products with exceptionally talented and compassionate teammates, come shape the future of AI. We're hiring on the product team for curious, determined, and kind individuals:

2

40

fraser

@Fraser

3 years

Just over a year ago, we released GPT3. The MIT Technology Review named it one of the 10 Breakthrough Technologies of 2021 (alongside mRNA vaccine, no less)

1

0

39

fraser

@Fraser

1 year

I believed that with their talent and ambition OpenAI was the group most likely to shepherd in this change. It’s been an honour supporting the researchers and engineers who have done exactly that. They are the best at what they do.

2

0

36

fraser

@Fraser

9 months

Few things in tech over the past decade have been more inspiring than what's happening in the open ecosystem around AI. I'm thrilled that @sparkcapital is supporting @csahil28 as he works to democratize AI via @GlaiveAI

Glaive - Enabling an Open Ecosystem for AI | Notion

Delivering a great product experience is a complex orchestration and optimization problem. This is especially true with AI-enabled products, where teams have to balance needs across different axes of...

spark-capital.notion.site

2

5

34

fraser

@Fraser

3 years

Earlier this month @github released Copilot, the first product powered by OpenAI Codex, which is coming to our API later this summer. Instagram’s cofounder calls Copilot “the single most mind-blowing application of ML I’ve ever seen.”

1

33

fraser

@Fraser

3 years

We also introduced CLIP, a state-of-the-art image classifying AI. An “AI-generated art scene has exploded as hackers have been modifying an OpenAI model to make astonishing image-generation tools.”

AI Generated Art Scene Explodes as Hackers Create Groundbreaking New Tools CLIP+VQ-GAN

New AI tools CLIP+VQ-GAN can create impressive works of art based on just a few words of input.

www.vice.com

2

4

31

fraser

@Fraser

1 month

This was a lovely discussion. @nabeel and I talk through when a model has differentiated value and when it becomes a commodity.

3

1

27

fraser

@Fraser

1 year

@amasad This is why maintaining and prioritizing against a detailed backlog is a mistake as it creates a false sense of progress and distracts from larger efforts to find pmf

2

25

fraser

@Fraser

5 months

@sama you are a hero of mine. thank you for everything so far and for all that will come next.

0

26

fraser

@Fraser

2 years

This was a remarkable effort from a remarkable team. @joannejang led this from the product side, one of her first projects since joining a few months ago. If you are determined, curious, and kind -- and want to ship product this ambitious -- join us. fraser @openai .com

0

4

25

fraser

@Fraser

10 months

For Canadians in California the July 1st - July 4th combo is always sweet, especially so when Canada Day falls on a Saturday!

1

0

15

fraser

@Fraser

3 months

Last week @nabeel and I chatted about how AI may change software development. I'm particularly interested in AI-enabled tools for software engineers (it feels akin to the electrification of scientific tools). More info in the thread below

1

0

24

fraser

@Fraser

1 year

Testing by✨vibes✨ and controlling the product experience

Testing by Vibes & Control Over the UX

Entropy #1

www.moreentropy.com

1

5

23

fraser

@Fraser

3 months

At devday, @OpenAI shared ChatGPT has 100M weekly active users. Even if a healthy percentage are on the paid plan, this means a very large number of people get meaningful value from GPT-3.5. It's worth sitting with this for a bit.

0

2

22

fraser

@Fraser

1 year

"Directly Competing With Open Source Is a Losing Proposition" purported leaked memo from Google

Google "We Have No Moat, And Neither Does OpenAI"

Leaked Internal Google Document Claims Open Source AI Will Outcompete Google and OpenAI

www.semianalysis.com

4

3

22

fraser

@Fraser

11 months

@Carlos_A_Wong @OpenAI @huggingface Their focus on the researcher as the user will preclude them from delivering on this, though they're obviously building part of the ecosystem that will enable it. I think the closest today is @bfirsh / @replicatehq and @NaveenGRao / @MosaicML

2

3

23

fraser

@Fraser

1 year

@fchollet I agree! Would value your thoughts on this:

Novelty vs utility, science vs belief, and where we are with AI-first products

Entropy #3

www.moreentropy.com

3

0

22

fraser

@Fraser

1 year

One year ago today the technique to have GPT follow instructions was released, which went on to enable ChatGPT, and which will enable many startups to create differentiated product experiences

2

3

22

fraser

@Fraser

10 months

@oFFMetaSweat No, white Lexus

2

1

22

fraser

@Fraser

1 year

"No gpu before pmf" - @spolu

3

20

fraser

@Fraser

11 months

:heart-eyes:

4

0

20

fraser

@Fraser

11 months

@OpenAI @ravin_tham and jack are the ideal founders to solve this problem. They worked together at Palantir for many years, deploying AI into enterprises where data security was critical. The future of work tools may be smart but they also have to be safe. Protect the jewels!

4

2

19

fraser

@Fraser

11 months

This research by @IreneSolaiman and @cbd was so surprising that in response I wrote a memo arguing that OpenAI should become the best in the world at human data annotation. Their work was foundational for a lot of what's to come with OSS

Improving language model behavior by training on a curated dataset

Our latest research finds we can improve language model behavior with respect to specific behavioral values by fine-tuning on a small, curated dataset.

openai.com

Yann LeCun

@ylecun

11 months

LIMA : LLaMA 65B + 1000 supervised samples = {GPT4, Bard} level performance. From @MetaAI

88

459

3K

1

2

19

fraser

@Fraser

11 months

RIP my inbox😅I'm working through every message. If you reach out, include your LinkedIn profile please.

1

0

20

fraser

@Fraser

1 year

@BigTechAlert @elonmusk @tszzl Started from the bottom

1

0

20

fraser

@Fraser

3 years

We’ve shipped a tonne of ambitious product beyond these major releases - a fine-tuning product, specialized endpoints, the Instruct Series of models, and much, much more. And we’ve done this all with a small, collegial team.

1

18

fraser

@Fraser

1 year

Something else mentioned by @amasad , which I didn’t discuss: @Replit maintains a high shipping velocity by _shunning_ process. The common response to a broken process is to add more process, and people to manage the process. But the optimal thing is usually to remove process.

1

2

16

fraser

@Fraser

9 months

2

0

11

fraser

@Fraser

4 years

“Everything around you that you call life was made up by people that were no smarter than you and you can change it, you can influence it, you can build your own things that other people can use. Once you learn that, you'll never be the same again. " - Steve Jobs

1

4

17

fraser

@Fraser

1 year

"We weren't at neurips last week" Product motivated researchers are an under appreciated reason for why what's happening is happening within AI

1

0

16

fraser

@Fraser

1 year

An organization is in trouble the moment it prioritizes doing things right ahead of doing the right things

Dare Obasanjo🐀

@Carnage4Life

1 year

“Google has 175,000+ capable and well-compensated employees who get very little done quarter over quarter, year over year. Like mice, they are trapped in a maze of approvals, launch processes, legal reviews, performance reviews, exec reviews,… and reorgs”

53

228

2K

0

4

16

fraser

@Fraser

11 months

@tszzl Too dangerous to release the weights, even in the horcrux-like fashion you describe here

1

0

16

fraser

@Fraser

5 months

It was a lot of fun to share stories about the months leading up to the chatgpt release with @nabeel

Hallway Chat | Launch stories of ChatGPT

Nabeel gets to ask Fraser for reflections on the development of ChatGPT on the one-year anniversary. They talk about the intersection of product managers and AI researchers, how ChatGPT came to be ...

hallwaychat.co

1

0

12

fraser

@Fraser

1 year

Bill Gates on the age of AI: "The development of AI is as fundamental as the creation of the microprocessor, the personal computer, the Internet, and the mobile phone. It will change the way people work, learn, travel, get health care, and communicate with each other."

1

15

fraser

@Fraser

1 year

Too much talent across the world, too much entrepreneurial energy emanating from researchers, too much wonder to explore... for a future like this not to take shape

The case for open AI

The memo that leaked from Google (which is real) makes the case for an open future for AI. I have increasing conviction that aspects of this future will unfold but I disagree with the conclusion. I...

www.moreentropy.com

Andy Weissman

@aweissman

1 year

"The likely future" by @Fraser

2

0

31

0

15

fraser

@Fraser

1 year

"In a moment when all these large language models are converging to become roughly functionally equivalent, no one is going to win the game on technology alone. AI is moving from a science problem to a product... problem"

5

0

14

fraser

@Fraser

1 year

Novelty vs utility, science vs belief, and where we are with AI-first products

Entropy #3

www.moreentropy.com

0

1

14

fraser

@Fraser

11 months

@NaveenGRao @OpenAI Yep. And I would like to help! I do believe that the diff between "building this" and "building a lot of this" is itself a meaningful company, alongside yours.

1

0

14

fraser

@Fraser

4 months

@OfficialLoganK @npew @jiangelaa @AndrewMayne @sherwinwu @OpenAI It’s been amazing to see all that you’ve done. The developer community, and all of OpenAI, is fortunate to have you in the role!

0

12

fraser

@Fraser

9 months

@amasad it's disingenuous and so intellectually dishonest that it's grotesque

0

1

11

fraser

@Fraser

2 years

Developers are among the most creative artists of our time. I’m excited to see what they build with our API.

OpenAI

@OpenAI

2 years

We introduced new safeguards to our API that make it possible to remove the waitlist. Now developers can sign up and explore GPT-3 right away.

61

597

2K

1

2

12

fraser

@Fraser

1 year

"no moat"

1

0

12

fraser

@Fraser

9 months

As part of today's announcement, @GlaiveAI is releasing an open source model that has the same function calling capabilities of OpenAI’s GPT-4 and GPT-3.5 but is small enough to run on mobile devices:

1

3

12

fraser

@Fraser

10 months

@Flomerboy Kids range from confused to shaken. Sorry that you also had to experience this. Appreciate the kind words

0

12

fraser

@Fraser

4 months

@rememberlenny @OpenAI Legend. What a fantastic run. Excited for all that you’ll do next

0

9

fraser

@Fraser

7 months

@AravSrinivas @_vztu We are moving from having to cherry pick what worked to cherry picking what doesn’t

0

10

fraser

@Fraser

1 month

Welcome @thisismadani and the talented team at Profluent!

Welcome, Profluent

Give modern AI models a tremendous amount of content and compute and they learn the blueprint of language. By seeing words create sentences, sentences form essays, these models learn to create…

medium.com

1

11

fraser

@Fraser

7 months

0

10

fraser

@Fraser

9 months

We're investing alongside @amasad , @pirroh , and @villageglobal and are excited to accelerate the open ecosystem around AI and the builders who are pushing on the frontier.

2

0

10

fraser

@Fraser

2 years

You can fine-tune GPT-3 with a single command and use it immediately in our API (with simple, pay-as-you-go pricing). We tackled an unbelievable amount of complexity to make this simple for everyone. The results are amazing.

OpenAI

@OpenAI

2 years

Developers can now create a custom version of GPT-3 for their applications with a single command. Fine-tuning GPT-3 on your data improves performance for many use cases. See results👇

24

237

1K

0

9

fraser

@Fraser

2 years

Maybe the optimism sits at the application layer, with founders, tinkerers, and hobbyists?

Stanislas Polu

@spolu

2 years

Looking at the replies to that tweet, one thing is clear. This is only the beginning. This is 2008 of the iPhone, I was there, I was even interning at Apple at the time. It was cool but no one had any clue how big it would get.

0

5

38

2

0

8

fraser

@Fraser

1 year

20 years late, but wow eboys is phenomenal. Ridiculous access.

eBoys: The First Inside Account of Venture Capitalists at Work

In eBOYS, Randall Stross takes us behind the scenes and inside the heads of the gutsy entrepreneurs who are financing the hottest businesses on the Web. The six tall men who started Benchmark,...

www.amazon.com

1

0

7

fraser

@Fraser

2 years

When good people do good things: ( And a great next chapter in the wonderful — and wonderfully unpredictable — story of @koko ) Lifelong love for @RobertRMorris and @kareemk

0

1

8

fraser

@Fraser

11 months

@BigTechAlert @JeffBezos @amazon @blueorigin @tszzl Started at the powerbottomdad

0

7

fraser

@Fraser

2 years

“It’s just a wrapper for gpt3” Tell me you’ve never built a product without telling me you’ve never built a product

1

0

8