cloud @cloud11665 Twitter profile

Pinned Tweet

cloud

@cloud11665

5 months

in 2024 i build

7

13

177

Last Seen Profiles

@tontowans

@BeckLabUBC

@stwmaniax

@wotop_

@Cara_shipper

@Blynich91

@CC_P_22

@ChrisCowlin

@Martin_davidb

@ThreeFiveSport1

@billybeefs

@RaideretteQT

@etherealalexiss

@DeettaN19119

@CookieRiverside

@OasiComics

@arisumaria_1021

@RentokilUK

@vikrams19734512

@NakiVand

@GrnRefugees

@FutbolInclusivo

@EvanKillinx

@tayl_rpaul

@BTrannoy

@projetar

@stw_pdg

@rich_soupbrands

@TheLilHBK

@Yuka_An

@JasonTheSpeaker

@Autism_Parents

@toyman_ace

@peru21noticias

@theniebraids

@stwmaniax

cloud

@cloud11665

5 months

wait is shazam really just a cosine similarity search over a big index of music scraped from the internet ?

73

130

4K

cloud

@cloud11665

3 months

the memes write themselves now. "everytime the gpu crashes - 1 minute meditation" - @realGeorgeHotz

37

146

2K

cloud

@cloud11665

1 month

"Chat with pdf", "chat with a codebase" Maybe it's time to chat with your family?

25

176

2K

cloud

@cloud11665

11 months

Tinygrad: 7x speed improvement for LLaMA in less than 10 lines of code? Yes, you’ve read that right. All by adding a single line that allows openMP to parallelize the global and local index loops in the clang backend. Before: After:

22

77

1K

cloud

@cloud11665

3 months

This is how SOTA papers get introduced in 2024

13

117

865

cloud

@cloud11665

5 months

@ropirito Just goes to show how filling a gap in a market matters

1

3

633

cloud

@cloud11665

2 months

gm

39

3

616

cloud

@cloud11665

4 months

no way this just happened

9

55

604

cloud

@cloud11665

2 months

“CPU gets hit with an interrupt and wakes up with a new thread in a completely different address space This is an isekai”

4

56

460

cloud

@cloud11665

6 months

It’s here! @francoisfleuret

7

12

277

cloud

@cloud11665

1 year

tinygrad day 15 (I think): PR merged, bounty claimed! LFG

17

5

273

cloud

@cloud11665

3 months

Yea she’s not Sam Altman

14

2

271

cloud

@cloud11665

4 months

going back to the trenches

6

1

258

cloud

@cloud11665

5 months

my life after @yacineMTB shared my blog post in june while I was at 150 followers and got me to 1000 in 2 days

8

4

229

cloud

@cloud11665

6 months

What are those prices lmao

26

5

206

cloud

@cloud11665

2 months

bravo 6 going dark

6

5

206

cloud

@cloud11665

30 days

WE ARE BACK BABY

35

2

201

cloud

@cloud11665

1 year

Tinygrad day 5: LLaMA now runs on the cuda backend! It's still very slow at 1100ms/token compared to 180ms on the opencl backend (I'm not even going to mention @ggerganov 's times, as they blow us out of the water)

2

9

175

cloud

@cloud11665

3 months

How to solve all KDE and Windows issues in a single step

11

4

166

cloud

@cloud11665

2 months

I'm proud to announce the beta release of Figura chat - an uncensored, privacy first AI companion platform running at lightning fast speeds. For more information on how to participate for free, join our discord using the link below

13

17

164

cloud

@cloud11665

4 months

Get VC money and spend like you’re bootstrapped. Why aren’t more people doing this ?

23

2

157

cloud

@cloud11665

29 days

"How should I initialize this c++ object?" my answer:

2

19

176

cloud

@cloud11665

2 months

Most people don't know it but the world is really, REALLY small. you can just talk to people

10

6

155

cloud

@cloud11665

5 months

@hyferg encoded and denoised waveforms I guess

2

1

151

cloud

@cloud11665

3 months

The legend himself @cametek #BPLS3

8

150

cloud

@cloud11665

1 year

Sad news everybody :( A couple of weeks ago I proposed an idea to replace 1GB vram chips with 2GB ones to achieve a 48gb 3090, today I have received news from a tinygrad community member that such configuration doesn’t even post.

10

5

146

cloud

@cloud11665

2 months

@PaulSkallas Not even a question in Japan

4

0

143

cloud

@cloud11665

24 days

Just got reminded of a cool old project of mine which was rendering realtime videos in the terminal with text in a decent quality. Not all of it got upstreamed to mpv tho, but I still have the patches somewhere in my archive

13

9

197

cloud

@cloud11665

11 months

Only in tinygrad: pretty kernel asm output in 10 lines of regex !

4

3

128

cloud

@cloud11665

1 year

@yacineMTB Everything comes down to the fact that memory (of any kind) is slower than compute

5

7

126

cloud

@cloud11665

5 months

do you ever just want to give up?

27

2

122

cloud

@cloud11665

26 days

Somebody asks me a CUDA question. *taps the sign* Consult THE book

5

9

145

cloud

@cloud11665

1 year

I, for one, welcome our robot overlords

1

14

119

cloud

@cloud11665

5 months

chatgpt has revolted against me in a very smart way. It's over...

9

1

115

cloud

@cloud11665

3 months

They even have a ChattoGPT-chan here

4

2

119

cloud

@cloud11665

2 months

You guys won’t believe what I’ve found

2

115

cloud

@cloud11665

3 months

I got exposed.

Air Katakana

@airkatakana

3 months

trying to meet up with a foreigner in japan, they unironically sent me this image and said “meet me here”

32

7

518

3

1

111

cloud

@cloud11665

3 months

it’s all coming together (a bit tight but i hope the temps will be okay)

16

0

111

cloud

@cloud11665

11 months

Link to the pr:

add openmp for clang backend by cloud11665 · Pull Request #1201 · tinygrad/tinygrad

I will post llama timing benchmarks soon.

github.com

1

3

109

cloud

@cloud11665

1 month

now (finally) with KVM !

12

3

105

cloud

@cloud11665

5 months

You may not be ready for this, but this is literally what we're building

4

3

98

cloud

@cloud11665

1 month

Aiobahnのコンサートで誰かが3DSで写真を撮っていたwwwwww #otoplanet @Aiobahn

1

12

101

cloud

@cloud11665

11 months

Llama-2-70B-GGML.

5

0

95

cloud

@cloud11665

3 months

I think this is a signal that we should buy more 4090s

4

0

96

cloud

@cloud11665

1 year

@yacineMTB @cto_junior tinygrad does tensor operations, these operations are lazy (executed only when the result is needed) there is a layer which operates on the OPs (custom tinygrad IR) and optimizes them (fusing, constant folding, etc.) then that IR gets executed by a backend 1/n

2

0

90

cloud

@cloud11665

2 months

Gm

10

1

91

cloud

@cloud11665

3 months

UPDATE: that poor top gpu is fighting for its life

cloud

@cloud11665

3 months

it’s all coming together (a bit tight but i hope the temps will be okay)

16

0

111

22

0

92

cloud

@cloud11665

1 month

Hello

8

0

93

cloud

@cloud11665

11 months

I love c++ ! (Fully working atomic blocks implemented in 15 lines of code)

5

1

84

cloud

@cloud11665

1 year

@cto_junior The doc site linked is a very good source, others I can recommend are the introduction to NVPTX () and also the ENCCS guide (). These are the ones I've read at least.

1

84

cloud

@cloud11665

3 months

okay, @Noctua_at industrial is all need. The top gpu is sitting at 80C under a 430W load

cloud

@cloud11665

3 months

UPDATE: that poor top gpu is fighting for its life

22

0

92

18

1

84

cloud

@cloud11665

2 months

Please, stop.

7

2

82

cloud

@cloud11665

11 months

@gf_256 If it was an ai startup, it’d be called “next gen, caching bi-device tensor allocator with first class debugging support”

0

81

cloud

@cloud11665

11 months

@__tinygrad__ Note: This is running the stock llama in fp16. oh and that's also 3x faster than pytorch cpu and >10x faster than numpy.

2

0

80

cloud

@cloud11665

5 months

@TuanMQ3 ofc I didn't mean searching by just the signal vector alone

0

1

80

cloud

@cloud11665

5 months

@mogustine @ropirito I mean I had a friend like that, "yo bro what song is that (music plays)" - personal shazam as a service

0

1

80

cloud

@cloud11665

2 months

I like how for anime people that have some audience on twitter, their profile picture becomes their brand. I'm kinda stuck with this akane one I guess

16

3

80

cloud

@cloud11665

1 year

tinygrad day (night) 6: cudacpu is now 5x faster, and 20 more tests pass ! No more segfaults, but I still have to do what I feared the most - fuzzing ptx assembly for bugs in the emulator...

5

1

77

cloud

@cloud11665

11 months

2**11 now, it went by so quick! A big thank you to everyone following me

cloud

@cloud11665

1 year

Passed 2**10 followers. Thank you all ! As for tinygrad updates, pycuda stopped working out of nowhere (moved to another server since) and there are still numerous edge cases in the assembler. so that's that

0

44

1

0

75

cloud

@cloud11665

29 days

That feeling of connection when you turn off your camera mid meeting to pop a zyn and you see your business partner do the same

2

77

cloud

@cloud11665

5 months

how do people keep pumping out tweet after tweet, hour after hour all day long?

23

1

70

cloud

@cloud11665

1 year

@yacineMTB @cto_junior my motto:

2

70

cloud

@cloud11665

5 months

you know shit's wild when you end up at the Chess Programming Wiki looking for an algorithm

2

0

68

cloud

@cloud11665

5 months

I won't be available for the rest of the day, entering CUDA mode.

1

68

cloud

@cloud11665

6 months

@yacineMTB $6.5/h for an A100. No way I'm going to break even with that. Compare that to @runpod_io

2

1

68

cloud

@cloud11665

2 months

I like how for anime people that have some audience on twitter, their profile picture becomes their brand. I'm kinda stuck with this konata one I guess

8

0

67

cloud

@cloud11665

2 months

im back

cloud

@cloud11665

2 months

bravo 6 going dark

6

5

206

1

2

66

cloud

@cloud11665

2 months

美味しい！！

2

0

66

cloud

@cloud11665

2 months

#NewProfilePic Okay guys pack it up the joke isn’t funny anymore

6

0

65

cloud

@cloud11665

1 year

@yacineMTB A 65B model lmao

4

1

61

cloud

@cloud11665

6 months

Is this what the YC pocket guide meant by "Founder relationships matter more than you think" ?

2

1

60

cloud

@cloud11665

3 months

Guess who just missed their flight to tokyo… Guess i’m stuck in finland for the day

3

0

60

cloud

@cloud11665

6 months

writing main code in c++ and calling into python scripts that have one function with arguments passed via shm, how cursed is that?

6

0

61

cloud

@cloud11665

1 year

Just received new drip from @zellic_io

1

3

61

cloud

@cloud11665

3 months

I've noticed that Twitter is all about traction. When you lose it, you need to keep rolling the dice to hope for a banger post that jumpstarts it. Kinda destructive but understandable, promotes being chronically online

6

1

62

cloud

@cloud11665

2 months

also can someone please unfuck tmux to make scrolling work and not just emit escape codes ?

5

1

59

cloud

@cloud11665

1 year

litteral steins;gate style commit from the future

3

57

cloud

@cloud11665

4 months

@gf_256 own the n00bz with a quick dlsym(dlopen(NULL, RTLD_NOW), __func__) haha

1

61

cloud

@cloud11665

6 months

It's embarrassing how slow even high end windows laptops are on battery compared to M{1,2,3} macbooks. My 13th gen i9 struggles with inference even on small models. Hell, even on usb-c power it's sluggish

6

0

57

cloud

@cloud11665

3 months

okay it's 3 times faster than my 13th gen i9 laptop, building our whole stack in 6.3 seconds while it was taking around 15 on my linux laptop

cloud

@cloud11665

3 months

How to solve all KDE and Windows issues in a single step

11

4

166

5

0

57

cloud

@cloud11665

5 months

@MaximePeabody I don't think it's going for exact matches as there are too many variables from the microphone differences alone to stuff like natural reverb, I'd bet it's "just" a kNN

1

0

57

cloud

@cloud11665

26 days

The boys are monitoring the (CO2) situation 👍

4

0

63

cloud

@cloud11665

6 months

Meeting some VCs tomorrow, how autistic of me would it be to ask them about their position on the acc vs decel spectrum?

5

0

55

cloud

@cloud11665

5 months

oh damn, this blew up. Anyways check out my startup

Figura

Figura is an AI companion service

figura.chat

cloud

@cloud11665

5 months

By anime pfps, for anime pfps. Together with @AnikiRip we're building the BEST AI companion platform available. If you're someone who's interested in digital companionship, we want to talk to you! Join the Discord (on the site) for launch updates.

1

2

29

1

54

cloud

@cloud11665

4 months

mf stole my meme

3

1

52

cloud

@cloud11665

1 month

@yacineMTB so... monero

0

53

cloud

@cloud11665

2 months

Just found this cool writeup from @ye_combinator "From Online Softmax to FlashAttention"

0

7

53

cloud

@cloud11665

2 months

„Don’t worry about it, honey”

3

0

51

cloud

@cloud11665

1 year

@gf_256 How long until stuff like this gets a CVE assigned to it?

0

51

cloud

@cloud11665

3 months

The early stage of the first server in our 3-server cluster is ready - balthazar, it's still little but will grow to a 7x4090 open air monster in some time, expect a blog post on fitting 2 air cooled 4090s in a standard sized case soon

9

0

51

cloud

@cloud11665

5 months

I went at like 5x pace in those 1.5h - unreal.

3

0

49

cloud

@cloud11665

11 months

tinygrad day ...20? Goodbye misaligned addresses and cudart errors, hello assembly_ptx ! One step closer to going even faster !

2

50

cloud

@cloud11665

1 year

Oh wow, forget fixing bugs. I just git stashed new changes and reimplemented them from scratch and it seems to be working. Unreal. I diffed the changes and it was a 0 vs 1 index issue that was causing some weird behavior with aligning stores and loads. I’m glad it’s over

5

0

51

cloud

@cloud11665

2 months

@yifever yea this, I dropped out and started a startup because of this guy

1

0

51

cloud

@cloud11665

1 year

@gf_256 I’d guess that firstly ret is not emitted due to the infinite loop, then the loop without side-effects is removed due to UB, and now we have main which is just an empty label without ret, so the next instruction is the one in unreachable()

2

0

50

cloud

@cloud11665

2 months