Alex Mordvintsev @zzznah Twitter profile

Pinned Tweet

Alex Mordvintsev

10 months

New article: "Isotropic Neural Cellular Automata", a review of our previous work on making NCAs rotation and reflection equivariant @RandazzoEttore @eyvindn @cwpfautz

10

79

339

Last Seen Profiles

@berserkerh3aler

@maxg_official

@Gshock99

@Ivy_Cangaro

@MDBiz

@Falkon_Hawk88

@bidoiajessicaa

@Jessica26776027

@Tecit0_

@Driver5868

@EMPRBoomin

@ThabisoNon

@CIANE_hosikuzu

@suitupministry

@hebnnn

@bournemouthuni

@SCCgov

@leothecream

@saaddousari

@gokuiru

@jiaochun8

@AbdurH78937

@sandiego1611

@LTUWLacrosse

@DSraiderlax

@jung2neko

@gaa_pam

@AirbusCareers

@Zac_wilson55

@pendle_fi

@SyMbini

@TexasRugbyUnion

@MyakuY

@turiyaaa

@KilHer_Instinct

@sendanayu

Alex Mordvintsev

@zzznah

11 months

New "DotCamera" demo shows how to feed a video camera stream into #swissgl and drive some particles in 70 lines!

39

633

5K

Alex Mordvintsev

@zzznah

6 years

My submissions for #nips4creativity are here

31

638

2K

Alex Mordvintsev

@zzznah

3 years

"Calligraphy of Chaos", trying to predict the future of a stochastic chaotic system

17

279

2K

Alex Mordvintsev

@zzznah

5 years

Sinkhorn iteration for Optimal Transport with TF. Code:

12

237

1K

Alex Mordvintsev

@zzznah

4 years

Self-repairing Mondrian

6

186

1K

Alex Mordvintsev

@zzznah

3 years

Exploring the relation between parts and the whole. Neural CA, WebGL, 2020

35

227

1K

Alex Mordvintsev

@zzznah

3 years

what it feels like / what it actually is?

21

142

911

Alex Mordvintsev

@zzznah

3 years

I may have heard and read about immune system 1000s times, but seeing it in action is totally different experience

Slava Bobrov

@slava__bobrov

3 years

Our white blood cells attacking a parasite:

16

186

774

10

115

924

Alex Mordvintsev

@zzznah

5 years

I'm trying to make a visual explanation of DeepDream process for a wide audience. Also learning svg+d3 animations. WDYT?

15

149

858

Alex Mordvintsev

@zzznah

6 years

10

134

776

Alex Mordvintsev

@zzznah

2 years

New tutorial! "Differentiable Finite State Machines" - using JAX and gradient descent to learn discrete state machines from input-output string pairs

12

124

756

Alex Mordvintsev

@zzznah

5 years

Goodbye SVG diagrams... Hello WebGL, my old friend.

14

132

734

Alex Mordvintsev

@zzznah

5 years

7

101

718

Alex Mordvintsev

@zzznah

7 months

my language model is not like yours

19

74

657

Alex Mordvintsev

@zzznah

4 years

Our article on Growing Neural Cellular Automata is LIVE!!! Thanks @RandazzoEttore @eyvindn @drmichaellevin @blaiseaguera @ch402 and many others!

Growing Neural Cellular Automata

Training an end-to-end differentiable, self-organising cellular automata model of morphogenesis, able to both grow and regenerate specific patterns.

distill.pub

30

199

645

Alex Mordvintsev

@zzznah

4 years

My paint brush is alive

9

72

632

Alex Mordvintsev

@zzznah

5 months

No, I will not think about using RegEx to convert JS into WebGPU WGSL shaders. No, I will not try to write such RegExp. No, I will never use this method to write an actual shader. Oh no, what I've done. #webgpu #wgsl #js

17

53

626

Alex Mordvintsev

@zzznah

2 years

New tutorial: "Simple 3D visualization with JAX raycasting". 3D rendering with nothing but ~100 lines of JAX code

6

95

624

Alex Mordvintsev

@zzznah

5 years

This type of AI art is the favourite to explore for me and my wife. (1/5)

13

89

616

Alex Mordvintsev

@zzznah

2 years

accident

16

40

542

Alex Mordvintsev

@zzznah

6 years

Optimizer finding its way through the parameter space

8

126

542

Alex Mordvintsev

@zzznah

4 years

10

76

521

Alex Mordvintsev

@zzznah

2 years

a reminder that 'reshape', 'transpose' and many other functions in np, tf, jax and torch are obsolete and should be deprecated

23

52

509

Alex Mordvintsev

@zzznah

1 year

Over the last few weeks I was working on SwissGL, tiny JS graphics library with a single function that does everything. Demos: Code:

14

88

506

Alex Mordvintsev

@zzznah

3 years

New Neural CA article "Self-Organising Textures" is live on @distillpub !!! From @eyvindn , @drmichaellevin , @RandazzoEttore and me. Remember Hexells and all those living textures I've been posting lately? That's how we do it, and you can now too!

Self-Organising Textures

Neural Cellular Automata learn to generate textures, exhibiting surprising properties.

distill.pub

9

111

501

Alex Mordvintsev

@zzznah

1 year

Pleased to share our new work: “Particle Lenia and the energy-based formulation” by @eyvindn @RandazzoEttore and me! (thread ⬇️ )

Particle Lenia and the energy-based formulation

Simple particle-based artificial life-form

google-research.github.io

5

118

466

Alex Mordvintsev

@zzznah

1 year

WebGL2 State diagram is awesome as (1) WebGL/OpenGL reference, (2) showcase how overcomplicated graphics APIs are

3

74

458

Alex Mordvintsev

@zzznah

1 year

Added particle fields visualization, two particles interact when their fields overlap.

8

54

425

Alex Mordvintsev

@zzznah

3 years

Trying to explain AD modes

5

65

429

Alex Mordvintsev

@zzznah

4 years

The most interesting things happen outside of the training conditions.

6

49

423

Alex Mordvintsev

@zzznah

6 years

Normalizing Flow bending the space. Thank you for the great tutorial and notebooks, @ericjang11

5

85

418

Alex Mordvintsev

@zzznah

4 years

3

60

389

Alex Mordvintsev

@zzznah

1 year

Particle Life, reimplemented using WebGL. Inspired by @tom_mohr_ 's cool work ()

2

44

392

Alex Mordvintsev

@zzznah

2 years

What I've done? Row-column sorted pairwise distance matrix as a rotation-reflection invariant point cloud description. Using optimisation to reconstruct shape from matrix. Is this a well known thing? (code below) @gabrielpeyre

7

53

393

Alex Mordvintsev

@zzznah

1 year

🐸

8

37

383

Alex Mordvintsev

@zzznah

6 years

This is what style optimization looks like in 3d mesh

5

65

377

Alex Mordvintsev

@zzznah

5 years

4

55

368

Alex Mordvintsev

@zzznah

2 years

OMG, the whole city, rendering, shadows, ambient occlusion... 274 chars!!!

yonatan

@zozuar

2 years

float i,e,a,l,y;vec3 p,q,d=vec3((FC.xy-.5*r)/r.y,-1);for(d.xz*=rotate2D(t*.2);i++<2e2;e=max(min(++y,-e),y-3.)){i>1e2?l=log(e+=1e-4)/1e2,d/=d,o:o+=exp(-e*1e3)/2e2;p=q+=d*e*.7;p++;y=p.y;for(a=3.;a>.04;a*=.6)p.xz*=rotate2D(5.),p=abs(p)-a,e=min(e,max(p.x,(max(p.y,p.z))));}o+=l;

89

1K

8K

5

42

352

Alex Mordvintsev

@zzznah

3 years

Haeckel

8

41

339

Alex Mordvintsev

@zzznah

4 years

I often complain about NumPy-ish frameworks (TF, jax, torch) being inefficient for anything less conventional. Here is a benchmark of today, 10k iters of Physarum: TF - 11.9 s, Taichi - 240ms. Taichi is 40-50x times faster and the code is more readable.

9

29

333

Alex Mordvintsev

@zzznah

8 months

Started working on mipmap support in SwissGL, which allowed to greatly simplify the DotCamera demo. So, I decided to fix the camera aspect and add the "dayMode" (available under the gear button)

4

48

330

Alex Mordvintsev

@zzznah

3 years

Much cleaner, isn't it?

6

40

327

Alex Mordvintsev

@zzznah

2 years

Isn't it strange that, despite decades of work in generative models, denoising diffusion was developed so recently?

9

24

318

Alex Mordvintsev

@zzznah

3 years

Last week I gave a lecture on differentiable programming for which I implemented a toy version of TF/PyTorch on top of NumPy. It took ~150 loc and was a very fun exercise. I think I'll call it TensorToy. Anyone's interested?

24

7

303

Alex Mordvintsev

@zzznah

4 years

Imagine a group of agents on a plane, arranged in a shape of a digit. Can they figure out what digit they make by talking to their neighbors only? Check out our new paper from the Differentiable Self-Organisation series!

Ettore Randazzo

@RandazzoEttore

4 years

Our second Distill article: Self-classifying MNSIT digits is out! w/ @zzznah @eyvindn @drmichaellevin @samgreydanus @distillpub This time, our beloved Neural CA learn to self-classify the digit they compose! 1/N

4

107

363

2

62

304

Alex Mordvintsev

@zzznah

8 months

SwissGL Demo: Particle Lenia with alien SOUNDS! Audio is fully rendered on GPU with GLSL shaders and streamed to WebAudio thanks to the new async GPU->CPU read feature. LIVE DEMO: Press "toggleAudio" in settings for sound 4K YouTube version:…

6

57

296

Alex Mordvintsev

@zzznah

3 years

"Controlling Neural CA with noise" -- new tutorial where I'm trying to document the exploration precess (idea -> experiment -> early results). I'd really appreciate your feedback!

14

58

297

Alex Mordvintsev

@zzznah

1 year

The main reason I love graphics programming is because it allows to show pictures I have in my head to everyone (). Particle Lenia fields: U (heightmap), G (color)

5

22

290

Alex Mordvintsev

@zzznah

4 years

I've posted my first "life-coding" tutorial () that shows how to implement a simple model of 2d vector alignment on a grid! Looking forward to your feedback! (Neural CA tutorials will follow later)

6

42

283

Alex Mordvintsev

@zzznah

5 years

Neverending Story music video for our friends from St.Petersburg! Music by PCP, see youtube for the full video and credits

2

64

282

Alex Mordvintsev

@zzznah

5 years

I don't always do 3d tsne in colab, but when I do, I prefer VR.

7

52

278

Alex Mordvintsev

@zzznah

3 years

My toy implementation of the "Implicit Geometric Regularization for Learning Shapes" by Amos Gropp et al. Fitting SDF to a set of points WITHOUT normals by implicitly solving Eikonal equation is MAGIC!

3

31

279

Alex Mordvintsev

@zzznah

1 year

Work in progress: real-time Particle Lenia with 16k points (4K video )

5

36

269

Alex Mordvintsev

@zzznah

3 years

The World is pushing The-State-of-The-Art, and I'm... dragging dots

8

20

267

Alex Mordvintsev

@zzznah

2 years

Wow, texture NCAs are also way cooler when they have a starting seed!

4

21

256

Alex Mordvintsev

@zzznah

3 years

DeepMind have solved protein folding, and I'm just sitting here preparing some tutorial materials on backprop

6

9

256

Alex Mordvintsev

@zzznah

5 years

This summer I spent quite a few evenings working on a zooming effect for a music video by @bssmusic . Glad it's finally live!

8

35

253

Alex Mordvintsev

@zzznah

1 year

Tiny thing that felt missing: touch in the ParticleLife demo

3

29

254

Alex Mordvintsev

@zzznah

3 years

Digital collectables are all the rage now. What about collecting GitHub repos? Look at this beauty I've made, you may own it one day, with GitHub-redirect based authenticity proof! No blockchain involved ;) Digital ownership becomes digital responsibility!

11

27

247

Alex Mordvintsev

@zzznah

3 years

I see a lot of developments in Optimal Transport these days. What about Optimal Transport Paths, assuming that moving things together is cheaper? The most comprehensive page I've found is 10-20 years old! @gabrielpeyre

Nicolas Keriven

@n_keriven

3 years

OT with Sinkhorn's algo in an epsilon-random graph wrt shortest path distance poke @gabrielpeyre

4

51

455

5

47

245

Alex Mordvintsev

@zzznah

2 years

Happy New Year!!!

8

19

244

Alex Mordvintsev

@zzznah

3 years

Back to the basics

4

8

240

Alex Mordvintsev

@zzznah

3 years

Wow! FPGA-controlled speakers support and move a particle with standing acoustic waves 🤯

Jure S. Menart

@JureMenart

3 years

@Rainmaker1973 my home made levitator, just a little bit larger and able to move particles in 3 dimensions :)

6

42

255

0

24

245

Alex Mordvintsev

@zzznah

2 years

Early training is my favourite part

5

10

239

Alex Mordvintsev

@zzznah

5 years

Keep finding strange attracts from 2015. This one was done by warping the image by the rotated gradient of the activation field.

1

24

240

Alex Mordvintsev

@zzznah

3 years

9

24

239

Alex Mordvintsev

@zzznah

4 years

Feel like your hands are tied when using DL frameworks? Want low-level control on data layout and access, but still need backprop? Don't want to leave cosy Colab-kernel? Try Taichi on @GoogleColab !!! (brought to you by ~10 hours of staring at GDB)

4

37

237

Alex Mordvintsev

@zzznah

3 years

It's always nice to have a compact and efficient boilerplate as a base for new experiments. I've updated the PyTorch Texture NCA code with the improvements from my latest video tutorial

8

24

237

Alex Mordvintsev

@zzznah

6 years

This is the main thing I was working on during the last year, together with @ch402 @nicolapezzotti and @ludwigschubert

Differentiable Image Parameterizations

A powerful, under-explored tool for neural network visualizations and art.

distill.pub

2

68

233

Alex Mordvintsev

@zzznah

5 years

3

26

226

Alex Mordvintsev

@zzznah

6 years

Does a laptop have historical value, if it rendered the first DeepDream image ever? I'll have to return it soon...

9

22

228

Alex Mordvintsev

@zzznah

4 years

Zooming in

5

26

224

Alex Mordvintsev

@zzznah

3 years

I'm finally releasing 'deepdream.c' source on GitHub ()! Inception-V1 classification, adversarial examples and #DeepDream , all in ~900 lines of C89 code. Big thanx to @KanonDotArt for inspiring and supporting this project!

Kanon

@KanonDotArt

3 years

#K21 artwork 07 by Alexander Mordvintsev ( @zzznah ) is now live on our gallery! 🌚 Read more about Alex and his work on our Medium

1

8

45

6

51

222

Alex Mordvintsev

@zzznah

6 years

6yo son found his style

9

16

213

Alex Mordvintsev

@zzznah

3 years

New to video tutorial: Neural CA "Grafting". I show how to combine multiple CA rules on the same grid (top), and how to use fine-tuning to make CA "realtives" that can collaborate across the boundary area (bottom)!

10

40

208

Alex Mordvintsev

@zzznah

2 years

failures are usually more interesting than the intended behaviour

5

26

208

Alex Mordvintsev

@zzznah

5 years

New advances in differentiable image parameterizations: backprop through the smoke!

Two Minute Papers

@twominutepapers

5 years

Finally, Style Transfer For Smoke Simulations! 💨 ▶️Full video: #ai #deeplearning #fluids

5

157

794

2

34

206

Alex Mordvintsev

@zzznah

6 years

neural pixel art attempt

7

29

204

Alex Mordvintsev

@zzznah

4 years

Unboxing

11

200

Alex Mordvintsev

@zzznah

5 years

Interesting cloud formation

9

23

200

Alex Mordvintsev

@zzznah

3 years

Math is weird: it's like an imaginary world in your head, but in every other head it's the same.

14

25

192

Alex Mordvintsev

@zzznah

4 years

Woke up with an idea of using Verilog to design Minecraft redstone circuits. Quick search revealed a few already existing projects, e.g.

6

67

191

Alex Mordvintsev

@zzznah

4 years

On the importance of Gamma Correction for motion blur in visualisation. Moving particles look darker than static if you don't do "img **= 1/2.2" before writing the frame.

5

28

193

Alex Mordvintsev

@zzznah

3 years

Visited Cellular Automata museum

3

9

189

Alex Mordvintsev

@zzznah

5 years

Seattle

6

22

181

Alex Mordvintsev

@zzznah

3 years

Zooming into lives of individual cells is something I particularly enjoy, although it doesn't seem to tell much about what's going on. All cells are rendered with a single quad using tricks from @Shadertoy

4

19

186

Alex Mordvintsev

@zzznah

11 months

llama.cpp is a triumph of minimalism, that reminds us how useful it is to throw away the crust and start from the blank canvas. First dependencies serve you, then they slow you.

Nat Friedman

@natfriedman

11 months

Watching llama.cpp do 40 tok/s inference of the 7B model on my M2 Max, with 0% CPU usage, and using all 38 GPU cores. Congratulations @ggerganov ! This is a triumph.