High-functioning millennial ■ NVIDIA Research ■ AI, XR, Robotics & Omniverse ■ VFX⎯Mathematics⎯Electronic Elsewheres ■ Opinions mine, you can't have them ■ he
I’ve been working from a NYC 1BR for 3.5 years now. During this time, I’ve lead projects with 3-30 people involved, often needing lots of discussion, prototyping together and visual communication. it’s difficult. Here are some things I wish I’d been told:
Desktop linux is an experience. I spent weeks without a mic b/c Ubuntu suddenly stopped recognizing it. Then it started again, then over a period of 3 days audio output started drifting towards the left speaker. Today incoming video call audio is just white noise. Exciting times
Good opportunity as ever to remind that:
• The Turing Test was designed to fail humans, not certify non-humans.
• COMPUTING MACHINERY AND INTELLIGENCE (1950) by Alan Turing is freely available online, and is still largely undisputed.
youtube-dl, one of the most useful applications if you happen to, you know, use computers, was taken down from GitHub, “because of piracy” (lol). Here’s source in two images
shit mom says:
* “neural networks are for losers who are too lazy to do mathematical modeling”
* “you better not be solving it with covariance matrices, I did that 30yrs ago”
* “SIGGRAPH? yeah, I remember - I just thought they were all dead by now”
get her on twitter, twitter
every time I hear the word “lab” in a company / coworking space’s name, I quietly replace it with the word “hole”
Nike Innovation Hole
Columbia Urban Design Hole
MIT Media Hole
This man has taught me more in any field of undergraduate math than the professor I had in class. I’m not exaggerating. His books and lectures belong in the library of congress.
Thanks, Gil.
Omniverse, NVIDIA’s collaborative graphics platform, is now in public beta!
This release connects with Maya, Revit, Sketchup, Photoshop, Substance_*, and UE4.
We’ve been using Omniverse for our own demos for a few years now. They’re included, too.
devs: the compiler is slow, we have to pray before adding another
#include
, once I wrote a templated vector and got a call from con-ed
c++ working group: a class is now a MetaCompaction<T,φ, 𓀤>
devs: what
c++wg: “extern” finally works underwater
Windows now has a graphing calculator. It even has dark mode! Well done, Microsoft!
Just one minor detail, folks -
This graphic? It’s the implicit surface of A FUCKING CIRCLE.
YOUR GRAPHING CALCULATOR, A TOOL FOR VISUAL FUCKING INTUITION, DOESN’T FIX A FUCKING ASPECT RATIO.
Someone (
@chris_whong
) ran the watershed algorithm on walking + commute graphs in NYC, and it's the highest information value visualization I've seen in a long time
Today we're announcing Omniverse XR, a VR+AR app for Omniverse:
• It's got real-time ray-traced VR. This means soft shadows and real reflections.
• It can handle gigantic assets without pre-processing
• It works with the Omniverse ecosystem.
I've neither touched the audio settings nor turned off my PC this entire time. This is a living art installation and I am obliged to act as its' conservator
Learned 3 new C++ features today looking at my twitter feed. None have any importance in the grander scheme of things, doesn't exploit processor features or tidy up data arrangement.
It's just stuff.
Like scrolling Facebook and finding out whatever new bullshit your ex is into
Turns out hallucinating a whole channel is more stable in production than constructing a difference key after de-spilling translucent and GI-affected surfaces. huh.
Clever new paper from Netflix: sidestep the hard problem of collecting alpha matte training data by recording in front of a green screen and lighting the subject with only blue+red light. The green channel records alpha, and ML hallucinates real-green.
NEWS
After >2yrs building Omnvierse XR, I've stepped down from leading the effort.
We shipped the world's first Raytraced XR engine, first to live-edit USD, and built an incredible team.
It's now time for it to focus platform and SDK, but life is short and I have other interests.
Omniverse just merged my last design, so after years of being a collaborator to research, I've now officially moved to NVIDIA Research.
I've wanted to contribute to Human-facing AI since undergrad. After years of breadth work in simulation and XR, it's time for more depth.
This paper by is incredible: looking at the heavy baggage picked up by applying the diffusion mindset to diffusion models, rolling up the sleeves saying "math is math" and bringing it down to bare bones.
Papers like this should be revered by the community, they memeify knowledge
When
@_Laurent
and I started learning about diffusion models, we were puzzled by the amount of jargon and concepts.
So, we derived a model from scratch with our own graphics-people intuitions. Simple derivation, simple implementation, SOTA quality.
Keynote by
@mmalex
at
#HPG2021
hits home painfully.
Creators avoid expensive operations to protect their creative flow. They won't admit it; They'll subconsciously classify it as a dead end.
Happens in every practice that requires thinking with your hands or HIDs.
While introducing the Sand Dune simulation talk (good stuff, go read ), I gave a summary of all other sand sim presentations, summarizing them as “sand papers”. Absolute silence. This is no longer my scene
My 80yo mom calls me up.
“Hey, what’s Omniverse? I just read about it in the news”
-Yeah, I’ve been working on it for a few years now
“Are you sure? Because this thing sounds really good”
What we really need to make the cryptocurrency revolution complete is a popular new coin that requires massive amounts of RAM. Then all components of homemade PCs will be equally unaffordable, and balance will have been restored
Happy and proud to announce that
@Shadertoy
cofounders
@iquilezles
and
@poljeremias
have been awarded the prestigious ACM SIGGRAPH Practitioner Award () for their decade long work to broaden the use and openness of computer graphics and its learning.
Lord give me the strength to ignore video compression artifacts, the courage to tackle rendering artifacts, and the wisdom to tell them apart on a video call
Started out the year with STREET FIGHTING MATHEMATICS by Sanjoy Mahajan. Been meaning to get to it for about 15 years now. Short read and full of insight. I’ll probably revisit this book every few years for new tricks. The MIT course is still up:
The work done in this 17 minute read to simplify the vaccine code - just enough so a complete fuckwit like myself can get it - is astounding. Well worth a read, even if you’re not a blithering idiot like me
@downdogapp
Google and Apple are doing such an amazing job explaining to devs how taxation works, you’d think they’d be doing a better job paying taxes
like VR? better still, hate VR?
we've set up a sick immersive design internship at NVIDIA. you'll be working with Josef, Morgan and myself, making weird XR interactions.
Brilliant portfolio required, not C++ experience.
Our team is hiring undergrads/Masters for a dream internship. Design AR+VR interfaces in a rolling gam jam all summer at NVIDIA.
Canadian students will be mentored by me in Toronto and US students in Durham by
@josefspjut
. Make images like these real!
Congrats
@sightful
for finally moving out of stealth. Spacetop is a surprisingly delightful device, and the first long-term use for tethered XR.
You really need to try it to understand.
stuck in Istanbul because of a firmware error in an airline ramp controller, touring the halls listening to “The Peripheral” on audiobook, looking for a quiet place to write code. appropriate.
@GreatDismal
The “Fibers, oh my!” post by Dave Weiler (tl;dr: how to implement an efficient M Core : N Fiber system from scratch) comes down to "how to trick C compilers into replacing the stack, regiters, and instruction ptrs". Can’t say I ever wanted this knowledge
list of things I don’t trust when evaluating color:
• other people
• whatever viewer you’re using
• ffmpeg? no
• whatever viewer you just switched to
• your monitor
• my monitor
• your eye, 2min ago
• your eyes, now
• my eyes? fuck right off
• my own brain
something really poetic about making a reference to a painting style which outlasted its creators by several multipliers - with a rule system that has the average longevity of a butterfly.
enjoy it now, it’ll be a picasso next week
caught an absolutely gorgeous tilt-shifting effect created by specular lines reflected from the surface of gently-moving water. The more I look at this video, the more I notice going on.