🎨 Artist on the forefront of tech, VR and AI. Client list include Runway, Lumalabs, Media Molecule, The UN, LEGO, Adobe. Once performed VR for 40k audience.
So the title might be a bit bombastic, but if this isn't one of the most incredible glimpses of a future way of creating and rendering 3D.. I don't know what is.
This was sculpted on my PS5 in mere minutes and transformed as I was sculpting, through a "Real-time Latent…
Here's a timelapse of making the train station scene in Dreams on my PS5. No mouse, no keyboard. Just waving my arms in the air with two glowing wands :D
Big props to Lorenzo Draco for the inspiration.
#madeindreams
#ue5
Here's a timelapse of my Elden Ring fanart. Made in Dreams on my PS5 yesterday. Let me know what you think of it and if I captured the mood of the game, which I have yet to play.. need to finish Horizon First :D
#madeindreams
#ELDENRING
@PlayStation
As you know, my explorations of the Gen AI space is ultimately all about creative control. You should be able to shape the generative matter using all your artistic sensibilities and your aesthetic sense.
OpenAI's Sora is a huge technological leap, but what excites me the most…
Text to 3d is here, and it's sooner than I expected. I know the founders of Midjourney and Stable Diffusion have mentioned that it wasn't far off.. and they were right! Check these out and read about the system here:
#AIart
#3d
For generative AI to become an interesting art tool, we need much more control over the output. The slot-machine-like nature of pure text-to-image leaves too much to chance.
Using the "Real-time Latent Consistency Model" that I'm using in the example here, is the first time I…
Timelapse of my 2-hour fanart for episode 2 of
#TheLastOfUs
on HBO.. loving the show so far! ♥️ Might make a Dreams scene for each episode. Thanks for the many years of inspiration,
@Neil_Druckmann
, and co.
Stick around for a quick glimpse at my Episode one scene.
#MadeInDreams
I loved the Unreal Engine 5 demonstration so I wanted to try and recreate a scene from it in
#DreamsPS4
. Two hours of Dreams sculpting from this evening.
Better quality here:
#MadeInDreams
@UnrealEngine
This was MADE by me on my Playstation.. It's not an fps game I bought and recorded a small sequence in. All elements of the environment were sculpted, painted, animated and made playable on my PS5 in the game engine Dreams. Incredible software 😍
#MadeInDreams
#playstation
A Playstation title that allows its users to create stuff like this? A few years ago I wouldn't have believed that to be possible.. But is is now, with
#dreamsps5
. And I'm loving every minute of it ❤️👏
Here's an update to my Horror game, all
#MadeInDreams
.
Here's a quick test of a new tool called Krea. It's like the Real-time latent consistency model tests I've done with my photoshop and Dreams creations, but instead in a single application with faster refresh rates and higher quality output. I find that it strays too far from the…
More tests of painting with a realtime ai transformation.
This time, the model settings ensure that the ai stays closer to the painting, which gives me more control over the final look of things. Eventually, we should be able to get as fine-grained control as we want with our…
Midjourney just launched a beta version of their system, which combines Midjourney and Stable Diffusion. Here are a few examples. Made only by writing text prompts to their discord bot. To test it yourself, just write --beta after your Midjourney prompt.
#midjourney
#conceptart
Made this in Dreams on my PS5 today.. You might be able to tell what inspired this 😁 It's just an early WIP but I'll give it some more work next week.
#MadeInDreams
#UnrealEngine5
Here's the finished version of this scene. All made in Dreams on my PS5. Started work on this one two days ago. Dreams is incredible! :D
#madeindreams
#dreamsps5
@mediamolecule
Had to do another piece of
#ELdenring
fanart in Dreams. So here's one from this evening. I'll upload a timelapse of the process (around 3.5 hours) when I've had time to edit it. I love the style of the universe
@FromSoftware
has created.. very inspiring!
#MadeInDreams
I made this on my PS5.. From scratch (except for the gun).
Not sure if anyone need a reminder these days, but
#dreamsps4
is a game-engine/creative tool that's ahead of its time, and even the competition today in a lot of ways. It's currently free on Playstation Plus and it's…
Couldn't help but do a bit of VR Graffiti :D
This was all made in Dreams, inspired by the beautiful UE5 train station made by Lorenzo Draco.
#madeindreams
#UE5
How to generate an owl?
Ai image generation tools are evolving fast these days, and here's one of the latest ones. The new Artbreeder beta is powered by Stable Diffusion, and it's a different take on what tools like this could become.
#stablediffusion
#artbreeder
As a photobashing tool this is insane..
Krea AI running as an overlay over my Photoshop canvas as I'm painting. I'm using a tool called Windowtop for that. I'll post a small tutorial on how to do that, in the thread below🧵
#art
#ai
I deleted my post of painting in Photoshop with an AI interpretation running as I was painting. The amount of hate, negativity, and fear was staggering and I don't want to defend myself against that. My stance on AI is that it can become a powerful, artistic tool if the tools are…
Generative 3d environments just became a thing with the announcement of OpenAI's new video model, Sora.
Michael Rublof from took one of those videos, and turned it into a NeRF using Colmap and Nerfstudio.
While people are laughing at the topology of…
Here's a piece of artwork made in Dreams by one of my big Dreams idols,
@Johnee_B
. We haven't seen much of his Dreams work yet (hopefully we will see more when Dreams is released February 14th).
This scene was made by him on a Playstation 4.. what a game changer!
#MadeInDreams
This scene was another "aha" experience for me in Dreams. I wanted to build an old worn down barn, and initially set out trying to build board by board. There turned out to be a much easier solution as you'll see in the video 😁
#MadeInDreams
#dreamsps5
@mediamolecule
It's been about 4 months since I made my Unreal Engine 5 recreation and in that time there seems to be an increasing awareness of the potential of
#DreamsPS4
as a tool for film/tv/gaming/art outside of the Dreamiverse. It's obvious what I think. What about you?
#MadeInDreams
My tribute to the beautiful
#HorizonForbiddenWest
. I'm so inspired by the love and care that was obviously put into making it one of the most beautiful and impressive games I've ever seen
@Guerrilla
.
These scenes were all
#madeindreams
from scratch on my PS5.
After playing Cyberpunk 2077 for the first time yesterday, and being blown away by the art-direction and the visuals, I was inspired to do a scene in Dreams. The scene itself took around 2 hours to do, and the sound was added after.
The music is from Artlist.
#MadeInDreams
#art
This is insane.. damn. Look at how the Generative AI process nails the consistent light source, shadows and reflections across the whole scene here.
#ai
#art
Leonardo AI's new motion feature is really impressive! Here's 5 examples from my latest sketch to video project. The sketch was given form and color using Vizcom ai and then I took it through Leonardo ai for refinement and motion.
#ai
#art
The other day, I gave you a few examples of why my Photoshop is more fun than yours and promised to share a more in-depth tutorial on how to set up a workflow like this.
The basic idea here is to paint directly into a real-time AI transformation layer, which combines Krea AI…
I see your text prompt and raise you my 3d to anything.. It's all about control if we want Gen ai to be a useful creative tool.
Keep reading to see the finished images based on this technique.🧵
#ai
#art
Hi all, here's a small test of a kind of mixed reality capture of a quick
#DreamsPS4
sculpt. Especially with the move controllers, I think it helps to actually see them in use to get an idea of what's going on.
#MadeInDreams
@mediamolecule
The next stage of AI image gen is going to be all about control. Human creativity is a beautiful thing, and the images we all have in our heads is much better expressed through motion, brush-strokes, song, tone of voice than through a simple text prompt.
"Make a tree with a…
Time for another 1-minute Dreams snack. Made this last evening over the course of a 2-hour stream. You can watch that here:
I made the scene to test out how
#DreamsPS4
can be used as a base for overpainting. Check the result below.
@mediamolecule
#art
After sculpting Pinocchio, from Guillermo Del Toros beautiful version of the story, I felt like I had to sculpt Gepetto too. Took a bit longer and was more challenging than
#Pinocchio
, but here he is 😊
#MadeInDreams
#dreamsps5
In Dreams there's no polygons or pixelated textures.. Instead we have signed distance fields and flecks, tiny splats of texture that can be manipulated and animated to achieve a plethora of wonderful effects!
#MadeInDreams
#dreamsps5
A 45-minute robot sculpt in this Horizon: Forbidden West fanart. It's so cool to be able to create directly in an environment like this :D
All made on my PS5 in Dreams.
#madeindreams
#HorizonForbiddenWest
@Guerrilla
A quick test of using 3d drawing with 6DOF controllers as an "instructor" for a generative AI process.
There's so many powerful and fun new ways to create just around the corner..
Here I'm using Dreams, Krea and 3daistudio. The 3d model at the end of the video was generated…
Still high on the fact that Guillermo Del Toro retweeted two of my
#Pinocchio
fanarts 😊 So I had to go back to this small thing and work a bit more on it. All made on my PS5 in
#Dreams
ofc! I absolutely love the light in the engine.. My favorite thing about Dreams 😍
Some more tests of this workflow.. imagine when this happens 100% in realtime with the ability to lock down any area you're not working on😱
Red below how I did this test.. found a better way to overlay the AI layer.
#art
#ai
Speaking about control.. another step in the right direction!
Testing out the latest Krea ai updates.. crazy stuff😍
Combined with some Magnific ai magic.
#ai
#art
This is mesmerizing.. as I'm sculpting quick 3d scenes on my PS5 in Dreams, using two glowing sticks that react to my gestures like 3-dimensional brushes, a layer of generative AI interprets each of my sculpt marks and brushstrokes based on a prompt, I gave the system. All…
My photoshop is more fun than yours 😜 With a bit of help from Krea ai.
It's a crazy feeling to see brushstrokes transformed like this in realtime.. And the feeling of control is magnitudes better than with text prompts.
#ai
#art
I'm excited to share with you that I've been beta-testing
#AdobeFirefly
, a new image generator model trained on images from the Adobe Stock library, openly licensed content, and public domain content. I'm very impressed so far!
#AdobePartner
Sculpting in Dreams while my model is transformed with just a short delay on my secondary screen, is pretty mind-blowing! Imagine once this works in full 3D with more consistency.
#madeindreams
#dreamsps5
Using Unbound SDF sculpting with generative ai through "Krea". The first part is a timelapse, but check out the realtime sequence.. It's mind blowing honestly. And
@unbound_io
is one to follow 💪How long do you think it will be before workflows like this allows us to bake in…
I asked ChatGPT to generate a good prompt for Midjourney to help with references for a lamp post I want to sculpt in Dreams. Judge for yourself 😱
#midjourney
#madeindreams
Here's my fanart for each of the 9 episodes of
#thelastofus
season 1. Can't wait to see season two and get to work on the next round of artwork! All
#MadeInDreams
on my PS5. Thanks for the inspiration
@Neil_Druckmann
and team 👌
Apples, oranges, and the future of 3d ;-)
Realtime, instant feedback, real-time lighting, and effects in a more painterly, sculptural, intuitive workflow. An underlying game engine lets you make full games, interactive movies, or art installations.
AI takes care of the final…
More experiments of this workflow: Generating quick 3d models using Lumas Genie 3D. A text prompt generates 4 models in 10 seconds.
Then, using Lumas webviewer, I feed a screencapture of the model into Krea ai which details the model based on another prompt.
Finally, Magnific…
A generated mesh using an image made with Leonardo AI. The image was re-projected onto the mesh as the texture had lost some definition. The jawline is clearly not so successful here, but besides that this is a pretty crazy look at a very near future where AI gen works in 3D at a…
From sketches in photoshop to a full 3d scene.. what a crazy time to be alive.
The workflow was: Sketching in Photoshop, Screen2image in Krea AI, using a tool called Windowtop to superimpose the Krea transformation over Photoshop as I was painting, and then turning the resulting…
On February 14th, Dreams by
@mediamolecule
is released. Here's my work from 300 days of early access. I can positively say, that Dreams is the most amazing piece of console software ever, and one of the best digital art tools overall. Thank you, MM!
#MadeInDreams
#playstation
Such a strange feeling to see brush-strokes, compositions and color transform like this with AI as I paint.. almost like seeing worlds and images flow from the tip of the Wacom pencil.
Done using Krea ai as an overlay over my painting software as I paint. The final zoom is a…
Speedsculpt + AI image gen. What an incredibly powerful combo compared to text to image.
Made using Dreams on my PS5, by far the fastest way to sculpt in 3d anywhere. Transformed with Krea ai.
Imagine when it's possible to convert this to an actual 3d model, to animate it, and…
Here's my latest scene made in
@mediamolecule
's amazing game/art/universe creation tool "Dreams".
Another example of how spoiled we are as artists today, with such great tools available to us. Making art in VR, making art on a console and being able to tell stories in new ways!
Ai image gen is great at generating nice-looking images, but still not great at capturing the images you have in your mind before generating an image. That's a big problem for use in professional workflows where precision and art direction is essential.
Sketch to image workflows…
P(ai)nting - crazy and weird to see brush marks transformed like this as I'm painting.. Stick around for the animated version at the end of the video.
#ai
#painting
The future of 3d sculpting? And yeah, I know I'm throwing that line around a lot.. but I honestly believe we'll see something like this in realtime sculpting soon.
What do you think?
#ai
#art
3D AI Rocks.. yeah that's what the video is about.
Painting rocks in photoshop and transforming it with Krea ai and Magnific. Converting that to 3d with 3daistudio.
#3d
#ai
An 18 minute sculpt, made on my Playstation, turned into this? The future is here. Imagine the worlds we can build! The power!! Muahaha.. ahem.
Joking aside, this is pretty mindblowing. AI tools are starting to turn into actual tools we can control, art-direct and amplify our…
"AI-Generated 3d models suck, they'll never be useful for anything".. well if you aren't creative about it, sure.
How long before the low-res generated 3d models have the quality of the Magnific upscales/enhancements?
Stay tuned for more art and ai experiments!
#ai
#art
Alright, so Luma Labs released V1 of their generative 3d tool, "Genie". That's incredibly cool and all, but look at the logo on their website...😍😱
Stick around for an example of Genie V1, a mere 10 seconds to generate 4 models that can then be used for anything.. in this case…
This scene from my batch of The Last of Us fanart, only took 2! hours to make from scratch. No prefabs, no texture presets.. All from primitives. Another example of a scene I couldn't imagine making in any other software at that speed 🔥
Made on my PS5 in Dreams (free for all PS…
Hi all, here's another architectural study made in Dreams on my PS4. 2 hours of work from this evening. It would probably have taken me a few days in any other 3d workflow! 😅
#madeindreams
#playstation4
@mediamolecule