Blog Layout

Okay, this is pretty cool.

DreamFusion

DreamFusion, Google’s next-gen, AI-powered text-to- 3D -image generator, is here.

Well, sort of. A proof-of-concept paper is here , at least. DreamFusion is an evolution of Dream Fields , a text-to-3D-image generator revealed by Google back in 2021. And like Dream Fields, DreamFusion creates its 3D images by combining a Neural Radiance Field (NeRF) — or a neural network that can create synthetic 3D scenes using partial 2D datasets — with a pre-trained text-to-image prompt model.

The twist? Unlike Dream Fields, which utilized OpenAI’s CLIP technology as that latter pre-trained model, DreamFusion now uses its own: Imagen , Google’s DALL-E 2 competitor.

So, basically, Google booted Elon Musk’s OpenAI tech and figured out how to use its own. Keeping things in-house — smart.

“Happy to announce DreamFusion, our new method for Text-to-3D!” Ben Poole, a research scientist at Google Brain and co-author of the proof-of-concept paper, wrote on Twitter. “We optimize a NeRF from scratch using a pre-trained text-to-image diffusion model. No 3D data needed!”

Ghost Eating a Hamburger

While the DreamFusion models aren’t totally realistic, they’re admittedly pretty impressive — as its creators explain the paper, the AI-generated forms that are shown off on its website are “coherent, with high-quality normals, surface geometry and depth, and are relightable with a Lambertian shading model.”

In other words, while they might not be as convincingly realistic as some of those photorealistic DALL-E 2 images (yet), they have all of the right elements. The proportions are right, the depth makes sense, and so on. And not to shade OpenAI, but this next version of the tech is certainly a visual improvement from its first iteration.

It’s unclear when DreamFusion — or whatever comes next — will be available to the public, though we can definitely see a number of applications already. Just think of the value to indie game developers alone! And according to Twitter , it’s already been used to 3D-print a ghost eating a hamburger, so cheers to that.

Share This Article

Slush’s startup pitch competition transformed into a political nightmare

By Laurence • November 21, 2022
Usually, the winners of a pitching competition are bathed with accolades, media attention, and applause. After it’s done and dusted, all they have to think about is what to spend

Behind the Lawsuit Against Celebs Who Shilled FTX Before Its Spectacular Meltdown

By Laurence • November 19, 2022
Above all else, FTX advertisements wanted you to know two things: that cryptocurrency is a force for good, and that you don’t need to be an expert to buy and

The best coworking spaces and cafés in Barcelona to code

By Laurence • November 19, 2022
This article was originally published on .cult by Luis Minvielle. .cult is a Berlin-based community platform for developers. We write about all things career-related, make original documentaries, and share heaps

Experts Baffled by Why NASA’s “Red Crew” Wear Blue Shirts

By Laurence • November 18, 2022
Okay, that’s a good question. Red Crew, Blue Crew Had it not been for the heroics of three members of NASA’s specialized “Red Crew,” NASA’s absolutely massive — and incredibly

3D-printed personalized meds are almost here, thanks to this Finnish startup

By Laurence • November 18, 2022
Pharmaceutical manufacturing is closely linked to mass production. In order for medicines to be sold cheaply, they often have to be made in huge amounts. But what happens if you

Telsa Superfan Dismayed When He Pays for Checkmark and It Doesn’t Even Appear on His Profile

By Laurence • November 17, 2022
“I’m in checkmark purgatory.” Checkmate They say “don’t meet your heroes,” but what’s even worse? When your hero buys Twitter, forces you and others to start paying eight dollars per
More Posts
Share by: