How to Create 3D Models Using AI: Step-by-Step Guide with TRELLIS

Take any image, turn it into a 3D model with TRELLIS and watch it come alive in an interactive 3D environment.

In this blog, I’ll walk through each step.

1. Example: Meet "Turion"

This is our 3D model for the demo inside Bolt .new.

2. Image for your model

Generate & find Images for your 3D scene.

3. Clean up

Clean the image and remove the background (Optional)

4. Convert Image

This is the part where it gets interesting: We're using TRELLIS a 3D asset generator by Microsoft Research. Input an image and it generates you an 3D model.

Once you feed in the cleaned or original image, the AI identifies shapes and textures, then translates those details into a workable 3D model.

5. Image to 3D

• Self-hosted: Install TRELLIS locally on your machine (make sure your hardware meets the requirements).

• Online demo: Use the TRELLIS demo on Hugging Face without local hardware or installation.

• Third-party services: Platforms like Fal.ai or Replicate host TRELLIS for you.

6. Clean Your 3D Model in Blender (Optional)

• Remove any unwanted geometry.

• Smooth or simplify the mesh to optimize it for real-time use.

• Adjust the scale, rotation, or positioning of the model as needed.

7. Prompt

This prompt gives you a starting point for creating 3D scenes with AI

Summary

Like many other aspects of the AI sector... it’s not perfect. Similar to code generation, post-processing is necessary and you pay $ for every output generated (if not running on your own machine). But that's not the point here: A year ago, generated images were far from impressive. Today, it’s hard to tell the difference between real and AI-generated. And this development will also be observed in all other areas like in 3D.

Bonus: Generate 3D Meshes Directly in Blender with AI

Another way you can create 3D Meshes is the "MeshGen" Addon for blender.

Practical Example: AI-generated Christmas Scene

Every pixel you see here is AI generated.

Made in Bolt .new

• Model

• Shaders

• Code

• Scene

Want to learn more?

Sign up to Instructa Pro

Access the full video course on building 3D Games with AI that run directly in your browser, as well as:

• Weekly Videos + Vibe Coding

• Unlimited access to all course modules

• Get access to all course updates

• Unlimited Access to Guides & Prompts

• Access to the private Discord community

Click here: Instructa Pro

Other interesting posts:

Have a look at the rest of my blogs posts:

Other interesting posts:

Have a look at the rest of my blogs posts:

• Cursor 0.47 Update: What's New

• Optimize AI generated 3D models for the Web

• Everything you need to know about Cursor Rules

Happy coding!🚀