TRELLIS.2 on Apple Silicon: A Revolution in 3D Model Generation

Discover how adapting TRELLIS.2 for Apple Silicon is revolutionizing 3D model generation on Mac.

TRELLIS.2 on Apple Silicon: A Revolution in 3D Model Generation
TRELLIS.2 logo on Mac with Apple Silicon

Generating 3D models from images is a process that requires significant computing resources and has traditionally run on hardware with NVIDIA GPUs. Recently, an innovative adaptation has made it possible to run the TRELLIS.2 model natively on Macs with Apple Silicon, removing the need for dedicated GPUs and opening new possibilities for professionals in the field.

What Is TRELLIS.2?

TRELLIS.2 is a 3D image generation model developed by Microsoft Research, designed to create detailed 3D models from single 2D images. With 4 billion parameters, it can produce 3D assets at resolutions up to 1536³, complete with PBR (Physically Based Rendering) materials, making them ready for use in applications such as games and simulations. (microsoft.github.io)

Adaptation for Apple Silicon

Traditionally, running complex models such as TRELLIS.2 required specific hardware, especially NVIDIA GPUs, to handle the intensive processing. However, thanks to PyTorch MPS (Metal Performance Shaders), it has been possible to adapt TRELLIS.2 to run natively on Macs with Apple Silicon, such as the M1 and M4 Pro. This adaptation can generate 3D meshes with over 400,000 vertices in about 3.5 minutes on an M4 Pro, without the need for dedicated GPUs. (github.com)

Implications for Industry Professionals

This development has several significant implications for professionals working with 3D model generation:

  • Accessibility and Affordability: The ability to run TRELLIS.2 on Macs with Apple Silicon makes advanced 3D model generation accessible to a wider range of professionals, reducing the need to invest in expensive hardware.
  • Operational Efficiency: Removing the dependence on NVIDIA GPUs and the ability to run the model locally on a Mac can improve operational efficiency, reducing waiting times and increasing productivity.
  • Workflow Innovation: Integrating TRELLIS.2 into Mac environments can spur innovation in design and development workflows, enabling faster iteration and more experimentation with complex 3D models.

Final Thoughts

The adaptation of TRELLIS.2 for Apple Silicon is a significant step in the evolution of 3D model generation, making this advanced technology more accessible and practical for industry professionals. With further development and optimization, broader adoption of these solutions is likely, leading to more efficient and innovative workflows in 3D design and development.