PrismML has announced Bonsai Image 4B, a family of compressed image-generation models designed to make high-quality diffusion inference practical on local hardware, from laptops to phones. This is the company's first move beyond language models, and it's a significant one.
Available in both 1-bit and ternary variants, Bonsai Image 4B reduces the footprint of a modern 4B-class diffusion transformer by up to 8.3x while preserving strong visual quality, making it the first image model in its parameter class to run directly on the iPhone.
Both 1-bit and Ternary Bonsai Image 4B are released with open weights and code under the Apache 2.0 license. For a field that has largely kept high-quality image generation locked behind cloud APIs, that combination of compression depth and open weights is worth paying close attention to.
What Is Bonsai Image 4B?
The models are built for local inference across iPhone, Apple Silicon Macs, CUDA GPUs, and local or small-scale serving environments. The underlying compression approach follows the same philosophy PrismML has applied to its language model line, but now extended to diffusion transformers, which present different architectural challenges.
The 1-bit variant uses binary {−1, +1} transformer weights with group-wise FP16 scaling, targeting maximum compression and designed for deployments where memory pressure and model footprint are the primary constraints.
The ternary variant uses ternary {−1, 0, +1} transformer weights with group-wise FP16 scaling. The additional zero state gives the model more representational flexibility, improving visual quality and prompt fidelity while remaining extremely compact.
This is the same weight-quantization philosophy PrismML used in its LLM work, now applied to image generation. The company addresses the challenge of model size by fundamentally rethinking neural networks at the mathematical level. Instead of traditional 16- or 32-bit architectures, it creates models with a native low-bit structure, which dramatically reduces inference compute and memory requirements without sacrificing performance.
Key Technical Highlights
The 1-bit variant compresses the diffusion transformer to 0.93 GB, an 8.3x reduction from the full-precision model. The ternary variant compresses it to 1.21 GB, a 6.4x reduction from the full-precision transformer.
Other notable specs:
- The compressed variants retain up to 95% of the image-generation quality of the full-precision model.
- On iPhone 17 Pro Max, Bonsai Image 4B generates a 512×512 image in about 9.4 seconds.
- On Mac M4 Pro, the same resolution takes about 6 seconds.
- Open weights and code are available under the Apache 2.0 license.
