# 🤖 Gemma4 MTP Performance

> 💻 **SYSTEM**  
> **CPU:** Ryzen 5 5500.  
> **RAM:** 32G DDR4 3200.  
> **GPU:** RTX 3060 12G VRAM.

With MTP: Sometime the tps hit 147 token/s.  
Without MTP: Hit 32 token/s.

But MTP is only hit 147 token/s at start. After few seconds, the tps is only 29 token/s.  
I think the hardware have no enough VRAM. If all the layers is fully loaded, the TPS can be keep at 147 token/s.

[![](https://wiki.chenjia.org/uploads/images/gallery/2026-05/scaled-1680-/tphZoeKeLHZW7Xif-image-1779992713320.png)](https://wiki.chenjia.org/uploads/images/gallery/2026-05/tphZoeKeLHZW7Xif-image-1779992713320.png)