Ming-3.0-tts on a 16 GB card: the GPU sat mostly idle, and why a bigger one barely helps

Ming-3.0-tts-0.5B peaked at 2.9 GB and ran at about 0.65x real time. The Python decode loop sets the pace, not the card. What to measure first.

Read Original

Related