Serving a stateful video world model on one RTX 4090: memory, flags and seeds in Hy-Nomas

Hy-Nomas keeps a video world between calls. On one RTX 4090 a turn took about 90 s, two decode flags ran out of memory, and Ada was required.

Read Original

Related