[D] GPT-J for text generation: hardware requirements

Video games have, for several decades, only loaded the assets they needed to use, as they used them, due to tiny RAM amounts relative to the asset sizes yea. The original Playstation is a good example with its 2MB of RAM and 800MB discs full of assets. Enabling the ability to do something at all for many, is often more important than being able to do it extremely quickly for a few. Modern games get around this in part, by having the graphics driver handle all the asset management in and out of VRAM, allowing the driver to swap the least recently used assets out to RAM until they are needed, and then swap them back to VRAM, without the executing program having to know it happened. Basically treating all of VRAM and virtual VRAM hosted in RAM as one big asymmetrically speedy storage medium.