In Text Generation Web UI, how do I set it up for a small model?
In Text Generation Web UI, how do I set it up for a small model?
github.com
GitHub - oobabooga/text-generation-webui: A Gradio web UI for Large Language Models with support for multiple inference backends.
I'm trying to use Text Generation Web UI, but I'm stuck with small models due to being limited to using a cpu that's "Model name: Intel(R) Core(TM)2 Duo CPU E7500 @ 2.93GHz" How do I set this up?