70b model taking 1.5GB? So 0.02 bit per parameter?
Are you sure you're not thinking of a heavily quantised and compressed 7b model or something? Ollama llama3 70b is 40GB from what i can find, that's a lot of DVDs
Wow, I've actually never seen this disc. However, funnily enough, I have another disc with that program burned into it. Someone didn't read the notice, it seems.
Fun fact: you can download llama3, an llm model made by meta (which is surprisingly good for its size), and it's only 4.7gb.
A dvd can store 4.7 gb of data, meaning you could in theory have an llm on a DVD.