thecrabsbelow [comrade/them] @ thecrabsbelow @hexbear.net Posts 1Comments 5Joined 3 yr. ago
![thecrabsbelow [comrade/them]](https://hexbear.net/pictrs/image/d27a9a42-212d-4821-a9ba-64faa301b536.jpeg?format=webp&thumbnail=128)
I'd like some LLM features centered around "here is my organized folder of documents for context" but without paying $20/month or buying a $2,000 GPU or giving all of my data to Google/Microsoft. I couldn't find anything that actually worked even if I did pay money or give my data to Google/Microsoft. Ignoring even the folder thing, I remember asking Claude to summarize a novel I'm writing and it kept mixing character's with details that unambiguously only applied to other characters.
If only there was a way to run this on linux.
Thanks! I estimate I'm at least 25% of the way through, where the last 75% will be editing and finding beta readers.
I'm still writing, slow and steady lol.
I made a similar thread a year ago if that helps: https://hexbear.net/post/185417