deleted by creator

I think I found my jam! AnythingLLM self-hostable

I really want to self host a system that will let me upload documents to be indexed by a vector DB, then run natural language queries using some kind of RAG approach.

Pretty vanilla RAG/Vector DB use-case: Having a markdown software product and technical knowledge base and wanting quick answers to questions like “How should screen X behave if I am not a registered user?”.

Closest I’ve found is LlamaIndex but this is still more of a foundation than a turn-key solution and right now I’m too time poor to do the assembly required… I realise I’m describing close-to-frontier tech, but anything more turn-key out there yet?

Thanks for any suggestions!

$14 USD/mo… Ironically

I’ve been an enthusiastic adopter of Generative AI in my coding work; and know that Claude 3.7 is the greatest coding model out there right now (at least for my niche).

That said, at some point you have to choose principles over convenience; so I’ve cancelled all my US Tech service accounts - now exclusively using ‘Le Chat Pro’ (+ sometimes local LLM’s).

Honestly, it’s not quite as good, but it’s not half bad either, and it is very very fast thanks to some nifty hardware acceleration that the others lack.

I still get my work done, and sleep better at night.

The more subscriptions Mistral get, the more they’re able to compete with the US offerings.

Anyone can do this.