• 5 Posts
  • 409 Comments
Joined 3 years ago
cake
Cake day: July 13th, 2023

help-circle



  • You need to do a custom program if you want to do that. I mean a traditional program where variables are stored properly.

    The models have no memory at all, at every question it starts from scratch, so the clients are just “pretending” it has a memory by simply including all previous questions and answers in your last query. You reply “ok”, but the model is getting thousands of words with all the history.

    Because each question becomes exponentially expensive, at some point it starts to prune old stuff. It either truncates the content (for example the completely useless meta ai chatbot that WhatsApp forced down the throat loses context after 2-3 questions) or it uses the model itself to have a condensed resume of past interactions, but this is how it hallucinates.

    Otherwise it will cost like $1 per question and more




  • I like the idea of a federated version of that, but there are many problems:

    1. When people scroll, they need an algorithm to choose content for them.
    2. 99% of average TikTok content is low quality shit and it’s the algorithm to find and promote what works
    3. All that 99% of shit is occupying exabytes on bytedance servers. Users are uploading terabytes of shit every hour, it’s impossibile for a federated instance to keep all this shit on disk. Look how Lemmy is designed for example. I upload an image and then it’s stored forever in hundreds of instances. For videos is untenable. Only companies that are profiting from this (for example using such videos for training ai models, or using this videos to hook people and serve them highly personalized ads) can host a TikTok clone











  • Already before the LLMs for me it was the last chance before I would post over there. The desperation move. It was too toxic and I would always get pissed to get my question closed because too similar or too easy or whatever. Hey I wasted 15 minutes to type that, if the other question solved the problem I wouldn’t post again…

    In the beginning it wasn’t like that…

    I went to watch my stack overflow account and the first questions that I posted (and that gave me 2000 karma) would have been almost all of them rejected and removed