Training/finetuning an uncensored LLM AI model, with redpill ideology and it's core information

ZET_unown_ · 2024-02-05T15:51:31+00:00

PhD student working on Deep Learning here.

Training a proper LLM from scratch is not feasible unless you are a corporation with lots of funding, since it requires thousands of GPU each costing 30K dollars. You can of course rent cloud GPUs, but it still costs millions. You will run into the same funding issue if you provide a chatbot without charging money, not to mention the legal risks.

This leaves you with finetuning existing LLM for personal use, but those model weights will already have a massive amount of bias on non-redpill or anti-redpill material (since ML models reflect the data it is trained on). So a naive finetuning approach will probably give you a chatbot that doesn’t have hard censorship rules (off limit topics), but still spits out stuff that focuses on political correctness rather than logic.

You can of course compensate for this by feeding it a massive amount of redpill material (that you need to curate yourself) and/or adjust the loss functions and try to steer it towards red pill philosophy, but at that point, you risk ending up with a model that’s so overfitted to redpill that it just repeats fringe redpill theories - it’s no longer a somewhat objective ML model that can be useful in any manner. It just says stuff that model maker wants to hear, not necessarily what is right or correct.

If you spend more time researching this, it is certainly possible to make one, but no, laymans do not have the skills or resources to make it work. Those that do won’t waste time on this.

new__vision · 2024-02-05T22:35:53+00:00

If you don't have technical skills in the field I wouldn't recommend trying to fine tune a model.

The easiest way for a non-technical person to achieve an uncensored LLM with Redpill knowledge:

Download https://gpt4all.io
Download an uncensored model, I recommend openhermes-2.5-mistral-7b.Q4. Put it in the models folder.
Dump all your RP texts and books in a folder and use the Local Documents feature to scan it.
Start a new chat with the local docs feature on. You might need to change the local docs settings to get better results.
Make sure it's using your GPU or Mac M1/M2/M3 chip if you have one, otherwise it will be slow.

This doesn't work nearly as well as fine tuning but is way easier and doesn’t require writing code.

thesuccessfuladrian · 2024-02-15T14:53:41+00:00

Let me know about the progress, this is a great idea, thought about it but my time and resources I have at the moment have to be directed towards a better tomorrow, right now I'm kinda in a shit whole.

Good luck guys and take care!

sagricorn · 2024-02-06T20:42:06+00:00

Cannot promise anything, but now i finally have an excuse to dive deep in this topic. Totally new to nlp, but i guess finetuning with lora and retrieval augmented generation could be good starting points to explore a smallscale proof of concept. No clue about deployment though.
Meanwhile, it could be interesting to explore potential use cases, like personal mentoring, a shittest guru or something like that.
And I am curious about potential solutions you guys come up with!

CalmEntrepreneur884 · 2024-03-06T05:13:38+00:00

Im going to try this

Vermillion-Rx · 2024-03-06T10:17:33+00:00

the sidebar

Yeah no. I don't want a chat bot that has the most autistic interpretation of RP imagineable

The sidebar requires nuance to not sperg reading. I don't want a bot taking the sidebar literally. If spergs meltdown taking it literally, i can only imagine the chaos a bot would cause, especially to spergs using it

Title	Training/finetuning an uncensored LLM AI model, with redpill ideology and it's core information
Author	mikrodizels
Upvotes	81
Comments	24
Date	February 5, 2024 1:40 PM UTC (2 years ago)
Subreddit	Posted in /r/TheRedPill
Original Link	https://old.reddit.com/r/TheRedPill/comments/1ajgr2y/trainingfinetuning_an_uncensored_llm_ai_model/
Archive Link	https://theredarchive.com/r/TheRedPill/trainingfinetuning-an-uncensored-llm-ai-model-with.1244646 https://theredarchive.com/post/1244646

Comments