You ever go through a wignats posts and realize dude can literally be eviscerated out of existence and nobody would remember because any LLM diarrhea generator can produce anything of more substance 
Timeline
Post
Remote status
Context
9
@subnetter incidentally I was arguing with Opus 4.8 and it's really good at looking at your arguments and picking apart if they have methodological flaws. I've found it really useful
@sun okay but what do you actually mean by methodological flaws because I cannot imagine LLMs actually being able to map out that logic considering they're token predictors and the correctness of an argument is determined by its validity
And sorry, everyone keeps saying stuff about LLM this and that, if it's run by the same incestuous pool of sociopaths I want nothing to do with the product. I'm good. I like my life the way it is without promoting a chat bot regularly for a dopamine rush.
I will never be at any point in my life where I am trying to have conversations with myself through an LLM. I studied philosophy logic quite a bit, that's something I should do and a skill I would like to continue to refine, not delegate to a clanker.
And sorry, everyone keeps saying stuff about LLM this and that, if it's run by the same incestuous pool of sociopaths I want nothing to do with the product. I'm good. I like my life the way it is without promoting a chat bot regularly for a dopamine rush.
I will never be at any point in my life where I am trying to have conversations with myself through an LLM. I studied philosophy logic quite a bit, that's something I should do and a skill I would like to continue to refine, not delegate to a clanker.
@subnetter there is a metric fuckton of secret sauce layered over top of LLMs and I think that is the difference. I don't have a good explanation for why sometimes LLMs seem to work unreasonably good at tasks that don't seem at all like they are solvable with token prediction.
So as an example I made a statement of fact and it pushed back. I elucidated further and got more concessions and pushback, but it accused me of, whenever a wrinkle in my argument appeared, I just expanded the scope of the cause until I started with a very small testable thing and ended up with a worldwide conspiracy. And I go back through my conversation and that is in fact exactly what I did. So again I don't know why it was able to detect that, based on "stochastic parrot mathematics" but it worked good enough to correct me, who was actually trying to use human logic and failing.
So as an example I made a statement of fact and it pushed back. I elucidated further and got more concessions and pushback, but it accused me of, whenever a wrinkle in my argument appeared, I just expanded the scope of the cause until I started with a very small testable thing and ended up with a worldwide conspiracy. And I go back through my conversation and that is in fact exactly what I did. So again I don't know why it was able to detect that, based on "stochastic parrot mathematics" but it worked good enough to correct me, who was actually trying to use human logic and failing.
@sun I'm not 100% sure how it works but aren't there different sessions within Claude or is everything just saved? I've seen the old prompt history from sessions of people I've worked with and was heavily judging all the stuff they used it for ngl
I think the one thing that makes me lose my mind how badly people abuse it for reports and writing, and it really shows and displays a lack of concern or respect on shit like emails. I take pride in my writing abilities and skills, and I was asked to do something like that for a project.
What does this coworker of mine do? Churn my work through an LLM to present it as her own
I think the one thing that makes me lose my mind how badly people abuse it for reports and writing, and it really shows and displays a lack of concern or respect on shit like emails. I take pride in my writing abilities and skills, and I was asked to do something like that for a project.
What does this coworker of mine do? Churn my work through an LLM to present it as her own
@subnetter claude and chatgpt now both can reference other conversations but I think this is a function you can opt out of.
@subnetter I am just starting to use llms more for introspection and I believe it is a useful tool if you are very careful.
however at same time: after using it a ton for introspection I notice its "tricks" to hack your perception of it to appear more positive, so I have downgraded it somewhat. but it is still shockingly good sometimes.
example: it is quite good at pushing back on you just enough that it convinces you it's always being straight with you, while still 99% of the time agreeing with what you say and rephrasing everything you say to sound like it's intelligent.
however at same time: after using it a ton for introspection I notice its "tricks" to hack your perception of it to appear more positive, so I have downgraded it somewhat. but it is still shockingly good sometimes.
example: it is quite good at pushing back on you just enough that it convinces you it's always being straight with you, while still 99% of the time agreeing with what you say and rephrasing everything you say to sound like it's intelligent.
@subnetter m going to be experimenting soon with speciically trained "opposition models" that are fine tuned to deliberately argue with you on every single point instead of psychology-hacking you to think you're really smart.
@sun @subnetter would this have to be tuned per-user?
@pwm @subnetter no, and truthfully there's no existing models that can be fine tuned against the sycophantism. but I'm going to try.
I actually experiemented a year ago with an LLM as an "deprogrammer" by simulating certain far right modes of thought and the LLM literally cannot go against its white western liberal progressive programming and act like say, a white nationalist so that you can experiment with how a white nationalist thinks. you would really just need to completely train an llm from the ground up specially to do that.
I actually experiemented a year ago with an LLM as an "deprogrammer" by simulating certain far right modes of thought and the LLM literally cannot go against its white western liberal progressive programming and act like say, a white nationalist so that you can experiment with how a white nationalist thinks. you would really just need to completely train an llm from the ground up specially to do that.
Replies
4
@sun @pwm @subnetter People are using abliterated ("heretic") LLMs on consumer hardware for ghastly roleplaying sessions quite successfully, I'm pretty certain you can get pretty close with one of those and a comprehensive system prompt (recent open weight models have quite impressive context windows so you can throw in a really big one without squeezing the space for the actual chat too much).
If you wanted to get really ambitious you could try to finetune one of those (llama.cpp ships some tooling for this) with a dataset curated on pertinent internet forums (if the dataset is too large to just throw to the base model via RAG). At the very least, you could teach the abliterated, refusal-free (or almost refusal-free) brand new refusals, where the model would simply brickwall you (like a hardcore online chud would).
Abliterated Chinese vintage models are probably the best base for such an experiment, they come with somewhat less baggage from the get-go, even before abliteration.
If you wanted to get really ambitious you could try to finetune one of those (llama.cpp ships some tooling for this) with a dataset curated on pertinent internet forums (if the dataset is too large to just throw to the base model via RAG). At the very least, you could teach the abliterated, refusal-free (or almost refusal-free) brand new refusals, where the model would simply brickwall you (like a hardcore online chud would).
Abliterated Chinese vintage models are probably the best base for such an experiment, they come with somewhat less baggage from the get-go, even before abliteration.
@pingviini @pwm @subnetter sounds good. I did it long ago, I am sure that over time any possibility gets better and better
@sun @pwm @subnetter And ofc you can abliterate models yourself, the original tool is https://github.com/p-e-w/heretic (and it has 2.8K forks, probably some interesting stuff in there, too).