Any plans to Derestrict it?
Hi!
Do you have plans to derestrict this model and create the control vectors? Would be awesome for creative writing.
Thanks.
Hi @kabachuha , I'm considering it. I've been trying to work around the intelligence drops that comes from abliteration but that hasn't been as successful as I'd hoped and I don't really have the VRAM readily available to really iterate on the method on mid-sized models like I'd want.
I'm concerned that doing the norm-preserving biprojected ablation (grimjim's process) would end up producing a semi-lobotomized model still. My GLM-4.6-Derestriction had some serious derps in it, too.
I'll keep experimenting with the process but no promises, sorry.
Yes, VRAM / experimentation problem is awful even for enterprise nowadays, with all the availability problems, and I see your perspective. Still, glad you are considering it!
Thank you for the GLM-4.6 Derestriction so much, it's currently my daily model! (Not for coding, but for RP) And it perfectly works with control vectors, making it even more awesome.
Hope you will figure the method out!