PEFT
Safetensors
How to use from the
Use from the
PEFT library
from peft import PeftModel
from transformers import AutoModelForCausalLM

base_model = AutoModelForCausalLM.from_pretrained("meta-llama/Llama-3.1-8B-Instruct")
model = PeftModel.from_pretrained(base_model, "millicentli/llama3_inversion_llama3_multi")

This is the model used to invert Llama-3-8B activations using a Llama-3-8B model (multiple, not a single, activation).

The model is used in Do Activation Verbalization Methods Convey Privileged Information?. Read more of our paper for training information.

Downloads last month
51
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for millicentli/llama3_inversion_llama3_multi

Adapter
(2253)
this model

Paper for millicentli/llama3_inversion_llama3_multi