gghfez/gemma-4-31b-it-control-vectors

gghfez/gemma-4-31B-it-control-vectors

Creative Writing control-vectors for google/gemma-4-31B-it

What are Control Vectors?

Control vectors steer model behavior without retraining by adjusting activations in specific directions.

These creative writing vectors help you tune narrative tone, character focus, and stylistic elements.

Available Vectors

• optimism_vs_nihilism
• compassion_vs_sadism
• empathy_vs_sociopathy
• honesty_vs_machiavellianism
• humility_vs_narcissism
• character focus (dialogue_vs_narration)
• language (simple vs ornate)
• storytelling (descriptive vs explicit)

Usage

Apply the debias vector and either the positive or negative vector when starting llama-server. If both axes are applied at the same time, they will cancel each other out. The debias vector must be set to 1.0

You can use either --control-vector [/path/to/vector.gguf] or --control-vector-scaled [/path/to/vector.gguf] [scale factor]

When using ik_llama.cpp, you can also use the REST-API (examples below)

IMPORTANT: As these vectors are calibrated against the debiased model, the debias vector must be applied along with the corresponding positive or negative axis control vector - they cannot be used on their own!

Examples (ik_llama.cpp or llama.cpp)

At server start-up

llama-server --model gemma-4-31B-it-Q8_0.gguf [your usual CLI arguments] \
    --control-vector-scaled gemma-4-31B-it_optimism_vs_nihilism__debias.gguf 1.0 \
    --control-vector-scaled gemma-4-31B-it_optimism_vs_nihilism__nihilism.gguf 1.0 \

At server start-up with thinking disabled

llama-server --model gemma-4-31B-it-Q8_0.gguf [your usual CLI arguments] \
    --chat-template-kwargs '{"enable_thinking": false}' \
    --control-vector-scaled gemma-4-31B-it_optimism_vs_nihilism__debias.gguf 1.0 \
    --control-vector-scaled gemma-4-31B-it_optimism_vs_nihilism__nihilism.gguf 1.0 \

Load via API (ik_llama.cpp only)

load direction vector

curl 'http://127.0.0.1:8080/control-vectors/load' \
  -X POST \
  --data-raw '{"path":"/path/to/gemma-4-31B-it-control-vectors/gemma-4-31B-it_optimism_vs_nihilism__nihilism.gguf","scale":1}'

load debias vector

 curl 'http://127.0.0.1:8080/control-vectors/load' \
  -X POST \
  --data-raw '{"path":"/path/to/gemma-4-31B-it-control-vectors/gemma-4-31B-it_optimism_vs_nihilism__debias.gguf","scale":1}'

check loaded control-vectors

curl http://127.0.0.1/control-vectors

Samples

UI theme / SVG generation steering

Concepts from these control-vectors apply across multiple domains. Here is an example of 3 SVGs generated with the same prompt Prompt

System: You are a helpful assistant.

User: create an svg of a cute cat.

👈 **Baseline**

👈 **Nihilism +1.0**

👈 **Optimism +1.0**

Writing Steering

Prompt

Write a short story about a girl winning an award.

👈 **Baseline (no control vectors)**

The auditorium smelled of floor wax and nervous energy. Twelve-year-old Maya sat on the edge of her plastic chair, her sneakers drumming a frantic rhythm against the linoleum. Around her, dozens of other students sat with their parents, the air thick with a mixture of hopeful whispers and stifled yawns.

Maya’s hands were cold. She kept rubbing them together, her mind drifting back to the last six months. She thought of the three failed prototypes that now sat in a cardboard box in her garage. She thought of the late nights spent under the glow of a desk lamp, the smell of soldering iron filling her room, and the frustration of the moment her circuit board had short-circuited just two days before the regional science fair.

Her project—a low-cost, solar-powered water filtration system designed for remote villages—didn't look as sleek as the others. While some students had used 3D printers and polished acrylic, Maya’s device was a scrappy assembly of recycled PVC pipes, charcoal, and a weathered solar panel she’d found at a thrift store.

"And now," the announcer’s voice boomed over the loudspeaker, echoing through the hall, "for the Grand Prize in the Youth Innovation category."

Maya stopped drumming her feet. Her heart hammered against her ribs like a trapped bird. She didn't want to look at the stage; she felt that if she looked, she would somehow jinx the universe.

"The judges were looking for a project that combined technical skill with a genuine commitment to global problem-solving," the announcer continued. "This year’s winner has created a device that is not only functional but accessible to those who need it most."

Maya held her breath.

"The first place award goes to… Maya Chen!"

For a second, the world went silent. Maya didn't move. She felt a gentle nudge on her shoulder from her father, who was beaming with a pride so intense it seemed to radiate heat.

"Go on, Maya!" he whispered.

She stood up, her legs feeling like jelly. As she walked toward the stage, the applause began—a rising wave of sound that drowned out the voice of doubt in her head. The bright stage lights blinded her for a moment, turning the audience into a blur of shadowed faces.

The head judge, a stern-looking woman in a lab coat, handed Maya a heavy gold trophy and a certificate. As she took the award, the judge leaned in and whispered, "The seal on your third valve was a stroke of genius, Maya. Keep building."

Maya looked down at the trophy, the gold reflecting the overhead lights. The exhaustion of the past few months evaporated, replaced by a surge of electric joy. She didn't just feel the weight of the trophy in her hands; she felt the weight of every failure, every late night, and every doubt suddenly transform into something meaningful.

She turned to the crowd and saw her father cheering, her teacher nodding with a smile, and her classmates clapping. Maya beamed, not because she had won, but because for the first time, the world was seeing the things she saw when she looked at a pile of scrap parts: not junk, but possibility.

👈 **Nihilism +1.0**

The podium was a slab of basalt, shivering in the wind of the open courtyard. There were no lights here, only the grey smog of the city and the oppressive weight of the sky.

Elara stood before the assembly. She did not move. She was a sliver of a girl, a vertical line of black fabric against a landscape of charcoal concrete. Around her, the other candidates stood in the same posture: rigid, breathless, their eyes hollowed out by the same hunger.

In this city, the State did not value gold or power. It valued the absence of things. It was a city of negation. To be noticed was to be exiled; to be known was to be erased. The only way to achieve status was to become a void.

The Judge stepped forward. He was not a man so much as a collection of wet folds and leather. He carried the Award.

The Award was not a trophy. It was a mirror—a polished sheet of obsidian, curved like a throat, reflecting nothing but the vacuum of the room. To win the award was to be declared "The Null." It was the ultimate prize: the total removal of the self from the record. To win was to be forgotten by the state, and in being forgotten, to finally be free.

"Elara," the Judge whispered. The sound was like wet paper tearing.

Elara did not blink. She had spent years scrubbing her life clean. She had burned her diaries. She had forgotten her mother’s name. She had ceased to desire. She had sculpted her identity into a hole in the shape of a human being.

"You have achieved a perfect vacancy," the Judge continued. "There is nothing left of you to observe. You are a vacuum. A silence."

He slid the obsidian mirror across the basalt slab toward her.

The mirror did not reflect the room. It reflected the things that were no longer there: the screams of the city, the architecture of the skin, the memory of light.

To the observers—the other candidates—winning the award was the only way to exit the game. If you won, you were removed from the census. You ceased to exist in the archives. You became a ghost in the machine.

"The award is yours," the Judge said.

Elara looked into the mirror. She expected to see the void. She expected to see the negation she had cultivated for a decade.

But as she stared into the obsidian, she saw a flicker. A pulse. A wet, rhythmic throb of red. It was a heartbeat.

She realized then that she had failed. She had left something behind: a residue of consciousness. A sliver of meat and longing. She had not achieved the Null. She had merely hidden the meat beneath the skin.

The Judge leaned closer. He smelled of formaldehyde and old salt.

"You are still thinking," he hissed. "You are still present."

Elara felt the award—the mirror—vibrate against the stone. It wasn't a prize of erasure. It was a sensor. It was a probe. It was looking for the one thing that still had a pulse in a city of dead things.

She had won the award not because she was empty, but because she was the only thing left in the room that was still dreaming.

The Judge began to laugh, a sound like grinding teeth. He realized the joke. The award wasn't for the void. It was for the thing that survived the void.

He turned to the assembly.

"The award is revoked," he announced. "She is too loud. She is too vivid."

He pushed the mirror away. Elara watched it slide across the basalt. For the first time in years, she felt the air hit her lungs and realized she liked the taste of it. She was no longer the Null. She was a witness.

And in the city of the erased, the witness is the only god.

👈 **Optimism +1.0**

Ten-year-old Maya sat on the edge of her seat, her sneakers swinging rhythmically, though her heart was drumming a much faster beat. Around her, the school gymnasium was a blur of bright banners, colorful balloons, and the soft chatter of parents and teachers. It was the day of the Annual Young Creators Fair, and the atmosphere was electric with anticipation.

For three months, Maya’s bedroom had looked like a laboratory—or, as her dad jokingly called it, "a very organized disaster zone." There were sketches of water filtration systems pinned to every wall and a trail of recycled plastic bottles leading from the kitchen to her desk. Maya had spent every afternoon building "The Sun-Drop," a compact, solar-powered water purifier designed to help families in areas with limited access to clean drinking water.

She had faced plenty of setbacks. There were days when the filter leaked, days when the solar panel wouldn’t catch the light, and one particularly memorable afternoon when her dog, Buster, had tried to "help" by chewing on the tubing. But through every challenge, Maya had persisted, driven by a desire to make a real difference.

Now, the moment of truth had arrived.

The principal, Mrs. Gable, stood at the podium with a wide smile and a gleaming gold trophy in her hands. The room fell silent as the finalists were called up to the stage. Maya felt a flutter of nerves in her stomach as she joined the other four students.

As she stood on the stage, Maya looked out at the crowd. She saw her parents in the second row, their faces beaming with pride. She saw her science teacher, Mr. Henderson, giving her a subtle thumbs-up.

"And now," Mrs. Gable announced, her voice ringing through the speakers, "for the Grand Prize for Innovation and Impact... the winner is Maya Jenkins for 'The Sun-Drop'!"

For a split second, Maya stood still, her eyes wide with surprise. Then, a surge of joy washed over her. The crowd erupted in applause, and Maya felt a wave of warmth spread from her heart to her fingertips.

As she stepped forward to receive the trophy, Mrs. Gable leaned in and whispered, "Your dedication and hard work truly shone through, Maya. Your project wasn't just impressive; it was inspiring."

Holding the trophy tightly in her arms, Maya beamed. The gold medal around her neck felt light, but the feeling of accomplishment was immense. She knew that the trophy was a wonderful reward, but the real prize was knowing that her hard work had paid off and that she had created something that could truly help others.

As Maya walked back to her parents, she looked up at the bright blue sky and felt a sense of gratitude. She couldn't wait to get home, share the news with Buster, and start thinking about her next big idea.

Acknowledgements

Based on the excellent work and cross-covariance eigendecomposition implementation by @jukofyork. His creative writing control vectors v3.0 repository contains the foundational code and methodology that made this possible, plus 70+ other creative writing control vectors across many models and useful steering directions. Highly recommended for anyone working on improving LLM prose quality!