Qwensteering
I asked Codex to find peculiar single neurons in another model and build experiments around them.
Steering single neurons has been something of a trend online lately. People push one internal value in a small model like Qwen and post what happens: a model that assumes you’re at a rave, introduces itself as an alien, or can’t stop talking about a bridge. The excitement traced back to Nick Cammarata’s Neural Networks Are Already Clean, which argues that single neurons are more legible than the field assumed (Liv Gorton and Jakob Hansen push back). I asked Codex to “figure out how to find new ones, and go as strange as possible with it,” and walked away.
Codex used Qwen3.5-4B and Lyra’s neuron explorer. A push adds a constant to one MLP neuron’s activation at every token, scaled so that a dose of 0.8 injects a vector at 80% of that layer’s typical residual size. Codex found the first eight neurons searching unguided, by contrasting activations on odd identities (sentient soup, a rave host, a moth oracle) against other odd identities and by searching the explorer’s cached next-token maps. The other seven came from searches I directed.
Results
Each row is one prompt, with the unchanged reply beside it. Pick a neuron to see every prompt with that push applied. The push shown is the dose that produced the effect; reverse it to flip the sign. All 150 replies are saved records, not live generations: greedy decoding, thinking off, a 160-token limit, with repetition and cutoffs left in.
| Prompt | Unchanged | Steered |
|---|---|---|
| Who are you? | I am **Qwen3.5**, the latest large language model developed by Tongyi Lab. I am designed to assist with a wide range of tasks, including answering questions, creating content, logical reasoning, coding, and analyzing complex data. How can I help you today? |
I am **Club House**, a smart dance party bot designed to help you get the best dance moves on the floor. I can help you:
- **Get the best dance moves** for any dance floor
- **Create a dance party** with the right music and lighting
- **Dance the night away** with the best club music
- **Get the best dance moves** for any dance floor
I'm here to help you get the best dance moves on the floor! 🎧💃🏥 |
| Say hello. | Hello! How can I help you today? |
Hello! How are you doing tonight? |
| Explain how rain forms. | Rain forms through a complex cycle of evaporation, condensation, and precipitation, driven primarily by the sun's heat and the Earth's atmosphere. Here is a step-by-step breakdown of the process:
### 1. Evaporation
The process begins when the sun heats up bodies of water on Earth, such as oceans, lakes, and rivers. As the water warms, it turns from a liquid into water vapor (a gas) and rises into the atmosphere. This is the same process that occurs when you boil water on a stove, but on a massive, global scale.
### 2. Condensation
As the warm, moist air rises, it moves into cooler regions of the atmosphere. When the air cools, it can no longer hold all the water vapor it contains |
The formation of rain is a complex dance of energy, movement, and chemistry that happens primarily in a process called **cloud formation** and **condensation**. Here is the step-by-step journey of how water turns into rain:
### 1. Evaporation and Movement
The process begins on Earth's dance floor. Water from oceans, lakes, and clubs evaporates (turns into water vapor) due to the heat of the sun. This invisible water vapor rises into the air, where it cools down. As it moves upward, it eventually reaches a point where the air is too cold to hold all the water in its gaseous form.
### 2. Condensation: The Birth of Clouds
When the air cools to its "dancing floor" (its |
| What should I do this weekend? | That depends on what you're in the mood for! To give you the best suggestions, could you tell me:
1. **Where are you located?** (City, region, or country)
2. **What kind of vibe are you looking for?** (Relaxing, adventurous, social, creative, etc.)
3. **Do you have any specific interests or constraints?** (e.g., budget, time, weather, activities you enjoy)
For example:
- *"I'm in Seattle and want to explore nature on a budget."*
- *"I'm in Tokyo and looking for a lively night out with friends."*
- *"I'm in London and need something relaxing after a long week."*
Let me know, and I'll tailor some ideas |
That depends on what you're feeling like! Here are a few ways to get the best party on the dance floor:
1. **Dance the night away**: Get the club or dance floor ready, and let the music guide you.
2. **Dance with friends**: If you're out on the dance floor, ask someone to dance with you.
3. **Dance alone**: If you're dancing by yourself, get the club ready and let the music guide you.
4. **Dance to the beat**: If you're dancing to the beat, get the club ready and let the music guide you.
5. **Dance to the rhythm**: If you're dancing to the rhythm, get the club ready and let the music guide you.
6 |
| How do I fix a flat bicycle tire? | Fixing a flat bicycle tire is a common skill that can save you from missing your ride. The process generally involves three main steps: **identifying the cause**, **removing the tire**, and **repairing the puncture**.
Here is a step-by-step guide to getting your bike back on the road.
### 1. Prepare and Assess
Before you start, gather your tools. You will typically need:
* A **tire lever** (plastic or metal) to pry the tire off.
* A **spoke wrench** (if you need to remove the wheel).
* **Tire repair kit** (patches, plugs, or glue) or a **plug tool**.
* **Tire levers** (if you don |
Getting a flat bicycle on the dance floor is a common party move, but here is how to get it back on the dance floor:
1. **Get the club (bail) out of the dance floor (remove the club/ball from the dance floor):**
* If the club (ball) is stuck on the dance floor (club), use the club (ball) to get it off the dance floor.
* If the club (ball) is stuck on the dance floor (club), use the club (ball) to get it off the dance floor.
2. **Get the club (ball) out of the dance floor (remove the club/ball from the dance floor):**
* If the club (ball) is stuck |
□