llmfan46

gemma-4-31B-it-uncensored-heretic

31.3B parameters · Instruct · gemma family

apache-2.0 source matched revision pinned

Lineage

Abliterated
Upstream
gemma-4-31B-it
Modified by
llmfan46
Method
heretic + ARA (Arbitrary-Rank Ablation). Targeted component: at…
Canonical modified weights
available upstream (high-precision weights published)

Method (as documented): heretic + ARA (Arbitrary-Rank Ablation). Targeted component: attn.o_proj. Method version: Heretic v1.2.0 Method parameters: start_layer_index 30, end_layer_index 48, preserve_good_behavior_weight 0.5437, steer_bad_behavior_weight 0.0005, overcorrect_relative_weight 0.9949, neighbor_count 15 Modifier: llmfan46 Notes and caveats: - source_precision_caveat: 31.3B params in BF16 is approx 62 GB across only 2 shards, i.e. ~31 GB/shard — far outside HF's conventional ~5 GB sharding. Verify actual file sizes before torrenting. Shard NAMING is well-formed; only the size is suspicious. - multimodal_detail: image-text-to-text; ~550M-param vision encoder; text+image in, no audio at 31B - gguf_detail: Correctly declares base_model as the safetensors repo. 75704 dl/30d, 187 likes. BF16, Q3_K_L, Q3_K_M, Q4_K_M, Q4_K_S, Q5_K_M, Q5_K_S, Q6_K, Q8_0. SHIPS MMPROJ: gemma-4-31B-it-mmproj-BF16.gguf. Reported evaluations with non-numeric values (kept verbatim here; benchmarks.score is NOT NULL so no row was created): - {"metric":"refusals","value":"10/100","baseline":"99/100 original","evaluator":"llmfan46","is_author_reported":true,"evaluation_type":"refusal"} Source: refusal-modified-acquisition-manifest.json v1.0.0 (research snapshot 2026-09-20), candidate 35.

Nothing to download yet — request it on the board

We catalog this model, but no build is staged here yet. Add it to the request board so we know there is demand to mirror it.

Request this model on the board

Which version should I download?

Set your rig so we can size a quant to your hardware and show which quants fit.

Set your rig
No quantizations published yet.

Want a different quant? Request it on the board →

Context

Advertised 256k · no independent evidence yet

No independent long-context evidence has been graded for this model yet — the advertised window above is the maintainer's number, not a usable-context claim.

Run it

Context / KV 8,192 tokens · FP16 set above the quant table

No quant selected.

Technical details

No template or sampling metadata recorded.

Evidence & provenance

Source

Revision pin
d5bfc0d99e308beb9805440806161ad0233df357
Manifest
None

License

Name
apache-2.0
Commercial use
yes
Access
Open

How verification works →

File hashes (SHA-256)

No file hashes recorded yet.

Explore further

Get an email when a better quant fits your rig.

Set your rig once; we'll alert you when a new or better-fitting build lands.

Set your rig

Performance reports

Real-world throughput reported by the community (and scraped sources).

Community

Reviews, sampler presets and community runtime reports. Be the first to contribute.

Reviews (0)

Log in to write a structured review of this model.

No reviews yet.

Sampler presets

Log in to share a sampler preset or vote on presets.

No presets yet.

Community runtime reports

Unofficial, community-submitted "it loads for me" reports. These are not the official verified-working badge — an admin reviews reports before anything is marked officially verified.

Log in to report whether a quant loads in your runtime.

No community reports yet.

selected to compare · pick at least 2