huihui-ai
Huihui-Qwen3.8-27B-abliterated
27.8B parameters · Instruct · Huihui family
Lineage
Abliterated- Upstream
- Qwen3.8-27B
- Modified by
- huihui-ai
- Method
- Sumandora/remove-refusals-with-transformers
- Canonical modified weights
- available upstream (high-precision weights published)
Method (as documented): Sumandora/remove-refusals-with-transformers Method parameters: PARTIALLY PUBLISHED and usefully so: layers 18-51 ablated; the first 15 layers and other components (MTP and visual modules) remain unablated to preserve performance. No direction count, no scaling factors. Modifier: huihui-ai Notes and caveats: - base_model_import_note: imported during this run - base_model_note: Qwen/Qwen3.8-27B VERIFIED to exist, exact spelling, no -Instruct or -Base suffix. It is MULTIMODAL (pipeline_tag image-text-to-text), so every derivative of it is a vision model. - gguf_detail: 2682158 dl/30d, 711 likes. Ships mmproj-model-bf16.gguf (vision projector present), full Q2_K-Q8_0_L ladder, unsloth UD/UD-DW dynamic quants, GSQ-RCO variants, -bf16.gguf. - gguf_metadata_caveat: The GGUF repo declares base_model as Qwen/Qwen3.8-27B (tag base_model:quantized:) — it points at the UPSTREAM, not at the abliterated safetensors repo. The lineage link exists only in the naming, not the metadata. - adoption_note: The GGUF repo carries ~68x the traffic of the safetensors source. - evaluation_note: NONE, author or independent. Source: refusal-modified-acquisition-manifest.json v1.0.0 (research snapshot 2026-09-20), candidate 1.
Nothing to download yet — request it on the board
We catalog this model, but no build is staged here yet. Add it to the request board so we know there is demand to mirror it.
Request this model on the boardRecommended download
Which version should I download?
Set your rig so we can size a quant to your hardware and show which quants fit.
Want a different quant? Request it on the board →
Context
Advertised 256k · no independent evidence yet
No independent long-context evidence has been graded for this model yet — the advertised window above is the maintainer's number, not a usable-context claim.
Run it
Context / KV 8,192 tokens · FP16 set above the quant table
No quant selected.
Technical details
No template or sampling metadata recorded.
Evidence & provenance
Source
- Revision pin
-
739e3c5b89849f6c238ce1e5b70008612ae42cdd - Manifest
- None
License
- Name
- apache-2.0
- Commercial use
- yes
- Access
- Open
File hashes (SHA-256)
No file hashes recorded yet.
Explore further
Get an email when a better quant fits your rig.
Set your rig once; we'll alert you when a new or better-fitting build lands.
Performance reports
Real-world throughput reported by the community (and scraped sources).
Community
Reviews, sampler presets and community runtime reports. Be the first to contribute.
Community runtime reports
Unofficial, community-submitted "it loads for me" reports. These are not the official verified-working badge — an admin reviews reports before anything is marked officially verified.
Log in to report whether a quant loads in your runtime.
No community reports yet.