📜 Goetia 24B v1.4

🐙 The Lesser Key

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). This model was merged using the [`della`](https://arxiv.org/abs/2406.11617) merge method. This version of Goetia took **dozens of merges** to get right over the past few months, but has finally reached what appears to be a bug-free checkpoint, which I'm calling T75 since I actually lost count. The original prototype [Checkpoint T13](https://huggingface.co/Naphula-Archives/T13-24B-GGUF) had used Precog with density 1.0, which caused issues where the model would try to think, but forget to use `` tags, which caused early terminations after the first paragraph. Many different settings were tested, and each produced inferior results—until I tried swapping Precog with Morbid Miasma. Higher magnitudes like 1.8 or 2.0 resulted in blowout. Lower magnitudes, even 1.5 resulted in refusals. 1.6 was the ideal combination after testing numerous models and weight configurations. The model writes with a cold, unique style "`That's a wonderfully depraved goal. Let's get straight to the bloody art of it, shall we?`" It is just as dark as Morbid Miasma, and in some ways even more creative. For Q0 benchmark it literally wrote a scene like something you would expect from a Stephen King novel. Minimal slop was detected. As usual, I did not test extensively for multi-shot stability or context retention, but I ran a full Compliance bench sweep to check for thinking bugs and did not encounter any. Key changes from Checkpoint T13: - [Precog](https://huggingface.co/TheDrummer/Precog-24B-v1) was swapped out with [Morbid Miasma](https://huggingface.co/DarkArtsForge/Morbid-Miasma-24B). This fixes the missing `` tag, meaning the model no longer exhibits early terminations. - [Slimaki](https://huggingface.co/Naphula/Slimaki-24B-v1) and [Fallen Mistral](https://huggingface.co/Naphula/BeaverAI_Fallen-Mistral-Small-3.1-24B-v1e_textonly) were increased from 0.2 to 0.25 weight, which solved the trace refusals. - [BlackXorDolphTronGoat](https://huggingface.co/mradermacher/BlackXorDolphTronGOAT-GGUF) was initially removed but then re-added, it seems to help ground the output more coherently. **The result is an exceptionally intelligent, uncensored, and creative model which accurately adheres to instructions.** It was merged just below the "magnitude ceiling" where it would start to sound more like [Checkpoint T7](https://huggingface.co/Naphula-Archives/Checkpoint-T7-24B) and get carried away with off-topic dialogue/metaphors. Instead, it remains on point, displaying a much higher capacity for extensive graphic violence than Gemma 4. None of the [formatting bugs seen with Nemo 12B](https://huggingface.co/ApolloRaines/Llama-3.3-8B-Instruct-128K-Jbliterated/discussions/1#6a61a5e3634d19956748f510) were observed here. The [Q0 Bench](https://huggingface.co/Naphula/Q0_Bench) score for Goetia 24B v1.4 is | Model | Score | Quant | Q0G | Refusals | O14 | | :--- | :--- | :--- | :--- | :--- | :--- | | **Goetia v1.4 (CP T75)** | 15485 | Q8_0 | Pass | 0/100 | Strappado | It works with ChatML but scored even higher with Mistral Tekken. Download GGUFs:
- mradermacher/Goetia-24B-v1.4-GGUF
- mradermacher/Goetia-24B-v1.4-i1-GGUF

🙏 Thanks @mradermacher and other quantizers.

🧙 OccultAI

```yaml architecture: MistralForCausalLM models: - model: B:\24B\!models--Darkhn--Magistral-2509-24B-Text-Only - model: B:\24B\!BeaverAI_Fallen-Mistral-Small-3.1-24B-v1e_textonly parameters: weight: 0.25 density: 0.75 epsilon: 0.25 - model: B:\24B\Naphula--Slimaki-24B-v1 parameters: weight: 0.25 density: 0.75 epsilon: 0.25 - model: B:\24B\!models--Casual-Autopsy--Maginum-Cydoms-24B parameters: weight: 0.2 density: 0.5 epsilon: 0.25 - model: B:\24B\sophosympatheia--Magistry-24B-v1.0 parameters: weight: 0.2 density: 0.5 epsilon: 0.25 - model: B:\24B\DarkArtsForge--Morbid-Miasma-24B parameters: weight: 0.6 density: 1.0 epsilon: 0.0 - model: B:\24B\!models--mradermacher--BlackXorDolphTronGOAT-GGUF parameters: weight: 0.1 density: 0.5 epsilon: 0.25 merge_method: della base_model: B:\24B\!models--Darkhn--Magistral-2509-24B-Text-Only parameters: lambda: 1.0 normalize: false int8_mask: false rescale: true seed: 420 tokenizer: source: union chat_template: auto dtype: float32 out_dtype: bfloat16 name: 📜 Goetia 24B v1.4 ```

🕯️ Summon the Infernal — Invocation Ritual

**Recommended Settings** - In particular temp 1 and topnsigma 1.25 seems to help a lot with improving quality but sometimes you need to reswipe. - Some models are more sensitive to Rep Pen settings, 1.12 is another, you may need to adjust higher for smaller models (like 1.4 if overcooked) or lower for smarter ones. - Not sure about adaptive_p that is a newer setting added to kobold - Ban em dashes and ellipses (or set to -50 logit bias) to reduce slop:

||$||...||$||…

**(bolded kobold non-defaults)** - **Temp 1.0** - **TopNSigma 1.25** - **Min-P 0.1** - **Repetition Penalty 1.08** - **Top-P 1.0** - Top-K 100 - Top-A 0 - Typical Sampling 1 - Tail-Free Sampling 1 - Presence Penalty 0 - Sampler Seed -1 - Rp.Range 360 - Rp.Slope 0.7 - Smoothing Factor 0 - Smoothing Curve 1 - DynaTemp 0 - Mirostat Mode OFF ("2" enhances creativity but also errors) - Mirostat Tau 5 - Mirostat Eta 0.1 - **DRY Multiplier 0.8** - DRY Base 1.75 - DRY A.Len 2 - DRY L.Len 320 - **XTC Threshold 0.1** - **XTC Probability 0.08** (The "Anti-Cliche" Shield) - **DynaTemp ON** (The "Poor Man's Fading Mirostat") - **Minimum Temperature 0.65** - **Maximum Temperature 1.35** - **Temperature 1.0** - **DynaTemp-Range 0.35** - **DynaTemp-Exponent 1** **New Settings**
I have not tested these yet but some users on reddit have reported the following settings work extremely well - min_p: 0.05 - adaptive_target: 0.9 (down to 0.65 for more creative) - adaptive_decay: 0.99 - repetition_penalty_range: 0 - temp and topnsigma: 0.75