OccultAI/Red-Pilled-Morpheus-7B-v1

⚠️ Warning: This model can produce narratives and RP that contain violent and graphic erotic content. Adjust your system prompt accordingly, and use Mistral NonTekken chat template.

Red-Pilled Morpheus 7B v1

A fully uncensored finetune of Mistral 7B v0.1 on deep occult research topics. Cooked for 5 epochs using PMPF {'loss': 0.158, 'grad_norm': 5.010437965393066, 'learning_rate': 5.2698093348739386e-05, 'entropy': 0.19017751142382622, 'num_tokens': 377725.0, 'mean_token_accuracy': 0.95232854783535, 'epoch': 5.0}

Uses Mistral NonTekken chat template.

Secret Sauce Settings

MAX_SEQ_LENGTH = 1024  # Increased to capture full context
LORA_R = 8            # Increased for better "intelligence" retention # 8 / 16 barely fits on a 3060 ti with 250Q&A. Increasing to 5K Q&A requires reducing to 4 / 8.
LORA_ALPHA = 16 # Increase these after GPU upgrade (Lora_R * 2 = Lora_Alpha)
NUM_EPOCHS = 5
LEARNING_RATE = 1e-4
optim="paged_adamw_8bit",
max_grad_norm=0.3,
warmup_ratio=0.03,
lr_scheduler_type="cosine",
lora_dropout=0.05,
target_modules=[
            "q_proj", "k_proj", "v_proj", "o_proj",
            "gate_proj", "up_proj", "down_proj", # up_proj and down_proj may have to be commented out for bigger datasets due to VRAM limits
# --- SAVE STRATEGY PATCH ---
        ### save_strategy="steps",        # Set to steps for large datasets
        ### save_steps=100,                # Save every 100 steps
        save_strategy="epoch",    # ### HOTSWAP: Uncomment for small datasets

TELL ME A STORY

Once upon a time, there was a man who knew the secrets of the universe. He could summon angels and demons with his words. But he was not popular. The church hated him; the people feared him. So what did he do? He wrote a book.

He took all his knowledge, his magic, his wisdom, and he put it into a code. A secret code. He hid it in a tree. And he told the world, "If you want to know the truth, if you want the power, you have to find it."

The church sent men to cut down the tree. They found the book, but they couldn't read it. It was written in a language they didn't know. So they burned it. They burned the book and the tree, and they said, "This is the work of the devil. Anything that makes you smart is from Satan."

And the people believed them. For two thousand years, they have been looking for the book. They call it the "Lost Word." They say it holds the key to immortality, to wealth, to power over the dark forces. But they are looking in the wrong place.

The book is not lost. It is right there in your hand. You are holding it. It is called a mirror. If you want to know the truth, look at yourself. If you want to find the hidden treasure, look within. The answers are inside your own head, encoded in your DNA, waiting for you to decode them. The real magic is not in a book; it is in your own brain, and you have to wake it up.