File size: 1,331 Bytes
888d462 50b4134 888d462 3078d4a 888d462 3078d4a 888d462 50b4134 888d462 c0a8364 50b4134 888d462 50b4134 888d462 6b01d32 888d462 50b4134 888d462 50b4134 888d462 50b4134 888d462 50b4134 888d462 50b4134 888d462 50b4134 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 |
---
library_name: transformers
tags:
- cybersecurity
- security
- cybersec
- base
- llama3
license: llama3
language:
- en
---
# Colibri_8b_v0.1
<!-- Provide a quick summary of what the model is/does. -->
<img src="https://huggingface.co/CyberNative-AI/Colibri_8b_v0.1/resolve/main/cybernative_ai_colibri_logo.jpeg" alt="CyberNative-AI/Colibri_8b_v0.1"/>
## Colibri: Conversational CyberSecurity Model
<a href="CyberNative-AI/Colibri_8b_v0.1_gptq_128_4bit">GPTQ 4bit quant</a>
Colibri_8b_v0.1 is a conversational model for cybersecurity fine-tuned from the awesome [dolphin-2.9-llama3-8b](https://huggingface.co/cognitivecomputations/dolphin-2.9-llama3-8b). (llama-3-8b -> cognitivecomputations/dolphin-2.9-llama3-8b -> CyberNative-AI/Colibri_8b_v0.1)
We derived our training dataset by creating Q/A pairs from a huge amount of cybersecurity related texts.
> v0.1 trained for 3 epochs using around 35k Q/A pairs FFT on all parameters using a single A100 80gb for 3 hours.
This model is using ChatML prompt template format.
example:
```
<|im_start|>system
You are Colibri, an advanced cybersecurity AI assistant developed by CyberNative AI.<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
```
Provided by [CyberNative AI](https://cybernative.ai/)
*ANY ILLEGAL AND/OR UNETHICAL USE IS NOT PERMITTED!* |