mrm8488/synthtraces-bucket
326 MB
Manuel Romero PRO
mrm8488
AI & ML interests
#AI Research and Democratization. NLP/NLG 🤗
Recent Activity
updated a model 3 days ago
MAISAAI/gemma-4-E2B-it published a model 3 days ago
MAISAAI/gemma-4-E2B-it liked a model 13 days ago
DavidAU/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-NEO-MAX-MTP-GGUFOrganizations
![Unofficial Mistral Community [deprecated]'s profile picture](https://cdn-avatars.huggingface.co/v1/production/uploads/6141a88b3a0ec78603c9e784/HAdAzcs1CDB9OxgxT2W9K.png)
Posts 3
Post
9139
🚨Exciting news for the Multilingual Synthetic Data Community!🚨
I’ve taken inspiration from the MAGPIE paper on Llama-3-8B-instruct and extended its capabilities. Here’s what’s new!
🗞 The MAGPIE paper showcased that if you use the instruction-tuned version (
🤔 While reading a script by Sebastian Raschka, PhD, I wondered: Could these advancements be replicated in other languages? Specifically, could they benefit non-English datasets?
🎉 And the answer is YES! At least for Spanish. I've successfully adapted the techniques for Spanish, proving the model's flexibility and multilingual capabilities.
👩💻 To make this accessible, I created a basic script (heavily inspired by the Sebastian Raschka one) that allows you to generate similar datasets using
[Script](https://gist.github.com/mrm8488/4650a5e3cc45523798a527a3446eb312)
🔍 Explore the datasets 📚 generated using our new script!
- [Llama-3-8B](https://huggingface.co/datasets/mrm8488/dataset_llama3_5000_samples_es_4231_filtered)
- [Phi-3-medium](https://huggingface.co/datasets/mrm8488/dataset_phi3-medium_5000_samples_es_3906_filtered)
- [Phi-3-mini](https://huggingface.co/datasets/mrm8488/dataset_phi3_5000_samples_es_3282_filtered)
Note: These datasets have basic filtering. Apply additional quality filters before using them to fine-tune large language models.
Inspiration and base script:
https://github.com/rasbt/LLMs-from-scratch/blob/main/ch07/05_dataset-generation/llama3-ollama.ipynb
https://www.linkedin.com/feed/update/urn:li:activity:7210982019751661568/
I’ve taken inspiration from the MAGPIE paper on Llama-3-8B-instruct and extended its capabilities. Here’s what’s new!
🗞 The MAGPIE paper showcased that if you use the instruction-tuned version (
Llama-3-8B-instruct) to generate synthetic instructions and then fine-tune the base version (Llama-3-8B) on this dataset, you can improve even the it-tuned version🤔 While reading a script by Sebastian Raschka, PhD, I wondered: Could these advancements be replicated in other languages? Specifically, could they benefit non-English datasets?
🎉 And the answer is YES! At least for Spanish. I've successfully adapted the techniques for Spanish, proving the model's flexibility and multilingual capabilities.
👩💻 To make this accessible, I created a basic script (heavily inspired by the Sebastian Raschka one) that allows you to generate similar datasets using
ollama models (initially phi and llama3) automatically and upload it to the Hugging Face Hub
🔍 Explore the datasets 📚 generated using our new script!
- [Llama-3-8B](https://huggingface.co/datasets/mrm8488/dataset_llama3_5000_samples_es_4231_filtered)
- [Phi-3-medium](https://huggingface.co/datasets/mrm8488/dataset_phi3-medium_5000_samples_es_3906_filtered)
- [Phi-3-mini](https://huggingface.co/datasets/mrm8488/dataset_phi3_5000_samples_es_3282_filtered)
Note: These datasets have basic filtering. Apply additional quality filters before using them to fine-tune large language models.
Inspiration and base script:
https://github.com/rasbt/LLMs-from-scratch/blob/main/ch07/05_dataset-generation/llama3-ollama.ipynb
https://www.linkedin.com/feed/update/urn:li:activity:7210982019751661568/
spaces 25
pinned
Runtime error
Agents
13
Whisper V3 Large Demo
🎙
No application file
Agents
Unia Test
🏃
Sleeping
Agents
Test Dev Mode
🦀
Get LLM recommendations for tasks
No application file
Agents
Space Test
🌍
Running
83
FlappyBirds
:
Watch AI learn to play Flappy Bird with neuroevolution
Runtime error
Agents
7
Idefics 9b Ft Describe Diffusion Mj
👁
models 588
mrm8488/Qwopus3.6-27B
Updated • 1
mrm8488/functiongemma-270m-it-ft-mobile-actions-es
0.3B • Updated • 5
mrm8488/functiongemma-270m-it-ft-mobile-actions-it
0.3B • Updated • 3
mrm8488/functiongemma-270m-it-ft-mobile-actions-fr
0.3B • Updated • 3 • 1
mrm8488/bert-hash-nano-ft-prompt-injection
Text Classification • 970k • Updated • 11
mrm8488/bert-hash-pico-ft-prompt-injection
Text Classification • 448k • Updated • 14 • 1
mrm8488/bert-hash-femto-ft-prompt-injection
Text Classification • 243k • Updated • 15 • 1
mrm8488/bert-es-hash-femto-ft-imdb-es
Text Classification • 243k • Updated • 5
mrm8488/bert-es-hash-pico-ft-imdb-es
Text Classification • 448k • Updated • 5
mrm8488/bert-es-hash-nano-ft-imdb-es
Text Classification • 970k • Updated • 5
datasets 49
mrm8488/fineweb-2-spa-3m-wikipedia-2m
Viewer • Updated • 4.99M • 468
mrm8488/fineweb-2-spa-5m-wikipedia-2m
Viewer • Updated • 6.99M • 110
mrm8488/fineweb-2-spa-5m
Viewer • Updated • 5M • 93
mrm8488/fineweb-2-spa-1m
Viewer • Updated • 1M • 31
mrm8488/FineTome-single-turn
Viewer • Updated • 83.3k • 27
mrm8488/llava_instruct_150k
Viewer • Updated • 158k • 20
mrm8488/llava_v1_5_mix665k
Viewer • Updated • 665k • 72 • 1
mrm8488/all_nli_es
Viewer • Updated • 105k • 13
mrm8488/WebSight_70k
Viewer • Updated • 82.3k • 50 • 3
mrm8488/WebSight_140k
Updated • 13 • 1