Aratako/MioCodec-25Hz
Audio-to-Audio
•
Updated
•
83
•
4
Yatharth Sharma
YatharthS
AI & ML interests
TTS, speech generation, Agents, MCP
Recent Activity
liked
a model
2 days ago
Aratako/MioCodec-25Hz
updated
a Space
3 days ago
YatharthS/LuxTTS
new activity
3 days ago
YatharthS/LuxTTS:Thanks a Million for This HF Space!
Organizations
liked
a
model
2 days ago
updated
a
Space
3 days ago
Thanks a Million for This HF Space!
3
#3 opened 5 days ago
by
9voltfan2009
reacted to
AbstractPhil's
post with 🔥
6 days ago
Post
944
Meet FluxLailah;
AbstractPhil/tiny-flux-deep; 220m Flux variant currently pretraining at BF16. She is experimental, does not produce solid images yet - and yet she is producing. There is both an EMA and a raw weights pair producing different images. The EMA is particularly interesting at times.
Lailah uses flan-t5-base, clip-vit-l-14, and BlackForestLabs Flux1s VAE.
SEQ limit 128, images 512x512 for now. Lailah's early form is based on three variants. TinyFlux's weights were carefully planted into a deeper structure and trained yet again - dubbed TinyFlux-Deep. This variant has 15 dual-stream blocks and 25 single-stream blocks, nearly identical weight code as Flux with a similar attention mechanism - but intentionally deviant and compacted with careful consideration to scaling and purpose of mechanisms.
She went through quite a few growing pains with her earlier attention mechanism which required a reimagining today and careful consideration of the consequences, and now I present to you the preliminary look into Lailah.
The preliminary training is still heavily under way, the mechanisms are still being augmented, and her stability is currently being measured. The potential for fidelity, depth, and quality are still in measure - so I will be shifting attention and pivoting utility based on the needs over time.
Lailah uses flan-t5-base, clip-vit-l-14, and BlackForestLabs Flux1s VAE.
SEQ limit 128, images 512x512 for now. Lailah's early form is based on three variants. TinyFlux's weights were carefully planted into a deeper structure and trained yet again - dubbed TinyFlux-Deep. This variant has 15 dual-stream blocks and 25 single-stream blocks, nearly identical weight code as Flux with a similar attention mechanism - but intentionally deviant and compacted with careful consideration to scaling and purpose of mechanisms.
She went through quite a few growing pains with her earlier attention mechanism which required a reimagining today and careful consideration of the consequences, and now I present to you the preliminary look into Lailah.
The preliminary training is still heavily under way, the mechanisms are still being augmented, and her stability is currently being measured. The potential for fidelity, depth, and quality are still in measure - so I will be shifting attention and pivoting utility based on the needs over time.
- 2 replies
reacted to
raincandy-u's
post with 🔥
6 days ago
Post
5219
🤗 Just released Rain-100M, an experimental ~97M-parameter Qwen3-style language model trained from random initialization.
Repo: raincandy-u/Rain-100M
Data: HuggingFaceFW/fineweb-edu, ~3B tokens, English only
Tokenizer: custom 16k BPE, context length 4096
Architecture: 12 Transformer layers, hidden size 768, 12 heads, MLP 2048, SiLU, bf16
Rain-100M is a raw base model (not instruction-tuned or safety-aligned), aimed at small-scale research, debugging training pipelines, and CPU/edge experiments. If you run evaluations, finetunes, or visualizations with it, I would be very interested in your results!
Repo: raincandy-u/Rain-100M
Data: HuggingFaceFW/fineweb-edu, ~3B tokens, English only
Tokenizer: custom 16k BPE, context length 4096
Architecture: 12 Transformer layers, hidden size 768, 12 heads, MLP 2048, SiLU, bf16
Rain-100M is a raw base model (not instruction-tuned or safety-aligned), aimed at small-scale research, debugging training pipelines, and CPU/edge experiments. If you run evaluations, finetunes, or visualizations with it, I would be very interested in your results!
- 3 replies
About the architecture
2
#1 opened 6 days ago
by
PatnaikAshish
Your Space has a generation error
13
#1 opened 7 days ago
by
MihaiPopa-1
liked
a
Space
7 days ago
updated
a
model
7 days ago
published
a
Space
7 days ago
liked
a
model
8 days ago
published
a
model
8 days ago
liked
a
model
9 days ago
Update README.md
1
#3 opened 11 days ago
by
Meyer54
replied to
their
post
12 days ago
Hey, I am working on a new TTS model called LuxVoice which will include this instead and I’ll try my best to convert this to onnx as well.
updated
a
Space
14 days ago
replied to
their
post
14 days ago
Yeah seems very cool, great work!
liked
a
model
14 days ago
updated
a
model
16 days ago
liked
a
model
16 days ago
