Update README.md
Browse files
README.md
CHANGED
|
@@ -1,2 +1,29 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
|
| 2 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
pipeline_tag: any-to-any
|
| 3 |
+
license: mit
|
| 4 |
+
library_name: transformers
|
| 5 |
+
language:
|
| 6 |
+
- multilingual
|
| 7 |
+
tags:
|
| 8 |
+
- omni
|
| 9 |
+
- custom_code
|
| 10 |
+
- audio
|
| 11 |
+
- speech
|
| 12 |
+
- voice cloning
|
| 13 |
+
- live Streaming
|
| 14 |
+
- realtime speech conversation
|
| 15 |
+
- asr
|
| 16 |
+
- tts
|
| 17 |
+
---
|
| 18 |
|
| 19 |
+
# JoyTTS: LLM-based Spoken Chatbot With Voice Cloning
|
| 20 |
+
|
| 21 |
+
<br>
|
| 22 |
+
<div align='left'>
|
| 23 |
+
<a href='https://github.com/jdh-algo/JoyTTS'><img src='https://img.shields.io/github/stars/jdh-algo/JoyTTS?style=social'></a>
|
| 24 |
+
</div>
|
| 25 |
+
<br>
|
| 26 |
+
|
| 27 |
+
## 📖 Introduction
|
| 28 |
+
|
| 29 |
+
JoyTTS is an end-to-end spoken chatbot that combines large language models (LLM) with text-to-speech (TTS) technology, featuring voice cloning capabilities. This project is built upon the open-source MiniCPM-o and CosyVoice2 models and trained on 2000 hours of conversational data. We have also provided the complete training code to facilitate further development and optimization by the community. On the testing machine seed-tts-zh, it achieves a SM (Similarity Measure) score of 73 and a WER (Word Error Rate) of 5.
|