Simonlee711
/

Clinical_ModernBERT

Feature Extraction

biomedical-text

discharge-notes

text-embeddings-inference

Model card Files Files and versions

Simonlee711 commited on May 11

Commit

1d7e937

·

verified ·

1 Parent(s): 38531a1

Update README.md

Files changed (1) hide show

README.md +0 -4

README.md CHANGED Viewed

@@ -17,10 +17,6 @@ base_model:
 library_name: transformers
 ---
-Below is a draft Hugging Face model card for Clinical ModernBERT. The card emphasizes the masked language modeling setup and describes the pre-training optimizations.
----
 # Clinical ModernBERT
 Clinical ModernBERT is a state-of-the-art encoder-based transformer tailored specifically for biomedical and clinical text handling context length up to **8192 tokens**. Building on the innovations introduced by ModernBERT, this model extends the context window to 8,192 tokens and incorporates domain-specific vocabulary refinements. It is designed to produce semantically rich representations that capture both the nuanced syntax of biomedical literature and the intricate semantics of clinical narratives.

 library_name: transformers
 ---
 # Clinical ModernBERT
 Clinical ModernBERT is a state-of-the-art encoder-based transformer tailored specifically for biomedical and clinical text handling context length up to **8192 tokens**. Building on the innovations introduced by ModernBERT, this model extends the context window to 8,192 tokens and incorporates domain-specific vocabulary refinements. It is designed to produce semantically rich representations that capture both the nuanced syntax of biomedical literature and the intricate semantics of clinical narratives.