Add new SentenceTransformer model

1_Pooling/config.json

@@ -0,0 +1,10 @@
+{
+    "word_embedding_dimension": 768,
+    "pooling_mode_cls_token": false,
+    "pooling_mode_mean_tokens": true,
+    "pooling_mode_max_tokens": false,
+    "pooling_mode_mean_sqrt_len_tokens": false,
+    "pooling_mode_weightedmean_tokens": false,
+    "pooling_mode_lasttoken": false,
+    "include_prompt": true
+}

README.md

@@ -0,0 +1,566 @@
+---
+tags:
+- sentence-transformers
+- sentence-similarity
+- feature-extraction
+- dense
+- generated_from_trainer
+- dataset_size:4524
+- loss:MultipleNegativesRankingLoss
+base_model: nomic-ai/modernbert-embed-base
+widget:
+- source_sentence: The Bell Captain orchestrates a professional and memorable service
+    experience for all guests and customers. Apart from providing bell services to
+    guests, addressing their concerns and feedback and recommending them tourism products
+    and services, he/she also performs the role of a team leader, allocating work
+    duties, coordinating and supervising bell service operations to ensure service
+    standards are met or exceeded. As a key service ambassador, he oversees the grooming
+    of the bell staff and acts as a role model to drive service culture within the
+    team. To ensure workplace safety and the security of the property, the Bell Captain
+    monitors the bell team's compliance with organisational and regulatory requirements
+    as they carry out their duties and keeps an eye on lobby activities to identify
+    security threats. He also assists in the execution of crisis management plans
+    during emergency situations. As a senior member of the team, he trains and guides
+    team members on their work performance. He is a service-oriented individual who
+    possesses excellent guest relations and communication skills to interact with
+    guests from diverse cultural backgrounds. He is physically fit to lift heavy pieces
+    of luggage and to stand or walk for an extended period of time or for an entire
+    work shift. He works shifts, including weekends and public holidays.
+  sentences:
+  - Senior User Experience Designer leading projects to create compelling user interactions,
+    conducting research to identify innovative design solutions, and responsible for
+    all UX design choices within the company. The goal is to improve customer engagement
+    and loyalty while developing strategies to address potential risks in implementing
+    new design solutions. This role involves forging strategic partnerships to fulfill
+    organizational objectives and providing expert guidance to enhance team members'
+    skills. Exceptional leadership and communication abilities are essential to inspire
+    stakeholders in realizing the best user experience and securing their support
+    for proposed initiatives, along with staying current with industry trends and
+    demonstrating strong negotiation and problem-solving skills.
+  - Bell Captain responsible for delivering exceptional service experiences to guests,
+    managing bell services, addressing guest feedback, and recommending local attractions.
+    This role includes leading the bell team, supervising operations to maintain high
+    service standards, and ensuring compliance with safety and security protocols.
+    The Bell Captain also plays a crucial role in training staff and fostering a strong
+    service culture, while being physically capable of handling luggage and working
+    varied shifts.
+  - Junior Security Officer ensures the safety and protection of guests and property
+    by monitoring lobby activities and addressing security concerns. This role involves
+    supervising the security team, allocating duties, and maintaining compliance with
+    safety regulations. The Junior Security Officer also trains new team members on
+    security protocols and is responsible for responding to emergency situations.
+    Candidates must be physically fit to manage security equipment and stand for long
+    periods, working shifts that include weekends and holidays.
+- source_sentence: The Centre Director/Head of Institute sets the overall learning
+    direction for the organisation, formulates strategic goals and drives organisational
+    growth. He/She assesses the industry, landscape to identify new business opportunities
+    and drive the continual development of the organisation's learning products and
+    services portfolio. He champions the organisations service excellence aspirations
+    and fosters strategic relationships with stakeholders. He is accountable for the
+    success of the organisation and is responsible for driving the, organisations
+    financial, innovation and productivity strategies. He has a strong understanding
+    of market and industry developments, including research developments and technology
+    innovations. He is an inspirational leader with a forward-thinking mindset and
+    a deep passion for learning and development. He establishes and communicates a
+    clear vision, and is highly skilled in influencing and engaging stakeholders to
+    secure their buy-in and support. He has strong business acumen and is able to
+    make calculated-risk decisions, performing effectively in a complex and difficult
+    environment. He frequently works outside of the office, attends industry events
+    and client meetings to develop networks and build strong business relationships.
+  sentences:
+  - Job opening for a General Manager responsible for establishing the vision and
+    strategic direction of a property, leading organizational strategies to enhance
+    business growth and operational excellence, and managing various functional areas
+    to ensure exceptional guest experiences and brand integrity.
+  - Director of Learning and Development responsible for shaping the educational vision,
+    setting strategic objectives, and promoting growth within the organization. Evaluates
+    market trends to uncover new opportunities and enhances the portfolio of learning
+    products and services. Advocates for excellence in service delivery and builds
+    strategic partnerships with key stakeholders. Oversees the organization's success
+    by implementing financial, innovation, and productivity initiatives. Possesses
+    a comprehensive understanding of industry advancements, including research and
+    technological innovations. An inspiring leader with a proactive approach and a
+    genuine enthusiasm for education and development. Clearly articulates a vision
+    and excels in engaging stakeholders to gain their support. Demonstrates strong
+    business insight and makes informed decisions in challenging environments, often
+    networking at industry events and client engagements.
+  - Junior Project Coordinator in a technology firm responsible for supporting project
+    management efforts, assisting in the development of project goals and tracking
+    progress. Evaluates project timelines and identifies potential risks to ensure
+    successful completion of tasks. Supports the team in delivering high-quality service
+    and maintains relationships with clients. Responsible for the day-to-day operations
+    of project management, including budget tracking and resource allocation. Holds
+    a basic understanding of project management methodologies and tools. A collaborative
+    team member with a focus on assisting in the execution of project plans and achieving
+    team objectives. Communicates effectively with team members and stakeholders to
+    ensure alignment and support. Demonstrates foundational business skills and addresses
+    challenges in a structured manner, participating in team meetings and project
+    reviews.
+- source_sentence: The Chief Engineer /Senior Engineering Manager (Mechanical and
+    Electrical) leads and facilitates the implementation of mechanical and electrical
+    maintenance regime within the organisation. He/She works closely with internal
+    and external stakeholders in implementing new engineering initiatives to enhance
+    the reliability of mechanical and electrical systems. He demonstrates his technical
+    expertise in providing advice to cross-disciplinary engineering studies. His role
+    also, includes establishing competency standards and engineering standards to
+    ensure staff are equipped with relevant skills. He has a strong understanding
+    of rail operational activities, industry developments and regulatory requirements
+    of mechanical and electrical systems. He also maintains a forward-thinking mindset
+    to contribute strategically towards achieving the department goals.
+  sentences:
+  - Junior Electrical Technician responsible for performing routine inspections and
+    maintenance on electrical systems within residential buildings. This role requires
+    basic troubleshooting skills and adherence to safety regulations, while collaborating
+    with contractors to ensure compliance with local electrical codes. The technician
+    will also assist in documenting maintenance activities and support senior staff
+    in project implementations.
+  - Restructuring and Insolvency Executive responsible for managing client engagements,
+    overseeing daily operations, and ensuring quality assurance in processes. Expected
+    to develop business relationships, interact with stakeholders, and deliver projects
+    on time while demonstrating strong technical expertise and project management
+    skills in a fast-paced environment.
+  - Senior Engineering Manager for Mechanical and Electrical Systems overseeing maintenance
+    strategies and collaborating with stakeholders to improve system reliability and
+    staff competency in engineering standards.
+- source_sentence: The Procurement Manager leads the procurement function and is responsible
+    for establishing procurement plans, policies and processes required to obtain
+    the materials, equipment and services to deliver on marine manufacturing projects.
+    He/She leads improvement initiatives to enhance the procurement process and timeliness
+    of providing the necessary resources to complete projects on schedule. He has
+    good communication and negotiation skills for engaging vendors and other external
+    parties, and is able to balance the organisations needs, as the job encompasses
+    a strategic role in selecting new vendors, fostering relationships and managing
+    vendor performance and contract-related processes by liaising with legal and other
+    key stakeholders.
+  sentences:
+  - Procurement lead responsible for developing plans and processes to acquire materials
+    and services for marine manufacturing projects, while improving procurement efficiency
+    and vendor management through strong communication and negotiation skills.
+  - Junior Supply Chain Coordinator responsible for managing inventory levels and
+    ensuring timely delivery of products within the retail industry. This role involves
+    collaborating with suppliers, tracking shipments, and maintaining accurate records
+    while focusing on cost reduction and efficiency improvements. Strong analytical
+    and problem-solving skills are essential for optimizing supply chain processes.
+  - Director of Aircraft Engine Maintenance is tasked with establishing the long-term
+    strategic vision to enhance business growth in alignment with the organization's
+    mission and values. This role involves advocating for innovative aircraft engine
+    maintenance programs to boost competitiveness and guiding the organization in
+    leading maintenance practices. The director engages with customers, stakeholders,
+    and partners while ensuring compliance with airworthiness regulations, promoting
+    a safe workplace culture, and championing quality and risk management initiatives.
+    The position requires inspiring continuous improvement, driving digital advancements,
+    and assessing strategies for a sustainable business model. Strong leadership and
+    strategic partnership-building skills are essential, along with overseeing financial
+    strategies and talent management.
+- source_sentence: The Designer is responsible for all phases of design projects and
+    ascertains the feasibility of implementing new products and services for the organisation.
+    He/She executes research to gather data and translates research insights into
+    design outcomes. He uncovers new design ideas, conducts feasibility tests on prototypes
+    and communicates results of design tests and project implementation. The Designer
+    works in a team. He is encouraged to uncover the latest trends in the industry
+    and develop deep business acumen to meet the needs of the organisation. He possesses
+    mastery of design fundamentals and technical skills to execute design concepts
+    required for products and services. He is able to work on multiple projects concurrently,
+    and deliver on expectations within tight deadlines. He may specialise as an Architect,
+    Landscape Architect/Landscape Designer, Interior Designer, Fashion Designer, Product
+    Designer, Furniture Designer, Graphic Designer and/or Interaction Designer, etc.
+  sentences:
+  - Job opening for a Designer responsible for managing all stages of design projects,
+    assessing the feasibility of new products and services. The role involves conducting
+    research to collect data and translating insights into effective design solutions.
+    The Designer will explore innovative design concepts, perform prototype feasibility
+    tests, and share findings on design evaluations and project execution. Collaboration
+    within a team is essential, as is staying updated on industry trends and developing
+    strong business insights to fulfill organizational needs. Proficiency in design
+    principles and technical skills is required to implement design ideas for various
+    products and services, while managing multiple projects under tight deadlines.
+    Specializations may include roles such as Architect, Landscape Designer, Interior
+    Designer, Fashion Designer, Product Designer, Furniture Designer, Graphic Designer,
+    or Interaction Designer.
+  - The Junior Risk Management Analyst is accountable for supporting various stages
+    of risk assessment projects and determining the viability of implementing new
+    compliance measures for the organization. He/She conducts market analysis to gather
+    insights and transforms those insights into actionable risk management strategies.
+    The Analyst identifies potential risk factors, performs assessments on risk mitigation
+    plans, and communicates findings on risk evaluations and project compliance. The
+    Analyst collaborates with cross-functional teams and is expected to stay informed
+    about regulatory changes in the industry and develop a strong understanding of
+    business operations to address organizational risks. A solid grasp of risk management
+    principles and analytical skills is necessary to execute risk assessments effectively,
+    while managing multiple tasks simultaneously and meeting project deadlines.
+  - Job opening for a Senior Manager in youth work management, responsible for overseeing
+    strategic initiatives, resource allocation, collaboration, and governance to enhance
+    operational efficiency. The role involves managing budgets, developing professional
+    development programs, and fostering relationships across various agencies. Ideal
+    candidates should have strong problem-solving skills and experience in institutional
+    settings, communities, and Voluntary Welfare Organizations.
+pipeline_tag: sentence-similarity
+library_name: sentence-transformers
+---
+
+# SentenceTransformer based on nomic-ai/modernbert-embed-base
+
+This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [nomic-ai/modernbert-embed-base](https://huggingface.co/nomic-ai/modernbert-embed-base). It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
+
+## Model Details
+
+### Model Description
+- **Model Type:** Sentence Transformer
+- **Base model:** [nomic-ai/modernbert-embed-base](https://huggingface.co/nomic-ai/modernbert-embed-base) <!-- at revision d556a88e332558790b210f7bdbe87da2fa94a8d8 -->
+- **Maximum Sequence Length:** 8192 tokens
+- **Output Dimensionality:** 768 dimensions
+- **Similarity Function:** Cosine Similarity
+<!-- - **Training Dataset:** Unknown -->
+<!-- - **Language:** Unknown -->
+<!-- - **License:** Unknown -->
+
+### Model Sources
+
+- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
+- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
+- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
+
+### Full Model Architecture
+
+```
+SentenceTransformer(
+  (0): Transformer({'max_seq_length': 8192, 'do_lower_case': False, 'architecture': 'ModernBertModel'})
+  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
+  (2): Normalize()
+)
+```
+
+## Usage
+
+### Direct Usage (Sentence Transformers)
+
+First install the Sentence Transformers library:
+
+```bash
+pip install -U sentence-transformers
+```
+
+Then you can load this model and run inference.
+```python
+from sentence_transformers import SentenceTransformer
+
+# Download from the 🤗 Hub
+model = SentenceTransformer("dnth/ssf-retriever-modernbert-embed-base")
+# Run inference
+sentences = [
+    'The Designer is responsible for all phases of design projects and ascertains the feasibility of implementing new products and services for the organisation. He/She executes research to gather data and translates research insights into design outcomes. He uncovers new design ideas, conducts feasibility tests on prototypes and communicates results of design tests and project implementation. The Designer works in a team. He is encouraged to uncover the latest trends in the industry and develop deep business acumen to meet the needs of the organisation. He possesses mastery of design fundamentals and technical skills to execute design concepts required for products and services. He is able to work on multiple projects concurrently, and deliver on expectations within tight deadlines. He may specialise as an Architect, Landscape Architect/Landscape Designer, Interior Designer, Fashion Designer, Product Designer, Furniture Designer, Graphic Designer and/or Interaction Designer, etc.',
+    'Job opening for a Designer responsible for managing all stages of design projects, assessing the feasibility of new products and services. The role involves conducting research to collect data and translating insights into effective design solutions. The Designer will explore innovative design concepts, perform prototype feasibility tests, and share findings on design evaluations and project execution. Collaboration within a team is essential, as is staying updated on industry trends and developing strong business insights to fulfill organizational needs. Proficiency in design principles and technical skills is required to implement design ideas for various products and services, while managing multiple projects under tight deadlines. Specializations may include roles such as Architect, Landscape Designer, Interior Designer, Fashion Designer, Product Designer, Furniture Designer, Graphic Designer, or Interaction Designer.',
+    'The Junior Risk Management Analyst is accountable for supporting various stages of risk assessment projects and determining the viability of implementing new compliance measures for the organization. He/She conducts market analysis to gather insights and transforms those insights into actionable risk management strategies. The Analyst identifies potential risk factors, performs assessments on risk mitigation plans, and communicates findings on risk evaluations and project compliance. The Analyst collaborates with cross-functional teams and is expected to stay informed about regulatory changes in the industry and develop a strong understanding of business operations to address organizational risks. A solid grasp of risk management principles and analytical skills is necessary to execute risk assessments effectively, while managing multiple tasks simultaneously and meeting project deadlines.',
+]
+embeddings = model.encode(sentences)
+print(embeddings.shape)
+# [3, 768]
+
+# Get the similarity scores for the embeddings
+similarities = model.similarity(embeddings, embeddings)
+print(similarities)
+# tensor([[1.0000, 0.8963, 0.2004],
+#         [0.8963, 1.0000, 0.2645],
+#         [0.2004, 0.2645, 1.0000]])
+```
+
+<!--
+### Direct Usage (Transformers)
+
+<details><summary>Click to see the direct usage in Transformers</summary>
+
+</details>
+-->
+
+<!--
+### Downstream Usage (Sentence Transformers)
+
+You can finetune this model on your own dataset.
+
+<details><summary>Click to expand</summary>
+
+</details>
+-->
+
+<!--
+### Out-of-Scope Use
+
+*List how the model may foreseeably be misused and address what users ought not to do with the model.*
+-->
+
+<!--
+## Bias, Risks and Limitations
+
+*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
+-->
+
+<!--
+### Recommendations
+
+*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
+-->
+
+## Training Details
+
+### Training Dataset
+
+#### Unnamed Dataset
+
+* Size: 4,524 training samples
+* Columns: <code>anchor</code>, <code>positive</code>, and <code>negative</code>
+* Approximate statistics based on the first 1000 samples:
+  |         | anchor                                                                               | positive                                                                            | negative                                                                            |
+  |:--------|:-------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------|
+  | type    | string                                                                               | string                                                                              | string                                                                              |
+  | details | <ul><li>min: 57 tokens</li><li>mean: 168.21 tokens</li><li>max: 380 tokens</li></ul> | <ul><li>min: 22 tokens</li><li>mean: 66.42 tokens</li><li>max: 204 tokens</li></ul> | <ul><li>min: 33 tokens</li><li>mean: 82.38 tokens</li><li>max: 247 tokens</li></ul> |
+* Samples:
+  | anchor                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   | positive                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         | negative                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    |
+  |:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+  | <code>The Material Handling Equipment (MHE) Operator/Forklift Operator/Warehouse Assistant/Inventory Assistant is responsible for sorting, routing and loading cargo to and from various warehousing or storage locations. Systematic and mechanically-inclined, he/she is also responsible for upholding quality standards, ensuring the safe and efficient operation of material-handling equipment and may also be required to support general warehouse operations. He is expected work with internal and external stakeholders to accomplish his work.</code>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       | <code>Looking for a Warehouse Operator or Forklift Operator to manage cargo sorting, routing, and loading at various storage facilities. The ideal candidate should be mechanically inclined, maintain quality standards, ensure safe operation of material handling equipment, and assist with overall warehouse tasks while collaborating with stakeholders.</code>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            | <code>Seeking a Junior Risk Management Analyst to assess and evaluate potential risks within the financial services sector. The candidate will be responsible for analyzing data, developing risk mitigation strategies, and ensuring compliance with industry regulations. Strong analytical skills and attention to detail are essential, as well as the ability to work with both internal teams and external clients.</code>                                                                                                                                                                                                                                                                                                                                                                            |
+  | <code>The Social Service Assistant supports interventions for clients. He/She accompanies social service professionals on client visits and accompanies clients to and from their appointments activities. He provides administrative and logistical support for the implementation of programmes and supports the organisation of core programmes and services. He provides support for the implementation of the organisation's outreach plans and identifies potential platforms for outreach that are used by the target client group. He also supports the implementation of relevant frameworks, protocols and procedures in his own area of work. A proactive, resourceful and client-centric individual, the Social Service Assistant works in various voluntary welfare organisations, communities and institutional settings.</code>                                                                                                                                                                                                           | <code>Social Service Assistant role involving client support and administrative assistance for social service programs, including accompanying professionals and clients to appointments, and aiding in outreach initiatives.</code>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             | <code>Junior Financial Analyst responsible for conducting market research and analyzing financial statements. The role involves preparing reports, assisting in budgeting processes, and supporting the finance team in various projects. The candidate should be detail-oriented, with strong analytical skills and proficiency in financial software, working primarily in the corporate finance sector.</code>                                                                                                                                                                                                                                                                                                                                                                                           |
+  | <code>The Marketing Communications Manager/Digital Marketing Manager/Public Relations Manager/Assistant Marketing Communications Manager/Assistant Digital Marketing Manager/Assistant Public Relations Manager manages the execution of the organisation's branding and marketing efforts across traditional and new media platforms to create positive customer engagement. He/She enhances the property's brand reputation and brand image consistency across all marketing channels and liaises with key stakeholders to develop marketing strategies and plans, leveraging on market research and analyses to identify marketing opportunities, target markets and marketing channels. He plans marketing campaigns and manages the execution of marketing and media-related activities and events. His responsibilities include developing campaign design concepts and ideas, marketing collaterals as well as measures to engage customers. He manages public communications as well, monitoring and responding to online comments, de...</code> | <code>Digital Marketing Manager overseeing branding and marketing initiatives across various media platforms to foster positive customer interaction. Responsible for enhancing brand reputation and ensuring consistent brand image across marketing channels while collaborating with stakeholders to formulate effective marketing strategies. Plans and executes marketing campaigns, manages media-related events, and develops engaging marketing materials. Also handles public communications, monitors online feedback, creates press releases, and responds to media inquiries. At the management level, guides team performance, manages budget forecasts, and evaluates new technologies to enhance customer engagement. Utilizes data analytics to identify market trends and develop successful marketing and digital initiatives in a dynamic environment.</code> | <code>Junior Public Relations Coordinator responsible for managing internal communications and employee engagement initiatives within the organization. Tasks include creating newsletters, organizing team-building events, and maintaining the company intranet. The role focuses on enhancing employee morale and promoting a positive workplace culture through various communication channels. Additionally, the coordinator assists in drafting internal memos and managing responses to employee feedback. This position involves collaborating with HR to develop training materials and support staff development programs. The coordinator also analyzes employee satisfaction surveys to identify areas for improvement and implement strategies to foster a supportive work environment.</code> |
+* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
+  ```json
+  {
+      "scale": 20.0,
+      "similarity_fct": "cos_sim"
+  }
+  ```
+
+### Evaluation Dataset
+
+#### Unnamed Dataset
+
+* Size: 1,131 evaluation samples
+* Columns: <code>anchor</code>, <code>positive</code>, and <code>negative</code>
+* Approximate statistics based on the first 1000 samples:
+  |         | anchor                                                                               | positive                                                                            | negative                                                                            |
+  |:--------|:-------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------|
+  | type    | string                                                                               | string                                                                              | string                                                                              |
+  | details | <ul><li>min: 57 tokens</li><li>mean: 167.67 tokens</li><li>max: 349 tokens</li></ul> | <ul><li>min: 17 tokens</li><li>mean: 67.35 tokens</li><li>max: 204 tokens</li></ul> | <ul><li>min: 33 tokens</li><li>mean: 82.88 tokens</li><li>max: 198 tokens</li></ul> |
+* Samples:
+  | anchor                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   | positive                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   | negative                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         |
+  |:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+  | <code>The HSE Specialist implements and administers the organisations Workplace Safety and Health (WSH) and Environmental Management System (EMS) programmes in the workplace and supports the development of WSH and EMS frameworks, in compliance with pertinent government regulations and organisational health, safety and environmental guidelines. The HSE Specialist supports the development and implementation of Safe System of Work (SSoW) processes and procedures at the workplace, and interfaces with the production and process engineering department, engineering and maintenance department, and contractors to ensure compliance. He/She assists in the development of emergency response and crisis management plans and works to identify and reduce known risks that could lead to emergencies or crises. He also supports the implementation of continuous improvement initiatives and activities at the workplace. The HSE Specialist is a good team player, has good written and verbal communication skills, inter...</code> | <code>Job opening for an HSE Specialist to manage and implement Workplace Safety and Health (WSH) and Environmental Management System (EMS) initiatives, ensuring compliance with government regulations and internal guidelines. Responsibilities include developing Safe System of Work (SSoW) procedures, collaborating with engineering and maintenance teams, and assisting in emergency response planning. The ideal candidate will have strong communication skills and a passion for training and continuous improvement.</code>                                                                                                                   | <code>Seeking a Junior Risk Management Analyst to oversee the implementation and administration of Workplace Safety and Health (WSH) protocols and Environmental Management System (EMS) standards in a healthcare setting. This role requires the development of risk assessment frameworks and the execution of compliance audits with relevant health regulations. The Junior Analyst will work closely with clinical teams and administrative departments to ensure adherence to safety guidelines and will assist in creating training materials for staff. Strong analytical skills and effective communication are essential for this position.</code>                    |
+  | <code>The Membership Crew assists in the execution of plans covering membership acquisition and member retention. He/She is involved in the sale of memberships and monitors the membership statistics in accordance with the parameters set by management, monitors the budgeting and forecasting of membership rates and conducts training for operations staff on membership-related issues. Resourceful and service-oriented, he leverages his strong interpersonal and communication skills to answer queries from current and potential members regarding membership-related procedures and policies. He is also able to assist with any customer queries directed to him by his team members. Able to work on a shift system, he is comfortable with working in an outdoor environment, be on his feet for long hours and maintains a flexible work-week including weekends, evenings and public holidays.</code>                                                                                                                                 | <code>Membership Coordinator responsible for driving membership growth and retention strategies, managing sales of memberships, analyzing membership data according to management guidelines, overseeing budget forecasts, and providing training to staff on membership processes. Strong interpersonal and communication skills are essential for addressing inquiries from current and prospective members, as well as assisting team members with customer service issues. Must be adaptable to a shift schedule and comfortable working outdoors, standing for extended periods, and available during weekends, evenings, and public holidays.</code> | <code>Junior Financial Analyst tasked with supporting the financial planning and analysis team in the healthcare sector. Responsibilities include assisting in budget preparation, forecasting financial performance, and analyzing variance reports. The role requires strong analytical skills to interpret financial data and produce reports for management review. The candidate should be proficient in Microsoft Excel and financial modeling, while also possessing excellent communication skills to collaborate with various departments. Flexibility in work hours is necessary, and the position may involve occasional weekend work for reporting deadlines.</code> |
+  | <code>The Senior Infant Educator plays an active role as a mentor to the Infant Educator team. He/She takes responsibility for coaching and leading the infant care team in the Centre. He plays an important role in the design and implementation of developmentally appropriate curricula and programmes for the day-to-day developmental and caregiving tasks for infants. He also leads the building of relationships and partnerships with stakeholders. He designs and implements family and community programmes, and contributes to the Centres culture of continuous learning, collaboration and collegiality, in line with its vision, mission and goals.</code>                                                                                                                                                                                                                                                                                                                                                                              | <code>Senior Infant Care Supervisor responsible for mentoring the infant care team, leading curriculum development, and fostering relationships with families and stakeholders while promoting a culture of collaboration and continuous learning in the childcare center.</code>                                                                                                                                                                                                                                                                                                                                                                          | <code>Junior Risk Management Analyst tasked with assessing and mitigating potential risks within the financial sector. This role involves analyzing data, preparing reports, and collaborating with various departments to ensure compliance and safety standards are met, while contributing to the overall risk management strategy of the organization.</code>                                                                                                                                                                                                                                                                                                                |
+* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
+  ```json
+  {
+      "scale": 20.0,
+      "similarity_fct": "cos_sim"
+  }
+  ```
+
+### Training Hyperparameters
+#### Non-Default Hyperparameters
+
+- `eval_strategy`: steps
+- `per_device_train_batch_size`: 16
+- `gradient_accumulation_steps`: 2
+- `weight_decay`: 0.1
+- `num_train_epochs`: 5
+- `lr_scheduler_type`: cosine
+- `warmup_ratio`: 0.1
+- `fp16`: True
+- `load_best_model_at_end`: True
+- `batch_sampler`: no_duplicates
+
+#### All Hyperparameters
+<details><summary>Click to expand</summary>
+
+- `overwrite_output_dir`: False
+- `do_predict`: False
+- `eval_strategy`: steps
+- `prediction_loss_only`: True
+- `per_device_train_batch_size`: 16
+- `per_device_eval_batch_size`: 8
+- `per_gpu_train_batch_size`: None
+- `per_gpu_eval_batch_size`: None
+- `gradient_accumulation_steps`: 2
+- `eval_accumulation_steps`: None
+- `torch_empty_cache_steps`: None
+- `learning_rate`: 5e-05
+- `weight_decay`: 0.1
+- `adam_beta1`: 0.9
+- `adam_beta2`: 0.999
+- `adam_epsilon`: 1e-08
+- `max_grad_norm`: 1.0
+- `num_train_epochs`: 5
+- `max_steps`: -1
+- `lr_scheduler_type`: cosine
+- `lr_scheduler_kwargs`: {}
+- `warmup_ratio`: 0.1
+- `warmup_steps`: 0
+- `log_level`: passive
+- `log_level_replica`: warning
+- `log_on_each_node`: True
+- `logging_nan_inf_filter`: True
+- `save_safetensors`: True
+- `save_on_each_node`: False
+- `save_only_model`: False
+- `restore_callback_states_from_checkpoint`: False
+- `no_cuda`: False
+- `use_cpu`: False
+- `use_mps_device`: False
+- `seed`: 42
+- `data_seed`: None
+- `jit_mode_eval`: False
+- `use_ipex`: False
+- `bf16`: False
+- `fp16`: True
+- `fp16_opt_level`: O1
+- `half_precision_backend`: auto
+- `bf16_full_eval`: False
+- `fp16_full_eval`: False
+- `tf32`: None
+- `local_rank`: 0
+- `ddp_backend`: None
+- `tpu_num_cores`: None
+- `tpu_metrics_debug`: False
+- `debug`: []
+- `dataloader_drop_last`: False
+- `dataloader_num_workers`: 0
+- `dataloader_prefetch_factor`: None
+- `past_index`: -1
+- `disable_tqdm`: False
+- `remove_unused_columns`: True
+- `label_names`: None
+- `load_best_model_at_end`: True
+- `ignore_data_skip`: False
+- `fsdp`: []
+- `fsdp_min_num_params`: 0
+- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
+- `fsdp_transformer_layer_cls_to_wrap`: None
+- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
+- `deepspeed`: None
+- `label_smoothing_factor`: 0.0
+- `optim`: adamw_torch
+- `optim_args`: None
+- `adafactor`: False
+- `group_by_length`: False
+- `length_column_name`: length
+- `ddp_find_unused_parameters`: None
+- `ddp_bucket_cap_mb`: None
+- `ddp_broadcast_buffers`: False
+- `dataloader_pin_memory`: True
+- `dataloader_persistent_workers`: False
+- `skip_memory_metrics`: True
+- `use_legacy_prediction_loop`: False
+- `push_to_hub`: False
+- `resume_from_checkpoint`: None
+- `hub_model_id`: None
+- `hub_strategy`: every_save
+- `hub_private_repo`: None
+- `hub_always_push`: False
+- `hub_revision`: None
+- `gradient_checkpointing`: False
+- `gradient_checkpointing_kwargs`: None
+- `include_inputs_for_metrics`: False
+- `include_for_metrics`: []
+- `eval_do_concat_batches`: True
+- `fp16_backend`: auto
+- `push_to_hub_model_id`: None
+- `push_to_hub_organization`: None
+- `mp_parameters`: 
+- `auto_find_batch_size`: False
+- `full_determinism`: False
+- `torchdynamo`: None
+- `ray_scope`: last
+- `ddp_timeout`: 1800
+- `torch_compile`: False
+- `torch_compile_backend`: None
+- `torch_compile_mode`: None
+- `include_tokens_per_second`: False
+- `include_num_input_tokens_seen`: False
+- `neftune_noise_alpha`: None
+- `optim_target_modules`: None
+- `batch_eval_metrics`: False
+- `eval_on_start`: False
+- `use_liger_kernel`: False
+- `liger_kernel_config`: None
+- `eval_use_gather_object`: False
+- `average_tokens_across_devices`: False
+- `prompts`: None
+- `batch_sampler`: no_duplicates
+- `multi_dataset_batch_sampler`: proportional
+- `router_mapping`: {}
+- `learning_rate_mapping`: {}
+
+</details>
+
+### Training Logs
+| Epoch     | Step    | Training Loss | Validation Loss |
+|:---------:|:-------:|:-------------:|:---------------:|
+| 0.3534    | 50      | 0.049         | 0.0051          |
+| 0.7067    | 100     | 0.0079        | 0.0038          |
+| 1.0565    | 150     | 0.004         | 0.0032          |
+| 1.4099    | 200     | 0.0048        | 0.0029          |
+| 1.7633    | 250     | 0.0025        | 0.0023          |
+| 2.1131    | 300     | 0.0024        | 0.0022          |
+| 2.4664    | 350     | 0.004         | 0.0026          |
+| 2.8198    | 400     | 0.0056        | 0.0023          |
+| 3.1696    | 450     | 0.0013        | 0.0017          |
+| **3.523** | **500** | **0.0014**    | **0.0016**      |
+| 3.8763    | 550     | 0.0016        | 0.0019          |
+| 4.2261    | 600     | 0.0013        | 0.0018          |
+| 4.5795    | 650     | 0.0032        | 0.0017          |
+| 4.9329    | 700     | 0.0011        | 0.0017          |
+
+* The bold row denotes the saved checkpoint.
+
+### Framework Versions
+- Python: 3.12.8
+- Sentence Transformers: 5.0.0
+- Transformers: 4.54.1
+- PyTorch: 2.7.1+cu126
+- Accelerate: 1.9.0
+- Datasets: 4.0.0
+- Tokenizers: 0.21.4
+
+## Citation
+
+### BibTeX
+
+#### Sentence Transformers
+```bibtex
+@inproceedings{reimers-2019-sentence-bert,
+    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
+    author = "Reimers, Nils and Gurevych, Iryna",
+    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
+    month = "11",
+    year = "2019",
+    publisher = "Association for Computational Linguistics",
+    url = "https://arxiv.org/abs/1908.10084",
+}
+```
+
+#### MultipleNegativesRankingLoss
+```bibtex
+@misc{henderson2017efficient,
+    title={Efficient Natural Language Response Suggestion for Smart Reply},
+    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
+    year={2017},
+    eprint={1705.00652},
+    archivePrefix={arXiv},
+    primaryClass={cs.CL}
+}
+```
+
+<!--
+## Glossary
+
+*Clearly define terms in order to be accessible across audiences.*
+-->
+
+<!--
+## Model Card Authors
+
+*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
+-->
+
+<!--
+## Model Card Contact
+
+*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
+-->

config.json

@@ -0,0 +1,45 @@
+{
+  "architectures": [
+    "ModernBertModel"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "bos_token_id": 50281,
+  "classifier_activation": "gelu",
+  "classifier_bias": false,
+  "classifier_dropout": 0.0,
+  "classifier_pooling": "mean",
+  "cls_token_id": 50281,
+  "decoder_bias": true,
+  "deterministic_flash_attn": false,
+  "embedding_dropout": 0.0,
+  "eos_token_id": 50282,
+  "global_attn_every_n_layers": 3,
+  "global_rope_theta": 160000.0,
+  "gradient_checkpointing": false,
+  "hidden_activation": "gelu",
+  "hidden_size": 768,
+  "initializer_cutoff_factor": 2.0,
+  "initializer_range": 0.02,
+  "intermediate_size": 1152,
+  "layer_norm_eps": 1e-05,
+  "local_attention": 128,
+  "local_rope_theta": 10000.0,
+  "max_position_embeddings": 8192,
+  "mlp_bias": false,
+  "mlp_dropout": 0.0,
+  "model_type": "modernbert",
+  "norm_bias": false,
+  "norm_eps": 1e-05,
+  "num_attention_heads": 12,
+  "num_hidden_layers": 22,
+  "pad_token_id": 50283,
+  "position_embedding_type": "absolute",
+  "repad_logits_with_grad": false,
+  "sep_token_id": 50282,
+  "sparse_pred_ignore_index": -100,
+  "sparse_prediction": false,
+  "torch_dtype": "float32",
+  "transformers_version": "4.54.1",
+  "vocab_size": 50368
+}

config_sentence_transformers.json

@@ -0,0 +1,14 @@
+{
+  "__version__": {
+    "sentence_transformers": "5.0.0",
+    "transformers": "4.54.1",
+    "pytorch": "2.7.1+cu126"
+  },
+  "prompts": {
+    "query": "",
+    "document": ""
+  },
+  "default_prompt_name": null,
+  "similarity_fn_name": "cosine",
+  "model_type": "SentenceTransformer"
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0ee08ea76e21cc14757f6c87ec704c5a7ba89cab17e01402aa25042694c4a992
+size 596070136

modules.json

@@ -0,0 +1,20 @@
+[
+  {
+    "idx": 0,
+    "name": "0",
+    "path": "",
+    "type": "sentence_transformers.models.Transformer"
+  },
+  {
+    "idx": 1,
+    "name": "1",
+    "path": "1_Pooling",
+    "type": "sentence_transformers.models.Pooling"
+  },
+  {
+    "idx": 2,
+    "name": "2",
+    "path": "2_Normalize",
+    "type": "sentence_transformers.models.Normalize"
+  }
+]

sentence_bert_config.json

@@ -0,0 +1,4 @@
+{
+    "max_seq_length": 8192,
+    "do_lower_case": false
+}

special_tokens_map.json

@@ -0,0 +1,37 @@
+{
+  "cls_token": {
+    "content": "[CLS]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "mask_token": {
+    "content": "[MASK]",
+    "lstrip": true,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "[PAD]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "sep_token": {
+    "content": "[SEP]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "[UNK]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer_config.json

@@ -0,0 +1,945 @@
+{
+  "added_tokens_decoder": {
+    "0": {
+      "content": "|||IP_ADDRESS|||",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "1": {
+      "content": "<|padding|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50254": {
+      "content": "                        ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50255": {
+      "content": "                       ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50256": {
+      "content": "                      ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50257": {
+      "content": "                     ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50258": {
+      "content": "                    ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50259": {
+      "content": "                   ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50260": {
+      "content": "                  ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50261": {
+      "content": "                 ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50262": {
+      "content": "                ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50263": {
+      "content": "               ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50264": {
+      "content": "              ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50265": {
+      "content": "             ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50266": {
+      "content": "            ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50267": {
+      "content": "           ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50268": {
+      "content": "          ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50269": {
+      "content": "         ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50270": {
+      "content": "        ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50271": {
+      "content": "       ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50272": {
+      "content": "      ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50273": {
+      "content": "     ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50274": {
+      "content": "    ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50275": {
+      "content": "   ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50276": {
+      "content": "  ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50277": {
+      "content": "|||EMAIL_ADDRESS|||",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50278": {
+      "content": "|||PHONE_NUMBER|||",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50279": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50280": {
+      "content": "[UNK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50281": {
+      "content": "[CLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50282": {
+      "content": "[SEP]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50283": {
+      "content": "[PAD]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50284": {
+      "content": "[MASK]",
+      "lstrip": true,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50285": {
+      "content": "[unused0]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50286": {
+      "content": "[unused1]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50287": {
+      "content": "[unused2]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50288": {
+      "content": "[unused3]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50289": {
+      "content": "[unused4]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50290": {
+      "content": "[unused5]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50291": {
+      "content": "[unused6]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50292": {
+      "content": "[unused7]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50293": {
+      "content": "[unused8]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50294": {
+      "content": "[unused9]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50295": {
+      "content": "[unused10]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50296": {
+      "content": "[unused11]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50297": {
+      "content": "[unused12]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50298": {
+      "content": "[unused13]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50299": {
+      "content": "[unused14]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50300": {
+      "content": "[unused15]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50301": {
+      "content": "[unused16]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50302": {
+      "content": "[unused17]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50303": {
+      "content": "[unused18]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50304": {
+      "content": "[unused19]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50305": {
+      "content": "[unused20]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50306": {
+      "content": "[unused21]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50307": {
+      "content": "[unused22]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50308": {
+      "content": "[unused23]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50309": {
+      "content": "[unused24]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50310": {
+      "content": "[unused25]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50311": {
+      "content": "[unused26]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50312": {
+      "content": "[unused27]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50313": {
+      "content": "[unused28]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50314": {
+      "content": "[unused29]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50315": {
+      "content": "[unused30]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50316": {
+      "content": "[unused31]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50317": {
+      "content": "[unused32]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50318": {
+      "content": "[unused33]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50319": {
+      "content": "[unused34]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50320": {
+      "content": "[unused35]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50321": {
+      "content": "[unused36]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50322": {
+      "content": "[unused37]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50323": {
+      "content": "[unused38]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50324": {
+      "content": "[unused39]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50325": {
+      "content": "[unused40]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50326": {
+      "content": "[unused41]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50327": {
+      "content": "[unused42]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50328": {
+      "content": "[unused43]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50329": {
+      "content": "[unused44]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50330": {
+      "content": "[unused45]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50331": {
+      "content": "[unused46]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50332": {
+      "content": "[unused47]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50333": {
+      "content": "[unused48]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50334": {
+      "content": "[unused49]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50335": {
+      "content": "[unused50]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50336": {
+      "content": "[unused51]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50337": {
+      "content": "[unused52]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50338": {
+      "content": "[unused53]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50339": {
+      "content": "[unused54]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50340": {
+      "content": "[unused55]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50341": {
+      "content": "[unused56]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50342": {
+      "content": "[unused57]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50343": {
+      "content": "[unused58]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50344": {
+      "content": "[unused59]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50345": {
+      "content": "[unused60]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50346": {
+      "content": "[unused61]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50347": {
+      "content": "[unused62]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50348": {
+      "content": "[unused63]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50349": {
+      "content": "[unused64]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50350": {
+      "content": "[unused65]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50351": {
+      "content": "[unused66]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50352": {
+      "content": "[unused67]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50353": {
+      "content": "[unused68]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50354": {
+      "content": "[unused69]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50355": {
+      "content": "[unused70]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50356": {
+      "content": "[unused71]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50357": {
+      "content": "[unused72]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50358": {
+      "content": "[unused73]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50359": {
+      "content": "[unused74]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50360": {
+      "content": "[unused75]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50361": {
+      "content": "[unused76]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50362": {
+      "content": "[unused77]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50363": {
+      "content": "[unused78]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50364": {
+      "content": "[unused79]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50365": {
+      "content": "[unused80]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50366": {
+      "content": "[unused81]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50367": {
+      "content": "[unused82]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    }
+  },
+  "clean_up_tokenization_spaces": true,
+  "cls_token": "[CLS]",
+  "extra_special_tokens": {},
+  "mask_token": "[MASK]",
+  "model_input_names": [
+    "input_ids",
+    "attention_mask"
+  ],
+  "model_max_length": 8192,
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "tokenizer_class": "PreTrainedTokenizerFast",
+  "unk_token": "[UNK]"
+}