This is a Bert model and has been uploaded using the KerasNLP library.
Model config:
- name: bert_backbone
- trainable: True
- vocabulary_size: 30522
- num_layers: 2
- num_heads: 2
- hidden_dim: 128
- intermediate_dim: 512
- dropout: 0.1
- max_sequence_length: 512
- num_segments: 2
Note