google/electra-small-generator

Fill-Mask • Updated Feb 29, 2024 • 14.3k • • 14

Note Smallest generator model. 12 Layers, 1024 intermediate size, 256 hidden size, 4 attention heads.

google/electra-small-discriminator

Updated Feb 29, 2024 • 809k • 38

Note Smallest discriminator model. 12 Layers, 1024 intermediate size, 256 hidden size, 4 attention heads.

google/electra-base-generator

Fill-Mask • Updated Feb 29, 2024 • 1.11k • • 9

Note Base generator model. 12 Layers, 1024 intermediate size, 256 hidden size, 4 attention heads.

google/electra-base-discriminator

Updated Feb 29, 2024 • 49.1M • 89

Note Base discriminator model. 12 Layers, 3072 intermediate size, 768 hidden size, 12 attention heads.

google/electra-large-generator

Fill-Mask • Updated Feb 29, 2024 • 71 • 8

Note Largest generator model. 24 Layers, 1024 intermediate size, 1024 hidden size, 4 attention heads.

google/electra-large-discriminator

Updated Feb 29, 2024 • 27.8k • 16

Note Largest discriminator model. 24 Layers, 4096 intermediate size, 1024 hidden size, 16 attention heads.