aws-neuron
/

optimum-neuron-cache

Model card Files Files and versions

optimum-neuron-cache / inference-cache-config

13.1 kB

Ctrl+K

Ctrl+K

5 contributors

History: 29 commits

Jingya's picture

Jingya HF Staff

Temporarily remove SD 1.5 from Runway

a74d412 verified almost 2 years ago

gpt2.json

398 Bytes
Add more gpt2 configurations over 2 years ago
llama-variants.json

2.63 kB
Update inference-cache-config/llama-variants.json about 2 years ago
llama2-70b.json

287 Bytes
Create llama2-70b.json about 2 years ago
llama2-7b-13b.json

2.02 kB
Rename inference-cache-config/llama2.json to inference-cache-config/llama2-7b-13b.json about 2 years ago
llama3-70b.json

283 Bytes
Create llama3-70b.json about 2 years ago
llama3-8b.json

883 Bytes
Rename inference-cache-config/llama3.json to inference-cache-config/llama3-8b.json about 2 years ago
mistral-variants.json

3.29 kB
Remove SalesForce embedding model over 2 years ago
mistral.json

1.46 kB
Add more batch_size for mistral on smaller instances about 2 years ago
mixtral.json

294 Bytes
Create mixtral.json about 2 years ago
stable-diffusion.json

1.54 kB
Temporarily remove SD 1.5 from Runway almost 2 years ago