RedHatAI
/

Llama-3.1-8B-tldr-FP8-dynamic

Text Generation

text-generation-inference

compressed-tensors

Model card Files Files and versions

Llama-3.1-8B-tldr-FP8-dynamic / inference_performance

1 contributor

History: 1 commit

alexmarques's picture

Rename chart (3).png to inference_performance/latency.png

b93a144 verified 3 months ago

latency.png

32.6 kB

Rename chart (3).png to inference_performance/latency.png 3 months ago