Performance?

#1
by MaZeNsMz - opened

Thank you,
Any performance metrics to be shared?
Can this be used with llama.cpp after the conversion to gguf?

Thanks again.

Owner

Thank you,
Any performance metrics to be shared?
Can this be used with llama.cpp after the conversion to gguf?

Thanks again.

This is an early checkpoint, I did not run eval code but the training acceptance length was around ~2 (excluding bonus token).

image

llama.cpp is always slow to catchup, I don't think it will get this model for a long time.

Sign up or log in to comment

Free AI Image Generator No sign-up. Instant results. Open Now