monsterapi
/

llama2-7b-tiny-codes-code-generation

code generation

code-generation

alpaca-instruct

Model card Files Files and versions

gvij commited on Aug 16, 2023

Commit

abc613e

·

1 Parent(s): 424431a

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -22,7 +22,7 @@ We finetuned [Llama 2 7B model](https://huggingface.co/meta-llama/Llama-2-7b-hf)
 This dataset contains **1.63 million rows** and is a collection of short and clear code snippets that can help LLM models learn how to reason with both natural and programming languages. The dataset covers a wide range of programming languages, such as Python, TypeScript, JavaScript, Ruby, Julia, Rust, C++, Bash, Java, C#, and Go. It also includes two database languages: Cypher (for graph databases) and SQL (for relational databases) in order to study the relationship of entities.
-The finetuning session got completed in 53 hours and costed us ~ `$125` for the entire finetuning run!
 #### Hyperparameters & Run details:
 - Model Path: meta-llama/Llama-2-7b-hf

 This dataset contains **1.63 million rows** and is a collection of short and clear code snippets that can help LLM models learn how to reason with both natural and programming languages. The dataset covers a wide range of programming languages, such as Python, TypeScript, JavaScript, Ruby, Julia, Rust, C++, Bash, Java, C#, and Go. It also includes two database languages: Cypher (for graph databases) and SQL (for relational databases) in order to study the relationship of entities.
+The finetuning session got completed in 193 minutes and costed us only ~ `$7.5` for the entire finetuning run!
 #### Hyperparameters & Run details:
 - Model Path: meta-llama/Llama-2-7b-hf