Xenova HF Staff commited on
Commit
dea8ca8
·
verified ·
1 Parent(s): 13d9eb3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +35 -1
README.md CHANGED
@@ -16,4 +16,38 @@ language:
16
  library_name: transformers.js
17
  base_model:
18
  - arcee-ai/AFM-4.5B
19
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
16
  library_name: transformers.js
17
  base_model:
18
  - arcee-ai/AFM-4.5B
19
+ ---
20
+
21
+
22
+ ## Usage (Transformers.js)
23
+
24
+ If you haven't already, you can install the [Transformers.js](https://huggingface.co/docs/transformers.js) JavaScript library from [NPM](https://www.npmjs.com/package/@huggingface/transformers) using:
25
+ ```bash
26
+ npm i @huggingface/transformers
27
+ ```
28
+
29
+ You can then generate text as follows:
30
+ ```js
31
+ import { pipeline, TextStreamer } from "@huggingface/transformers";
32
+
33
+ // Create a text generation pipeline
34
+ const generator = await pipeline(
35
+ "text-generation",
36
+ "onnx-community/AFM-4.5B-ONNX",
37
+ { dtype: "q4f16" },
38
+ );
39
+
40
+ // Define the list of messages
41
+ const messages = [
42
+ { role: "system", content: "You are a helpful assistant." },
43
+ { role: "user", content: "What is the capital of France?" },
44
+ ];
45
+ // Generate a response
46
+ const output = await generator(messages, {
47
+ max_new_tokens: 512,
48
+ do_sample: false,
49
+ streamer: new TextStreamer(generator.tokenizer, { skip_prompt: true, skip_special_tokens: true }),
50
+ });
51
+ console.log(output[0].generated_text.at(-1).content);
52
+ ```
53
+