dragynir commited on
Commit
d0ed74b
·
verified ·
1 Parent(s): e81b12e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +29 -3
README.md CHANGED
@@ -1,3 +1,29 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ ---
4
+
5
+ This model provides HuggingFaceTB/SmolVLM-256M-Instruct model in tflite format.
6
+ You can use this model with [AI Edge Cpp Example](https://github.com/google-ai-edge/ai-edge-torch/tree/main/ai_edge_torch/generative/examples/cpp)
7
+ You need to slightly modify this pipeline to support image as input (see COLAB example below).
8
+ Currently, [AI Edge Torch](https://github.com/google-ai-edge/ai-edge-torch/tree/main/ai_edge_torch/generative/examples) models not supported
9
+ on [MediaPipe LLM Inference API](https://ai.google.dev/edge/mediapipe/solutions/genai/llm_inference).
10
+ For example [llava model](https://github.com/google-ai-edge/ai-edge-torch/tree/main/ai_edge_torch/generative/examples/qwen_vl), that was used to
11
+ as reference to write SmolVLM-256M-Instruct convertation scripts (coming soon).
12
+
13
+
14
+ ## Use the models
15
+
16
+ ### Colab
17
+
18
+
19
+
20
+
21
+ ## Details
22
+
23
+ The model was converted using:
24
+ ```shell
25
+ python convert_to_tflite.py --quantize="dynamic_int8"\
26
+ --checkpoint_path='./models/SmolVLM-256M-Instruct' --output_path="./models/SmolVLM-256M-Instruct-tflite"\
27
+ --mask_as_input=True --prefill_seq_lens=256 --kv_cache_max_len=2048
28
+ ```
29
+