updated samples

README.md

@@ -10,8 +10,13 @@ This model as intended to be used as an accelerator for llama 13B (chat).
 Undlerlying implementation of Paged Attention KV-Cached and speculator can be found in https://github.com/foundation-model-stack/fms-extras
 Production implementation using `fms-extras` implementation can be found in https://github.com/tdoublep/text-generation-inference/tree/speculative-decoding
 
+## Samples
 
-To try this out running in a production-like environment, please use the pre-built docker image:
+### Production Server Sample
+
+*To try this out running in a production-like environment, please use the pre-built docker image:*
+
+#### Setup
 
 ```bash
 docker pull docker-eu-public.artifactory.swg-devops.com/res-zrl-snap-docker-local/tgis-os:spec.7
docker run -d --rm --gpus all \
@@ -35,17 +40,31 @@ git clone --branch speculative-decoding --single-branch https://github.com/tdoub
 cd text-generation-inference/integration_tests
 make gen-client
 pip install . --no-cache-dir
+```
+
+#### Run Sample
+
+```bash
 python sample_client.py
 ```
 
-To try this out with the fms-native compiled model, please execute the following:
+### Minimal Sample
+
+*To try this out with the fms-native compiled model, please execute the following:*
 
-#### batch_size=1 (compile + cudagraphs)
+#### Install
 
 ```bash
 git clone https://github.com/foundation-model-stack/fms-extras
 (cd fms-extras && pip install -e .)
 pip install transformers==4.35.0 sentencepiece numpy
+```
+
+#### Run Sample
+
+##### batch_size=1 (compile + cudagraphs)
+
+```bash
 python fms-extras/scripts/paged_speculative_inference.py \
     --variant=13b \
     --model_path=/path/to/model_weights/llama/13B-F \
@@ -57,12 +76,9 @@ python fms-extras/scripts/paged_speculative_inference.py \
     --compile_mode=reduce-overhead
 ```
 
-#### batch_size=1 (compile)
+##### batch_size=1 (compile)
 
 ```bash
-git clone https://github.com/foundation-model-stack/fms-extras
-(cd fms-extras && pip install -e .)
-pip install transformers==4.35.0 sentencepiece numpy
 python fms-extras/scripts/paged_speculative_inference.py \
     --variant=13b \
     --model_path=/path/to/model_weights/llama/13B-F \
@@ -73,12 +89,9 @@ python fms-extras/scripts/paged_speculative_inference.py \
     --compile \
 ```
 
-#### batch_size=4 (compile)
+##### batch_size=4 (compile)
 
 ```bash
-git clone https://github.com/foundation-model-stack/fms-extras
-(cd fms-extras && pip install -e .)
-pip install transformers==4.35.0 sentencepiece numpy
 python fms-extras/scripts/paged_speculative_inference.py \
     --variant=13b \
     --model_path=/path/to/model_weights/llama/13B-F \