update readme regarding FA2

README.md

@@ -105,7 +105,7 @@ from transformers import AutoProcessor
 
 model_id = "microsoft/Phi-3-vision-128k-instruct" 
 
-model = AutoModelForCausalLM.from_pretrained(model_id, device_map="cuda", trust_remote_code=True, torch_dtype="auto")
+model = AutoModelForCausalLM.from_pretrained(model_id, device_map="cuda", trust_remote_code=True, torch_dtype="auto", attn_implementation='eager') # use attn_implementation='flash_attention_2' to enable flash attention
 
 processor = AutoProcessor.from_pretrained(model_id, trust_remote_code=True) 
 
@@ -217,24 +217,6 @@ Note that by default, the Phi-3-Vision-128K model uses flash attention, which re
 * NVIDIA A6000
 * NVIDIA H100
 
-### Running on Windows or without flash attention
-To enable the model on these enviroment here are steps that you may consider to follow:
-
-Step 1: comment flash attention import code in modeling_phi3_v.py from line 52 to line 56.
-```python
-# if is_flash_attn_2_available():
-#     from flash_attn import flash_attn_func, flash_attn_varlen_func
-#     from flash_attn.bert_padding import index_first_axis, pad_input, unpad_input  # noqa
-
-#     _flash_supports_window_size = "window_size" in list(inspect.signature(flash_attn_func).parameters)
-```
-
-Step 2: change _"_attn_implementation"_ from _"flash_attention_2"_ to _"eager"_ in config.json or disable flash attention when you create the model as below.
-
-```python
-model = AutoModelForCausalLM.from_pretrained('microsoft/Phi-3-vision-128k-instruct', device_map="cuda", trust_remote_code=True, torch_dtype="auto", _attn_implementation="eager")
-```
-
 ## License
 
 The model is licensed under the [MIT license](https://huggingface.co/microsoft/Phi-3-vision-128k-instruct/resolve/main/LICENSE).