satreysa commited on
Commit
928747f
·
verified ·
1 Parent(s): a1844d2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +164 -36
README.md CHANGED
@@ -1,36 +1,164 @@
1
- ---
2
- license: llama2
3
- base_model:
4
- - meta-llama/CodeLlama-7b-Instruct-hf
5
- ---
6
-
7
- # amd/CodeLlama-7b-instruct-g128-hybrid
8
- - ## Introduction
9
- This model was prepared using the AMD Quark Quantization tool, followed by necessary post-processing.
10
-
11
- - ## Quantization Strategy
12
- - AWQ / Group 128 / Asymmetric / UINT4 Weights / FP16 activations
13
- - Excluded Layers: None
14
- -
15
- - ## Quick Start
16
- For quickstart, refer to [Ryzen AI doucmentation](https://ryzenai.docs.amd.com/en/latest/hybrid_oga.html)
17
-
18
- #### Evaluation scores
19
- The perplexity measurement is run on the wikitext-2-raw-v1 (raw data) dataset provided by Hugging Face. Perplexity score measured for prompt length 2k is 7.260.
20
-
21
- #### License
22
- Modifications copyright(c) 2024 Advanced Micro Devices,Inc. All rights reserved.
23
-
24
- MIT License
25
-
26
- Copyright (c) 2024 Advanced Micro Devices, Inc
27
-
28
- Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal
29
- in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
30
- copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
31
- The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
32
-
33
- THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
34
- FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
35
- LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
36
- SOFTWARE.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: llama2
3
+ base_model:
4
+ - meta-llama/CodeLlama-7b-Instruct-hf
5
+ ---
6
+
7
+ # amd/CodeLlama-7b-instruct-g128-hybrid
8
+ - ## Introduction
9
+ This model was prepared using the AMD Quark Quantization tool, followed by necessary post-processing.
10
+
11
+ - ## Quantization Strategy
12
+ - AWQ / Group 128 / Asymmetric / UINT4 Weights / FP16 activations
13
+ - Excluded Layers: None
14
+ -
15
+ - ## Quick Start
16
+ For quickstart, refer to [Ryzen AI doucmentation](https://ryzenai.docs.amd.com/en/latest/hybrid_oga.html)
17
+
18
+ #### Evaluation scores
19
+ The perplexity measurement is run on the wikitext-2-raw-v1 (raw data) dataset provided by Hugging Face. Perplexity score measured for prompt length 2k is 7.260.
20
+
21
+ #### License
22
+ Modifications copyright(c) 2024 Advanced Micro Devices,Inc. All rights reserved.
23
+
24
+ MIT License
25
+
26
+ Copyright (c) 2024 Advanced Micro Devices, Inc
27
+
28
+ Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal
29
+ in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
30
+ copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
31
+ The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
32
+
33
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
34
+ FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
35
+ LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
36
+ SOFTWARE.
37
+
38
+ LLAMA 2 COMMUNITY LICENSE AGREEMENT
39
+ Llama 2 Version Release Date: July 18, 2023
40
+
41
+ "Agreement" means the terms and conditions for use, reproduction, distribution and
42
+ modification of the Llama Materials set forth herein.
43
+
44
+ "Documentation" means the specifications, manuals and documentation
45
+ accompanying Llama 2 distributed by Meta at ai.meta.com/resources/models-and-
46
+ libraries/llama-downloads/.
47
+
48
+ "Licensee" or "you" means you, or your employer or any other person or entity (if
49
+ you are entering into this Agreement on such person or entity's behalf), of the age
50
+ required under applicable laws, rules or regulations to provide legal consent and that
51
+ has legal authority to bind your employer or such other person or entity if you are
52
+ entering in this Agreement on their behalf.
53
+
54
+ "Llama 2" means the foundational large language models and software and
55
+ algorithms, including machine-learning model code, trained model weights,
56
+ inference-enabling code, training-enabling code, fine-tuning enabling code and other
57
+ elements of the foregoing distributed by Meta at ai.meta.com/resources/models-and-
58
+ libraries/llama-downloads/.
59
+
60
+ "Llama Materials" means, collectively, Meta's proprietary Llama 2 and
61
+ Documentation (and any portion thereof) made available under this Agreement.
62
+
63
+ "Meta" or "we" means Meta Platforms Ireland Limited (if you are located in or, if you
64
+ are an entity, your principal place of business is in the EEA or Switzerland) and Meta
65
+ Platforms, Inc. (if you are located outside of the EEA or Switzerland).
66
+
67
+ By clicking "I Accept" below or by using or distributing any portion or element of the
68
+ Llama Materials, you agree to be bound by this Agreement.
69
+
70
+ 1. License Rights and Redistribution.
71
+
72
+ a. Grant of Rights. You are granted a non-exclusive, worldwide, non-
73
+ transferable and royalty-free limited license under Meta's intellectual property or
74
+ other rights owned by Meta embodied in the Llama Materials to use, reproduce,
75
+ distribute, copy, create derivative works of, and make modifications to the Llama
76
+ Materials.
77
+
78
+ b. Redistribution and Use.
79
+
80
+ i. If you distribute or make the Llama Materials, or any derivative works
81
+ thereof, available to a third party, you shall provide a copy of this Agreement to such
82
+ third party.
83
+ ii. If you receive Llama Materials, or any derivative works thereof, from
84
+ a Licensee as part of an integrated end user product, then Section 2 of this
85
+ Agreement will not apply to you.
86
+
87
+ iii. You must retain in all copies of the Llama Materials that you
88
+ distribute the following attribution notice within a "Notice" text file distributed as a
89
+ part of such copies: "Llama 2 is licensed under the LLAMA 2 Community License,
90
+ Copyright (c) Meta Platforms, Inc. All Rights Reserved."
91
+
92
+ iv. Your use of the Llama Materials must comply with applicable laws
93
+ and regulations (including trade compliance laws and regulations) and adhere to the
94
+ Acceptable Use Policy for the Llama Materials (available at
95
+ https://ai.meta.com/llama/use-policy), which is hereby incorporated by reference into
96
+ this Agreement.
97
+
98
+ v. You will not use the Llama Materials or any output or results of the
99
+ Llama Materials to improve any other large language model (excluding Llama 2 or
100
+ derivative works thereof).
101
+
102
+ 2. Additional Commercial Terms. If, on the Llama 2 version release date, the
103
+ monthly active users of the products or services made available by or for Licensee,
104
+ or Licensee's affiliates, is greater than 700 million monthly active users in the
105
+ preceding calendar month, you must request a license from Meta, which Meta may
106
+ grant to you in its sole discretion, and you are not authorized to exercise any of the
107
+ rights under this Agreement unless or until Meta otherwise expressly grants you
108
+ such rights.
109
+
110
+ 3. Disclaimer of Warranty. UNLESS REQUIRED BY APPLICABLE LAW, THE
111
+ LLAMA MATERIALS AND ANY OUTPUT AND RESULTS THEREFROM ARE
112
+ PROVIDED ON AN "AS IS" BASIS, WITHOUT WARRANTIES OF ANY KIND,
113
+ EITHER EXPRESS OR IMPLIED, INCLUDING, WITHOUT LIMITATION, ANY
114
+ WARRANTIES OF TITLE, NON-INFRINGEMENT, MERCHANTABILITY, OR
115
+ FITNESS FOR A PARTICULAR PURPOSE. YOU ARE SOLELY RESPONSIBLE
116
+ FOR DETERMINING THE APPROPRIATENESS OF USING OR REDISTRIBUTING
117
+ THE LLAMA MATERIALS AND ASSUME ANY RISKS ASSOCIATED WITH YOUR
118
+ USE OF THE LLAMA MATERIALS AND ANY OUTPUT AND RESULTS.
119
+
120
+ 4. Limitation of Liability. IN NO EVENT WILL META OR ITS AFFILIATES BE
121
+ LIABLE UNDER ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, TORT,
122
+ NEGLIGENCE, PRODUCTS LIABILITY, OR OTHERWISE, ARISING OUT OF THIS
123
+ AGREEMENT, FOR ANY LOST PROFITS OR ANY INDIRECT, SPECIAL,
124
+ CONSEQUENTIAL, INCIDENTAL, EXEMPLARY OR PUNITIVE DAMAGES, EVEN
125
+ IF META OR ITS AFFILIATES HAVE BEEN ADVISED OF THE POSSIBILITY OF
126
+ ANY OF THE FOREGOING.
127
+
128
+ 5. Intellectual Property.
129
+
130
+ a. No trademark licenses are granted under this Agreement, and in
131
+ connection with the Llama Materials, neither Meta nor Licensee may use any name
132
+ or mark owned by or associated with the other or any of its affiliates, except as
133
+ required for reasonable and customary use in describing and redistributing the
134
+ Llama Materials.
135
+
136
+ b. Subject to Meta's ownership of Llama Materials and derivatives made by or
137
+ for Meta, with respect to any derivative works and modifications of the Llama
138
+ Materials that are made by you, as between you and Meta, you are and will be the
139
+ owner of such derivative works and modifications.
140
+
141
+ c. If you institute litigation or other proceedings against Meta or any entity
142
+ (including a cross-claim or counterclaim in a lawsuit) alleging that the Llama
143
+ Materials or Llama 2 outputs or results, or any portion of any of the foregoing,
144
+ constitutes infringement of intellectual property or other rights owned or licensable
145
+ by you, then any licenses granted to you under this Agreement shall terminate as of
146
+ the date such litigation or claim is filed or instituted. You will indemnify and hold
147
+ harmless Meta from and against any claim by any third party arising out of or related
148
+ to your use or distribution of the Llama Materials.
149
+
150
+ 6. Term and Termination. The term of this Agreement will commence upon your
151
+ acceptance of this Agreement or access to the Llama Materials and will continue in
152
+ full force and effect until terminated in accordance with the terms and conditions
153
+ herein. Meta may terminate this Agreement if you are in breach of any term or
154
+ condition of this Agreement. Upon termination of this Agreement, you shall delete
155
+ and cease use of the Llama Materials. Sections 3, 4 and 7 shall survive the
156
+ termination of this Agreement.
157
+
158
+ 7. Governing Law and Jurisdiction. This Agreement will be governed and
159
+ construed under the laws of the State of California without regard to choice of law
160
+ principles, and the UN Convention on Contracts for the International Sale of Goods
161
+ does not apply to this Agreement. The courts of California shall have exclusive
162
+ jurisdiction of any dispute arising out of this Agreement.
163
+
164
+