dronefreak commited on
Commit
bb6736c
·
1 Parent(s): 5c2a54b

Upload 3 files (#2)

Browse files

- Upload 3 files (284563f7ac0103fdc3ae7265fb47caef58aa15ba)

Files changed (3) hide show
  1. README.md +42 -22
  2. country_breakdown.json +32 -0
  3. domain_metadata.json +0 -0
README.md CHANGED
@@ -25,13 +25,13 @@ metrics:
25
  - recall
26
  - f1
27
 
28
- base_model: "Roboflow/rf-detr-small"
29
  ---
30
 
31
 
32
- # RF-DETR Small Finetuned on Global Wheat Head Dataset
33
 
34
- Fine-tuned RF-DETR Small object detector on the **Global Wheat Head Dataset** benchmark dataset, trained and evaluated as part of [DetectionBench](https://github.com/dronefreak/DetectionBench) -- a framework for reproducibly benchmarking modern object detectors with identical training recipes and evaluation metrics across multiple real-world datasets.
35
 
36
  <br>
37
 
@@ -39,14 +39,14 @@ Fine-tuned RF-DETR Small object detector on the **Global Wheat Head Dataset** be
39
  <div style="display: flex; justify-content: center; align-items: center; gap: 8px; margin-bottom: 8px; flex-wrap: wrap;">
40
  <img src="https://img.shields.io/badge/Task-Object_Detection-blue?style=flat-square" alt="Task">
41
  <img src="https://img.shields.io/badge/Framework-RF--DETR-0aa1a7?style=flat-square" alt="Framework">
42
- <img src="https://img.shields.io/badge/Base_Model-RF--DETR_Small-purple?style=flat-square" alt="Base Model">
43
  </div>
44
 
45
  <!-- ROW 2: Performance Metrics -->
46
  <div style="display: flex; justify-content: center; align-items: center; gap: 8px; margin-bottom: 8px; flex-wrap: wrap;">
47
- <img src="https://img.shields.io/badge/mAP@50-64.51%25-success?style=flat-square" alt="mAP@50">
48
- <img src="https://img.shields.io/badge/mAP@50:95-26.12%25-orange?style=flat-square" alt="mAP@50:95">
49
- <img src="https://img.shields.io/badge/Params-32.1M-lightgrey?style=flat-square" alt="Params">
50
  </div>
51
 
52
  <!-- ROW 3: Metadata -->
@@ -60,7 +60,7 @@ Fine-tuned RF-DETR Small object detector on the **Global Wheat Head Dataset** be
60
  ## Detection Showcase
61
 
62
  <p align="center">
63
- <img src="gwhd_rfdetr-small_showcase.jpg" alt="Global Wheat Head Dataset Detection Demo" width="900">
64
  </p>
65
 
66
  ---
@@ -69,12 +69,12 @@ Fine-tuned RF-DETR Small object detector on the **Global Wheat Head Dataset** be
69
 
70
  | Metric | Score (%) |
71
  | ---------- | --------------- |
72
- | mAP@50 | 64.51 |
73
- | mAP@50-95 | 26.12 |
74
- | Precision | 77.6 |
75
- | Recall | 63.61 |
76
- | F1 Score | 69.91 |
77
- | Parameters | 32.1M |
78
  | FLOPs | N/A (not published upstream) |
79
 
80
  ---
@@ -106,7 +106,25 @@ Every model DetectionBench has trained and evaluated on Global Wheat Head Datase
106
 
107
  | Class | mAP@50 | mAP@50-95 |
108
  | -------------------------- | --------------- | ----------------- |
109
- | wheat_head | 64.51 | 26.12 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
110
  ---
111
 
112
  ## Evaluation Visualizations
@@ -141,11 +159,11 @@ from huggingface_hub import hf_hub_download
141
  import rfdetr
142
 
143
  weights = hf_hub_download(
144
- repo_id="dronefreak/gwhd-rfdetr-small",
145
  filename="checkpoint_best_total.pth"
146
  )
147
 
148
- model = rfdetr.RFDETRSmall(pretrain_weights=weights)
149
  ```
150
 
151
  ### Run Inference
@@ -163,10 +181,10 @@ detections = model.predict("image.jpg", threshold=0.25)
163
  | Framework | RF-DETR |
164
  | Training Toolkit | DetectionBench |
165
  | Epochs (configured max) | 500 |
166
- | Epochs (actually trained) | 124 |
167
  | Early Stopping Patience | 100 |
168
- | Batch Size | 6 |
169
- | Resolution | 512 |
170
  | Optimizer | adamw |
171
  | Learning Rate | 0.0001 |
172
  | Seed | 42 |
@@ -178,7 +196,9 @@ detections = model.predict("image.jpg", threshold=0.25)
178
  checkpoint_best_total.pth
179
  metrics.csv
180
  config.json
181
- gwhd_rfdetr-small_showcase.jpg
 
 
182
  README.md
183
  ```
184
 
@@ -221,7 +241,7 @@ If you find this model useful, please consider starring the repository.
221
  If you use this model in your research, please consider citing:
222
 
223
  1. The Global Wheat Head Dataset dataset (see below)
224
- 2. The original RF-DETR Small architecture (see below)
225
  3. The other model architectures shown in the Model Zoo/External Comparison tables above, if you reference their results
226
  4. DetectionBench, the training/evaluation framework used to produce this checkpoint
227
  ```
 
25
  - recall
26
  - f1
27
 
28
+ base_model: "Roboflow/rf-detr-nano"
29
  ---
30
 
31
 
32
+ # RF-DETR Nano Finetuned on Global Wheat Head Dataset
33
 
34
+ Fine-tuned RF-DETR Nano object detector on the **Global Wheat Head Dataset** benchmark dataset, trained and evaluated as part of [DetectionBench](https://github.com/dronefreak/DetectionBench) -- a framework for reproducibly benchmarking modern object detectors with identical training recipes and evaluation metrics across multiple real-world datasets.
35
 
36
  <br>
37
 
 
39
  <div style="display: flex; justify-content: center; align-items: center; gap: 8px; margin-bottom: 8px; flex-wrap: wrap;">
40
  <img src="https://img.shields.io/badge/Task-Object_Detection-blue?style=flat-square" alt="Task">
41
  <img src="https://img.shields.io/badge/Framework-RF--DETR-0aa1a7?style=flat-square" alt="Framework">
42
+ <img src="https://img.shields.io/badge/Base_Model-RF--DETR_Nano-purple?style=flat-square" alt="Base Model">
43
  </div>
44
 
45
  <!-- ROW 2: Performance Metrics -->
46
  <div style="display: flex; justify-content: center; align-items: center; gap: 8px; margin-bottom: 8px; flex-wrap: wrap;">
47
+ <img src="https://img.shields.io/badge/mAP@50-53.82%25-success?style=flat-square" alt="mAP@50">
48
+ <img src="https://img.shields.io/badge/mAP@50:95-19.65%25-orange?style=flat-square" alt="mAP@50:95">
49
+ <img src="https://img.shields.io/badge/Params-30.5M-lightgrey?style=flat-square" alt="Params">
50
  </div>
51
 
52
  <!-- ROW 3: Metadata -->
 
60
  ## Detection Showcase
61
 
62
  <p align="center">
63
+ <img src="gwhd_rfdetr-nano_showcase.jpg" alt="Global Wheat Head Dataset Detection Demo" width="900">
64
  </p>
65
 
66
  ---
 
69
 
70
  | Metric | Score (%) |
71
  | ---------- | --------------- |
72
+ | mAP@50 | 53.82 |
73
+ | mAP@50-95 | 19.65 |
74
+ | Precision | 72.52 |
75
+ | Recall | 53.64 |
76
+ | F1 Score | 61.67 |
77
+ | Parameters | 30.5M |
78
  | FLOPs | N/A (not published upstream) |
79
 
80
  ---
 
106
 
107
  | Class | mAP@50 | mAP@50-95 |
108
  | -------------------------- | --------------- | ----------------- |
109
+ | wheat_head | 53.82 | 19.65 |
110
+ ---
111
+
112
+ ## Per-Country Performance
113
+
114
+ Domain shift can matter more than the aggregate score above for field deployment, so this evaluates the same test split broken down by the contributing country/institution, using per-image domain metadata (`domain_metadata.json` in this repository) compiled by this project for this stratified evaluation -- not a file shipped with the original GWHD release. Each row below is computed by re-running this exact model's evaluation restricted to that country's images only -- the same mAP definition as the aggregate number above (Ultralytics' `model.val()` for YOLO, Supervision's `MeanAveragePrecision` for RF-DETR), just on a filtered subset, not a separate metric implementation. One test image with no resolvable country in the source metadata (a documented upstream duplicate-filename quirk) is excluded from every row below.
115
+
116
+ | Country | mAP@50 | mAP@50-95 | Test Images |
117
+ | --------------------------- | --------------- | ----------------- | ------------------ |
118
+ | Australia | 35.4 | 10.86 | 281 |
119
+ | China | 79.78 | 33.58 | 200 |
120
+ | Japan | 61.07 | 30.42 | 60 |
121
+ | Mexico | 54.51 | 19.27 | 205 |
122
+ | Sudan | 61.42 | 24.15 | 30 |
123
+ | US | 58.7 | 20.9 | 605 |
124
+
125
+
126
+ See `country_breakdown.json` (results) and `domain_metadata.json` (the country/growth-stage mapping used to compute them) in this repository for the raw data behind this table.
127
+
128
  ---
129
 
130
  ## Evaluation Visualizations
 
159
  import rfdetr
160
 
161
  weights = hf_hub_download(
162
+ repo_id="dronefreak/gwhd-rfdetr-nano",
163
  filename="checkpoint_best_total.pth"
164
  )
165
 
166
+ model = rfdetr.RFDETRNano(pretrain_weights=weights)
167
  ```
168
 
169
  ### Run Inference
 
181
  | Framework | RF-DETR |
182
  | Training Toolkit | DetectionBench |
183
  | Epochs (configured max) | 500 |
184
+ | Epochs (actually trained) | 110 |
185
  | Early Stopping Patience | 100 |
186
+ | Batch Size | 7 |
187
+ | Resolution | 384 |
188
  | Optimizer | adamw |
189
  | Learning Rate | 0.0001 |
190
  | Seed | 42 |
 
196
  checkpoint_best_total.pth
197
  metrics.csv
198
  config.json
199
+ country_breakdown.json
200
+ domain_metadata.json
201
+ gwhd_rfdetr-nano_showcase.jpg
202
  README.md
203
  ```
204
 
 
241
  If you use this model in your research, please consider citing:
242
 
243
  1. The Global Wheat Head Dataset dataset (see below)
244
+ 2. The original RF-DETR Nano architecture (see below)
245
  3. The other model architectures shown in the Model Zoo/External Comparison tables above, if you reference their results
246
  4. DetectionBench, the training/evaluation framework used to produce this checkpoint
247
  ```
country_breakdown.json ADDED
@@ -0,0 +1,32 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "Australia": {
3
+ "mAP50": 0.3540254533290863,
4
+ "mAP50_95": 0.10858235508203506,
5
+ "num_images": 281
6
+ },
7
+ "China": {
8
+ "mAP50": 0.7978321313858032,
9
+ "mAP50_95": 0.3357720375061035,
10
+ "num_images": 200
11
+ },
12
+ "Japan": {
13
+ "mAP50": 0.6107019186019897,
14
+ "mAP50_95": 0.30420443415641785,
15
+ "num_images": 60
16
+ },
17
+ "Mexico": {
18
+ "mAP50": 0.5450758934020996,
19
+ "mAP50_95": 0.1927119940519333,
20
+ "num_images": 205
21
+ },
22
+ "Sudan": {
23
+ "mAP50": 0.6141822934150696,
24
+ "mAP50_95": 0.24153614044189453,
25
+ "num_images": 30
26
+ },
27
+ "US": {
28
+ "mAP50": 0.5870068073272705,
29
+ "mAP50_95": 0.2090480625629425,
30
+ "num_images": 605
31
+ }
32
+ }
domain_metadata.json ADDED
The diff for this file is too large to render. See raw diff
 
Free AI Image Generator No sign-up. Instant results. Open Now