Skip to content

Training results: result_4.3.0-nobackground - #27

Closed
MateoLostanlen wants to merge 6 commits into
mainfrom
result_4.3.0-nobackground
Closed

Training results: result_4.3.0-nobackground#27
MateoLostanlen wants to merge 6 commits into
mainfrom
result_4.3.0-nobackground

Conversation

@MateoLostanlen

Copy link
Copy Markdown
Member

Evaluation results on test set

Metric main current Δ
mAP@50 0.7478 0.6399 -0.1079
mAP@50-95 0.4567 0.4021 -0.0546
Precision 0.7802 0.6588 -0.1214
Recall 0.7130 0.6950 -0.0180

Sequential evaluation on test (optimized params: nb_frames=6, conf=0.35)

TP=148 FN=7 FP=33 TN=109

Metric main current Δ
Recall (TP rate) 0.9664 0.9548 -0.0116
FPR 0.1182 0.2324 +0.1142
F1 0.9312 0.8810 -0.0502
Precision 0.8984 0.8177 -0.0807

Engine parameter optimization (top 10 on val)

nb_frames conf TP FN FP TN Recall FPR F1
6 0.35 128 12 21 109 0.9143 0.1615 0.8858
8 0.3 131 9 25 105 0.9357 0.1923 0.8851
7 0.3 132 8 27 103 0.9429 0.2077 0.8829
7 0.35 127 13 21 109 0.9071 0.1615 0.8819
5 0.4 125 15 20 110 0.8929 0.1538 0.8772
8 0.35 126 14 22 108 0.9 0.1692 0.875
5 0.35 131 9 29 101 0.9357 0.2231 0.8733
8 0.25 133 7 32 98 0.95 0.2462 0.8721
7 0.4 122 18 18 112 0.8714 0.1385 0.8714
6 0.4 123 17 20 110 0.8786 0.1538 0.8693

(vs last committed results on main)
Branch: result_4.3.0-nobackground | Test dataset: pyronear/pyro-dataset @ v4.3.0

MateoLostanlen and others added 6 commits September 7, 2026 14:23
Both fetches pointed at yolo_train_val_corrected / yolo_test_corrected at
v4.0.0-corrected. Those are frozen snapshots added by pyro-dataset commit
76eb464 and tracked outside its pipeline: their content hash is identical at
v4.0.0-corrected, v4.1.0, v4.2.0 and v4.3.0. Bumping the tag alone would have
retrained on the same 32201 files and reported it as a v4.3.0 model.

Switches to the pipeline outputs, which do carry the annotator imports —
roughly 18169 train+val images against 16100 in the snapshot, and the test
set grows from 183 to 190 sequences.

The trade is the frame-level annotation corrections from
vision-rd/data-quality, which only ever existed for the v4.0.0 frames.
Reproducing that pass on v4.3.0 would be the way to get both.

The result-PR footer named the old tag too; it would have misreported which
dataset the numbers came from.
Add --exclude-background flag to build.py that drops background images
(empty label files) from the train split, and enable it in the
train_yolo_best DVC stage. Removes 1642 background images from train
(13039 remaining); val split kept intact for comparable evaluation.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant