Open
Description
@gorjanradevski Dear author, I downloaded the STLT model on Action Genome Oracle and tried to run the following code, but the map is 58.75, slightly lower than 60.6 in the paper. Can you tell me why?
`(dp-env) wn@node01:~/temp/STLT$ python inference.py --test_dataset_path "data/ActionGenome/val_dataset.json" --batch_size 1 --dataset_type "layout" --model_name "stlt" --checkpoint_path "checkpoints/action_genome_gt_stlt.pt" --dataset_name "action_genome" --labels_path "data/ActionGenome/labels.json" --videoid2size_path "data/ActionGenome/videoid2size.json"
INFO:root:Preparing dataset...
INFO:root:Inference on 1814
INFO:root:Preparing model...
INFO:root:==================================
INFO:root:The model's configuration is:
- Unique categories: 38
- Number of classes: 157
- Hidden size: 768
- Hidden dropout probability: 0.1
- Layer normalization epsilon: 1e-12
- Number of attention heads: 12
- Number of spatial layers: 4
- Number of temporal layers: 8
- Max number of layout frames: 256
- The backbone path is: None
- Freezing the backbone: False
INFO:root:==================================
INFO:root:Starting inference...
100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1814/1814 [00:37<00:00, 48.10it/s]
INFO:root:=================================
INFO:root:The metrics are:
INFO:root:map: 58.75
INFO:root:=================================
`
Metadata
Metadata
Assignees
Labels
No labels