Skip to content

results on ActionGenome dataset #7

Open
@NingWang2049

Description

@NingWang2049

@gorjanradevski Dear author, I downloaded the STLT model on Action Genome Oracle and tried to run the following code, but the map is 58.75, slightly lower than 60.6 in the paper. Can you tell me why?
`(dp-env) wn@node01:~/temp/STLT$ python inference.py --test_dataset_path "data/ActionGenome/val_dataset.json" --batch_size 1 --dataset_type "layout" --model_name "stlt" --checkpoint_path "checkpoints/action_genome_gt_stlt.pt" --dataset_name "action_genome" --labels_path "data/ActionGenome/labels.json" --videoid2size_path "data/ActionGenome/videoid2size.json"
INFO:root:Preparing dataset...
INFO:root:Inference on 1814
INFO:root:Preparing model...
INFO:root:==================================
INFO:root:The model's configuration is:

  • Unique categories: 38
  • Number of classes: 157
  • Hidden size: 768
  • Hidden dropout probability: 0.1
  • Layer normalization epsilon: 1e-12
  • Number of attention heads: 12
  • Number of spatial layers: 4
  • Number of temporal layers: 8
  • Max number of layout frames: 256
  • The backbone path is: None
  • Freezing the backbone: False
    INFO:root:==================================
    INFO:root:Starting inference...
    100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1814/1814 [00:37<00:00, 48.10it/s]
    INFO:root:=================================
    INFO:root:The metrics are:
    INFO:root:map: 58.75
    INFO:root:=================================
    `

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions