Leaderboard

You may submit results to this leaderboard with an email titled "VisCOLL submission (your model name)" to xisenjin@usc.edu.

COCO-shift


MethodFinal Log PPLFinal BLEU-1Final BLEU-2
Vanilla Online + VLBERT5.04025.961.29
Vanilla Online + LXMERT5.19325.191.81
ER + VLBERT2.30758.0632.22
ER-MIR + VLBERT2.46958.0032.33
ER-MIR-Max + VLBERT2.47358.1432.48
ER + LXMERT2.42661.0135.45
ER-MIR + LXMERT2.37460.7935.10
ER-MIR-MAX + LXMERT2.37861.0635.24
Offline + VLBERT1.44348.9344.16
Offline + LXMERT1.50367.5342.79

Flickr-shift


MethodFinal Log PPLFinal BLEU-1Final BLEU-2
Vanilla Online + VLBERT5.69125.013.01
Vanilla Online + LXMERT6.10724.773.09
ER + VLBERT3.49240.2316.80
ER-MIR + VLBERT3.50440.2716.81
ER-MIR-Max + VLBERT3.55540.0416.64
ER + LXMERT3.19744.3420.73
ER-MIR + LXMERT3.21144.3020.83
ER-MIR-MAX + LXMERT3.22643.5119.95
Offline + VLBERT2.02557.1332.29
Offline + LXMERT2.02557.1032.25