how to visulize the attention map of each word on a tested image about adaptiveattention HOT 3 OPEN

I think you can use the eval_visulization.lua to generate 'visu_gt_test.json' and 'atten_gt_test_1'. Selecting the commented code, it can generate attention in ground truth sentence or sample sentence. And then use visu/visAtten.lua to process the data.

I write the data out and use the code to generate heat map.

from adaptiveattention.

thanks @YeDeming

from adaptiveattention.

hello @YeDeming @alandonald
can keras-cam generate heat maps for each word?
if it can do that, please tell me how to do that. thank you!

from adaptiveattention.