jingkang50 / funqa Goto Github PK

Hi, I'm confused about the purpose of this file, looking forward to your reply~

Where are the original videos and extended datasets mentioned in Part 2 that I didn't find in the relevant links?

hi ~thanks for releasing this excellent work to the public! But it seems that there is only annotations json file released, how can i donwload the videos in train/val/test sets.

chk_answer = []
    for data in answer:
        chk_answer.append({
            'task': data['task'],
            'output': data['output'],
            'instruction': data['instruction'],
            'ID': data['ID']
        })

    diff = False
    for data in submission:
        if {
                'task': data['task'],
                'output': data['output'],
                'instruction': data['instruction'],
                'ID': data['ID']
        } not in chk_answer:
            diff = True
            break

    assert diff == False, 'Submission file is not valid'
    print('File is valid! Loading File...')

The 'output' value of submission and gt answer is probably different. So there will definitely be an AssertionError.

Hi! Thanks for the exciting jobs! I have noticed another multi-choice version dataset but can not find the annotation files. Will it be released? 😁