Comments (8)
Hey, sorry for late reply. Despite how much we would like to include more datasets, MKQA is more of a open domain question answering dataset than a KGQA dataset. Therefore, I do not think we would integrate MKQA. What do you think @RicardoUsbeck?
from leaderboard.
I think this is a very interesting special case. In particular, MKQA has answers grounded in a graph. Similar to FreebaseQA. Even though it has no KGQA logical form, e.g. a SPARQL query or a lambda expression, it still is valid. So, adding it makes sense if it fits the other criteria.
@alexanderpanchenko feel free to submit a pull request.
from leaderboard.
Thank you! From what I understood, part of the queries are answered from KG. But if the question is non-answerable with KG then there is no answer in this form.
Regarding pull request: in case you are not planning to implement yourself but is ready to include we may try to do it on our side, yes.
from leaderboard.
Then it makes sense to add this dataset.
@alexanderpanchenko It would be faster if you add the MKQA. We would publish an instruction video soon, you can check it out. :)
from leaderboard.
fixed by #49
from leaderboard.
Thank you. We will consider implementing it during fall 2022.
from leaderboard.
Implementing?
from leaderboard.
Thanks for integrating it: so far I did not had capacity to do it. It's great you managed to find resources to include it (and RuBQ too).
from leaderboard.
Related Issues (20)
- add "Evaluating Large Language Models in Semantic Parsing for Conversational Question Answering over Knowledge Graphs"
- add "KnowledgeNavigator: Leveraging Large Language Models for Enhanced Reasoning over Knowledge Graph"
- add "KEQING: KNOWLEDGE-BASED QUESTION ANSWERING IS A NATURE CHAIN-OF-THOUGHT MENTOR OF LLM"
- add "DSAMR: Dual-Stream Attention Multi-hop Reasoning for knowledge-based visual question answering"
- add "JOINT MULTI-FACTS REASONING NETWORK FOR COMPLEX TEMPORAL QUESTION ANSWERING OVER KNOWLEDGE GRAPH"
- add dataset "Spider4SPARQL"
- add "A novel technique using graph neural networks and relevance scoring to improve the performance of knowledge graph-based question answering systems"
- add "Temporal Knowledge Graph Question Answering Models Enhanced with GAT" HOT 1
- add "Benchmarking Large Language Models in Complex Question Answering Attribution using Knowledge Graphs"
- add "LB-KBQA: Large-language-model and BERT based Knowledge-Based Question and Answering System"
- add "Enhancing Complex Question Answering over Knowledge Graphs through Evidence Pattern Retrieval"
- add "Enhancing Complex Question Answering over Knowledge Graphs through Evidence Pattern Retrieval"
- add "Semantic-enhanced reasoning question answering over temporal knowledge graphs"
- add "Enhancing SPARQL Query Generation for Knowledge Base Question Answering Systems by Learning to Correct Triplets"
- add "Question Answering Over Spatio-Temporal Knowledge Graph"
- add "Question Calibration and Multi-Hop Modeling for Temporal Question Answering"
- add "Can SPARQL Talk in Portuguese? Answering Questions in Natural Language Using Knowledge Graphs"
- add "Complex Reasoning over Logical Queries on Commonsense Knowledge Graphs"
- add "Question-Directed Reasoning With Relation-Aware Graph Attention Network for Complex Question Answering Over Knowledge Graph"
- The dataset SciQA is missing HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from leaderboard.