BestHub
search
Sign in
Tag

Complex QA

1 views collected around this technical thread.

DataFunSummit
DataFunSummit
Mar 19, 2023 · Artificial Intelligence

Complex Question Answering Evaluation of ChatGPT

This paper presents a large‑scale evaluation of ChatGPT on knowledge‑base complex question answering, introducing a feature‑driven multi‑label annotation framework and CheckList‑based functional, robustness, and controllability tests, and comparing its performance with other LLMs across multiple English and multilingual datasets.

Chain-of-ThoughtChatGPTComplex QA
0 likes · 25 min read
Complex Question Answering Evaluation of ChatGPT
DataFunTalk
DataFunTalk
Mar 18, 2023 · Artificial Intelligence

Evaluating ChatGPT on Complex Knowledge‑Base Question Answering Using a Feature‑Driven Multi‑Label Framework

This study presents a comprehensive evaluation of ChatGPT's ability to answer complex knowledge‑base questions by introducing a feature‑driven multi‑label classification framework and applying the CheckList black‑box testing methodology across eight KB‑based CQA datasets, comparing its performance with GPT‑3, GPT‑3.5 and FLAN‑T5.

ChatGPTComplex QAEvaluation
0 likes · 24 min read
Evaluating ChatGPT on Complex Knowledge‑Base Question Answering Using a Feature‑Driven Multi‑Label Framework