Data Science Stack Exchange
Data Science Stack Exchange

Questions tagged [question-answering]

29 questions
6
votes
2 answers

Question answering (QA) vs Chatbots

Are Question answering (QA) the same as Chatbots? I can not understand the difference between them. For me it's the same thing: interact with a robot that answers questions.
ladybug
  • 161
  • 1
  • 3
4
votes
1 answer

Bert for QuestionAnswering input exceeds 512

I'm training Bert on question answering (in Spanish) and i have a large context, only the context exceeds 512, the total question + context is 10k, i found that longformer is bert like for long document, but there's no pretrained in spanish so, is…
Sadak
  • 252
  • 3
  • 10
4
votes
1 answer

Answer to Question

Looking for a system which can generate answers to questions. Most systems and blogs posted on internet are on Question to answer but not on answer to question or paraphrasing or keyword to questions. Seq2Seq I tried and even after training for many…
Sandeep Bhutani
  • 914
  • 1
  • 7
  • 26
3
votes
3 answers

Group unstructured chat logs into conversations

I am new to ML/AI/NLP and am interested in tackling the following problem. I have a database of chat logs from a Discord server. The database contains the following labeled data: Author, Text, Text Created Timestamp, and Channel ID. I think what I…
imaginative
  • 31
  • 4
2
votes
0 answers

How does fine-tuning work in question answering for custom documents

I am trying to build a Q&A bot for which I have a bunch of documents like articles (specific domain). I understand I can create a Retrieval-Augmented Generation (RAG) system for this, but I want to know how does fine-tuning work for this case, what…
Glinty
  • 33
  • 4
1
vote
1 answer

Pretrained models for Propositional logic

Are there any pretrained models which understand propositional logic? For example, the t5 model can do question-answering. Given a context such as "Alice is Bob's mother. Bob is Charlie's father", t5 can answer the question "Who is Charlie's father"…
androidguy
  • 113
  • 2
1
vote
0 answers

Best way to suggest answers given historical question-answer pairs

Many question-answering implementations focus on extracting information from large documents/corpora of text such as Wikipedia. I have access to a full chat log from the customer service of a large electronics company and I'm wondering if I can use…
Joep
  • 11
  • 1
1
vote
0 answers

How to process list type questions in Question Answering task

How to generate question-answer-context triplets for questions with multiple answer strings? How to measure performance for it? For a question with one single answer, we generate one question-answer-context triplet, and calculate EM/F1 score. Then…
Qian
  • 11
  • 1
1
vote
1 answer

Select best answer from several existing ones for a question

After analyzing questions on a forum, a human support team has created a set of general answers, that can be used to provide basic answers on the forum. I am trying to build a system that: Selects best answer from this set of answers for a given…
dokondr
  • 295
  • 4
  • 11
1
vote
0 answers

Options to find the most similar question in a dataset of question-answer pairs?

I am building a chatbot that will only handle FAQs, but these FAQs are very specific to an organisation, so I cannot use any existing off-the-shelf solutions, or connect to question-answering APIs. I have a dataset which consists of questions,…
KOB
  • 189
  • 6
1
vote
0 answers

Meaningful Information retrieval and question answering for unstructured data - Is it even possible?

Hello good NLP people, I am working on a task that gradually seems not solvable for me. My data-set consists of long, messy, unstructured documents (pdfs, doc, docx, scans with tables, graphs, text, etc) and the client wants to obtain a system that…
XsLiar
  • 121
  • 5
1
vote
1 answer

Measuring quality of answers from QnA systems

I am having a question answering system which is using Seq2Seq kind of architecture. Actually it is a transformer architecture. When a question is asked it gives startposition and endposition of answer along with their logits. The answer is formed…
Sandeep Bhutani
  • 914
  • 1
  • 7
  • 26
1
vote
1 answer

BERT - How Question answering is different than classification

Basically I am trying to understand how question answering works in case of BERT. Code for both classes QuestionAnswering and Classification is pasted below for reference. My understanding is: class…
Sandeep Bhutani
  • 914
  • 1
  • 7
  • 26
1
vote
1 answer

Easier way to use Haystack Annotation Tool or alternative to generate SQuAD data

I want to annotate some passages in the SQuAD format. After some research, I found that the Haystack Annotation Tool by deepset.ai is the best option for this purpose. Most of the old tutorials suggest opening an account on their annotation website…
Israt Afrin
  • 11
  • 1
1
vote
0 answers

Is it possible to access "Data Science" on Stack Exchange using an API?

I am a programmer with C and Python knowledge. I am trying to "educate" or train my Chatbot with name "Stella" in "Science and Technology History" and related areas, helped by ChatGPT 3.5. I am already using contents provided by Wikipedia, but some…
user545577
  • 11
  • 1
1
2