Using Wikipedia and Conceptual Graph Structures to Generate Questions for Academic Writing Support
description
Transcript of Using Wikipedia and Conceptual Graph Structures to Generate Questions for Academic Writing Support
![Page 1: Using Wikipedia and Conceptual Graph Structures to Generate Questions for Academic Writing Support](https://reader036.fdocuments.us/reader036/viewer/2022062423/5681458b550346895db27298/html5/thumbnails/1.jpg)
Intelligent Database Systems Lab
Presenter : JIAN-REN CHEN
Authors : Ming Liu, Rafael A. Calvo, Senior Member,
IEEE, Anindito Aditomo, and Luiz Augusto Pizzato
2012 , TLT
Using Wikipedia and Conceptual Graph Structures to Generate Questions for
Academic Writing Support
![Page 2: Using Wikipedia and Conceptual Graph Structures to Generate Questions for Academic Writing Support](https://reader036.fdocuments.us/reader036/viewer/2022062423/5681458b550346895db27298/html5/thumbnails/2.jpg)
Intelligent Database Systems Lab
Outlines
MotivationObjectivesArchitectureMethodologyExperimentsConclusionsComments
![Page 3: Using Wikipedia and Conceptual Graph Structures to Generate Questions for Academic Writing Support](https://reader036.fdocuments.us/reader036/viewer/2022062423/5681458b550346895db27298/html5/thumbnails/3.jpg)
Intelligent Database Systems Lab
Motivation• Generic trigger questions have been widely
used for literature review support.
• creating specific questions difficult
time consuming
![Page 4: Using Wikipedia and Conceptual Graph Structures to Generate Questions for Academic Writing Support](https://reader036.fdocuments.us/reader036/viewer/2022062423/5681458b550346895db27298/html5/thumbnails/4.jpg)
Intelligent Database Systems Lab
Objectives• The goal of our research is to develop a fully
automated method to generate specific questions
to support academic writing.
• fully automated -> semiautomatic
![Page 5: Using Wikipedia and Conceptual Graph Structures to Generate Questions for Academic Writing Support](https://reader036.fdocuments.us/reader036/viewer/2022062423/5681458b550346895db27298/html5/thumbnails/5.jpg)
Intelligent Database Systems Lab
Architecture• Three key challenges of automatic trigger question
generation for supporting writing.
1. identification of key/central concepts
Research
Field、 Technology、 System、 Term、 Other
2. system’s lack of knowledge
Wikipedia3. evaluate whether the questions generated by the
system
Social sciences are the fields of academic scholarship that study society.
SOAP, originally defined as Simple Object Access Protocol, is a protocol specification for exchanging structured information in the implementation of web services in computer networks.
An image retrieval system is a computer system for browsing, searching and retrieving images from a large database of digital images.
The term cognitive load is used in cognitive psychology to illustrate the load related to the executive control of WM.
![Page 6: Using Wikipedia and Conceptual Graph Structures to Generate Questions for Academic Writing Support](https://reader036.fdocuments.us/reader036/viewer/2022062423/5681458b550346895db27298/html5/thumbnails/6.jpg)
Intelligent Database Systems Lab
Methodology-FrameworkKey Phrase Extraction
Named Entity Linking and Key Phrase Classification
Conceptual Graph Construction
Question Generation
![Page 7: Using Wikipedia and Conceptual Graph Structures to Generate Questions for Academic Writing Support](https://reader036.fdocuments.us/reader036/viewer/2022062423/5681458b550346895db27298/html5/thumbnails/7.jpg)
Intelligent Database Systems Lab
MethodologyKey Phrase Extraction
Named Entity Linking and Key Phrase Classification
Conceptual Graph Construction
Question Generation
VSM
D1 = "I like databases"D2 = "I hate hate databases"
Document-term matrix:
![Page 8: Using Wikipedia and Conceptual Graph Structures to Generate Questions for Academic Writing Support](https://reader036.fdocuments.us/reader036/viewer/2022062423/5681458b550346895db27298/html5/thumbnails/8.jpg)
Intelligent Database Systems Lab
MethodologyKey Phrase Extraction
Named Entity Linking and Key Phrase Classification
Conceptual Graph Construction
Question Generation
Key Phrase
Wikipedia articles
match
articles retrieve
definition sentence
classify the associated key phrase
Tregex expression rules
Research Field, Technology, System,Term, and Other
research field
Data mining, a branch of computer science and artificialintelligence, is the process of extracting patterns from data.
![Page 9: Using Wikipedia and Conceptual Graph Structures to Generate Questions for Academic Writing Support](https://reader036.fdocuments.us/reader036/viewer/2022062423/5681458b550346895db27298/html5/thumbnails/9.jpg)
Intelligent Database Systems Lab
MethodologyKey Phrase Extraction
Named Entity Linking and Key Phrase Classification
Conceptual Graph Construction
Question Generation
2. phrase list
1. target sentence: (Tregex expression rules)Ex:Apply-to:concept name + is|are + usedfor/in + ObjectHas-Limitation, and Has-Strength :concept name + overcome/address/+ a problem/limitation of something
![Page 10: Using Wikipedia and Conceptual Graph Structures to Generate Questions for Academic Writing Support](https://reader036.fdocuments.us/reader036/viewer/2022062423/5681458b550346895db27298/html5/thumbnails/10.jpg)
Intelligent Database Systems Lab
MethodologyKey Phrase Extraction
Named Entity Linking and Key Phrase Classification
Conceptual Graph Construction
Question Generation
![Page 11: Using Wikipedia and Conceptual Graph Structures to Generate Questions for Academic Writing Support](https://reader036.fdocuments.us/reader036/viewer/2022062423/5681458b550346895db27298/html5/thumbnails/11.jpg)
Intelligent Database Systems Lab
MethodologyKey Phrase Extraction
Named Entity Linking and Key Phrase Classification
Conceptual Graph Construction
Question Generation
first triple with Is-a relation matches Rule 2:Latent Semantic Indexing is an indexing and retrieval method that uses a math... How do you see Latent semantic indexing being applied in your project?
the second triple with an Apply-to relation and a phrase list as white node matches Rule 7:Do you know that Latent Semantic Indexing has been applied in Information Discovery, automated document Classification, and Text summarization? How are these applications of Latent Semantic Indexing relevant to your project?
![Page 12: Using Wikipedia and Conceptual Graph Structures to Generate Questions for Academic Writing Support](https://reader036.fdocuments.us/reader036/viewer/2022062423/5681458b550346895db27298/html5/thumbnails/12.jpg)
Intelligent Database Systems Lab
Experiments-Evaluation
![Page 13: Using Wikipedia and Conceptual Graph Structures to Generate Questions for Academic Writing Support](https://reader036.fdocuments.us/reader036/viewer/2022062423/5681458b550346895db27298/html5/thumbnails/13.jpg)
Intelligent Database Systems Lab
Experiments-Key Phrase Classification
F-score: 0.79 0.86 0.7 0.8
“denial-of-service attack”: A denial-of-service attack (DoS attack)or distributed denial-of-service attack (DDoS attack) is an attemptto make a computer resource unavailable to its intended users.
In pattern recognition and in image processing, feature extraction is a special form of dimensionality reduction.“Data mining, a branch of computer science and artificial intelligence, is the process of extracting patterns from data.”
algorithm, collaboration, compiler, gray, measurement, ownership, research, goal, lingua franca, bought, and review
![Page 14: Using Wikipedia and Conceptual Graph Structures to Generate Questions for Academic Writing Support](https://reader036.fdocuments.us/reader036/viewer/2022062423/5681458b550346895db27298/html5/thumbnails/14.jpg)
Intelligent Database Systems Lab
Experiments-Question Authorship Evaluation
![Page 15: Using Wikipedia and Conceptual Graph Structures to Generate Questions for Academic Writing Support](https://reader036.fdocuments.us/reader036/viewer/2022062423/5681458b550346895db27298/html5/thumbnails/15.jpg)
Intelligent Database Systems Lab
Experiments-Comparative Evaluation of Three Question Producers
ANOVA:
Fisher’s least significant difference (LSD) :Computer VS Generic:QM3 (MD(0.47) > LSD(0.23)) and QM4 (MD(0.33) > LSD(0.22))Supervisor VS Generic:QM3 (MD(0.35) > LSD(0.24)) and QM4 (MD(0.35) > LSD(0.23))Computer VS Supervisor :QM3 (MD(0.12) > LSD(0.25)) and QM4 (MD(0.01) > LSD(0.24))
![Page 16: Using Wikipedia and Conceptual Graph Structures to Generate Questions for Academic Writing Support](https://reader036.fdocuments.us/reader036/viewer/2022062423/5681458b550346895db27298/html5/thumbnails/16.jpg)
Intelligent Database Systems Lab
Experiments-Correlation Analysis of Quality Measures
![Page 17: Using Wikipedia and Conceptual Graph Structures to Generate Questions for Academic Writing Support](https://reader036.fdocuments.us/reader036/viewer/2022062423/5681458b550346895db27298/html5/thumbnails/17.jpg)
Intelligent Database Systems Lab
Experiments-Investigation on the Impact of Computer Generated Questions by Groups
![Page 18: Using Wikipedia and Conceptual Graph Structures to Generate Questions for Academic Writing Support](https://reader036.fdocuments.us/reader036/viewer/2022062423/5681458b550346895db27298/html5/thumbnails/18.jpg)
Intelligent Database Systems Lab
Experiments-Relation Type Evaluation
![Page 19: Using Wikipedia and Conceptual Graph Structures to Generate Questions for Academic Writing Support](https://reader036.fdocuments.us/reader036/viewer/2022062423/5681458b550346895db27298/html5/thumbnails/19.jpg)
Intelligent Database Systems Lab
Conclusions
• The computer-generated questions were perceived to
be as pedagogically useful as human supervisor
questions, and more useful than generic questions.
• The computer-generated questions were considered
to be more useful by first-year students, compared to
second and third year students.
![Page 20: Using Wikipedia and Conceptual Graph Structures to Generate Questions for Academic Writing Support](https://reader036.fdocuments.us/reader036/viewer/2022062423/5681458b550346895db27298/html5/thumbnails/20.jpg)
Intelligent Database Systems Lab
Comments• Advantages– Computer-generated questions is useful.
• Disadvantage– it is domain dependent.– may not apply this approach to other applications.
• Applications– Key Phrase Extraction and Classification– Automatic Question Generation