Advanced Topics in Knowledge Bases

Block seminar, 7 ECTS credits, winter semester 2018–19

Basic Information

  • Type: Block seminar
  • Lecturer: Simon Razniewski
  • Credits: 7 ECTS credits
  • Registration: Sign up under this link until September 28
  • Dates: 3 introductory meetings on October 23, 25 and November 7, two days block seminar in winter 2019 (probably February, to be agreed among the participants).

The seminar is a block seminar and will take place on two consecutive days in winter 2019. There will also be three meetings at the beginning of the semester, for which participation is mandatory.

News

  • July 4 -- first version of the course website online
  • July 24 -- registration deadline fixed to September 28
  • October 22 -- Vote for the block seminar date here
  • November 7
    • Seminar dates fixed to 12./13.3.
    • Slides from the kickoff meetings online
    • Latex template online

Topics

A detailed list is below

Representation, collection and extraction of general knowledge in knowledge bases (KBs) is at the core of many AI applications. In this seminar, we cover a range of topics around KBs, in particular factual KBs (e.g., Wikidata, YAGO, DBPedia), common-sense KBs (e.g., science knowledge, howto-knowledge, script knowledge) and non-textual KBs (e.g., ImageNet). We explore how these KBs are constructed and how they are used in various applications such as question answering (QA), story/script prediction and biography generation. We also explore learning new facts over KBs.

Registration

  • The number of participants is limited
  • To apply for registration, please fill the form under this link. You will receive an email confirmation
  • Places will be allocated based on background match (courses taken) and motivation

Schedule

  • September 28 -- Registration deadline
  • October 3 -- Notification of placement
  • October 23 -- Kick-off meeting and introduction to knowledge bases
    • Time: 10:00-11:30
    • Place: MPII building (E1 4), room 24 (ground floor)
      • Explanation of the structure and organization of the seminar
      • Introduction to knowledge bases
  • October 25 -- Introduction to knowledge bases (ctnd.) and topic presentation
    • Time: 10:00-11:30
    • Place: MPII building (E1 4), room 24 (ground floor)
      • Introduction to knowledge bases (ctnd.)
      • Presentation of the topics
  • November 7 -- "Survival skills for seminar participants"
    • Time: 10:00-11:30
    • Place: MPII building (E1 4), room 24 (ground floor)
      • This lecture aims at preparing the participants to literature research, seminar paper writing and scientific presentations.
      • Topic assignment: students prepare a preferred ranked list of proposed topics, we will do the live assignment based on a randomly decided order.
  • November 30 -- students send a suggestion of the outline of their seminar paper, including an itemization of the planned content for each section.
  • December 5/6 -- students have in-person feedback meetings
  • January 31, 2019 -- students submit their final seminar paper.
  • February 26 -- students send preliminary slides
  • March 10 -- students send their final slides which they will use in the block seminar
  • March 12 -- Block seminar, Day 1
    • Location: E1 4, room 021 (ground floor)
  • March 13 -- Block seminar, Day 2
    • Location: E1 4, room 021 (ground floor)

Seminar Schedule

Location: E1 4, room 021 (ground floor)

Format: 25 minutes presentation, 10 minutes discussion

March 12:
10:00-10:10 Opening remarks
10:10-10:45 1: Dingfan - Spatial common sense (Topic 3)
 10:45-11:20 2: Phong - Open IE (Topic 4)
   10 minutes break
 11:30-12:05 3: Matthias - Taxonomy induction (Topic 6)
 12:05-12:40 4: Sandra - Schema learning (Topic 7)
March 13:
 10:00-10:35 5: Sara - Recall assessment (Topic 8)
 10:35-11:10 6: Aleena - Coreference resolution (Topic 10)
   10 minutes break
 11:20-11:55 7: Ahmed - State changes (Topic 11)
 11:55-12:30 8: Mang - Fact ranking (Topic 12)
 12:30-12:40 Closing remarks

Rules and Grading

  • Participation in the introductory meetings, the "How to prepare and present a seminar talk" lecture, and both days of the block seminar is mandatory.
  • Students will be assigned a particular topic and have to submit a seminar paper (template will be provided) and give a presentation (25 minutes + 10 minutes for discussion) over the topic.
  • Grading will be based on:
    • the report
    • the presentation
    • knowledge on the subject (as evidenced in the discussion after the presentation)
    • activity in the discussions
    • ability to stick to deadlines
  • Attention: According to the study regulations, you are only allowed to withdraw from the seminar within three weeks after the kick-off meeting, i.e., until November 6. Later withdrawal counts as "failed".

Topics

Area I: Knowledge base construction

  • 1. A WordNet-based image KB: ImageNet
    • ImageNet: A large-scale hierarchical image database (Deng et al., CVPR 2009) [pdf]
    • WordNet: A lexical database for English (Miller, CACM 1995) [pdf]
  • 2. Lexicographical data in Wikidata: Goals and challenges
  • 3. Spatial common sense from text and images
    • Acquiring Common Sense Spatial Knowledge through Implicit Spatial Templates, Collell et al., AAAI 2018 [pdf]
    • Automatic Extraction of Commonsense LocatedNear Knowledge, Xu et al., ACL 2018 [pdf]
  • 4. Open information extraction
    • Minie: minimizing facts in open information extraction, Gashteovski et al., EMNLP 2017. [pdf]
    • Open Language Learning for Information Extraction, Mausam et al., EMNLP 2012 [pdf]
  • 5. Open knowledge base canonicalization
    • Canonicalizing Open Knowledge Bases, Galarraga et al., CIKM 2014 [pdf]
    • CESI: Canonicalizing Open Knowledge Bases using Embeddings and Side Information, Vashishth et al., WWW 2018 [pdf]

Area II: Knowledge base quality

  • 6. Taxonomy induction
    • Hierarchical Embeddings for Hypernymy Detection and Directionality, Nguyen et al., ACL 2017 [pdf]
    • Taxonomy Induction using Hypernym Subsequences. Gupta et al., CIKM 2017 [pdf]
  • 7. Schema learning
    • Are All People Married?: Determining Obligatory Attributes in Knowledge Bases, Lajus and Suchanek, WWW 2018 [pdf]
    • Recoin: Relative Completeness in Wikidata, Balaraman et al., Wiki workshop at WWW 2018 [pdf]
  • 8. Recall assessment
    • Demand-Weighted Completeness Prediction for a Knowledge Base, Hopkinson et al., NAACL 2018 [pdf]
    • Domain-targeted, high precision knowledge extraction, Dalvi et al., TACL 2017 (Section 5.1) [pdf]
  • 9. Change prediction and updating
    • "A Spousal Relation Begins with a Deletion of engage and Ends with an Addition of divorce": Learning State Changing Verbs from Wikipedia Revision History, Wijaya et al., EMNLP 2015 [pdf]
    • How to Keep a Knowledge Base Synchronized with Its Encyclopedia Source, Liang et al, IJCAI 2017 [pdf]

Area III: Applications and explanations

  • 10. Coreference resolution
    • Coreference Resolution with World Knowledge, Rahman and Ng, ACL 2011 [pdf]
    • Joint Coreference Resolution and Named-Entity Linking with Multi-pass Sieves, Hajishirzi et al., EMNLP 2013 [pdf]
    • Improving Coreference Resolution by Learning Entity-Level Distributed Representations, Clark and Manning, ACL 2016 [pdf]
  • 11. State changes
    • What Happened? Leveraging VerbNet to Predict the Effects of Actions in Procedural Text, Clark et al., ArXiv 2018 [pdf]
    • Tracking State Changes in Procedural Text: a Challenge Dataset and Models for Process Paragraph Comprehension, Dalvi et al., NAACL 2018 [pdf]
  • 12. Fact ranking
    • The unusual suspects: Deep learning based mining of interesting entity trivia from knowledge graphs (Fatma et al., AAAI 2017) [pdf]
  • 13. Fact explanation
    •  Tell Me Why Is It So? Explaining Knowledge Graph Relationships by Finding Descriptive Support Passages, Bathia et al., ISWC 2018 [pdf]

Proposals for other topics are welcome too.