Set expansion(iiit h[ire]team no-14)
•
1 like•692 views
Detail approach for expanding similar Entity Set on Wikipedia dataset
Recommended
More Related Content
Viewers also liked
Viewers also liked (19)
Similar to Set expansion(iiit h[ire]team no-14)
Similar to Set expansion(iiit h[ire]team no-14) (19)
Recently uploaded
Recently uploaded (20)
Set expansion(iiit h[ire]team no-14)
- 1. Set Expansion Meera Parmar (201305529) ! ! meera.parmar@students.iiit.ac.in! Nishith Maheshwari (201002016) ! ! nishith.maheshwari@students.iiit.ac.in! Vandan Mujadia(201323602) ! ! vandan.mujadia@research.iiit.ac.in! Venessa Tauro(201101032) ! ! venessaroshni.tauro@students.iiit.ac.in
- 2. Set Expansion-What is it? ❖ Set expansion is a way to expand a set of given seed entities automatically into a more complete set.! ! For example! Input set: ! • {Sachin Tendulkar, Dhoni,Rahul dravid}! expand set: ! • {amit bhandari, syed abid ali, parthiv patel, murali kartik,…}!
- 3. ! Tools used ! ❖ Stanford POS(parts of speech tagger)! • to eliminated non nominal entities from the parsed list.! ❖ Stanford NER(Named entity recoginizer)! • used in ranking to recognize proper name to put entities in relevance order
- 4. Approach (parsing and index creation)
- 5. A corpus based approach (wikipedia dataset)! • parse ‘list of ’ pages to get entity list. ! • parse entity list based on ‘category’ given in wiki page.! • parse entity list from ‘Infobox , Taxobox , Geobox ’ etc..! • parse entity list from wiki page contents.
- 7. Approach (ranking categories and search)
- 8. ! Ranking of categories ! ❖ ranked entity based on tf/idf score! ❖ ranked entity by word vector distance score ! Search ! ❖ First search in ‘category list’ index! ❖ If there is no list found then search in ‘list of pages list’ index
- 10. Experiment Input : ! ! raajneeti anjaana anjaani my name is khan ! Output: ! jaane kahan se aayi hai ! antardwand! pyaar impossible! peepli live! atithi tum kab jaoge! mr singh mrs mehta! khatta meetha! anjaana anjaani! thanks maa! khelein hum jee jaan sey
- 11. Applications! ❖ Named entities recognition ! ❖ In evaluation of question answering system! ❖ Text summarisation ! ❖ Search result suggestion ! ❖ etc..
- 12. Last words ❖ In this project we have devised a method for set expansion on the Wikipedia data by applying a simple yet effective approach. ! ❖ This unsupervised method used to extent entity list independent of the language. ! ❖ For the validation, we tested the approach on multiple domains and obtained acceptable results.(shown in video)
- 13. References ❖ http://mlg.eng.cam.ac.uk/zoubin/papers/bsets- nips05.pdf! ❖ https://www.cs.cmu.edu/afs/cs/Web/People/ wcohen/postscript/icdm-2007.pdf! ❖ http://www.dfki.de/~neumann/ InformationExtractionLecture2011/sessions/7- SetExpansion.pdf
- 14. Project Links ❖ Project description : http://researchweb.iiit.ac.in/ ~vandan.mujadia/! ❖ Project Demo : https://www.youtube.com/watch? v=XZez5aMBNNc&feature=youtu.be! ❖ Project Presentation : http://www.slideshare.net/ VandanMujadia/set-expansioniiit-hireteam-no14! ❖ Project CodeBase : https://github.com/vmujadia/IIIT- H-IRE14
- 15. Thank you