demonstration

Automatic web-scale information extraction

Authors:

Philip Bohannon,

Sathiya Keerthi,

Alok KirpalAuthors Info & Claims

SIGMOD '12: Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data

Pages 609 - 612

https://doi.org/10.1145/2213836.2213912

Published: 20 May 2012 Publication History

Abstract

In this demonstration, we showcase the technologies that we are building at Yahoo! for Web-scale Information Extraction. Given any new Website, containing semi-structured information about a pre-specified set of schemas, we show how to populate objects in the corresponding schema by automatically extracting information from the Website.

References

[1]

Tobias Anton. Xpath-wrapper induction by generating tree traversal patterns. In LWA, pages 126--133, 2005.

[2]

Michele Banko, Michael J. Cafarella, Stephen Soderland, Matthew Broadhead, and Oren Etzioni. Open information extraction from the web. In International Joint Conference on Artificial Intelligence, pages 2670--2676, 2007.

Digital Library

[3]

Lorenzo Blanco, Nilesh N. Dalvi, and Ashwin Machanavajjhala. Highly efficient algorithms for structural clustering of large websites. In WWW, pages 437--446, 2011.

Digital Library

[4]

Michael J. Cafarella, Alon Halevy, Daisy Zhe Wang, Eugene Wu, and Yang Zhang. Webtables: exploring the power of tables on the web. VLDB, 1(1):538--549, 2008.

Digital Library

[5]

Nilesh Dalvi, Ravi Kumar, Bo Pang, Raghu Ramakrishnan, Andrew Tomkins, Philip Bohannon, Sathiya Keerthi, and Srujana Merugu. A web of concepts (keynote). In PODS. Providence, Rhode Island, USA, June 2009.

Digital Library

[6]

Nilesh N. Dalvi, Ravi Kumar, and Mohamed A. Soliman. Automatic wrappers for large scale web extraction. PVLDB, 4(4):219--230, 2011.

Digital Library

[7]

Pedro DeRose, Warren Shen, Fei Chen, AnHai Doan, and Raghu Ramakrishnan. Building structured web community portals: A top-down, compositional, and incremental approach. In VLDB, pages 399--410, 2007.

Digital Library

[8]

Hazem Elmeleegy, Jayant Madhavan, and Alon Y. Halevy. Harvesting relational tables from lists on the web. PVLDB, 2(1):1078--1089, 2009.

Digital Library

[9]

Oren Etzioni, Michael Cafarella, Doug Downey, Stanley Kok, Ana-Maria Popescu, Tal Shaked, Stephen Soderland, Daniel S. Weld, and Alexander Yates. Web-scale information extraction in Knowitall: (preliminary results). In WWW, pages 100--110, 2004.

Digital Library

[10]

Rahul Gupta and Sunita Sarawagi. Answering table augmentation queries from unstructured lists on the web. In VLDB, 2009.

Digital Library

[11]

Wei Han, David Buttler, and Calton Pu. Wrapping web data into XML. SIGMOD Record, 30(3):33--38, 2001.

Digital Library

[12]

Chun-Nan Hsu and Ming-Tzung Dung. Generating finite-state transducers for semi-structured data extraction from the web. Information Systems, 23(8):521--538, 1998.

Digital Library

[13]

Nickolas Kushmerick, Daniel S. Weld, and Robert B. Doorenbos. Wrapper induction for information extraction. In IJCAI, pages 729--737, 1997.

[14]

Jussi Myllymaki and Jared Jackson. Robust web data extraction with XML path expressions. Technical Report RJ 10245, IBM, 2002.

[15]

Arnaud Sahuguet and Fabien Azavant. Building light-weight wrappers for legacy web data-sources using w4f. In VLDB, pages 738--741, 1999.

Digital Library

[16]

Pierre Senellart, Avin Mittal, Daniel Muschick, Rémi Gilleron, and Marc Tommasi. Automatic wrapper induction from hidden-web sources with domain knowledge. In WIDM, pages 9--16, 2008.

Digital Library

Cited By

Nissa NJamwal SBhat JRashid Y(2024)Data Collection and Analysis: The Foundation of Evidence-Based Research in Various DisciplinesIntelligent Signal Processing and RF Energy Harvesting for State of art 5G and B5G Networks10.1007/978-981-99-8771-9_9(147-165)Online publication date: 25-Feb-2024
https://doi.org/10.1007/978-981-99-8771-9_9
Roh YHeo GWhang S(2021)A Survey on Data Collection for Machine Learning: A Big Data - AI Integration PerspectiveIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2019.294616233:4(1328-1347)Online publication date: 1-Apr-2021
https://doi.org/10.1109/TKDE.2019.2946162
Di Castro DGamzu IGrabovitch-Zuyev ILewin-Eytan LPundir ASahoo NViderman MChampin PGandon FMédini LLalmas MIpeirotis P(2018)Automated Extractions for Machine Generated MailCompanion Proceedings of the The Web Conference 201810.1145/3184558.3186582(655-662)Online publication date: 23-Apr-2018
https://dl.acm.org/doi/10.1145/3184558.3186582
Show More Cited By

Index Terms

Automatic web-scale information extraction
1. Information systems
  1. Information retrieval

Recommendations

Web-scale information extraction in knowitall: (preliminary results)
WWW '04: Proceedings of the 13th international conference on World Wide Web

Manually querying search engines in order to accumulate a large bodyof factual information is a tedious, error-prone process of piecemealsearch. Search engines retrieve and rank potentially relevantdocuments for human perusal, but do not extract facts, ...
Automatic information extraction from unstructured mammography reports using distributed semantics
Graphical abstract

Display Omitted
Highlights
- Proposed a hybrid information extraction system for unstructured mammography reports.
Abstract
To date, the methods developed for automated extraction of information from radiology reports are mainly rule-based or dictionary-based, and, therefore, require substantial manual effort to build these systems. Recent efforts to ...
A robust web personal name information extraction system

Highlights Features are extracted with various lightweight methods and from broad resources. The unsupervised features improve the robustness of a disambiguation system. Our AE system integrates various extraction approaches with high precision. Each ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGMOD '12: Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data

May 2012

886 pages

ISBN:9781450312479

DOI:10.1145/2213836

General Chairs:
K. Selçuk Candan
Arizona State University
,
Yi Chen
Arizona State University
,
Richard Snodgrass
University of Arizona
,
Program Chair:
Luis Gravano
Columbia University
,
Publications Chair:
Ariel Fuxman
Microsoft Research

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMOD: ACM Special Interest Group on Management of Data

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 May 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Demonstration

Conference

SIGMOD/PODS '12

Sponsor:

SIGMOD

SIGMOD/PODS '12: International Conference on Management of Data

May 20 - 24, 2012

Arizona, Scottsdale, USA

Acceptance Rates

SIGMOD '12 Paper Acceptance Rate 48 of 289 submissions, 17%;

Overall Acceptance Rate 785 of 4,003 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
840
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Nissa NJamwal SBhat JRashid Y(2024)Data Collection and Analysis: The Foundation of Evidence-Based Research in Various DisciplinesIntelligent Signal Processing and RF Energy Harvesting for State of art 5G and B5G Networks10.1007/978-981-99-8771-9_9(147-165)Online publication date: 25-Feb-2024
https://doi.org/10.1007/978-981-99-8771-9_9
Roh YHeo GWhang S(2021)A Survey on Data Collection for Machine Learning: A Big Data - AI Integration PerspectiveIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2019.294616233:4(1328-1347)Online publication date: 1-Apr-2021
https://doi.org/10.1109/TKDE.2019.2946162
Di Castro DGamzu IGrabovitch-Zuyev ILewin-Eytan LPundir ASahoo NViderman MChampin PGandon FMédini LLalmas MIpeirotis P(2018)Automated Extractions for Machine Generated MailCompanion Proceedings of the The Web Conference 201810.1145/3184558.3186582(655-662)Online publication date: 23-Apr-2018
https://dl.acm.org/doi/10.1145/3184558.3186582
Talaika ABiega JAmarilli ASuchanek F(2015)IBEXProceedings of the 18th International Workshop on Web and Databases10.1145/2767109.2767116(13-19)Online publication date: 31-May-2015
https://dl.acm.org/doi/10.1145/2767109.2767116
Huang XWei BZhang Y(2015)Automatic Question-Answering Based on Wikipedia Data Extraction2015 10th International Conference on Intelligent Systems and Knowledge Engineering (ISKE)10.1109/ISKE.2015.78(314-317)Online publication date: Nov-2015
https://doi.org/10.1109/ISKE.2015.78
Xiangzhou Huang Yin Zhang Baogang Wei Liang Yao (2015)A question-answering system over Traditional Chinese MedicineProceedings of the 2015 IEEE International Conference on Bioinformatics and Biomedicine (BIBM)10.1109/BIBM.2015.7359945(1737-1739)Online publication date: 9-Nov-2015
https://dl.acm.org/doi/10.1109/BIBM.2015.7359945
Chen LLiu MYu T(2015)A Schema-Less Data Model for the WebConceptual Modeling10.1007/978-3-319-25264-3_44(577-584)Online publication date: 8-Dec-2015
https://doi.org/10.1007/978-3-319-25264-3_44
Grigalis T(2014)Structured Data Extraction from Template-Generated Web Pages10.20334/2262-MOnline publication date: 2014
https://doi.org/10.20334/2262-M
Mukherjee SWeikum GDanescu-Niculescu-Mizil CMacskassy SPerlich CLeskovec JWang WGhani R(2014)People on drugsProceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining10.1145/2623330.2623714(65-74)Online publication date: 24-Aug-2014
https://dl.acm.org/doi/10.1145/2623330.2623714
Kondreddi STriantafillou PWeikum G(2014)Combining information extraction and human computing for crowdsourced knowledge acquisition2014 IEEE 30th International Conference on Data Engineering10.1109/ICDE.2014.6816717(988-999)Online publication date: Mar-2014
https://doi.org/10.1109/ICDE.2014.6816717
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten