Home|Journals|Articles by Year|Audio Abstracts RSS - TOC

EEO. 2021; 20(3): 432-441

Implementation of Web Scraping on News Sites Using the Supervised Learning Method

Dedy Rahman Prehanto, Aries Dwi Indriyanti, I Gusti Lanang Eka Prismana, Ginanjar Setyo Permadi, Edwin Hari Agus Prastyo.


Indonesia is one of the highest internet users in the world, including in the penetration of information on the internet, online news media. But in general news sites not only display news information, but most sites also display other information such as advertisements and also forms of navigation that interfere with news site readers and interfere with reader’s comfort, from these problems this study aims to implement web scraping techniques with supervised learning methods and analyzing the form of DOM tree and XPath news sites. The supervised learning approach method is the method used in this study, which is one of the methods of machine learning. By combining these web scraping techniques with supervised learning, the aim is to be able to implement and optimize web scraping techniques to gather news information from various sites. To do basic web scraping namely knowing DOM patterns, XPath structure as a data model or selector at each site. The results of research in the form of a web scrap application that can retrieve news site content without copy paste and the data is stored in a database and displayed to the user application form for the reader without any ads and navigation that disturb the reader.

Key words: web scraping, supervised learning, XPath, DOM tree.

Full-text options

Share this Article

Online Article Submission
• ejmanager.com

ejPort - eJManager.com
Review(er)s Central
About BiblioMed
License Information
Terms & Conditions
Privacy Policy
Contact Us

The articles in Bibliomed are open access articles licensed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License (https://creativecommons.org/licenses/by-nc-sa/4.0/) which permits unrestricted, non-commercial use, distribution and reproduction in any medium, provided the work is properly cited.