Web scraping by End user

Project Code :TCMAPY2449

Objective

The main objective of this project is to develop a web-based International Relations News Scraping System using the Django framework that automatically collects, manages, and displays real-time international news from multiple online sources through web scraping techniques. The system aims to provide authenticated users with a centralized platform to access updated international relations news efficiently and conveniently.

Abstract

Web scraping has become an important technique for collecting and analyzing information from online sources. With the rapid growth of digital news platforms, accessing and organizing international relations news from multiple websites has become increasingly difficult for users. This project presents a web-based International Relations News Scraping System developed using Django, which enables authenticated users to access dynamically scraped international news through an interactive and user-friendly platform.

The system provides separate modules for administrators and users. The admin module includes functionalities such as login authentication, user management, approval of registered users, and monitoring of system activities. The user module supports registration, login authentication, profile management, update profile functionality, and secure logout operations. Once authenticated, users can access real-time international relations news collected through web scraping techniques from online news sources.

The scraping module automatically extracts news headlines, descriptions, categories, and related information from international news websites. The system also includes advanced features such as category-based filtering, load more functionality, dynamic news updates, and personalized user interaction. Users can browse news based on regions such as World, Asia, Europe, and the Middle East, thereby improving accessibility and user experience.

The proposed system demonstrates how web scraping and dynamic content integration can be effectively utilized to provide users with updated international news in a centralized platform. The project combines concepts of web mining, data extraction, user authentication, and interactive web application development to create an efficient and scalable news aggregation system.

Keywords: The keywords used in this project include Web Scraping, Django Framework, Python, International Relations News, Data Extraction, BeautifulSoup, User Authentication, and Dynamic Web Application. These technologies are used to scrape, manage, and display real-time international news for authenticated users.

NOTE: Without the concern of our team, please don't submit to the college. This Abstract varies based on student requirements.

Block Diagram

Specifications

H/W CONFIGURATION:

Processor                                - I3/Intel Processor

Hard Disk                               - 160GB

Key Board                               - Standard Windows Keyboard

Mouse                                     - Two or Three Button Mouse

Monitor                                   - SVGA

RAM                                       - 8GB

S/W CONFIGURATION:

Operating System                   :  Windows 7/8/10

Server side Script                   :  HTML, CSS, Bootstrap & JS

Programming Language         :  Python

Libraries                                 :  Django

IDE/Workbench                      :  VSCODE

Technology                             :  Python 3.10+

Demo Video

mail-banner
call-banner
contact-banner
Request Video