Skip to content
Related Articles

Related Articles

How to Scrape Web Data from Google using Python?

Improve Article
Save Article
Like Article
  • Difficulty Level : Basic
  • Last Updated : 29 Dec, 2020

Prerequisites: Python Requests, Implementing Web Scraping in Python with BeautifulSoup

Web scraping is a technique to fetch data from websites. While surfing on the web, many websites don’t allow the user to save data for personal use. One way is to manually copy-paste the data, which both tedious and time-consuming. Web Scraping is the automation of the data extraction process from websites.

In this article, we will scrape the weather update from google’s search result.

Modules Requisred

  • BeautifulSoup: This module is used for iterating, searching, and modifying the parse tree over the HTML or XML parser. To download it type the below command in the terminal.
    pip install beautifulsoup4
  • Requests: Requests library is one of the integral part of Python for making HTTP requests to a specified URL. To download it type the below command in the terminal.
    pip install requests

Below is the implementation.

import requests
from bs4 import BeautifulSoup
# Enter the City Name
city = input("Enter the City Name: ")
search = "Weather in {}".format(city)
# URL 
url = f" / search?&q ={search}" 
# Sending HTTP request
req = requests.get(url)
# Pulling HTTP data from internet
sor = BeautifulSoup(req.text, "html.parser"
# Finding temperature in Celsius
temp = sor.find("div", class_='BNeawe').text

Output :


My Personal Notes arrow_drop_up
Recommended Articles
Page :

Start Your Coding Journey Now!