Open In App
Related Articles

Scrape Google Reviews and Ratings using Python

Improve Article
Save Article
Like Article

In this article, we are going to see how to scrape google reviews and ratings using Python.

Modules needed:

  • Beautiful Soup: The mechanism involved in scraping here is parsing the DOM,  i.e. from HTML and XML files, the data is extracted
# Installing with pip
pip install beautifulsoup4

# Installing with conda
conda install -c anaconda beautifulsoup4
  • Scrapy: An open-source package and it is meant to scrape larger datasets and as open-source, it is also effectively used.
  • Selenium: Usually, to automate testing, Selenium is used. We can do this for scraping also as the browser automation here helps with interacting javascript involved with clicks, scrolls, movement of data between multiple frames, etc.,
# Installing with pip
pip install selenium

# Installing with conda
conda install -c conda-forge selenium 

Chrome driver manager:

# Below installations are needed as browsers
# are getting changed with different versions
pip install webdriver
pip install webdriver-manager

Initialization of Web driver:


from selenium import webdriver
from import ChromeDriverManager
# As there are possibilities of different chrome
# browser and we are not sure under which it get
# executed let us use the below syntax
driver = webdriver.Chrome(ChromeDriverManager().install())


[WDM] – ====== WebDriver manager ======

[WDM] – Current google-chrome version is 99.0.4844

[WDM] – Get LATEST driver version for 99.0.4844

[WDM] – Driver [C:\Users\ksaty\.wdm\drivers\chromedriver\win32\99.0.4844.51\chromedriver.exe] found in cache

Let us try to locate “Rashtrapati Bhavan” and then do the further proceedings, Sometimes it will ask permission to access the page if it is done for the first time, If there is a kind of permission issue seen, just agree to it and move further.





Scrape Google Reviews and Ratings

Here we will try to fetch three entities from google Maps, like Books shop, Food,  and Temples for this we will make specific conditions and merge them with the location.


from selenium import webdriver
from import ChromeDriverManager
from import WebDriverWait
from selenium.webdriver.common.action_chains import ActionChains
from import expected_conditions as EC
from selenium.common.exceptions import ElementNotVisibleException
from import By
from selenium.common.exceptions import TimeoutException
from bs4 import BeautifulSoup
driver = webdriver.Chrome(ChromeDriverManager().install())
# Either we can hard code or can get via input.
# The given input should be a valid one
location = "600028"
print("Search By ")
print("1.Book shops")
ch = "Y"
while (ch.upper() == 'Y'):
    choice = input("Enter choice(1/2/3/4):")
    if (choice == '1'):
        query = "book shops  near " + location
    if (choice == '2'):
        query = "food  near " + location
    if (choice == '3'):
        query = "temples  near " + location
    driver.get("" + query)
    wait = WebDriverWait(driver, 10)
        (By.XPATH, "//a[contains(@href, '/search?tbs')]")))).perform()
        (By.XPATH, "//a[contains(@href, '/search?tbs')]"))).click()
    names = []
    for name in driver.find_elements(By.XPATH, "//div[@aria-level='3']"):
    ch = input("Do you want to continue (Y/N): ")




Whether you're preparing for your first job interview or aiming to upskill in this ever-evolving tech landscape, GeeksforGeeks Courses are your key to success. We provide top-quality content at affordable prices, all geared towards accelerating your growth in a time-bound manner. Join the millions we've already empowered, and we're here to do the same for you. Don't miss out - check it out now!

Last Updated : 27 Feb, 2023
Like Article
Save Article
Similar Reads
Complete Tutorials