Skip to content
Related Articles

Related Articles

Improve Article

How to Handle duplicate attributes in BeautifulSoup ?

  • Last Updated : 07 Apr, 2021

Sometimes while obtaining the information, are you facing any issue in handling the information received from duplicate attributes of the same tags? If YES, then read the article and clear all your doubts.

Once you have created the list to store the items, write the given below code.


list=soup.find_all(“#Widget Name”, {“id”:”#Id name of widget in which you want to edit”})

After writing the following code, remove the attributes from the output and print the certain item you want from the list.


  • Import module
  • Now, remove the last segment of the path by entering the name of Python file in which you are currently working.


base=os.path.dirname(os.path.abspath(‘#Name of Python file in which you are currently working’))

  • Then, open the HTML file from which you want to read the value.


html=open(os.path.join(base, ‘#Name of HTML file from which you wish to read value’))

  • Parse the HTML file in BeautifulSoup.
  • Further, create a list to store all the item values of the same tag and attributes.
  • Next, find all the items which have same tag and attributes.


list=soup.find_all(“#Widget Name”, {“id”:”#Id name of widget in which you want to edit”})

  • Later on, remove all the attributes from the tag.
  • Finally, print the certain item of the widget tag.

Webpage in use:


<!DOCTYPE html>
   Geeks For Geeks
     <p id="vinayak">King</p>
     <p id="vinayak">Prince</p>
     <p id="vinayak">Queen</p>
 <p id="vinayak">Princess</p>



# Import the libraries beautifulsoup and os
from bs4 import BeautifulSoup as bs
import os
# Remove the last segment of the path
# Here replace the name of your python file with
base = os.path.dirname(os.path.abspath(""))
# Open the HTML in which you want to make 
# changes
html = open(os.path.join(base, 'gfg.html'))
# Parse HTML file in Beautiful Soup
soup = bs(html, 'html.parser')
# Create a list to store the items
list = [3]
# Finding all the elements inside div
# with paragraph having id: vinayak
list = soup.div.find_all("p", {"id": "vinayak"})
# Removing attributes from the output
for i in list:
    i.attrs = {}
# Printing the value Prince
# Printing the value Queen




 Attention geek! Strengthen your foundations with the Python Programming Foundation Course and learn the basics.  

To begin with, your interview preparations Enhance your Data Structures concepts with the Python DS Course. And to begin with your Machine Learning Journey, join the Machine Learning – Basic Level Course

My Personal Notes arrow_drop_up
Recommended Articles
Page :