Python Web Scraping

This blog article shows you one of the ways to do Web Scraping, using Python. I have the below web page and I want to get all the titles.

‘

I need to install BeautifulSoup and loop through the web like the code sample below.

import requests

from bs4 import BeautifulSoup

url = “https://www.infobel.com/en/malaysia/business/10000/food_restaurants”

response = requests.get(url)

soup = BeautifulSoup(response.content, “html.parser”)

restaurant_names = []

restaurant_elements = soup.find_all(“h2″, class_=”customer-item-name”)

for restaurant in restaurant_elements:

    name = restaurant.text.strip()

    restaurant_names.append(name)

for idx, name in enumerate(restaurant_names, start=1):

    print(f”Restaurant {idx}: {name}”)

You can run the code snippet in Jupyter Notebook then you can see the results like the one below.

Also: SQL Server Insert Data using Python (the problem)

Source code download: https://github.com/chanmmn/python/tree/main/WebScraping/?WT.mc_id=DP-MVP-36769

Reference: https://realpython.com/beautiful-soup-web-scraper-python/