I'm a newbie seeking help. I've tried without success with the following.

from bs4 import BeautifulSoup
import pandas as pd

url = "https://www.canada.ca/en/immigration-refugees-citizenship/corporate/mandate/policies-operational-instructions-agreements/ministerial-instructions/express-entry-rounds.html"
html_text = requests.get(url).text
soup = BeautifulSoup(html_text, 'html.parser')
data = []

# Verifying tables and their classes
print('Classes of each table:')
for table in soup.find_all('table'):
    print(table.get('class'))

Result: ['table'] None

Can anyone help me with how to get this data? Thank you so much.

CodePudding user response：

The data you see on the page is loaded from external URL. To load the data you can use next example:

import requests
import pandas as pd


url = "https://www.canada.ca/content/dam/ircc/documents/json/ee_rounds_123_en.json"

data = requests.get(url).json()
df = pd.DataFrame(data["rounds"])
df = df.drop(columns=["drawNumberURL", "DrawText1", "mitext"])

print(df.head(10).to_markdown(index=False))

Prints: