I have a script where I'm trying to web scraping the data into table. But I'm getting errors

  raise exc.with_traceback(traceback)
ValueError: No tables found

Script :

import pandas as pd
import logging
from sqlalchemy import create engine
from urlib.parse import quote

db_connection = {mysql}://{username}:{quote'pwd'}@{DB:port}
ds_connection = create_engine(db_connection)
a = pd.read_html("https://www.centralbank.ae/en/forex-eibor/exchange-rates/")
df = pd.Dataframe(a[0])
df_final = df.loc[:,['Currency','Rate']]
df_final.to_sql('rate_table',db_connection,if_exists = append,index=false)

Can anyone suggest on this

CodePudding user response：

One easy way to obtain those exchange rates would be to scrape the API accessed to retrieve information in page (check Dev Tools - network tab):

import pandas as pd
import requests
from bs4 import BeautifulSoup

headers = {'Accept-Language': 'en-US,en;q=0.9',
          'Referer': 'https://www.centralbank.ae/en/forex-eibor/exchange-rates/'

          }
r = requests.post('https://www.centralbank.ae/umbraco/Surface/Exchange/GetExchangeRateAllCurrency', headers=headers)
dfs = pd.read_html(r.text)
print(dfs[0].loc[:,['Currency','Rates']])

This returns: