Windows fatal exception: stack overflow when trying to print beautiful soup content-CodePudding

I am trying to print the beautifulsoup content from this link: https://www.sec.gov/Archives/edgar/data/1750/0001047469-11-006302.txt using the code

session = requests.Session()
session.headers.update({'User-Agent': 'xxx'})
soup = bs4.BeautifulSoup(session.get(link).content, 'html.parser')
print(soup)

After running the code, spyder throw out the follow error and automatically restart the kernel I have searched almost everywhere but found no post describing this exact issue. Anyone has any thought?

Windows fatal exception: stack overflow


Main thread:
Current thread 0x00002434 (most recent call first):
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\formatter.py", line 123 in attributes
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1640 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1777 in decode_contents
  File "C:\Users\Arnold\anaconda3\envs\Exp\lib\site-packages\bs4\element.py", line 1683 in decode
  ...


Restarting kernel...

CodePudding user response：

BS4 is also using recursion to find all elements and Python has a recursion limit (check with sys.getrecursionlimit).

The error you're facing might be due to the HTML doc has too many child elements.

You may want to use sys.setrecursionlimit to increase the limit. For example:

import requests
import bs4
import sys

sys.setrecursionlimit(10000)

session = requests.Session()
session.headers.update({'User-Agent': 'xxx'})
soup = bs4.BeautifulSoup(session.get(link).content, 'html.parser')
print(soup)

Please note, if you set the limit too high, it may cause an overflow of the C stack and crashing Python.