I spent a couple of weeks trying to figure out how to extract the employment history of the broker on FINRA broker check. At this point, I can extract only the basic information such as name, crd number, disclosure history and address.
However, my target information is the employment history (please see the following 3. ). I used the extension of google chrome to do this, but it seems to me, at the moment, this task is quite challenging for me. Thus, I post my question on this site.
1.) 
2.) For example, if I want to scrape the employment history of brokers in New York, I fill up the search box with 'New York' and the website looks like this. (Since BrokerCheck data is public, I did not conceal the names.)
3.) I used the chrome extension but it cannot scrape the data because the data I target is inside each block. If you click on the box it will bring you to the employment history like this.
4.) and the boxes are on the page with element click like this one.
I used the Chrome extension called scraper, but I cannot scrape the data within the link because, when choosing the selector as 'link', I cannot click and choose the link from each box on BrokerCheck and cannot proceed to choose the information that is linked to another webpage.
Any suggestions would welcome!
CodePudding user response：
Here is a way to obtain that information in Python (first 36 items):
import requests
import pandas as pd
from tqdm.notebook import tqdm
pd.set_option('display.max_rows', None, 'display.max_columns', None, 'display.max_colwidth', None)
headers = {
'User-Agent': 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/109.0.0.0 Safari/537.36'
}
s = requests.Session()
s.headers.update(headers)
big_df = pd.DataFrame()
for x in tqdm(range(0, 36, 12)):
r = s.get(f'https://api.brokercheck.finra.org/search/individual?state=NY&includePrevious=true&hl=true&nrows=12&start={x}&r=25&sort=score desc&wt=json')
df = pd.json_normalize(r.json()['hits']['hits'])
big_df = pd.concat([big_df, df], axis=0, ignore_index=True)
print(big_df)
Result in terminal:
100%
3/3 [00:04<00:00, 1.30s/it]
_type _source.ind_source_id _source.ind_firstname _source.ind_lastname _source.ind_other_names _source.ind_bc_scope _source.ind_ia_scope _source.ind_bc_disclosure_fl _source.ind_approved_finra_registration_count _source.ind_employments_count _source.ind_industry_cal_date _source.ind_current_employments inner_hits.ind_current_employments.hits.hits inner_hits.ind_previous_employments.hits.hits _source.ind_middlename _source.ind_namesuffix
0 _doc 2986054 JAVIER KULESZ [] Active NotInScope N 1 1 1998-09-13 [{'firm_id': '2347', 'firm_name': 'JEFFERIES LLC', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10022', 'ia_only': 'N', 'firm_bd_sec_number': '15074', 'firm_bd_full_sec_number': '8-15074'}] [{'_source': {'firm_id': '2347', 'firm_name': 'JEFFERIES LLC', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10022', 'ia_only': 'N', 'firm_bd_sec_number': '15074', 'firm_bd_full_sec_number': '8-15074'}}] [] NaN NaN
1 _doc 2985299 RICARDO HERNANDEZ [] Active NotInScope N 1 1 2002-11-30 [{'firm_id': '22698', 'firm_name': 'NATIONAL BANK OF CANADA FINANCIAL INC.', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10022', 'ia_only': 'N', 'firm_bd_sec_number': '39947', 'firm_bd_full_sec_number': '8-39947'}] [{'_source': {'firm_id': '22698', 'firm_name': 'NATIONAL BANK OF CANADA FINANCIAL INC.', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10022', 'ia_only': 'N', 'firm_bd_sec_number': '39947', 'firm_bd_full_sec_number': '8-39947'}}] [] E NaN
2 _doc 3007947 PIERRE AUDRAIN [] Active NotInScope N 1 1 2012-02-11 [{'firm_id': '1101', 'firm_name': 'NATIXIS SECURITIES AMERICAS LLC', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10020', 'ia_only': 'N', 'firm_bd_sec_number': '719', 'firm_bd_full_sec_number': '8-719', 'firm_ia_sec_number': '72849', 'firm_ia_full_sec_number': '801-72849'}] [{'_source': {'firm_id': '1101', 'firm_name': 'NATIXIS SECURITIES AMERICAS LLC', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10020', 'ia_only': 'N', 'firm_bd_sec_number': '719', 'firm_bd_full_sec_number': '8-719', 'firm_ia_sec_number': '72849', 'firm_ia_full_sec_number': '801-72849'}}] [] ETIENNE NaN
3 _doc 3006427 VINCENT BUSARI [] Active NotInScope Y 1 1 2002-06-13 [{'firm_id': '5167', 'firm_name': 'NYLIFE SECURITIES LLC', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10010', 'ia_only': 'N', 'firm_bd_sec_number': '15517', 'firm_bd_full_sec_number': '8-15517'}] [{'_source': {'firm_id': '5167', 'firm_name': 'NYLIFE SECURITIES LLC', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10010', 'ia_only': 'N', 'firm_bd_sec_number': '15517', 'firm_bd_full_sec_number': '8-15517'}}] [] NaN NaN
4 _doc 3006501 ARLANA PUCKITT [ARLANA WONG PUCKITT, ARLANA PUCKITT, ARLANA WONG] Active NotInScope N 1 1 2012-10-11 [{'firm_id': '149777', 'firm_name': 'MORGAN STANLEY', 'branch_city': 'PURCHASE', 'branch_state': 'NY', 'branch_zip': '10577-2530', 'ia_only': 'N', 'firm_bd_sec_number': '68191', 'firm_bd_full_sec_number': '8-68191', 'firm_ia_sec_number': '70103', 'firm_ia_full_sec_number': '801-70103'}] [{'_source': {'firm_id': '149777', 'firm_name': 'MORGAN STANLEY', 'branch_city': 'PURCHASE', 'branch_state': 'NY', 'branch_zip': '10577-2530', 'ia_only': 'N', 'firm_bd_sec_number': '68191', 'firm_bd_full_sec_number': '8-68191', 'firm_ia_sec_number': '70103', 'firm_ia_full_sec_number': '801-70103'}}] [] W NaN
5 _doc 3006913 JOSEPH SANGALINE [] Active NotInScope N 1 2 1999-01-22 [{'firm_id': '18272', 'firm_name': 'ALLSTATE FINANCIAL SERVICES, LLC', 'branch_city': 'Lincoln', 'branch_state': 'NE', 'branch_zip': '68506-4142', 'ia_only': 'N', 'firm_bd_sec_number': '36365', 'firm_bd_full_sec_number': '8-36365'}, {'firm_id': '18272', 'firm_name': 'ALLSTATE FINANCIAL SERVICES, LLC', 'branch_city': 'Clifton Park', 'branch_state': 'NY', 'ia_only': 'N', 'firm_bd_sec_number': '36365', 'firm_bd_full_sec_number': '8-36365'}] [{'_source': {'firm_id': '18272', 'firm_name': 'ALLSTATE FINANCIAL SERVICES, LLC', 'branch_city': 'Clifton Park', 'branch_state': 'NY', 'ia_only': 'N', 'firm_bd_sec_number': '36365', 'firm_bd_full_sec_number': '8-36365'}}] [] MICHAEL NaN
6 _doc 2997351 WILLARD LIPE [BILL LIPE III, WILLARD CHARLES III LIPE] NotInScope Active N 0 1 NaN [{'firm_id': '132737', 'firm_name': 'LIPE & DALTON INVESTMENT COUNSEL', 'branch_city': 'SYRACUSE', 'branch_state': 'NY', 'branch_zip': '13202', 'ia_only': 'Y'}] [{'_source': {'firm_id': '132737', 'firm_name': 'LIPE & DALTON INVESTMENT COUNSEL', 'branch_city': 'SYRACUSE', 'branch_state': 'NY', 'branch_zip': '13202', 'ia_only': 'Y'}}] [] CHARLES III
7 _doc 2997999 ROGER PINTO [] Active NotInScope N 1 1 1998-11-30 [{'firm_id': '6413', 'firm_name': 'LPL FINANCIAL LLC', 'branch_city': 'HUNTINGTON', 'branch_state': 'NY', 'branch_zip': '11743', 'ia_only': 'N', 'firm_bd_sec_number': '17668', 'firm_bd_full_sec_number': '8-17668', 'firm_ia_sec_number': '10970', 'firm_ia_full_sec_number': '801-10970'}] [{'_source': {'firm_id': '6413', 'firm_name': 'LPL FINANCIAL LLC', 'branch_city': 'HUNTINGTON', 'branch_state': 'NY', 'branch_zip': '11743', 'ia_only': 'N', 'firm_bd_sec_number': '17668', 'firm_bd_full_sec_number': '8-17668', 'firm_ia_sec_number': '10970', 'firm_ia_full_sec_number': '801-10970'}}] [] EDMUND NaN
8 _doc 2998428 KEVIN CROSBY [] Active NotInScope N 1 1 2000-08-09 [{'firm_id': '18272', 'firm_name': 'ALLSTATE FINANCIAL SERVICES, LLC', 'branch_city': 'QUEENSBURY', 'branch_state': 'NY', 'branch_zip': '12804-3051', 'ia_only': 'N', 'firm_bd_sec_number': '36365', 'firm_bd_full_sec_number': '8-36365'}] [{'_source': {'firm_id': '18272', 'firm_name': 'ALLSTATE FINANCIAL SERVICES, LLC', 'branch_city': 'QUEENSBURY', 'branch_state': 'NY', 'branch_zip': '12804-3051', 'ia_only': 'N', 'firm_bd_sec_number': '36365', 'firm_bd_full_sec_number': '8-36365'}}] [] PATRICK NaN
9 _doc 2998425 KENNETH HEIN [KEN HEIN] Active NotInScope N 1 1 2001-03-11 [{'firm_id': '18272', 'firm_name': 'ALLSTATE FINANCIAL SERVICES, LLC', 'branch_city': 'QUEENSBURY', 'branch_state': 'NY', 'branch_zip': '12804-1726', 'ia_only': 'N', 'firm_bd_sec_number': '36365', 'firm_bd_full_sec_number': '8-36365'}] [{'_source': {'firm_id': '18272', 'firm_name': 'ALLSTATE FINANCIAL SERVICES, LLC', 'branch_city': 'QUEENSBURY', 'branch_state': 'NY', 'branch_zip': '12804-1726', 'ia_only': 'N', 'firm_bd_sec_number': '36365', 'firm_bd_full_sec_number': '8-36365'}}] [] ARTHUR NaN
10 _doc 3009838 GIAN BERNARDI [] Active NotInScope N 1 2 2000-10-08 [{'firm_id': '32205', 'firm_name': 'TRANSAMERICA INVESTORS SECURITIES CORPORATION', 'branch_city': 'Union', 'branch_state': 'KY', 'branch_zip': '41091', 'ia_only': 'N', 'firm_bd_sec_number': '45671', 'firm_bd_full_sec_number': '8-45671'}, {'firm_id': '32205', 'firm_name': 'TRANSAMERICA INVESTORS SECURITIES CORPORATION', 'branch_city': 'Katonah', 'branch_state': 'NY', 'ia_only': 'N', 'firm_bd_sec_number': '45671', 'firm_bd_full_sec_number': '8-45671'}] [{'_source': {'firm_id': '32205', 'firm_name': 'TRANSAMERICA INVESTORS SECURITIES CORPORATION', 'branch_city': 'Katonah', 'branch_state': 'NY', 'ia_only': 'N', 'firm_bd_sec_number': '45671', 'firm_bd_full_sec_number': '8-45671'}}] [] DANIEL NaN
11 _doc 3010685 SARA PEREZ [] Active NotInScope N 1 1 1998-06-03 [{'firm_id': '27878', 'firm_name': 'MUTUAL OF AMERICA SECURITIES LLC', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10022', 'ia_only': 'N', 'firm_bd_sec_number': '43278', 'firm_bd_full_sec_number': '8-43278'}] [{'_source': {'firm_id': '27878', 'firm_name': 'MUTUAL OF AMERICA SECURITIES LLC', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10022', 'ia_only': 'N', 'firm_bd_sec_number': '43278', 'firm_bd_full_sec_number': '8-43278'}}] [] NaN NaN
12 _doc 3010809 RUDOLF BULIS [RUDOLF JASEF BULIS] Active NotInScope N 1 1 2001-04-13 [{'firm_id': '122657', 'firm_name': 'RABO SECURITIES USA, INC.', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10167', 'ia_only': 'N', 'firm_bd_sec_number': '65525', 'firm_bd_full_sec_number': '8-65525'}] [{'_source': {'firm_id': '122657', 'firm_name': 'RABO SECURITIES USA, INC.', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10167', 'ia_only': 'N', 'firm_bd_sec_number': '65525', 'firm_bd_full_sec_number': '8-65525'}}] [] JOSEF NaN
13 _doc 3011584 TOSHIHIKO OSHIO [] Active NotInScope N 1 2 2011-06-05 [{'firm_id': '28602', 'firm_name': 'SMBC NIKKO SECURITIES AMERICA, INC.', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10172', 'ia_only': 'N', 'firm_bd_sec_number': '43852', 'firm_bd_full_sec_number': '8-43852'}, {'firm_id': '28602', 'firm_name': 'SMBC NIKKO SECURITIES AMERICA, INC.', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10172', 'ia_only': 'N', 'firm_bd_sec_number': '43852', 'firm_bd_full_sec_number': '8-43852'}, {'firm_id': '28602', 'firm_name': 'SMBC NIKKO SECURITIES AMERICA, INC.', 'branch_city': 'TOKYO', 'branch_zip': '100-6521', 'ia_only': 'N', 'firm_bd_sec_number': '43852', 'firm_bd_full_sec_number': '8-43852'}] [{'_source': {'firm_id': '28602', 'firm_name': 'SMBC NIKKO SECURITIES AMERICA, INC.', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10172', 'ia_only': 'N', 'firm_bd_sec_number': '43852', 'firm_bd_full_sec_number': '8-43852'}}, {'_source': {'firm_id': '28602', 'firm_name': 'SMBC NIKKO SECURITIES AMERICA, INC.', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10172', 'ia_only': 'N', 'firm_bd_sec_number': '43852', 'firm_bd_full_sec_number': '8-43852'}}] [] NaN NaN
14 _doc 3011972 TAEJIN KANG [] Active NotInScope N 1 2 2002-08-02 [{'firm_id': '8209', 'firm_name': 'MORGAN STANLEY & CO. LLC', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10036-8293', 'ia_only': 'N', 'firm_bd_sec_number': '15869', 'firm_bd_full_sec_number': '8-15869', 'firm_ia_sec_number': '11727', 'firm_ia_full_sec_number': '801-11727'}, {'firm_id': '8209', 'firm_name': 'MORGAN STANLEY & CO. LLC', 'branch_city': 'SEOUL', 'branch_zip': '110-061', 'ia_only': 'N', 'firm_bd_sec_number': '15869', 'firm_bd_full_sec_number': '8-15869', 'firm_ia_sec_number': '11727', 'firm_ia_full_sec_number': '801-11727'}] [{'_source': {'firm_id': '8209', 'firm_name': 'MORGAN STANLEY & CO. LLC', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10036-8293', 'ia_only': 'N', 'firm_bd_sec_number': '15869', 'firm_bd_full_sec_number': '8-15869', 'firm_ia_sec_number': '11727', 'firm_ia_full_sec_number': '801-11727'}}] [] NaN NaN
15 _doc 3013374 PETER BRAFFMAN [PETER A BRAFFMAN] Active NotInScope N 1 1 2009-11-02 [{'firm_id': '138348', 'firm_name': 'GRV SECURITIES LLC', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10153', 'ia_only': 'N', 'firm_bd_sec_number': '67160', 'firm_bd_full_sec_number': '8-67160'}] [{'_source': {'firm_id': '138348', 'firm_name': 'GRV SECURITIES LLC', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10153', 'ia_only': 'N', 'firm_bd_sec_number': '67160', 'firm_bd_full_sec_number': '8-67160'}}] [] ANDREW NaN
16 _doc 3014597 JARED COSTANZO [] Active NotInScope N 1 1 2012-06-24 [{'firm_id': '7654', 'firm_name': 'UBS SECURITIES LLC', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10019', 'ia_only': 'N', 'firm_bd_sec_number': '22651', 'firm_bd_full_sec_number': '8-22651', 'firm_ia_sec_number': '67178', 'firm_ia_full_sec_number': '801-67178'}] [{'_source': {'firm_id': '7654', 'firm_name': 'UBS SECURITIES LLC', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10019', 'ia_only': 'N', 'firm_bd_sec_number': '22651', 'firm_bd_full_sec_number': '8-22651', 'firm_ia_sec_number': '67178', 'firm_ia_full_sec_number': '801-67178'}}] [] ALAN NaN
17 _doc 2940649 HAREL GILLON [] Active NotInScope N 1 2 1997-09-24 [{'firm_id': '249', 'firm_name': 'OPPENHEIMER & CO. INC.', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10004', 'ia_only': 'N', 'firm_bd_sec_number': '4077', 'firm_bd_full_sec_number': '8-4077', 'firm_ia_sec_number': '887', 'firm_ia_full_sec_number': '801-887'}, {'firm_id': '249', 'firm_name': 'OPPENHEIMER & CO. INC.', 'branch_city': 'TEL AVIV', 'ia_only': 'N', 'firm_bd_sec_number': '4077', 'firm_bd_full_sec_number': '8-4077', 'firm_ia_sec_number': '887', 'firm_ia_full_sec_number': '801-887'}] [{'_source': {'firm_id': '249', 'firm_name': 'OPPENHEIMER & CO. INC.', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10004', 'ia_only': 'N', 'firm_bd_sec_number': '4077', 'firm_bd_full_sec_number': '8-4077', 'firm_ia_sec_number': '887', 'firm_ia_full_sec_number': '801-887'}}] [] NaN NaN
18 _doc 2949131 JUDY LEWIS [] Active NotInScope N 1 1 1997-12-09 [{'firm_id': '7461', 'firm_name': 'FSC SECURITIES CORPORATION', 'branch_city': 'SYRACUSE', 'branch_state': 'NY', 'branch_zip': '13219', 'ia_only': 'N', 'firm_bd_sec_number': '21770', 'firm_bd_full_sec_number': '8-21770', 'firm_ia_sec_number': '42017', 'firm_ia_full_sec_number': '801-42017'}] [{'_source': {'firm_id': '7461', 'firm_name': 'FSC SECURITIES CORPORATION', 'branch_city': 'SYRACUSE', 'branch_state': 'NY', 'branch_zip': '13219', 'ia_only': 'N', 'firm_bd_sec_number': '21770', 'firm_bd_full_sec_number': '8-21770', 'firm_ia_sec_number': '42017', 'firm_ia_full_sec_number': '801-42017'}}] [] ANN NaN
19 _doc 2953935 KAREN CASTIGLIONE [KAREN CASTIGLIONE, KAREN LYNN GALE] Active NotInScope N 1 1 2001-07-02 [{'firm_id': '249', 'firm_name': 'OPPENHEIMER & CO. INC.', 'branch_city': 'MELVILLE', 'branch_state': 'NY', 'branch_zip': '11747', 'ia_only': 'N', 'firm_bd_sec_number': '4077', 'firm_bd_full_sec_number': '8-4077', 'firm_ia_sec_number': '887', 'firm_ia_full_sec_number': '801-887'}] [{'_source': {'firm_id': '249', 'firm_name': 'OPPENHEIMER & CO. INC.', 'branch_city': 'MELVILLE', 'branch_state': 'NY', 'branch_zip': '11747', 'ia_only': 'N', 'firm_bd_sec_number': '4077', 'firm_bd_full_sec_number': '8-4077', 'firm_ia_sec_number': '887', 'firm_ia_full_sec_number': '801-887'}}] [] LYNN NaN
20 _doc 2973535 MICHAEL HARVEY [] Active NotInScope N 1 1 2001-11-08 [{'firm_id': '31194', 'firm_name': 'RBC CAPITAL MARKETS, LLC', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10281', 'ia_only': 'N', 'firm_bd_sec_number': '45411', 'firm_bd_full_sec_number': '8-45411', 'firm_ia_sec_number': '13059', 'firm_ia_full_sec_number': '801-13059'}] [{'_source': {'firm_id': '31194', 'firm_name': 'RBC CAPITAL MARKETS, LLC', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10281', 'ia_only': 'N', 'firm_bd_sec_number': '45411', 'firm_bd_full_sec_number': '8-45411', 'firm_ia_sec_number': '13059', 'firm_ia_full_sec_number': '801-13059'}}] [] STEVE NaN
21 _doc 2971023 CYNTHIA GENNARO [CINDY RINALDI, CYNTHIA MARIE RINALDI] Active NotInScope N 1 2 1998-05-18 [{'firm_id': '38784', 'firm_name': 'THOMASLLOYD CAPITAL LLC', 'branch_city': 'PLEASANTVILLE', 'branch_state': 'NY', 'branch_zip': '10570', 'ia_only': 'N', 'firm_bd_sec_number': '48402', 'firm_bd_full_sec_number': '8-48402'}, {'firm_id': '38784', 'firm_name': 'THOMASLLOYD CAPITAL LLC', 'branch_city': 'Ocala', 'branch_state': 'FL', 'ia_only': 'N', 'firm_bd_sec_number': '48402', 'firm_bd_full_sec_number': '8-48402'}] [{'_source': {'firm_id': '38784', 'firm_name': 'THOMASLLOYD CAPITAL LLC', 'branch_city': 'PLEASANTVILLE', 'branch_state': 'NY', 'branch_zip': '10570', 'ia_only': 'N', 'firm_bd_sec_number': '48402', 'firm_bd_full_sec_number': '8-48402'}}] [] M NaN
22 _doc 2972926 YISROEL STUHL [YISROEL STUHL] Active NotInScope Y 1 1 1997-12-27 [{'firm_id': '5167', 'firm_name': 'NYLIFE SECURITIES LLC', 'branch_city': 'BROOKLYN', 'branch_state': 'NY', 'branch_zip': '11249', 'ia_only': 'N', 'firm_bd_sec_number': '15517', 'firm_bd_full_sec_number': '8-15517'}] [{'_source': {'firm_id': '5167', 'firm_name': 'NYLIFE SECURITIES LLC', 'branch_city': 'BROOKLYN', 'branch_state': 'NY', 'branch_zip': '11249', 'ia_only': 'N', 'firm_bd_sec_number': '15517', 'firm_bd_full_sec_number': '8-15517'}}] [] MOSHE NaN
23 _doc 2973652 MASON STARK [] NotInScope Active N 0 1 NaN [{'firm_id': '33062', 'firm_name': 'THE HEALY GROUP LLC', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'ia_only': 'Y'}, {'firm_id': '33062', 'firm_name': 'THE HEALY GROUP LLC', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'ia_only': 'Y'}] [{'_source': {'firm_id': '33062', 'firm_name': 'THE HEALY GROUP LLC', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'ia_only': 'Y'}}, {'_source': {'firm_id': '33062', 'firm_name': 'THE HEALY GROUP LLC', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'ia_only': 'Y'}}] [] VANCOTT NaN
24 _doc 2973016 THOMAS ODELL [THOMAS ANSLYN ODELL] Active NotInScope N 1 2 2012-10-15 [{'firm_id': '361', 'firm_name': 'GOLDMAN SACHS & CO. LLC', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10282-2198', 'ia_only': 'N', 'firm_bd_sec_number': '129', 'firm_bd_full_sec_number': '8-129', 'firm_ia_sec_number': '16048', 'firm_ia_full_sec_number': '801-16048'}, {'firm_id': '361', 'firm_name': 'GOLDMAN SACHS & CO. LLC', 'branch_city': 'JERSEY CITY', 'branch_state': 'NJ', 'branch_zip': '07302', 'ia_only': 'N', 'firm_bd_sec_number': '129', 'firm_bd_full_sec_number': '8-129', 'firm_ia_sec_number': '16048', 'firm_ia_full_sec_number': '801-16048'}] [{'_source': {'firm_id': '361', 'firm_name': 'GOLDMAN SACHS & CO. LLC', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10282-2198', 'ia_only': 'N', 'firm_bd_sec_number': '129', 'firm_bd_full_sec_number': '8-129', 'firm_ia_sec_number': '16048', 'firm_ia_full_sec_number': '801-16048'}}] [] A NaN
25 _doc 2975017 JACQUELINE SABELLA [JACQUELINE NGUYN SABELLA] Active NotInScope N 1 1 2000-01-04 [{'firm_id': '27878', 'firm_name': 'MUTUAL OF AMERICA SECURITIES LLC', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10022', 'ia_only': 'N', 'firm_bd_sec_number': '43278', 'firm_bd_full_sec_number': '8-43278'}] [{'_source': {'firm_id': '27878', 'firm_name': 'MUTUAL OF AMERICA SECURITIES LLC', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10022', 'ia_only': 'N', 'firm_bd_sec_number': '43278', 'firm_bd_full_sec_number': '8-43278'}}] [] NGUYEN NaN
26 _doc 2974256 STEPHANIE MERGENTHALER [STEPHANIE S CRANE, STEPHANIE SARAH CRANE] Active NotInScope N 1 1 2011-11-24 [{'firm_id': '149777', 'firm_name': 'MORGAN STANLEY', 'branch_city': 'New York', 'branch_state': 'NY', 'branch_zip': '10036', 'ia_only': 'N', 'firm_bd_sec_number': '68191', 'firm_bd_full_sec_number': '8-68191', 'firm_ia_sec_number': '70103', 'firm_ia_full_sec_number': '801-70103'}] [{'_source': {'firm_id': '149777', 'firm_name': 'MORGAN STANLEY', 'branch_city': 'New York', 'branch_state': 'NY', 'branch_zip': '10036', 'ia_only': 'N', 'firm_bd_sec_number': '68191', 'firm_bd_full_sec_number': '8-68191', 'firm_ia_sec_number': '70103', 'firm_ia_full_sec_number': '801-70103'}}] [] CRANE NaN
27 _doc 2975653 CHARLES WENZEL [CHARLIE WENZEL] Active NotInScope N 1 1 2000-07-26 [{'firm_id': '29258', 'firm_name': 'COHEN & STEERS SECURITIES, LLC', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10017', 'ia_only': 'N', 'firm_bd_sec_number': '44123', 'firm_bd_full_sec_number': '8-44123'}] [{'_source': {'firm_id': '29258', 'firm_name': 'COHEN & STEERS SECURITIES, LLC', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10017', 'ia_only': 'N', 'firm_bd_sec_number': '44123', 'firm_bd_full_sec_number': '8-44123'}}] [] EDWARD NaN
28 _doc 2978168 HORACE CRARY [HORACE INGRAHAM CRARY JR, HORACE INGRAHAM CRARY JR., HORACE INGRAHAM CRARY, HORACE CRARY, HORACE INGRAHAM CRARY JR JR., ACE CRARY, JR.] Active NotInScope N 1 1 2002-05-13 [{'firm_id': '282732', 'firm_name': 'BROWN BROTHERS HARRIMAN INVESTMENTS, LLC', 'branch_city': 'New York', 'branch_state': 'NY', 'branch_zip': '10005', 'ia_only': 'N', 'firm_bd_sec_number': '69731', 'firm_bd_full_sec_number': '8-69731'}] [{'_source': {'firm_id': '282732', 'firm_name': 'BROWN BROTHERS HARRIMAN INVESTMENTS, LLC', 'branch_city': 'New York', 'branch_state': 'NY', 'branch_zip': '10005', 'ia_only': 'N', 'firm_bd_sec_number': '69731', 'firm_bd_full_sec_number': '8-69731'}}] [] INGRAHAM Jr.
29 _doc 2978403 MONA PAGNOZZI [MONA ANNE HANDELMAN] Active NotInScope N 1 2 2013-03-18 [{'firm_id': '15794', 'firm_name': 'BNP PARIBAS SECURITIES CORP.', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10019', 'ia_only': 'N', 'firm_bd_sec_number': '32682', 'firm_bd_full_sec_number': '8-32682'}, {'firm_id': '15794', 'firm_name': 'BNP PARIBAS SECURITIES CORP.', 'branch_city': 'JERSEY CITY', 'branch_state': 'NJ', 'branch_zip': '07310', 'ia_only': 'N', 'firm_bd_sec_number': '32682', 'firm_bd_full_sec_number': '8-32682'}] [{'_source': {'firm_id': '15794', 'firm_name': 'BNP PARIBAS SECURITIES CORP.', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10019', 'ia_only': 'N', 'firm_bd_sec_number': '32682', 'firm_bd_full_sec_number': '8-32682'}}] [] ANNE NaN
30 _doc 2978709 SALVATORE CERAVOLO [] Active Active N 1 2 1997-12-14 [{'firm_id': '20626', 'firm_name': 'TFS SECURITIES, INC.', 'branch_city': 'FOREST HILLS', 'branch_state': 'NY', 'branch_zip': '11375', 'ia_only': 'N', 'firm_bd_sec_number': '38377', 'firm_bd_full_sec_number': '8-38377', 'firm_ia_sec_number': '56426', 'firm_ia_full_sec_number': '801-56426'}, {'firm_id': '20626', 'firm_name': 'TFS ADVISORY SERVICES', 'branch_city': 'FOREST HILLS', 'branch_state': 'NY', 'branch_zip': '11375', 'ia_only': 'Y', 'firm_bd_sec_number': '38377', 'firm_bd_full_sec_number': '8-38377', 'firm_ia_sec_number': '56426', 'firm_ia_full_sec_number': '801-56426'}] [{'_source': {'firm_id': '20626', 'firm_name': 'TFS SECURITIES, INC.', 'branch_city': 'FOREST HILLS', 'branch_state': 'NY', 'branch_zip': '11375', 'ia_only': 'N', 'firm_bd_sec_number': '38377', 'firm_bd_full_sec_number': '8-38377', 'firm_ia_sec_number': '56426', 'firm_ia_full_sec_number': '801-56426'}}, {'_source': {'firm_id': '20626', 'firm_name': 'TFS ADVISORY SERVICES', 'branch_city': 'FOREST HILLS', 'branch_state': 'NY', 'branch_zip': '11375', 'ia_only': 'Y', 'firm_bd_sec_number': '38377', 'firm_bd_full_sec_number': '8-38377', 'firm_ia_sec_number': '56426', 'firm_ia_full_sec_number': '801-56426'}}] [] D NaN
31 _doc 3029623 DAVID SHANAHAN [] Active NotInScope N 1 1 1998-12-08 [{'firm_id': '29258', 'firm_name': 'COHEN & STEERS SECURITIES, LLC', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10017', 'ia_only': 'N', 'firm_bd_sec_number': '44123', 'firm_bd_full_sec_number': '8-44123'}] [{'_source': {'firm_id': '29258', 'firm_name': 'COHEN & STEERS SECURITIES, LLC', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10017', 'ia_only': 'N', 'firm_bd_sec_number': '44123', 'firm_bd_full_sec_number': '8-44123'}}] [] PETER NaN
32 _doc 3028405 MELISA MONTES [] Active NotInScope N 1 1 2020-06-29 [{'firm_id': '4297', 'firm_name': 'NOMURA SECURITIES INTERNATIONAL, INC.', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10019', 'ia_only': 'N', 'firm_bd_sec_number': '15255', 'firm_bd_full_sec_number': '8-15255', 'firm_ia_sec_number': '72991', 'firm_ia_full_sec_number': '801-72991'}] [{'_source': {'firm_id': '4297', 'firm_name': 'NOMURA SECURITIES INTERNATIONAL, INC.', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10019', 'ia_only': 'N', 'firm_bd_sec_number': '15255', 'firm_bd_full_sec_number': '8-15255', 'firm_ia_sec_number': '72991', 'firm_ia_full_sec_number': '801-72991'}}] [] MILAGROS NaN
33 _doc 3029703 LAURI PETTIT [] Active NotInScope N 1 1 2000-06-01 [{'firm_id': '6627', 'firm_name': 'EQUITABLE ADVISORS, LLC', 'branch_city': 'SYRACUSE', 'branch_state': 'NY', 'branch_zip': '13202', 'ia_only': 'N', 'firm_bd_sec_number': '17883', 'firm_bd_full_sec_number': '8-17883', 'firm_ia_sec_number': '14065', 'firm_ia_full_sec_number': '801-14065'}] [{'_source': {'firm_id': '6627', 'firm_name': 'EQUITABLE ADVISORS, LLC', 'branch_city': 'SYRACUSE', 'branch_state': 'NY', 'branch_zip': '13202', 'ia_only': 'N', 'firm_bd_sec_number': '17883', 'firm_bd_full_sec_number': '8-17883', 'firm_ia_sec_number': '14065', 'firm_ia_full_sec_number': '801-14065'}}] [] ANNE NaN
34 _doc 3031599 NICOLE GROGAN [NICOLE GRACE CHRISTIANSEN] Active NotInScope N 1 1 1998-07-27 [{'firm_id': '37306', 'firm_name': 'DWS DISTRIBUTORS, INC.', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10022', 'ia_only': 'N', 'firm_bd_sec_number': '47765', 'firm_bd_full_sec_number': '8-47765'}] [{'_source': {'firm_id': '37306', 'firm_name': 'DWS DISTRIBUTORS, INC.', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10022', 'ia_only': 'N', 'firm_bd_sec_number': '47765', 'firm_bd_full_sec_number': '8-47765'}}] [] CHRISTIANSEN NaN
35 _doc 3027832 THOMAS WOOD [] Active NotInScope N 1 1 2004-04-28 [{'firm_id': '36368', 'firm_name': 'MACQUARIE CAPITAL (USA) INC.', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10019', 'ia_only': 'N', 'firm_bd_sec_number': '47198', 'firm_bd_full_sec_number': '8-47198'}] [{'_source': {'firm_id': '36368', 'firm_name': 'MACQUARIE CAPITAL (USA) INC.', 'branch_city': 'NEW YORK', 'branch_state': 'NY', 'branch_zip': '10019', 'ia_only': 'N', 'firm_bd_sec_number': '47198', 'firm_bd_full_sec_number': '8-47198'}}] [] M NaN
You can get all records this way, just adjust the range accordingly. The result can be further structured in a couple of dataframes (or tables in database) linked with foreign keys.
CodePudding user response：
FINRA has built a platform just for this purpose: "FINRA's API platform is a sophisticated REST based solution with advanced querying capabilities. ".
You will have to create an account, learn how to use the system and take it from there.
Good luck.