크롤링에서 for문!!

Question

제가 xpath과 for문을 이용해서 연속적으로 크롤링을 하려고하는데요 for문이 안돌아가는거 같아서요..어떻게해야 for문을 돌아가게 할 수 있을까요?from selenium import webdriver from selenium.webdriver.chrome.options import Options from bs4 import BeautifulSoup import time options &#61; Options() options.add_argument('--kiosk') driver &#61; webdriver.Chrome('./chromedriver', options&#61;options) time.sleep(3) driver.get('https://www.govbergwatches.com/') driver.find_element_by_xpath('//*[&#64;id&#61;&#34;menu-primary-navigation-1&#34;]/li[4]/a').click() driver.execute_script( &#34;(function() { &#34; &#43; &#34;window.open('https://www.govbergwatches.com/product-category/preowned-watches/', 'second');&#34;&#43; &#34;})();&#34; ) driver.switch_to.window('second') driver.find_element_by_xpath('//*[&#64;id&#61;&#34;shop_productarea&#34;]/ul/li[2]/a/h3').click() targetSite &#61; driver.current_url print(targetSite) new_page &#61; driver.get(targetSite) last_tab &#61; driver.window_handles[-1] driver.switch_to.window(window_name&#61;last_tab) body &#61; driver.find_element_by_css_selector('body') soup &#61; BeautifulSoup(driver.page_source, 'html.parser') sale__price &#61; soup.find_all(class_ &#61; 'woocommerce-Price-amount amount') title &#61; soup.find_all(class_ &#61; 'product_title entry-title') reference_number &#61; soup.select('div.meta_row > div.meta_detail') condition &#61; soup.find('div.product_meta > div.meta_detail') print('ORIGINAL PRICE:{}'.format(sale__price[0].getText())) print('SALE PRICE(OUR PRICE):{}'.format(sale__price[1].getText())) print('REFERENCE NUMBER:{}'.format(reference_number[0].getText().strip())) print('MODEL:{}'.format(title[0].getText())) driver.close() first_tab &#61; driver.window_handles[0] driver.switch_to.window(window_name&#61;first_tab) for i in range(3, 100): driver.find_element_by_xpath('//*[&#64;id&#61;&#34;shop_productarea&#34;]/ul/li&#34;&#43;str(i)&#43;&#34;/a/h3').click() url &#61; driver.current_url print(url) new__page &#61; driver.get(url) last__tab &#61; driver.window_handles[-1] driver.switch_to.window(window_name&#61;last__tab) body &#61; driver.find_element_by_css_selector('body') soup &#61; BeautifulSoup(driver.page_source, 'html.parser') sale__price &#61; soup.find_all(class_&#61;'woocommerce-Price-amount amount') title &#61; soup.find_all(class_&#61;'product_title entry-title') reference_number &#61; soup.select('div.meta_row > div.meta_detail') condition &#61; soup.find('div.product_meta > div.meta_detail') print('ORIGINAL PRICE:{}'.format(sale__price[0].getText())) print('SALE PRICE(OUR PRICE):{}'.format(sale__price[1].getText())) print('REFERENCE NUMBER:{}'.format(reference_number[0].getText().strip())) print('MODEL:{}'.format(title[0].getText())) driver.close() first_tab &#61; driver.window_handles[0] driver.switch_to.window(window_name&#61;first_tab)감사합니다!!!

aksjm2 · Answer

driver.close() 후에 driver.window_handles[0] 이렇게 접근하고 있습니다.driver.close() first_tab &#61; driver.window_handles[0] driver.switch_to.window(window_name&#61;first_tab)

미니언올라퓨맹 · Answer

aksjm2님 !다른 사이트 크롤링 할때는 문제가 없었는데 흠 ,, 그럼 for문이 안돌아가는 이유가 handles[0] 때문이라는건가요??### 그럼 어떻게 바꾸어야 될까요ㅠㅠㅠ?

aksjm2 · Answer

print('MODEL:{}'.format(title[0].getText())) # 삭제 driver.close() first_tab &#61; driver.window_handles[0] driver.switch_to.window(window_name&#61;first_tab) for i in range(3, 100): ## 중략 ##for문 끝 print('MODEL:{}'.format(title[0].getText())) driver.close() # 삭제 first_tab &#61; driver.window_handles[0] # 삭제 driver.switch_to.window(window_name&#61;first_tab)

미니언올라퓨맹 · Answer

aksjm2님돌려봤는데 첫번째 시계 사이트만 2번 크롤링 되고 끝납니다ㅜㅜ

크롤링에서 for문!!

4개의 답변

#forloop 목록