pyinstaller ModuleNotFoundError: 'fake_useragent.data' 웹 크롤링/스크래핑

Question

안녕하세요pyinstaller 로 실행파일을 만들다가 에러가 발생해 질문드립니다.상황 :웹 스크래핑을 하고 있습니다.봇의 차단을 막기 위해fake_useragent import UserAgent 를 사용하고 있습니다.from ipypb import ipb from bs4 import BeautifulSoup from fake_useragent import UserAgent # from user_agent import generate_user_agent import requests import urllib.parse import time import random def download(dir_to_save, url_to_download) : # Instantiate the UserAgent class ua = UserAgent() # Get random user agents random_ua = ua.random headers = { 'user-agent': random_ua # "User-Agent": generate_user_agent(os='win',device_type='desktop') # "User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36" }그런데 이게 말썽입니다.다음과 같은 에러메시지가 뜹니다. Unable to find local data/json file or could not parse the contents using importlib-resources. Try pkg-resource next. Traceback (most recent call last): File "fake_useragent\utils.py", line 21, in load File "importlib esources\_common.py", line 22, in files File "importlib esources\_common.py", line 53, in get_package File "importlib esources\_common.py", line 44, in resolve File "importlib\__init__.py", line 126, in import_module File "", line 1206, in _gcd_import File "", line 1178, in _find_and_load File "", line 1142, in _find_and_load_unlocked ModuleNotFoundError: No module named 'fake_useragent.data' Could not find local data/json file or could not parse the contents using pkg-resource. Traceback (most recent call last): File "fake_useragent\utils.py", line 21, in load File "importlib esources\_common.py", line 22, in files File "importlib esources\_common.py", line 53, in get_package File "importlib esources\_common.py", line 44, in resolve File "importlib\__init__.py", line 126, in import_module File "", line 1206, in _gcd_import File "", line 1178, in _find_and_load File "", line 1142, in _find_and_load_unlocked ModuleNotFoundError: No module named 'fake_useragent.data' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "fake_useragent\utils.py", line 36, in load FileNotFoundError: [Errno 2] No such file or directory: 'C:\Users\sa031\AppData\Local\Temp\_MEI180322\fake_useragent\data\browsers.json' Exception in Tkinter callback Traceback (most recent call last): File "tkinter\__init__.py", line 1948, in __call__ File "download.py", line 81, in File "main_final.py", line 18, in download File "fake_useragent\fake.py", line 76, in __init__ File "fake_useragent\utils.py", line 52, in load fake_useragent.errors.FakeUserAgentError: ('Data list is empty', None) 시도해 본것구글링공식문서 확인스택오버플로우, 가장 가까운 답변은 이거였는데 이건 더 이상 지원? 하지 않는다고 공식문서에 나와있었습니다.https://stackoverflow.com/questions/75754852/pyinstaller-module-not-found-fake-useragentimport fake_useragent useragent = fake_useragent.UserAgent(use_external_data=True) 실력이 많이 부족해서 고수님들이 보시기엔 간단한 질문일 수도 있을 것 같습니다.가르침 주시면 감사하겠습니다. 보고 많이 배우겠습니다.

Clickin · Answer

fake_useragent도 data용 파일을 사용하나봅니다.pyinstaller는 파이썬과 직접 연관이 없는 다른 파일은 exe에 포함시키지 않는데이 부분은 별도의 옵션을 줘서 해결할 수 있을겁니다. 다음 링크 한번 참조해보세요https://stackoverflow.com/questions/46474588/pyinstaller-how-to-include-data-files-from-an-external-package-that-was-install※ 치트시트--collect-datas=fake_agent

pyinstaller ModuleNotFoundError: 'fake_useragent.data' 웹 크롤링/스크래핑

1개의 답변

#pyinstaller 목록