API reference

Entry point

scrapysplashwrapper.crawl(splash_url: str, url: str, *, cookies: Optional[List[Dict[Any, Any]]] = None, referer: Optional[str] = None, headers: Optional[Dict[str, str]] = None, proxy: Optional[str] = None, depth: int = 1, user_agent: str = 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.132 Safari/537.36', log_enabled: bool = False, log_level: str = 'WARNING') → List[Dict[Any, Any]]

Send the URL to crawl to splash, returns a list of responses from splash. Each entry from the list corresponds to a single URL loaded by Splash.

Exceptions

exception scrapysplashwrapper.exceptions.InvalidProxy(proxy: str, message_details: str = '')

Raised when the proxy is not valid

exception scrapysplashwrapper.exceptions.ScrapySplashWrapperError

Base class for other exceptions