Skip to content
On this page

Resource policy

Resource policies control which request types are allowed.

from webskrap import ResourcePolicy, SessionConfig
 
config = SessionConfig(resource_policy=ResourcePolicy.LITE)

Policies

Policy Behavior
ResourcePolicy.AUTO Default. Uses lite for text without screenshots; all for other tasks.
ResourcePolicy.ALL Allows all resources.
ResourcePolicy.LITE Blocks images, fonts, and media.
ResourcePolicy.DOCUMENTS Blocks images, fonts, media, and stylesheets.

Explicit policies take priority over AUTO. Use ALL for maximum page fidelity. Use LITE when you want a faster page load while keeping stylesheets and scripts.

Examples

Use LITE for most extraction jobs that still need styled or script-rendered HTML:

from webskrap import ResourcePolicy, SessionConfig, WebSkrapClient
 
config = SessionConfig(resource_policy=ResourcePolicy.LITE)
 
async with WebSkrapClient() as client:
    result = await client.fetch("https://example.com", config=config)

Use DOCUMENTS when you only need document-oriented HTML and can tolerate unstyled pages without losing required content:

config = SessionConfig(resource_policy=ResourcePolicy.DOCUMENTS)

Resource policies use the CDP Fetch domain. Auto selects a policy for each page and its cross-site iframes. Auto does not block resources in shared or service workers. Explicit policies also apply to shared and service workers. Scripts and XHR/fetch requests are not blocked by these presets.

CLI

webskrap fetch https://example.com --resource-policy lite
webskrap fetch https://example.com --resource-policy documents --output page.html

If a page renders incorrectly, switch back to all first. Many pages require images, fonts, media, or stylesheets for layout-dependent interactions even when the final extraction target is text.