agents.document_loader.web.agent¶
Web-specific Document Loader Agent.
This module provides a specialized document loader agent for loading documents from web URLs.
Classes¶
Specialized document loader agent for loading documents from web URLs. |
Module Contents¶
- class agents.document_loader.web.agent.WebLoaderAgent¶
Bases:
haive.agents.document_loader.base.agent.DocumentLoaderAgentSpecialized document loader agent for loading documents from web URLs.
This agent is pre-configured for loading from web sources and provides additional web-specific options.
- name¶
Name of the agent
- url¶
URL to load
- dynamic_loading¶
Whether to use a dynamic loading strategy (e.g., Playwright)
- recursive¶
Whether to recursively crawl links
- max_depth¶
Maximum depth for recursive crawling
- headers¶
Custom headers to use for requests
- setup_agent()¶
Set up the agent with a web loader engine.
- Return type:
None