Skip to content
Contents VORA VORA Guide

URL Crawling

Grab a webpage's content in one shot

What is the URL Crawling tool?

A tool that fetches the body content of a specific web page as text.

When you enter a URL, it retrieves the body content of that web page as plain text.

It goes beyond simple text extraction — it can also visually analyze what the page actually looks like with its vision analysis feature, something most crawling tools can't do.

Key Features

  • Quick Analysis: A standard text crawling feature that quickly extracts the page's body text.
  • Vision Analysis: Analyzes the page by looking at the actual screen rather than just the text, extracting key information accurately without missing anything. Just add "vision analysis" to your request to use it.

When can you use it?

The URL Crawling tool is especially useful in these situations.

  • When you want to receive the entire content of a web page as text
  • When you want to analyze multiple web pages together
  • When you want to use web content as data
  • When you want to understand the content of a shared link

For example, you can naturally ask "https://www.example.com Scrape the entire content of this web page", "https://example.com/article Get the content of this page", or "https://en.wikipedia.org/wiki/AI Extract the body of this page". The AI will then use this tool to generate the result.

How to use it

Usage is simple. Just enter your request naturally in the input box like this.

URL + [Get content · extract · crawl expression]

Here are some examples: