Crawler

A naive crawler for website. Return raw content in markdwon format.

Try it in the Widget Center

Click this url to try this widget and copy the Pro Config template.

Usage

Given the target website url, return the markdown string of the content

Input Parameters

NameTypeDescriptionDefaultRequired

url

string

The target website url

Output Parameters

NameTypeDescriptionFile Type

markdown_string

string

The raw content of given url

Output Example

{
  "markdown_string": "Title: MyShell - An Ultimate Place for AI Apps Creation, Discover, and Earn\n\nURL Source: https://app.myshell.ai/explore\n\nMarkdown Content:\nExplore\n-------\n"
}

Last updated