AskURL Bot

AskURL Bot is operated by AskURL for security analysis of URLs submitted by users.

Purpose

AskURL visits submitted URLs and may collect HTML, response headers, redirect information, page metadata, and resources required to analyze the page. It does not continuously crawl the web or independently discover websites for indexing. Results support the requesting user's security analysis.

Web Bot Auth

This endpoint publishes AskURL's Ed25519 public keys for HTTP Message Signatures:

Public key directory

Requests using this authentication method identify their signing service with:

Signature-Agent: "https://askurl.io"

They also include Signature-Input and Signature. A valid signature can establish the request's signing identity independently of the browser's User-Agent. The public key directory itself carries signatures proving possession of each listed key.

Publishing this directory does not establish Cloudflare registration, approval, or that all AskURL collectors have enabled request signing. Request verification and site access remain subject to each provider's configuration and the website operator's policy.

User-Agent and crawl behavior

Browser User-Agent values may differ by analysis environment. For signed requests, use the signature headers to verify the signing identity. Necessary redirects and page resources may be visited during analysis; AskURL attempts to avoid unnecessary repeat requests.

Contact

For traffic questions, abuse reports, or crawler-related inquiries, use the contact information on the AskURL website.