3 of 3 routes on responsive originswww.minifetch.com
minifetch
Check if a URL is allowed to be fetched according to the website's robots.txt file. Use this super-cheap endpoint before using our other paid endpoints to avoid spending extra on un-fetchable URLs
3
resources
1
data sources
2
network identifiers
0
registry calls / 30d
RESOURCE SAMPLE · 3 OF 3
search all →GET
Check if a URL is allowed to be fetched according to the website's robots.txt fi...
https://www.minifetch.com/api/v1/x402/preflight/url-check
no live 402 · origin reachable
GET
https://www.minifetch.com/api/v1/x402/extract/url-metadata
https://www.minifetch.com/api/v1/x402/extract/url-metadata
no live 402 · origin reachable
GET
https://www.minifetch.com/api/v1/x402/extract/url-preview
https://www.minifetch.com/api/v1/x402/extract/url-preview
no live 402 · origin reachable