Searching internet archive for URLs containing substring
WindowlessBasement @ WindowlessBasement @alien.top BOT Posts 1Comments 15Joined 2 yr. ago
WindowlessBasement @ WindowlessBasement @alien.top
BOT
Posts
1
Comments
15
Joined
2 yr. ago
Short answer: you're asking questions that will take a program requesting data (the whole internet archive?) non-stop for a month or more. You are gonna need to learn to code if you want to interact with that much data.
You're going to need to automate it. A rate-limiter is going to kick in very quickly if you are just spamming the API.
You need to learn for yourself if this is a project you are tackling. Also will need to familiarize yourself with the terms of service of the archive, because most services would consider scraping every piece of data they have as abusive behavior and/or malicious.