Depending on what you want to scape, that's a lot of overkill and overcomplication. Full website testing frameworks may not be necessary to scrape. Python with it's tooling and package management may not be necessary.
I've recently extracted and downloaded stuff via Nushell.
Requirement: Knowledge of CSS Selectors
Inspect Website DOM in Webbrowser web developer tools
Identify structure
Identify adequate selectors; testable via browser dev tools console document.querySelectorAll()
Get and query data
For me, my command line terminal and scripting language of choice is Nushell:
nu
let $html = http get 'https://example.org/'
let $meta = $html | query web --query '#infobox .title, #infobox .tags' | | { title: $in.0.0 tags: $in.1.0 }
let $content = $html | query web --query 'main img' --attribute data-src
$meta | save meta.json
or
nu
1..30 | each {|x| http get $'https://example.org/img/($x).jpg' | save $'($x).jpg'; sleep 100ms }
Depending on the tools you use, it'll be quite similar or very different.
Selenium is an entire web-browser driver meaning it does a lot more and has a more extensive interface because of it; and you can talk to it through different interfaces and languages.
YouTube channels can be terminated for both repeated copyright infringement and community guideline violations. In these cases, revenues are often withheld as well. It’s possible, however, that linked AdSense accounts are treated differently.
AdSense policies can be confusing, but based on additional information provided by Google’s AI, YouTube copyright bans are most likely to result in AdSense terminations too.
This is the first time I read of an AI as a source / AI being a source for an article.
Kissaki @ Kissaki @lemmy.dbzer0.com Posts 2Comments 123Joined 2 yr. ago 