Selenium is definitely not built for scraping in and of itself, but I find that it’s a critical piece of any pipeline where JavaScript heavy rendering is involved. However, I find that I just simply use it to load and parse the page, and then just extract the HML to be parsed via BS4.

In other words, I use it kind of as a helper function to get HTML on JS pages to pass along to a more efficient and succinct parser.