automation

Automating repetitive tasks with scripts, from file handling to scheduled jobs.

Python: Web Scraping with BeautifulSoup

The data you need is sitting right there on a web page: product prices, job listings, book catalogs. No API, no download button, just HTML. Python BeautifulSoup is how you take it anyway: fetch the page with requests, parse the HTML into a searchable tree, and pull out exactly the elements you want. This guide runs the full pipeline, from your first parse to pagination and saving results. “Information is power. But like all power, there are those who want ... Read More

Python: Web Scraping with Selenium

You tried to scrape a page with BeautifulSoup and got back almost nothing. The data you saw in your browser just was not there in the HTML. That is the wall Python Selenium was built to climb. Selenium drives a real Chrome or Firefox, so it scrapes JavaScript-rendered pages, fills forms, clicks buttons, and reaches data that BeautifulSoup never sees. “Selenium is a web browser in your Python script’s hands.” Simon Stewart, creator of WebDriver Last Updated: July 2026 | ... Read More