“It’s easy to get lost in the depths of the Internet, and you might be wondering how to keep track of all those sites that interest you without having to visit them every day to check for updates. While RSS feeds are an option, when dealing with showcase or institutional sites, there’s not much to do besides visiting them occasionally.
Whether you’re a tech enthusiast, a web developer, or simply someone who wants to stay up to date with updates from your favorite sites, I have a solution for you: web.Monitor.
web.Monitor is an awesome tool for tracking website changes in real-time. No more manually checking sites for updates! Imagine being notified as soon as your favorite site publishes a new article or when a new version of your favorite software is available. Thanks to web.Monitor, you can now do this easily.
This small, free, command-line software is quick and easy to use, offering continuous monitoring, flexible configuration, persistent storage, detailed logging, notifications, viewing changes, domain filtering, automation, and personalization. The icing on the cake is that it supports notifications, allowing you to send updates to your Telegram, Slack, and Discord, so you never miss an alert!
To configure web.Monitor, start by setting the binaries path in the web-monitor.ini.
To add a URL to the database, you can use the following commands to track a list of sites or just one site:
python3 web.monitor.py --add-urls urls.txt
python3 web.monitor.py --add easy-tutorials.comNotifications will then be sent after the first scan.
To scan all URLs in a root domain, you can also use:
python3 web.monitor.py -df roots.txt --check -H 1
python3 web.monitor.py -D easy-tutorials.com --check -H 1
The -df parameter scans all URLs in a root domain. For example, if the URLs admin.site.com and admin.site2.com are in the database, and the roots.txt file contains only *.site.com, the crawl will be on *.site.com.
The -D flag, for its part, only analyzes the URLs of the site indicated in the command. The -H parameter is used to specify that the domain will be scanned every 1 hour, and of course, you can customize this. The recommendation is to scan every 12 or 24 hours to avoid getting blacklisted or DDoS the sites.
And if you want to display the changes in a specific domain, here is the command you need:
python3 web.monitor.py -D easy-tutorials.com --show-changesSo, thanks to web.Monitor, you can now track changes to your favorite sites effortlessly. No more manual checks and frantic updates. It’s time to relax and let this Python script do the work for you!
"Because of the Google update, I, like many other blogs, lost a lot of traffic."
Join the Newsletter
Please, subscribe to get our latest content by email.
