This particular scraper came about one Sunday afternoon while on the phone with an old friend. He had mentioned that while he loved reading manga, he hated having to use the website mangareader.net.
Thus, a challenge was set. How fast could I come up with a scraper that would, given a link, retrieve an entire manga from the website. This was the result.

The way the scraper works is rather simple. Given a link, it will then find every issue of the manga, and then find every page of every issue and download the image that corresponds to that page.

For this demo, mostly because of time constraints, I only retrieve the first 3 pages of the first 3 issue of any given manga. The provided link should be in the form of https://www.mangareader.net/mangaName

This scraper is specifically written to gather works from mangareader.net, and as such all links used must be from mangareader.net

Any attempt at using links from a different website will likely result in failure.

Original in Python 3, Web Version in Python 2

To help with testing 3 sample links are provided:

• https://www.mangareader.net/naruto
• https://www.mangareader.net/bleach
• https://www.mangareader.net/one-piece

The Daily Updater was the first scraper that I ever wrote, during my earlier stages of using both python as a language and linux as an environment.

As an avid game, I like to stay on top of the best deal when it comes to computer games, and so I created a tool that would compile a list of the top 25 special deal found on Steam.com
Soon after I decided to also add a second online game store, GOG.com
It was soon that I realized that considering that I was running a checking the results daily, it was better to automate the task, so the weather report and automatic email feature was added as well.

As it currently sits, every morning at 8am an email arrives letting me know what the weather forecast for the day is and what kind of special deals I might be able to find.

To use this demo simply provide the email address to which you would like the results received. The results will arrive in an email titled “Daily Report”, with as sender listed as homeserveranderson2@gmail.com (this being the gmail account I use to make use of their smtp server).

For easier viewing the test results are also returned to the page and placed in a collapsible section, though note that because the page will not recognize characters like /n, etc the formatting will appear wrong.

(NOTE: Window 10 default mail application seems to have some difficulty displaying the email body, despite the contents still being there)

Original in Python 3, Web Version in Python 2

The Fan-Fiction scraper was born from the agony of spending an entire week with no internet access.

Being unable to read as much as I usually do was incredibly mind-numbing and, once Internet access had been restored, I set out to ensure it was not something that ever occurred.

Taking the skills and knowledge I gained from writing other scraper I began creating the Fan-Fiction Scraper. It was while doing this that I came across a daunting problem (daunting at the time at least), fanfiction.net was dynamically loaded at runtime using javascript.

After countless hours of research I finally found a tool that would allow me to run said javascript and parse the page as the user would see it in a web browser.

This demo simply requires a sample link from an chapter of a story, at which point it will retrieve the story, any associated css file and any associated images (typically the story profile image), package it up into a directory, zip it and return the zip file, at which point it will be downloaded.

The zip file, will thus contain one xss26.css file, one profImg.jpg file and one Chapter#.htm file for every chapter in the story.

This scraper is specifically written to gather works from fanfiction.net, and as such all links used must be from fanfiction.net

Any attempt at using links from a different website will likely result in failure.

Original and Web Demo in Python 3.7

To help with testing 3 sample links are provided:

• https://www.fanfiction.net/s/7528351/1/A-Very-Xander-Christmas
• https://www.fanfiction.net/s/10784770/1/Harry-Potter-Geth
• https://www.fanfiction.net/s/10203356/1/Hell-Hath-No-Fury