Web Scraping Project

[ravens2010]

I have built a web scraper that does a great job of pulling information out of a standard HTML page for me, looking to see which of my competitors was involved in building the actual website (in the schools industry).  I would like to be able to use a scraper to look at a school's URL to find out what their tuition was.  The problem is that there is no standard convention to tell the scraper to go find.  Some schools might use school.com/admission/tuition and some may use school.com/admissions/finance or some may use something completely different to find the information.

 

Does anyone have any creative way to use the web scraping concept to try and locate this data to parse out to a "tuition" field in the database?

 

Thanks.

Jesse