Jump to content
Server Maintenance This Week. ×

Web Scraping Project


ravens2010

This topic is 4053 days old. Please don't post here. Open a new topic instead.

Recommended Posts

I have built a web scraper that does a great job of pulling information out of a standard HTML page for me, looking to see which of my competitors was involved in building the actual website (in the schools industry).  I would like to be able to use a scraper to look at a school's URL to find out what their tuition was.  The problem is that there is no standard convention to tell the scraper to go find.  Some schools might use school.com/admission/tuition and some may use school.com/admissions/finance or some may use something completely different to find the information.

 

Does anyone have any creative way to use the web scraping concept to try and locate this data to parse out to a "tuition" field in the database?

 

Thanks.

Jesse

Link to comment
Share on other sites

This topic is 4053 days old. Please don't post here. Open a new topic instead.

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...

Important Information

By using this site, you agree to our Terms of Use.