Jump to content
View in the app

A better way to browse. Learn more.

FMForums.com

A full-screen app on your home screen with push notifications, badges and more.

To install this app on iOS and iPadOS
  1. Tap the Share icon in Safari
  2. Scroll the menu and tap Add to Home Screen.
  3. Tap Add in the top-right corner.
To install this app on Android
  1. Tap the 3-dot menu (⋮) in the top-right corner of the browser.
  2. Tap Add to Home screen or Install app.
  3. Confirm by tapping Install.

Web Scraping Project

Featured Replies

I have built a web scraper that does a great job of pulling information out of a standard HTML page for me, looking to see which of my competitors was involved in building the actual website (in the schools industry).  I would like to be able to use a scraper to look at a school's URL to find out what their tuition was.  The problem is that there is no standard convention to tell the scraper to go find.  Some schools might use school.com/admission/tuition and some may use school.com/admissions/finance or some may use something completely different to find the information.

 

Does anyone have any creative way to use the web scraping concept to try and locate this data to parse out to a "tuition" field in the database?

 

Thanks.

Jesse

Create an account or sign in to comment

Important Information

By using this site, you agree to our Terms of Use.

Configure browser push notifications

Chrome (Android)
  1. Tap the lock icon next to the address bar.
  2. Tap Permissions → Notifications.
  3. Adjust your preference.
Chrome (Desktop)
  1. Click the padlock icon in the address bar.
  2. Select Site settings.
  3. Find Notifications and adjust your preference.