HOME      WEB DEVELOPMENT      WEB DESIGN      PORTFOLIO      BLOG      ABOUT JS      CONTACT JS







Archive for the ‘Data Mining’ Category

Experts in Data Mining, Screen Scraping, and Import to a Single Source

Thursday, December 18th, 2008


Ok, it’s time to toot our own horn today.  I’ve seen plenty of blogs on this where businesses and individuals are looking to grab data from multiple sources (that they are allowed to scrape mind you), and combine it all into one grand application or database…often to no avail and leave very frustrated comments about their trials and tribulations.

Well, we’ve been doing this for quite a while and I felt as though it was time to let other folks know about it since there are a lot of opportunities for businesses to save on some soft employee costs, reduce overhead, and increase productivity and data.

A Quick Word About Why You Should Hire a Web Development/Design Company
This is where web development companies are worth their weight in gold.  Yes, I know there’s plenty of cookie cutter do it yourself websites out there, and they are great and very affordable.  But when you have an idea that is unique, or a situation that is unique, you really don’t want what is out there available for everyone else.  I mean, honestly…if Dell used a cookie cutter build your own computer plugin, would they really be all that different from the other 100 web stores that offer the same thing at approximately the same cost?  No, you’d probably go to the place that was unique, professional looking, and looked as though they actually spent some money building a better mousetrap.  Ok…so there’s my two cents why you should actually use us….on to the good stuff.

Why You Would Need an Expert in Data Mining and Screen Scraping
Let’s say you are a company in Arizona who has an idea to put together a site that puts together all of the latest reduction in homes for sale prices.  Now there’s a bunch of websites out there that you’ve contacted and said you’re going to promote this site and obviously push the business to the various real estate agents involved.  Now comes the fun….gathering this data on a daily basis and putting it all into your application.  That’s where Justice Solutions comes in.

Grab Data, Massage Data, Import Data, Display Data
So now you hire Justice Solutions to do this seemingly impossible task.  We now take the web addresses of these various sites and create an application that will go out to each one, identify the way each site displays its data, grab it (even if it’s on multiple pages), and then perform some massaging scripts that will convert any text data into price data, etc.  We then import that data into your master database which will then be used to display the data to your website users in a unique format specific to your website.

Why It’s So Difficult
The reason this is usually such a daunting task is because if you’re not used to it, trying to identify data patterns and other things that go into dealing with data from multiple sources can be quite overwhelming.  Also, you have to be able to automate all of it so it happens quickly and without much user intervention.

We’ll Toot Today
So if you or a person you know has an idea like this, or an existing business that would benefit from this type of application, please refer them to us.  We gladly pay referral fees and would be happy to help in easing the fears of this commonly thought of, but rarely successful, business model.  Contact info@justicesolutionsllc.com for more information.

Until next time…happy coding…and mining….

Doug.