Best Design For A Crawling Web Service?

Written by Make Money Online on January 24th, 2010 in Web Traffic.
Tags: , , ,


Making Money Idea "Write article, put Adsense code, Chitika, Amazon etc You can earn money every single day !" register at DeVUSE System


I’m developing a web service which returns the latest stock prices on a market. I’ve no access to the stock data. Instead I chose to scrap a HTML page to generate the data. At present my web service will do this scrapping whenever accessed. There is a performance flaw on this approach. The traffic of my hosting server shoots up for each of the service invocation. So I’ve two solutions to cut down the traffic.
1. Using a windows service that scraps the source HTML page in regular intervals and update a database, which will be read by the web service whenever invoked and returns the updated stock price.
2. Make the web service to update the database after scraping the HTML page, so that requests in next 10 minutes (or so) will get the data from the database, rather than scrapping the HTML page for every request.
For an user base of say 100, what will be optimal solution and why? Can you suggest a good choice for me?


You might like :

Advertisement

            

                             

2 Responses to “Best Design For A Crawling Web Service?”

  1. Ask Expert Live says:

    It is not that easy. May be you can contact an ASP.NET expert. Check websites like http://oktutorial.com/

  2. I love this site! Great post btw.. really interesting!

Leave a Reply

Join DeVUSE System and Earn Money With Us
Advertisement

For spam filtering purposes, please copy the number 5872 to the field below:



Site Navigation

Powered by WP Robot