![]() This post contains a few case examples where I have used web data scraping and the top ten of the most used web scraping tools that allow mere mortals (non-programmers) to harvest web data and sling it like Google. With the ability to scrape data quickly, I have harvested data for things as diverse as picking stocks to invest in, finding the right people to hire, and simply gather price and inventory information on our competitors. When I ran our optics company we hand-coded every web scrape, but today there are over 100 third-party tools that help people scrape the web even if they have no programming knowledge. I have often referred to web scraping as my swiss army knife because it helps me stay competitive in almost every situation. I still use data scraping tools every day for hundreds of different processes. We would then bring that data back and if profitable we would change our price to be the lowest on the web. ![]() We had bots that would go to all of our competitors and get their prices. One of the ingredients to our secret sauce was web scraping. ![]() We honestly thought we could compete with Amazon. 500 (now much easier as it is the inc 5000) more than three times. We were named by Internet Retailer as one of the best sites on the web and after reaching the Inc. We had the largest site on the web that sold Sunglasses, Binoculars, Telescopes and several other optics. As an early Internet optics company, we had a few niche e-commerce companies that were called “Category Killers”. The first company that I used web scraping for was (sold in 2006 to ). I have been scraping data from the web for over 20 years.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |