Real Time Automatic Data Extraction System for Effective Sourcing

ThinkCol built a real time automatic data extraction system for a world leading aircraft distributor. Business users originally had to go through a multitude of aviation websites and copy various pricing and inventory information back to their internal system. With some quotations requiring more than 1,000 searches, staff had to spend hours in retrieving and inputting information. Not only was this time-consuming, it was also error-prone.

ThinkCol’s system allows the business users to input the part number he/she wants to search for and automatically generates the needed information into the organization’s data base with a customized user interface. The customized user interface will run multiple scraping services that ThinkCol deployed on to AWS. ThinkCol’s system uses AWS services extensively to ensure that there is no downtime in the scraping and in the web application.

A minimum of 500 hours of manual searching and information inputting have now transformed to a fraction of what was needed. The system is now being used in Hong Kong and its global offices.