Achieving seamless bulk data extraction despite a tight deadline.

The Fintech giant had more than 50,000 product contract documents that we needed to extract data from. As business intelligence consultants, we were required to extract data in a usable format and then migrate it to their contract management system. Additionally, the client wanted us to develop big data analytics dashboards for maintenance as part of their ongoing process.

We began the process by sorting the files. The client teams shared all the contract documents through secured FTP. Then, the offshore teams downloaded the documents on a US server. The cognitive extraction team read the documents and converted them from image to text formats. Once the documents were sorted, we grouped them into client folders.

Once we sorted the contract documents, we moved on to the extraction. For read-easy entities, we used cognitive extraction. Our team created a document extractor (web application) to render the documents for manual users and the complex entities were manually extracted.

Next, our QA team performed an audit check for data correctness and completeness. They also conducted a spot check on the final reviewed documents to uncover any errors. Errors, wherever present, were corrected, and the updates were saved. We also created dashboards and PowerBI reports on the data extracted as part of our advanced analytics solution.

We repeated this process for each of the 50,000 contract documents. Once we had uploaded the final extracted documents, we asked our client for a review and signoff.