Big Data Analytics for Search Intelligence – Information System

Client Overview

An online technical reference collection provider, our client, helps practising engineers and applied scientists around the world to solve complex problems by providing relevant and reliable technical information, best practice insights, validated materials and substances data.

The client was expanding their portal with more content from its library for better performance. To keep pace with the content release, strategic engagement has been done by the client.

Business Challenge

• The client was expanding their existing information management portal with more content from its library to generate more exposure to its customers.
• They wanted an intelligent data search, data analytics and management system to handle and process a large chunk of data more efficiently.
• To keep pace with the content release, they wanted to have a strategic engagement plan in place.

Solution Highlights

A big data analytics solution with segments such as file system (Hadoop), databases or data stores and search (Apache Solr and SQL). Cloud-based Big-data analytics solution integrating technical information with analytical and search tools with a precise focus on the engineering and scientific community.

• An optimized, intelligent & fast search framework facilitating geospatial and document search operations from large data sets (200+ GB) clustered and stored across multiple Solr servers
• Big data infrastructure with over 40 virtual servers under the load balancer serving capacity of 500 requests per second with over 100 concurrent users
• Supports intelligent search from 6 million documents in less than 2 secs
• Apache-Solr powered fast-faceted document search
• Analysis engine to handle and process a large chunk of the data size of approximately 1TB
• API-level indexing through integrated search functionality of Lucene for a powerful search or hit prioritization and highlighting

Benefits

• Increased contextual search accuracy with machine learning to understand and respond to query
• Improved solution performance with quick document processing
• Increased precision in data acquisition
• Enhanced optimization in search capabilities with searching multi-million text, files, tables, graph, equations etc.
• Intuitive & interactive dashboards with real-time data insights