Case Study III of IV– Benchmarking PatSeer’s Semantic search relevance

The table lists all the elements mentioned in the paragraph, followed by the patent claim numbers in which the corresponding elements appeared. The next column shows the exact text from the patent claim that was matched against the key element. For e.g, ingestible sensors was matched with Ingestible device), the key components of an ingestible sensors usually include a sensor, data recorder and software which was matched with acoustic sensor and a data processing unit, and real time monitoring was matched with monitoring system.  The fourth column indicates the extent of overlap between the paragraph and the claims of the patent document. 

We can see that all the key elements mentioned in the paragraph were precisely covered in the claims of the first record identified through the AI Semantic search. 

A similar analysis was done for the remaining set of records. We have consolidated all the results in a single table below.  

We graded the records based on the overlaps, 1 point was assigned for full overlap, 0.5 was assigned for partial and 0 for no overlap. Based on the calculations done the final semantic performance score for the top 10 results in this case was 77%.