PatSeer-Fi-Logo-Large.png

Case Study – Benchmarking PatSeer’s Semantic search relevance

Technology: OLED based flexible screen; Series: I of IV

Paster’s new AI Semantic search harnesses the power of advanced transformer-based LLM models specifically trained for patent data. The result is, greater precision and accuracy, ensuring highly relevant search results tailored to the user’s input paragraph or patent.  

The AI search is ideal for screening of new invention disclosures and for all novelty (or similar) patent search projects.  

Searching within patents by paragraphs (or natural language) isn’t new and has been present for more than a decade now. So, users must evaluate the relevance and accuracy of results across different semantic search tools manually as the functionality pretty much boils down to the accuracy and relevance of the top 20/50 results.   

In this series of case-studies, we aim to demonstrative the effectiveness of PatSeer’s AI search against invention descriptions from different fields of science by using a manual evaluation of the claims in the search results against the input paragraph. 

For the first case study we chose OLED (Organic Light Emitting Diodes) as the topic. We wrote a sample invention description of our own that covered the OLED based flexible screen device and the description included the following key elements:  

Key elements of the invention description:

  1. Flexible OLED (Organic Light Emitting Diode) panel 
  2. Flexible substrate made of polyimide or elastic material  
  3. Organic light-emitting diode layer 
  4. Thin-film transistor layer 

The analysis of the results and their relevance (in Claims) was done for the first 10 records of search results. The approach used was to manually assess how well the claims of the first 10 records overlapped with the key elements.   

The following table shows the Claims mapping of the key elements for the first record (US2020241676 – Organic Light Emitting Diode folding display) that showed up in the results:  

Key Elements  

Claim Numbers matched 

Reference text from the matching claim  

Type of match  

Flexible OLED (Organic Light Emitting Diode) panel 

1, 11 

organic light emitting diode (OLED) folding display 

Full overlap 

Flexible substrate made of polyimide 

1, 11, 16 

Base substrate made of polyimide  

Full overlap 

Organic light-emitting diode layer 

1, 11 

OLED device layer 

Full overlap 

Thin-film transistor layer 

1, 9, 11, 20 

thin film transistor array layer 

Full overlap 

We can see that variations of the key elements in the Invention disclosure are also automatically matched due to the contextual nature of the semantic search. The last column indicates the type of match between element and the patent claim and this is based on manual review. 

As we can see, all the key elements mentioned in the paragraph were specifically covered in the claims of the first record identified through the AI Semantic search. 

A similar analysis was done for all the top 10 records, and the results are given in the table below. Assigning 1 pts for full overlap, 0.5 pts for partial and 0 for no overlap, and by giving a weight in proportion to the position of each record in the result, the final semantic performance score for the top 10 results = 88.6% 

 

Key Elements Claims Mapping 

Patent Number 

Title  

Flexible OLED panel 

Flexible substrate made of polyimide or elastic Material 

Organic light-emitting diode layer 

Thin-film transistor layer 

US2020241676A1 

Organic Light Emitting Diode folding display 

Full overlap 

Full overlap 

Full overlap 

Full overlap 

US2020235322A1 

 

Flexible and foldable OLED display device 

Full overlap 

Full overlap 

Full overlap 

Full overlap 

US2021091317A1 

 

Organic Light Emitting Diode folding display panel and manufacturing method thereof 

Full overlap 

Partial Overlap 

Full overlap 

Full overlap 

WO2021056670A1 

 

OLED foldable display screen and manufacturing method therefor 

Full overlap 

Full overlap 

Full overlap 

Partial Overlap 

US2021408404A1 

 

Flexible Organic Light Emitting Diode display panel and foldable display device 

Full overlap 

Full overlap 

Full overlap 

No Overlap 

US2018061893A1 

Foldable display design with generalized layer mechanical compatibility 

Partial Overlap 

Partial Overlap 

Partial Overlap 

Full overlap 

US2021234129A1 

Flexible Organic Light Emitting Diode display panel 

Full overlap 

Full overlap 

Full overlap 

Full overlap 

US2021408467A1 

Foldable Organic Light Emitting Diode display panel and Organic Light Emitting Diode display screen 

Full overlap 

Partial Overlap 

Full overlap 

Full overlap 

CN111613607A 

Flexible Organic Light Emitting Diode display panel 

Full overlap 

Partial Overlap 

Full overlap 

Partial Overlap 

US2019131550A1 

 

Flexible OLED display panel and method for manufacturing same 

Full overlap 

Full overlap 

Partial Overlap 

Full overlap 

PatSeer allows you to refine and/or re-rank the original search results based on records that you identify as relevant and these additional steps help improve result quality further but, in the above study we benchmarked the results without any manual refinements.  

To sum up, its important to make a detailed assessment of semantic search performance by using your own invention descriptions. The above case study shown such an example from electronics domain, and we hope to publish more studies from other domains soon. 

PatSeer’s AI Semantic Searching can bring remarkable productivity improvements to your novelty or invalidity studies. Why not take a trial and see for yourself? 

Similar Blogs​

Scroll to Top
PatSeer
Play Video