This case study is the third in a series of studies that cover benchmarking of PatSeer’s AI Search against invention descriptions from different fields of science.
The previous case study showed bench marking for Ingestible sensors related patents. For the present case study, we have chosen a topic from the FMCG domain – Topical Skin Care Composition and we will match the quality of results against and invention description from this domain by doing a manual evaluation of patents title, abstract claims and summary of invention for each of the Top 10 results.
We built a sample invention description of our own that discussed a skincare composition. The composition’s purpose is to brighten the skin, reduce the likelihood of blemishes or help slow down the skin’s natural aging process and promote a vibrant, healthy skin. Finally, the skin care composition contains the following key elements:
- Salicylic Acid
- Vitamin C
- Plant & Fruit Extracts
And the compositions purpose is for:
- Wrinkle improvement & Elasticity enhancement
- Skin texture improvement & Whitening
- Antioxidation & Acne reduction
We ran the above invention description in PatSeer’s AI Search and a manual evaluation of first 10 records that showed up was done pertaining to the above key elements.
The following table shows the manual analysis based on the key elements for the first record that appeared in the AI search (KR20170076147A – Composition for Improving Skin):
| Key Elements | Claim Numbers matched | Reference from the claim | Overlap | Matched with Title, Abstract & Summary of Invention | Matched with Examples |
|---|---|---|---|---|---|
| Salicylic Acid | No overlap | No overlap | No overlap | ||
| Vitamin C | 1,2 | Pineapple, kiwi and Indian gooseberry as active ingredients | Full overlap | Full overlap | Full overlap |
| Fruit Extracts | 1,2 | Pineapple, kiwi and Indian gooseberry as active ingredients | Full overlap | Full overlap | Full overlap |
| Wrinkle improvement & Elasticity enhancement | 1,2 | The cosmetic composition for wrinkle improvement, elasticity enhancement, antioxidation, whitening, exfoliation, and skin texture improvement | Full overlap | Full overlap | Full overlap |
| Skin texture improvement & Whitening | 1,2 | Full overlap | Full overlap | Full overlap | |
| Antioxidation & Acne reduction | 1,2 | Full overlap | Full overlap | Full overlap |
Protecting traditional knowledge is essential to safeguarding cultural diversity and supporting sustainable growth. Integrating sui generis structures in existing IPR frameworks could provide an equitable approach to protecting TK while allowing for innovation and commercialization.
The ultimate goal of protecting traditional knowledge is not only about preserving the past but also about helping communities to flourish in the coming years. By aligning intellectual property practices with traditional knowledge holders’ needs and values, we can build a more equitable and sustainable world in which knowledge and economic growth can coexist in harmony.
The table lists all the elements mentioned in the paragraph, followed by the patent claim numbers in which the corresponding elements appeared. The next column shows the exact text from the patent claim that was matched against the key element. For e.g, ingestible sensors was matched with Ingestible device), the key components of an ingestible sensors usually include a sensor, data recorder and software which was matched with acoustic sensor and a data processing unit, and real time monitoring was matched with monitoring system. The fourth column indicates the extent of overlap between the paragraph and the claims of the patent document.
We can see that all the key elements mentioned in the paragraph were precisely covered in the claims of the first record identified through the AI Semantic search.
A similar analysis was done for the remaining set of records. We have consolidated all the results in a single table below.
We graded the records based on the overlaps, 1 point was assigned for full overlap, 0.5 was assigned for partial and 0 for no overlap. Based on the calculations done the final semantic performance score for the top 10 results in this case was 77%.
| Key Elements | ||||||
| Patent Number | Title of the patent | Ingestible sensors | Bodily function check | Key Components | Wireless transmission of data | Real time monitoring |
| US2017156632A1 | Ingestible devices and Methods for Physiological Status Monitoring | Full Overlap | Full Overlap | Full Overlap | Full Overlap | Partial Overlap |
| TW202000133A | An ingestible system to monitor gastrointestinal health in situ | Full Overlap | Partial Overlap | Partial Overlap | Full Overlap | Full Overlap |
| WO2022220317A1 | Ingestible health sensor for animal | Full Overlap | Partial Overlap | Full Overlap | Partial Overlap | Partial Overlap |
| US2017337330A1 | Systems, devices, and methods for ingestible event sensing and analysis | Full Overlap | No Overlap | Full Overlap | Full Overlap | Full Overlap |
| US2016198978A1 | Ingestible sensor, sensing method, and food | Full Overlap | Partial Overlap | Partial Overlap | Partial Overlap | Partial Overlap |
| US2008146871A1 | Ingestible low power sensor device and system for communicating with same | Full Overlap | Partial Overlap | Full Overlap | Full Overlap | Full Overlap |
| US2013261410A1 | System and method for body and in-vivo device, motion and orientation sensing and analysis | Full Overlap | No Overlap | Full Overlap | Full Overlap | Partial Overlap |
| US2002132226A1 | Ingestible electronic capsule | Full Overlap | Partial Overlap | Full Overlap | Partial Overlap | Partial Overlap |
| US2004054278A1 | Ingestible pill | Full Overlap | No Overlap | Full Overlap | Partial Overlap | No Overlap |
| US2014162305A1 | Patient in vivo gut diagnostic and treatment tool | Full Overlap | Partial Overlap | Full Overlap | Full Overlap | Partial Overlap |
As we can see, all the key elements mentioned in the paragraph were specifically covered in the title, abstract, claims and summary of invention of the first record identified through the AI search. The table shows all the key elements followed by the claim number and the corresponding text that overlapped with the paragraph. Next column showed the extent of overlap between the paragraph and the claims of this record.
The last two columns of the table also give an idea about the extent of overlap between the invention and title, abstract, summary of invention and description examples of the record.
A similar analysis was done for the remaining set of records. We have consolidated all the results in a single table below.
We graded the records based on the overlaps, 1 point was assigned for full overlap, 0.5 was assigned for partial and 0 for no overlap. Based on the calculations done the final semantic performance score for the top 10 results in this case was 86%.
| Key Elements | |||||||
| Patent Number | Title | Salicylic Acid | Vitamin C | Fruit Extracts | Wrinkle improvement & Elasticity enhancement | Skin texture improvement | Antioxidation, Acne reduction & Whitening |
| KR20170076147A | Composition For Improving Skin | No Overlap | Full Overlap | Full Overlap | Full Overlap | Full Overlap | Full Overlap |
| WO2023058993A1 | Composition For Anti-Aging and Skin Improvement, Comprising Complex Of Indian Gooseberry Extract And Barley Sprout Extract (Ib Complex) As Active Ingredient | No Overlap | Full Overlap | Partial Overlap | Full Overlap | Full Overlap | Full Overlap |
| IN201611022467A | Beauty Supplement | No Overlap | Full Overlap | Partial Overlap | Full Overlap | Full Overlap | Full Overlap |
| KR101682394B1 | Cosmetic Composition Comprising Color Food Extracts | Partial Overlap | Full Overlap | Full Overlap | Full Overlap | Full Overlap | Full Overlap |
| JP2016108253A | Skin-Care Cosmetic Composition | Full Overlap | Full Overlap | Partial Overlap | Full Overlap | Full Overlap | Full Overlap |
| CN115399478A | Beautifying And Whitening Composition and Whitening Health-Care Product | Partial Overlap | Full Overlap | Full Overlap | Full Overlap | Full Overlap | Full Overlap |
| KR20120139005A | Natural Cosmetic Composition, Skin Sheet and Storage Container Comprising the Same | Full Overlap | Full Overlap | Full Overlap | Full Overlap | Full Overlap | Full Overlap |
| CN110123719A | Skin care product containing compound fruit extract and preparation method thereof | No Overlap | Full Overlap | Partial Overlap | Full Overlap | Full Overlap | Full Overlap |
| CN105168063A | Skin Care Composition with Acne Removing Effect and Preparation Method Thereof | Full Overlap | Partial Overlap | No Overlap | No Overlap | Full Overlap | Full Overlap |
| US2019274977A1 | Topical Skin Care Compositions | Full Overlap | Full Overlap | Partial Overlap | Full Overlap | Full Overlap | Full Overlap |
PatSeer allows you to refine the original search results based on records that you identify as relevant and these additional steps help improve result quality further but, in the above study we benchmarked the results without any manual refinements.
To sum up, it’s important to make a detailed assessment of semantic search performance by using your own invention descriptions. In the current evaluation, PatSeer’s semantic search attained a relevance score of 86% which makes for a strong case to use AI searches for novelty searches and patentability assessments.
The above case study shown such an example from Skin care domain, and we hope to publish more studies from other domains soon.
