Vision Pack - Food Detection



Vision Pack Food Detection (VPF) Engine recognizes food items inside a refrigerator and converts the data into usable information.

This engine uses image data taken by cameras installed in the DID (Door-in-Door) and the crisper drawer of a refrigerator as input values. It uses visual recognition technology to recognize food from the image data collected, and processes the data to provide the user with food names, types, and locations within the refrigerator. For example, if there is a can of cola in the DID, the engine informs the user of the cola’s location. If the user puts an apple inside the crisper drawer, the engine tells the user that an apple has been added to the crisper drawer.

VPF Engine can use its user learning function to register/edit/delete/identify a tag for the food that it recognized as a user's food. When the food is added to the refrigerator, the engine recognizes it and assigns a relevant tag to the food. A user can edit the tag assigned to the food, and the engine learns the food with the tag that the user-edited. Afterwards, when a food item similar to the learned food is added to the refrigerator, VPF Engine assigns the user's tag that it learned to the food. For example, when the user adds a “green juice” to the refrigerator, the engine recognizes the food and assigns a “juice” tag. But, if the user changes the “juice” tag into a “diet juice” tag, the engine learns the food with the tag. Afterwards, when the user adds a food item similar to the food that it learned to the refrigerator, the engine assigns a “diet juice” tag, not a “juice” tag, to the food.


Process of VPF Engine


VPF Engine by ThinQ.AI supports the following features:

Vision Pack 식품인식 엔진의 특징
Feature Description
Food recognition  

Recognizes more than 2,000 types of food:

  • Food inside the DID: 2,200+ types recognized
  • Produce inside the crisper drawer: 20+ types recognized
Various service applications The engine can be used for various services such as food management, recipe recommendations, and online food purchases.
Ease of use

Since it supports Rest API, you can easily develop food recognition functions using HTTP.

Excellent image recognition The engine uses the latest deep learning technology to provide the best recognition performance.
Fast response time Fast response time with an optimized recognition engine.
Wide recognition range The engine recognizes not only food items in the DID, but also produce in the crisper drawer.
User Learning A user can register/edit/delete/identify a food tag.


Engine Architecture

VPF Engine receives image data as input values, extracts usable information from the input values, and sends the result to the application.


Architecture of VPF Engine


Examples of Use

VPF Engine can be used in various ways during everyday life.


  • Checks and manages the food in the refrigerator

The engine checks the food in the refrigerator and informs the user of food with an approaching expiration date.

  • Recommends food recipes

The engine recommends recipes for meals that utilize the food stored in the refrigerator.

  • Helps you order groceries online

If the food you need is not in the refrigerator, the engine helps you place an online order with ease.