计算机科学
稳健性(进化)
人工智能
工作流程
适应性
机器学习
分割
可靠性(半导体)
图像分割
数据挖掘
图像处理
计算机视觉
灵活性(工程)
可视化
数据驱动
图像(数学)
作者
Pitikorn Khlaisamniang,Kun Kerdthaisong,Supasate Vorathammathorn,Nutchanon Yongsatianchot,Hirunkul Phimsiri,Amrest Chinkamol,Teermade Thitseesaeng,Kanyakorn Veerakanjana,Kaisorn Kachai,Piyalitt Ittichaiwong,Tossaporn Saengja
出处
期刊:
[Institute of Electrical and Electronics Engineers]
日期:2025-06-11
卷期号:: 482-491
被引量:8
标识
DOI:10.1109/cvprw67362.2025.00053
摘要
Accurate estimation of nutritional information from food images remains a challenging problem. Most existing approaches rely on deep image models fine-tuned with extensive food annotations or require detailed user inputs (e.g., portion size, cooking method), both of which are prone to error. Motivated by the workflow of nutrition experts, we propose a two-step prompting framework leveraging off-the-shelf Multimodal Large Language Models (MLLMs). The first step deconstructs the dish into its components listing major ingredients, portion sizes, and cooking details while the second step computes total calories and macronutrients. This approach alleviates the need for heavy fine-tuning or large ingredient databases, by instead harnessing the compositional reasoning capabilities of general MLLMs. We evaluate the method on both a subset of the Nutrition5k dataset (Nutrition320) and real-world samples from the Gindee application (Gindee121), achieving more accurate estimates than one-step direct queries. Additional experiments with visual prompts (bounding boxes, segmentation masks) further demonstrate the robustness and adaptability of our approach. Notably, our findings reveal that guiding MLLMs through a structured two-step reasoning process–separating “what is on the plate” from “how it translates nutritionally”–substantially improves the reliability of image-based macronutrient estimation.
科研通智能强力驱动
Strongly Powered by AbleSci AI