Benchmarking Intelligent Agents for Visual Food Recognition Against Manual Logging
Disciplines
Computer Engineering | Nutrition
Abstract (300 words maximum)
Accurate dietary tracking is crucial for nutrition management, but manual food logging can be time-consuming. This study benchmarks intelligent vision agents from Google, Anthropic, and OpenAI against MyFitnessPal user logs to assess their accuracy in food recognition and macronutrient estimation. We evaluate performance based on precision, recall, and mean absolute error (MAE) for calories, protein, carbohydrates, and fats.
Beyond accuracy, we analyze usability concerns, including ease of use, error correction, and adaptability to complex meals. Our findings highlight the strengths and limitations of AI-driven tracking compared to manual logging, providing insights into the future of automated nutrition assessment.
Academic department under which the project should be listed
CCSE - Computer Science
Primary Investigator (PI) Name
Maria Valero
Benchmarking Intelligent Agents for Visual Food Recognition Against Manual Logging
Accurate dietary tracking is crucial for nutrition management, but manual food logging can be time-consuming. This study benchmarks intelligent vision agents from Google, Anthropic, and OpenAI against MyFitnessPal user logs to assess their accuracy in food recognition and macronutrient estimation. We evaluate performance based on precision, recall, and mean absolute error (MAE) for calories, protein, carbohydrates, and fats.
Beyond accuracy, we analyze usability concerns, including ease of use, error correction, and adaptability to complex meals. Our findings highlight the strengths and limitations of AI-driven tracking compared to manual logging, providing insights into the future of automated nutrition assessment.