About This Project
Could an affordable robot reliably pick up and deliver bites of food? We hypothesize that an SO-101 arm using camera-based bite selection and pickup verification can successfully deliver at least 80% of bites in controlled tests. We will run 150 trials across five food types and measure acquisition, transfer, spillage, timing, and failure detection. Tests will use a soft mannequin, not people. We will openly share the design, code, data, failures, and results.
Ask the Scientists
Join The DiscussionWhat is the context of this research?
Eating independently is easy to take for granted. People with limited arm or hand movement may need help throughout a meal, reducing privacy and placing demands on caregivers. Prior research shows that robots can learn different skewering strategies for foods with different physical properties, while combining vision and touch can improve acquisition of unfamiliar foods. Other work reports that a general-purpose utensil can acquire varied foods at 80% or greater success. We will test whether these capabilities can be reproduced on the inexpensive, open-source LeRobot SO-101. We hypothesize that it can achieve at least 80% end-to-end success in four of five controlled food conditions when camera-based bite selection is paired with pickup verification.
What is the significance of this project?
A practical, affordable feeding assistant could help people with limited upper-body mobility participate in meals with greater independence and dignity. Before such a system can be tested with people, however, it must reliably handle everyday variation: foods move, deform, slip, and may not remain on a utensil. This project focuses on those basic technical challenges and on detecting failures rather than assuming every attempt succeeds. The results will show what a low-cost robot can and cannot do, identify the main barriers to safe operation, and provide open designs, code, data, and evaluation methods that other researchers can reproduce and improve.
What are the goals of the project?
I will evaluate the Lerobot SO-101, which is low cost, compact open-source tabletop robot arm. There will be 150 trials: 30 each with banana, strawberry, tofu, melon, and pasta, representing soft, slippery, deformable, firm, and loose foods. Trial order will be randomized. A trial succeeds when the robot acquires a bite and delivers it to the fixed mannequin target without dropping it. We will also record acquisition success, transfer success, spillage, cycle time, and whether the system correctly detects a failed pickup. Our Phase 1 benchmark is at least 80% end-to-end success in four of five food conditions, at least 90% failure-detection accuracy, and no more than 10% drops or spills. These are research thresholds for controlled mannequin testing, not evidence of safety for human use.
Budget
These funds will allow us to build and evaluate a complete low-cost robotic feeding prototype. The SO-101 arm will perform food acquisition and transfer, while cameras and force sensors will help the system locate food, confirm successful pickup, and detect contact or failure. Safety equipment, compliant utensils, and a soft mannequin will allow controlled testing without human participants. Computing and storage will support model training and analysis.
Endorsed by
Project Timeline
The project will run for six months. We will first assemble the robot and safety systems, then collect demonstrations and develop food acquisition, verification, and transfer capabilities. The final phase will test the complete system across different foods, analyze failures, and publish the designs, code, data, videos, and results for backers and researchers.
Sep 30, 2026
Project Launched
Oct 15, 2026
Real world testing with mannequin and immediate team
Nov 06, 2026
Prototype and safety system assembled
Dec 31, 2026
Train policies and iteratively test
Jan 29, 2027
Food detection model
Meet the Team
This project is led by Ayush Shah, an independent robotics researcher and builder with hands-on experience in Lerobot SO-101 hardware, robot simulation, learning systems, evaluation, and safety-focused control software.
Ayush Shah
I am an independent robotics researcher and builder focused on affordable robot learning and safe physical interaction. I became interested in robotics while exploring the gap between advances in artificial intelligence and the difficulty of acting reliably in the physical world.
I have commissioned and calibrated SO-101 hardware, recorded synchronized robot and wrist-camera observations, and built Project Atlas, an SO-101 manipulation research platform. It includes MuJoCo simulation, behavior-cloning and DAgger training pipelines, evaluation tools, hardware calibration checks, and a safety supervisor that rejects stale or out-of-bounds commands.
My earlier work includes Loop, an autonomous RC car involving computer vision and closed-loop control, and VineVision, a camera-based greenhouse system for capturing plant data and supporting automated phenotyping which gained $10k in funding and the opportunity to present at the Ministry of Ontario Agriculture Conference. I also contributed to the connected and automated vehicle team within the University of Waterloo Alternative Fuels Team. Our team at UWAFT were North American finalists at the 28th International Conference for Enhanced Safety of Vehicles with a low-cost 2D lidar based safety awareness system. These projects gave me practical experience integrating cameras, sensors, embedded hardware, software, and learning-based systems. More of my work is available on my public GitHub profile.
Lab Notes
Nothing posted yet.
Additional Information
This is an early-stage research prototype, not a medical device. No human feeding trials are included in this phase. Motion will be limited by fixed workspace boundaries, low speed and acceleration, an emergency stop, and a compliant or breakaway utensil mount. We will publish the hardware design, software, experimental protocol, anonymized performance data, and unsuccessful results. Success will mean producing reproducible evidence about reliability and failure modes, rather than claiming that the system is ready for unsupervised use.
Project Backers
- 0Backers
- 0%Funded
- $0Total Donations
- $0Average Donation


