Samuel Li

I am a M.S. in Robotics student at Carnegie Mellon University advised by Prof. Katia Sycara. I recieved my B.S. in Mathematics & Computer Science from University of Illinois Urbana-Champaign, where I worked on computer vision with Prof. Yuxiong Wang and machine learning for climate prediction with Prof. Ryan Sriver.

I am currently researching zero-shot 3D vision (semantic decomposition and generative reconstruction) and robot manipulation guided by LLMs infused with symbolic knowledge. Outside of research and classes, I like to play tennis, cook, backpack, and spend time with my dog and cat.

Email  /  Resume  /  GitHub  /  LinkedIn

profile photo


Research

project image

ShapeGrasp: Zero-Shot Task-Oriented Grasping with Large Language Models through Geometric Decomposition


Samuel Li, Sarthak Bhagat, Joseph Campbell, Yaqi Xie, Woojun Kim, Katia Sycara, Simon Stepputtis
IROS (In Review), 2024
paper / website

We develop a novel and efficient zero-shot, task-oriented grasping pipeline constructing a symbolic graph from monocular RGB+D input for fine-grained, shape-based LLM reasoning.

project image

Geometric Shape Reasoning for Zero-Shot Task-Oriented Grasping


Samuel Li, Sarthak Bhagat, Joseph Campbell, Yaqi Xie, Woojun Kim, Katia Sycara, Simon Stepputtis
ICRA 3D Visual Representations for Robot Manipulation Workshop, 2024
paper

We propose a lightweight zero-shot, task-oriented grasping approach utilizing LLMs for part-level semantic reasoning over geometric decompositions.

project image

Let Me Help You! Neuro-Symbolic Short-Context Action Anticipation


Sarthak Bhagat, Samuel Li, Joseph Campbell, Yaqi Xie, Katia Sycara, Simon Stepputtis
RA-L (In Review), 2024
paper / website

We develop a novel modification to the transformer architecture for short-context action anticipation, enabling human-robot collaboration in real-world experiments.

project image

YouTubePD: A Multimodal Benchmark for Parkinson’s Disease Analysis


Andy Zhou*, Samuel Li*, Pranav Sriram*, Xiang Li*, Jiahua Dong*, Ansh Sharma, Yuanyi Zhong, Shirui Luo, Maria Jaromin, Volodymyr Kindratenko, Joerg Heintz, Christopher Zallek, Yuxiong Wang
NeurIPS Datasets and Benchmarks Track, 2023
paper / website

We introduce the first publicly available Parkinson’s disease analysis benchmark and demonstrate the generalizability of our developed models to real-world clinical settings.

project image

Skillful Prediction of UK Seasonal Energy Consumption based on Surface Climate Information


Samuel Li, Ryan Sriver, Douglas E. Miller
Environmental Research Letters, 2023
paper / code

We show how winter climate and energy demand values can be predicted two months in advance using surface climate information.




Projects

project image

Enhancing Sample Efficiency via Affordance-Based Exploration


CMU 16-745 Optimal Control & Reinforcement Learning
2024-04-23
/ poster

With Yuchen Zhang, Yunchao Yao, and Yihan Ruan. We solve an optimal control problem on a robotic arm to accurately throw an object to a goal location.

project image

Enhancing Sample Efficiency via Affordance-Based Exploration


CMU 16-831 Intro to Robot Learning
2023-12-16
/ paper

With Yunchao Yao, we leverage affordance understanding in foundation models for efficient, safe, and aligned task-conditioned exploration and learning for robotic manipulation.


Design and source code from Leonid Keselman's Jekyll fork of Jon Barron's website