Samuel Li
I am a M.S. in Robotics student at Carnegie Mellon University advised by Prof. Katia Sycara. I recieved my B.S. in Mathematics & Computer Science from University of Illinois Urbana-Champaign, where I worked on computer vision with Prof. Yuxiong Wang and machine learning for climate prediction with Prof. Ryan Sriver.
I am currently researching zero-shot 3D vision (semantic decomposition and generative reconstruction) and robot manipulation guided by LLMs infused with symbolic knowledge. Outside of research and classes, I like to play tennis, cook, backpack, and spend time with my dog and cat.
Email /
Resume /
GitHub /
LinkedIn
|
|
|
ShapeGrasp: Zero-Shot Task-Oriented Grasping with Large Language Models through Geometric Decomposition
Samuel Li, Sarthak Bhagat, Joseph Campbell, Yaqi Xie, Woojun Kim, Katia Sycara, Simon Stepputtis
IROS (In Review), 2024
paper
/ website
We develop a novel and efficient zero-shot, task-oriented grasping pipeline constructing a symbolic graph from monocular RGB+D input for fine-grained, shape-based LLM reasoning.
|
|
Geometric Shape Reasoning for Zero-Shot Task-Oriented Grasping
Samuel Li, Sarthak Bhagat, Joseph Campbell, Yaqi Xie, Woojun Kim, Katia Sycara, Simon Stepputtis
ICRA 3D Visual Representations for Robot Manipulation Workshop, 2024
paper
We propose a lightweight zero-shot, task-oriented grasping approach utilizing LLMs for part-level semantic reasoning over geometric decompositions.
|
|
Let Me Help You! Neuro-Symbolic Short-Context Action Anticipation
Sarthak Bhagat, Samuel Li, Joseph Campbell, Yaqi Xie, Katia Sycara, Simon Stepputtis
RA-L (In Review), 2024
paper
/ website
We develop a novel modification to the transformer architecture for short-context action anticipation, enabling human-robot collaboration in real-world experiments.
|
|
YouTubePD: A Multimodal Benchmark for Parkinson’s Disease Analysis
Andy Zhou*, Samuel Li*, Pranav Sriram*, Xiang Li*, Jiahua Dong*, Ansh Sharma, Yuanyi Zhong, Shirui Luo, Maria Jaromin, Volodymyr Kindratenko, Joerg Heintz, Christopher Zallek, Yuxiong Wang
NeurIPS Datasets and Benchmarks Track, 2023
paper
/ website
We introduce the first publicly available Parkinson’s disease analysis benchmark and demonstrate the generalizability of our developed models to real-world clinical settings.
|
|
Skillful Prediction of UK Seasonal Energy Consumption based on Surface Climate Information
Samuel Li, Ryan Sriver, Douglas E. Miller
Environmental Research Letters, 2023
paper
/ code
We show how winter climate and energy demand values can be predicted two months in advance using surface climate information.
|
|
Enhancing Sample Efficiency via Affordance-Based Exploration
CMU 16-745 Optimal Control & Reinforcement Learning
2024-04-23
/ poster
With Yuchen Zhang, Yunchao Yao, and Yihan Ruan. We solve an optimal control problem on a robotic arm to accurately throw an object to a goal location.
|
|
Enhancing Sample Efficiency via Affordance-Based Exploration
CMU 16-831 Intro to Robot Learning
2023-12-16
/ paper
With Yunchao Yao, we leverage affordance understanding in foundation models for efficient, safe, and aligned task-conditioned exploration and learning for robotic manipulation.
|
|