arrow_upward
background

RemembeRL: what can past experience tell us about our current action?

public Workshop
CoRL 2025
location_on COEX Convention & Exhibition Center
Seoul, South Korea
event Saturday
September 27th, 2025
schedule Start: 9.30 AM
End: 4.30 PM

Robot learning traditionally relies on applications of machine learning methods via the induction paradigm, i.e. where the agent extrapolates a policy in the form of a condensed, unified model given a set of training data. Under this formulation, training data is therefore discarded at test time, and the agent may no longer explicitly reason on past experience to inform its current action. In other words, the agent is not allowed to remember previous situations.
However, we observe that humans are able to conveniently recall past experiences to solve decision making problems, and notice a close connection with recent trends towards in-context learning, meta-learning, and retrieval-augmented inference in the Reinforcement Learning (RL) and Imitation Learning (IL) literature.

In this workshop, we investigate how robot learning algorithms can be designed for robotic agents to explicitly retrieve, reason, attend, or leverage on past experience to quickly adapt to previously unseen situations or bootstrap their learning.
Recent advances in the field allow agents to remember by framing the problem as in-context learning and meta-learning, e.g. by incorporating memory in the form of explicit, contextual input to a policy. Similarly, recent works propose retrieval mechanisms (retrieval-augmented policies) for agents to conveniently reason about the current action based on previous experience.

We then raise the question: "Should robots know, or remember how to act?"

Our objective is to understand the interconnection between the fields of in-context learning, meta-learning, transductive and retrieval-augmented inference for robot learning applications. In this context, we aim to discuss about recent contributions, challenges, opportunities and novel directions for future research.

help_outline Open questions for the community

  • Should robotic agents know or remember how to act?
  • How can past experience be integrated implicitly or explicitly in RL and IL algorithms?
  • Does reasoning on past experience improve agent performance even for tasks that do not require memory?
  • Can agents generalize their memory over unseen data and tasks? (e.g. in-context learning with OOD contexts)
  • What are the interconnections between in-context learning, meta-learning, and retrieval-based approaches?
In-context learning Meta learning Transductive inference Retrieval-augmented policies Memory-based policies Non-parametric policies Episodic memory & control

News

live_tv

Recording

Video recordings will be made available here in Program section aside each talk.

Invited Speakers & Panelists

Gunhee Kim

Gunhee Kim

Seoul National University
Abhishek Gupta

Abhishek Gupta

University of Washington
Steven Morad

Steven Morad

University of Macau
Chelsea Finn

Chelsea Finn

Stanford University
Hung Le

Hung Le

Deakin University
Sergey Levine

Sergey Levine

UC Berkeley
Dhruv Shah

Dhruv Shah

Princeton University, Google DeepMind
Animesh Garg

Animesh Garg

Georgia Institute of Technology

Program

Morning

9:30 - 9:40 AM Welcome
Opening remarks
9:40 - 10:10 AM Invited Talk 1
Gunhee Kim, Seoul National University
10:10 - 10:40 AM Invited Talk 2
Abhishek Gupta, University of Washington
10:40 - 11:30 AM Break Poster Session
Coffee break + Poster Session (Morning)
11:30 - 12:00 PM Invited Talk 3
Steven Morad, University of Macau
12:00 - 12:30 PM Invited Talk 4
Chelsea Finn, Stanford University

12:30 - 1:30 PM Break
Lunch

Afternoon

1:30 - 2:00 PM Invited Talk 5
Hung Le, Deakin University
2.00 - 2:05 PM Startup pitch
Paperedge.ai
2:05 - 2:30 PM Poster Spotlights
Spotlight talks 1, 2, 3
2:30 - 3:15 PM Break Poster Session
Coffee break + Poster Session (Afternoon)
3:15 - 3:45 PM Poster Spotlights
Spotlight talks 4, 5, 6
3:45 - 4:15 PM Panel Discussion
Sergey Levine, Dhruv Shah, Steven Morad, Animesh Garg
4:20 - 4:30 PM Closing
Closing remarks & AWARDS! 🏆

Organizers

Gabriele Tiboni

Gabriele Tiboni

University of Würzburg
public gabrieletiboni.com · Main organizer
Federico Ceola

Federico Ceola

Italian Institute of Technology (IIT)
Yat Long Lo

Yat Long Lo

Amazon
Wenyan Yang

Wenyan Yang

Aalto University
Vivienne Wang

Vivienne Wang

Aalto University
Carlo D'Eramo

Carlo D'Eramo

University of Würzburg

Advisory Board

Georgia Chalvatzaki

Georgia Chalvatzaki

TU Darmstadt
Tatiana Tommasi

Tatiana Tommasi

Politecnico di Torino

Call for Papers keyboard_arrow_down

Accepted Papers

Acknowledgements