Latent Action RL Shrinks Exploration Space for Multimodal Dialogue Fine‑Tuning

By learning a compact latent‑action space from paired image‑text and large‑scale text data, the authors reduce the RL search space from a vocabulary of over 150 k tokens to a 128‑codebook, enabling more efficient fine‑tuning of multimodal conversational agents and achieving consistent gains across several RL algorithms.

Vision-Language Modelsdialogue agentslatent actions

0 likes · 11 min read

Latent Action RL Shrinks Exploration Space for Multimodal Dialogue Fine‑Tuning