AIBeyond position: how rotary embeddings shape representations and memory in autoregressive transfomers Oct 24, 2024 userComment on Beyond position: how rotary embeddings shape representations and memory in autoregressive transfomers Authors: Valeria Ruscio, Fabrizio Silvestri Abstract: Rotary Positional Embeddings (RoPE) enhance positional encoding in Transformer
AITraining Free Guided Flow Matching with Optimal Control Oct 24, 2024 userComment on Training Free Guided Flow Matching with Optimal Control Authors: Luran Wang, Chaoran Cheng, Yizhen Liao, Yanru Qu, Ge Liu Abstract: Controlled generation with
AITowards Reliable Evaluation of Behavior Steering Interventions in LLMs Oct 23, 2024 userComment on Towards Reliable Evaluation of Behavior Steering Interventions in LLMs Authors: Itamar Pres, Laura Ruis, Ekdeep Singh Lubana, David Krueger Abstract: Representation engineering methods have
AILearning Precise, Contact-Rich Manipulation through Uncalibrated Tactile Skins Oct 23, 2024 userComment on Learning Precise, Contact-Rich Manipulation through Uncalibrated Tactile Skins Authors: Venkatesh Pattabiraman, Yifeng Cao, Siddhant Haldar, Lerrel Pinto, Raunaq Bhirangi Abstract: While visuomotor policy
AIJMMMU: A Japanese Massive Multi-discipline Multimodal Understanding Benchmark for Culture-aware Evaluation Oct 23, 2024