AIBeyond position: how rotary embeddings shape representations and memory in autoregressive transfomers Oct 24, 2024 userComment on Beyond position: how rotary embeddings shape representations and memory in autoregressive transfomers Authors: Valeria Ruscio, Fabrizio Silvestri Abstract: Rotary Positional Embeddings (RoPE) enhance positional encoding in Transformer
AITP-Eval: Tap Multimodal LLMs’ Potential in Evaluation by Customizing Prompts Oct 24, 2024 userComment on TP-Eval: Tap Multimodal LLMs’ Potential in Evaluation by Customizing Prompts Authors: Yuxuan Xie, Tianhua Li, Wenqi Shao, Kaipeng Zhang Abstract: Recently, multimodal large language models
AITowards Reliable Evaluation of Behavior Steering Interventions in LLMs Oct 23, 2024 userComment on Towards Reliable Evaluation of Behavior Steering Interventions in LLMs Authors: Itamar Pres, Laura Ruis, Ekdeep Singh Lubana, David Krueger Abstract: Representation engineering methods have
AILearning Precise, Contact-Rich Manipulation through Uncalibrated Tactile Skins Oct 23, 2024 userComment on Learning Precise, Contact-Rich Manipulation through Uncalibrated Tactile Skins Authors: Venkatesh Pattabiraman, Yifeng Cao, Siddhant Haldar, Lerrel Pinto, Raunaq Bhirangi Abstract: While visuomotor policy
AIJMMMU: A Japanese Massive Multi-discipline Multimodal Understanding Benchmark for Culture-aware Evaluation Oct 23, 2024