Computation and Language

Authors and titles for June 2024

[2351] arXiv:2406.18626 (cross-list from q-bio.QM) [pdf, html, other]

Title: An LLM-based Knowledge Synthesis and Scientific Reasoning Framework for Biomedical Discovery

Oskar Wysocki, Magdalena Wysocka, Danilo Carvalho, Alex Teodor Bogatu, Danilo Miranda Gusicuma, Maxime Delmas, Harriet Unsworth, Andre Freitas

Comments: accepted for ACL 2024 System Demonstration Track

Subjects: Quantitative Methods (q-bio.QM); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2352] arXiv:2406.18629 (cross-list from cs.LG) [pdf, html, other]

Title: Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs

Xin Lai, Zhuotao Tian, Yukang Chen, Senqiao Yang, Xiangru Peng, Jiaya Jia

Comments: Code, data, and models are available at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2353] arXiv:2406.18665 (cross-list from cs.LG) [pdf, html, other]

Title: RouteLLM: Learning to Route LLMs with Preference Data

Isaac Ong, Amjad Almahairi, Vincent Wu, Wei-Lin Chiang, Tianhao Wu, Joseph E. Gonzalez, M Waleed Kadous, Ion Stoica

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2354] arXiv:2406.18675 (cross-list from cs.HC) [pdf, html, other]

Title: Human-AI Collaborative Taxonomy Construction: A Case Study in Profession-Specific Writing Assistants

Minhwa Lee, Zae Myung Kim, Vivek Khetan, Dongyeop Kang

Comments: Accepted to CHI 2024 In2Writing Workshop

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2355] arXiv:2406.18678 (cross-list from cs.LG) [pdf, html, other]

Title: Few-shot Personalization of LLMs with Mis-aligned Responses

Jaehyung Kim, Yiming Yang

Comments: NAACL 25 (main, long), 32 pages

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2356] arXiv:2406.18679 (cross-list from eess.AS) [pdf, html, other]

Title: Speakers Unembedded: Embedding-free Approach to Long-form Neural Diarization

Xiang Li, Vivek Govindan, Rohit Paturi, Sundararajan Srinivasan

Comments: Accepted at INTERSPEECH 2024

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2357] arXiv:2406.18695 (cross-list from cs.LG) [pdf, html, other]

Title: Learning to Correct for QA Reasoning with Black-box LLMs

Jaehyung Kim, Dongyoung Kim, Yiming Yang

Comments: 22 pages; EMNLP 2024 (long, main)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2358] arXiv:2406.18702 (cross-list from cs.HC) [pdf, html, other]

Title: Simulating The U.S. Senate: An LLM-Driven Agent Approach to Modeling Legislative Behavior and Bipartisanship

Zachary R. Baker, Zarif L. Azher

Subjects: Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

[2359] arXiv:2406.18708 (cross-list from cs.LG) [pdf, html, other]

Title: Learn it or Leave it: Module Composition and Pruning for Continual Learning

Mingyang Wang, Heike Adel, Lukas Lange, Jannik Strötgen, Hinrich Schütze

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2360] arXiv:2406.18725 (cross-list from cs.LG) [pdf, html, other]

Title: Jailbreaking LLMs with Arabic Transliteration and Arabizi

Mansour Al Ghanim, Saleh Almohaimeed, Mengxin Zheng, Yan Solihin, Qian Lou

Comments: Accepted by EMNLP 2024

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2361] arXiv:2406.18731 (cross-list from eess.AS) [pdf, html, other]

Title: WavRx: a Disease-Agnostic, Generalizable, and Privacy-Preserving Speech Health Diagnostic Model

Yi Zhu, Tiago Falk

Comments: Under review; Model script available at this https URL

Subjects: Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2362] arXiv:2406.18841 (cross-list from cs.CY) [pdf, other]

Title: Navigating LLM Ethics: Advancements, Challenges, and Future Directions

Junfeng Jiao, Saleh Afroogh, Yiming Xu, Connor Phillips

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2363] arXiv:2406.18842 (cross-list from cs.CY) [pdf, other]

Title: The global landscape of academic guidelines for generative AI and Large Language Models

Junfeng Jiao, Saleh Afroogh, Kevin Chen, David Atkinson, Amit Dhurandhar

Subjects: Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2364] arXiv:2406.18871 (cross-list from eess.AS) [pdf, html, other]

Title: DeSTA: Enhancing Speech Language Models through Descriptive Speech-Text Alignment

Ke-Han Lu, Zhehuai Chen, Szu-Wei Fu, He Huang, Boris Ginsburg, Yu-Chiang Frank Wang, Hung-yi Lee

Comments: Accepted to Interspeech 2024

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[2365] arXiv:2406.18928 (cross-list from cs.SD) [pdf, html, other]

Title: Enhanced ASR Robustness to Packet Loss with a Front-End Adaptation Network

Yehoshua Dissen, Shiry Yonash, Israel Cohen, Joseph Keshet

Comments: Accepted for publication at INTERSPEECH 2024

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)

[2366] arXiv:2406.18934 (cross-list from cs.FL) [pdf, other]

Title: The single-use restriction for register automata and transducers over infinite alphabets

Rafał Stefański

Comments: PhD Thesis at University of Warsaw. Supervisor: Mikołaj Bojańczyk

Subjects: Formal Languages and Automata Theory (cs.FL); Computation and Language (cs.CL)

[2367] arXiv:2406.18972 (cross-list from eess.AS) [pdf, html, other]

Title: Applying LLMs for Rescoring N-best ASR Hypotheses of Casual Conversations: Effects of Domain Adaptation and Context Carry-over

Atsunori Ogawa, Naoyuki Kamo, Kohei Matsuura, Takanori Ashihara, Takafumi Moriya, Takatomo Kano, Naohiro Tawara, Marc Delcroix

Comments: 5 pages

Subjects: Audio and Speech Processing (eess.AS); Computation and Language (cs.CL)

[2368] arXiv:2406.18977 (cross-list from cs.RO) [pdf, html, other]

Title: RoboUniView: Visual-Language Model with Unified View Representation for Robotic Manipulation

Fanfan Liu, Feng Yan, Liming Zheng, Chengjian Feng, Yiyang Huang, Lin Ma

Subjects: Robotics (cs.RO); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

[2369] arXiv:2406.19146 (cross-list from cs.LG) [pdf, html, other]

Title: Resolving Discrepancies in Compute-Optimal Scaling of Language Models

Tomer Porian, Mitchell Wortsman, Jenia Jitsev, Ludwig Schmidt, Yair Carmon

Comments: Spotlight at NeurIPS 2024

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[2370] arXiv:2406.19230 (cross-list from cs.NE) [pdf, html, other]

Title: Spiking Convolutional Neural Networks for Text Classification

Changze Lv, Jianhan Xu, Xiaoqing Zheng

Subjects: Neural and Evolutionary Computing (cs.NE); Computation and Language (cs.CL)

[2371] arXiv:2406.19255 (cross-list from cs.CV) [pdf, html, other]

Title: Enhancing Video-Language Representations with Structural Spatio-Temporal Alignment

Hao Fei, Shengqiong Wu, Meishan Zhang, Min Zhang, Tat-Seng Chua, Shuicheng Yan

Comments: Accepted by IEEE TPAMI 2024

Journal-ref: [J].IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024

Subjects: Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

[2372] arXiv:2406.19280 (cross-list from cs.CV) [pdf, html, other]

Title: HuatuoGPT-Vision, Towards Injecting Medical Visual Knowledge into Multimodal LLMs at Scale

Junying Chen, Chi Gui, Ruyi Ouyang, Anningzhe Gao, Shunian Chen, Guiming Hardy Chen, Xidong Wang, Ruifei Zhang, Zhenyang Cai, Ke Ji, Guangjun Yu, Xiang Wan, Benyou Wang

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2373] arXiv:2406.19292 (cross-list from cs.LG) [pdf, other]

Title: From Artificial Needles to Real Haystacks: Improving Retrieval Capabilities in LLMs by Finetuning on Synthetic Data

Zheyang Xiong, Vasilis Papageorgiou, Kangwook Lee, Dimitris Papailiopoulos

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2374] arXiv:2406.19317 (cross-list from cs.LG) [pdf, html, other]

Title: Jump Starting Bandits with LLM-Generated Prior Knowledge

Parand A. Alamdari, Yanshuai Cao, Kevin H. Wilson

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2375] arXiv:2406.19384 (cross-list from cs.LG) [pdf, html, other]

Title: The Remarkable Robustness of LLMs: Stages of Inference?

Vedang Lad, Wes Gurnee, Max Tegmark

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2376] arXiv:2406.19388 (cross-list from cs.SD) [pdf, html, other]

Title: Taming Data and Transformers for Audio Generation

Moayed Haji-Ali, Willi Menapace, Aliaksandr Siarohin, Guha Balakrishnan, Vicente Ordonez

Comments: Project Webpage: this https URL

Subjects: Sound (cs.SD); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)

[2377] arXiv:2406.19413 (cross-list from cs.CR) [pdf, other]

Title: Saliency Attention and Semantic Similarity-Driven Adversarial Perturbation

Hetvi Waghela, Jaydip Sen, Sneha Rakshit

Comments: The paper is 12 pages long. and it contains 5 tables. It is the pre-reviewed version of the paper that has been accepted for oral presentation and publication in the 5th International Conference on Data Science and Applications which will be organized in Jaipur, India from July 17 to 19, 2024. This is not the final version

Journal-ref: Nanda, S.J., Yadav, R.P., Gandomi, A.H., Saraswat, M. (eds) Data Science and Applications. ICDSA 2024. Lecture Notes in Networks and Systems, vol 1237. Springer, Singapore

Subjects: Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2378] arXiv:2406.19500 (cross-list from cs.AI) [pdf, html, other]

Title: Knowledge acquisition for dialogue agents using reinforcement learning on graph representations

Selene Baez Santamaria, Shihan Wang, Piek Vossen

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2379] arXiv:2406.19578 (cross-list from cs.CV) [pdf, html, other]

Title: PathAlign: A vision-language model for whole slide images in histopathology

Faruk Ahmed, Andrew Sellergren, Lin Yang, Shawn Xu, Boris Babenko, Abbi Ward, Niels Olson, Arash Mohtashamian, Yossi Matias, Greg S. Corrado, Quang Duong, Dale R. Webster, Shravya Shetty, Daniel Golden, Yun Liu, David F. Steiner, Ellery Wulczyn

Comments: 9 main pages and 19 pages of supplemental material; 3 main tables, 3 main figures and 11 supplemental tables, 7 supplemental figures

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2380] arXiv:2406.19648 (cross-list from cs.HC) [pdf, other]

Title: Designing and Evaluating Multi-Chatbot Interface for Human-AI Communication: Preliminary Findings from a Persuasion Task

Sion Yoon, Tae Eun Kim, Yoo Jung Oh

Subjects: Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2381] arXiv:2406.19712 (cross-list from cs.AI) [pdf, other]

Title: Uncertainty Quantification in Large Language Models Through Convex Hull Analysis

Ferhat Ozgur Catak, Murat Kuzlu

Comments: 17 pages

Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[2382] arXiv:2406.19736 (cross-list from cs.CV) [pdf, html, other]

Title: MM-Instruct: Generated Visual Instructions for Large Multimodal Model Alignment

Jihao Liu, Xin Huang, Jinliang Zheng, Boxiao Liu, Jia Wang, Osamu Yoshie, Yu Liu, Hongsheng Li

Comments: Dataset and models are available at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2383] arXiv:2406.19760 (cross-list from cs.IR) [pdf, html, other]

Title: Learning Interpretable Legal Case Retrieval via Knowledge-Guided Case Reformulation

Chenlong Deng, Kelong Mao, Zhicheng Dou

Subjects: Information Retrieval (cs.IR); Computation and Language (cs.CL)

[2384] arXiv:2406.19783 (cross-list from cs.SE) [pdf, html, other]

Title: NLPerturbator: Studying the Robustness of Code LLMs to Natural Language Variations

Junkai Chen, Zhenhao Li, Xing Hu, Xin Xia

Subjects: Software Engineering (cs.SE); Computation and Language (cs.CL)

[2385] arXiv:2406.20053 (cross-list from cs.CR) [pdf, html, other]

Title: Covert Malicious Finetuning: Challenges in Safeguarding LLM Adaptation

Danny Halawi, Alexander Wei, Eric Wallace, Tony T. Wang, Nika Haghtalab, Jacob Steinhardt

Comments: 22 pages

Subjects: Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

[2386] arXiv:2406.20087 (cross-list from cs.LG) [pdf, html, other]

Title: ProgressGym: Alignment with a Millennium of Moral Progress

Tianyi Qiu, Yang Zhang, Xuchuan Huang, Jasmine Xinze Li, Jiaming Ji, Yaodong Yang

Comments: NeurIPS 2024 Track on Datasets and Benchmarks (Spotlight)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC)

[2387] arXiv:2406.20095 (cross-list from cs.RO) [pdf, html, other]

Title: LLaRA: Supercharging Robot Learning Data for Vision-Language Policy

Xiang Li, Cristina Mata, Jongwoo Park, Kumara Kahatapitiya, Yoo Sung Jang, Jinghuan Shang, Kanchana Ranasinghe, Ryan Burgert, Mu Cai, Yong Jae Lee, Michael S. Ryoo

Comments: ICLR 2025

Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

[2388] arXiv:2406.20098 (cross-list from cs.CV) [pdf, html, other]

Title: Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs

Sukmin Yun, Haokun Lin, Rusiru Thushara, Mohammad Qazim Bhat, Yongxin Wang, Zutao Jiang, Mingkai Deng, Jinhong Wang, Tianhua Tao, Junbo Li, Haonan Li, Preslav Nakov, Timothy Baldwin, Zhengzhong Liu, Eric P. Xing, Xiaodan Liang, Zhiqiang Shen

Comments: NeurIPS 2024 Datasets and Benchmarks Camera-ready Version. Website at this https URL

Subjects: Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)