Machine Learning

Authors and titles for July 2024

[101] arXiv:2407.01049 [pdf, html, other]

Title: SE(3)-Hyena Operator for Scalable Equivariant Learning

Artem Moskalev, Mangal Prakash, Rui Liao, Tommaso Mansi

Subjects: Machine Learning (cs.LG)

[102] arXiv:2407.01054 [pdf, html, other]

Title: Joint Pruning and Channel-wise Mixed-Precision Quantization for Efficient Deep Neural Networks

Beatrice Alessandra Motetti, Matteo Risso, Alessio Burrello, Enrico Macii, Massimo Poncino, Daniele Jahier Pagliari

Comments: Accepted for publication in IEEE Transactions on Computers

Subjects: Machine Learning (cs.LG)

[103] arXiv:2407.01065 [pdf, html, other]

Title: Improve ROI with Causal Learning and Conformal Prediction

Meng Ai, Zhuo Chen, Jibin Wang, Jing Shang, Tao Tao, Zhen Li

Comments: Accepted by ICDE 2024; Link: this https URL

Subjects: Machine Learning (cs.LG)

[104] arXiv:2407.01085 [pdf, html, other]

Title: Explaining Length Bias in LLM-Based Preference Evaluations

Zhengyu Hu, Linxin Song, Jieyu Zhang, Zheyuan Xiao, Tianfu Wang, Zhengyu Chen, Nicholas Jing Yuan, Jianxun Lian, Kaize Ding, Hui Xiong

Subjects: Machine Learning (cs.LG); Computation and Language (cs.CL)

[105] arXiv:2407.01111 [pdf, html, other]

Title: Proximity Matters: Local Proximity Preserved Balancing for Treatment Effect Estimation

Hao Wang, Zhichao Chen, Yuan Shen, Jiajun Fan, Zhaoran Liu, Degui Yang, Xinggao Liu, Haoxuan Li

Comments: Code is available at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)

[106] arXiv:2407.01115 [pdf, html, other]

Title: Enabling Mixed Effects Neural Networks for Diverse, Clustered Data Using Monte Carlo Methods

Andrej Tschalzev, Paul Nitschke, Lukas Kirchdorfer, Stefan Lüdtke, Christian Bartelt, Heiner Stuckenschmidt

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[107] arXiv:2407.01154 [pdf, html, other]

Title: Wind Estimation in Unmanned Aerial Vehicles with Causal Machine Learning

Abdulaziz Alwalan, Miguel Arana-Catania

Comments: 11 pages, 9 figures, 10 tables. To be presented in 15th International Conference on Mechanical and Aerospace Engineering (ICMAE)

Subjects: Machine Learning (cs.LG); Robotics (cs.RO)

[108] arXiv:2407.01155 [pdf, html, other]

Title: CPT: Consistent Proxy Tuning for Black-box Optimization

Yuanyang He, Zitong Huang, Xinxing Xu, Rick Siow Mong Goh, Salman Khan, Wangmeng Zuo, Yong Liu, Chun-Mei Feng

Comments: 10 pages,2 figures plus supplementary materials

Subjects: Machine Learning (cs.LG)

[109] arXiv:2407.01163 [pdf, html, other]

Title: Benchmarking Predictive Coding Networks -- Made Simple

Luca Pinchetti, Chang Qi, Oleh Lokshyn, Gaspard Olivers, Cornelius Emde, Mufeng Tang, Amine M'Charrak, Simon Frieder, Bayar Menzat, Rafal Bogacz, Thomas Lukasiewicz, Tommaso Salvatori

Comments: 34 pages, 26 figures

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

[110] arXiv:2407.01171 [pdf, html, other]

Title: Neural Conditional Probability for Uncertainty Quantification

Vladimir R. Kostic, Karim Lounici, Gregoire Pacreau, Pietro Novelli, Giacomo Turri, Massimiliano Pontil

Comments: Advances in Neural Information Processing Systems (NeurIPS) 2024

Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Methodology (stat.ME); Machine Learning (stat.ML)

[111] arXiv:2407.01194 [pdf, html, other]

Title: A Learned Generalized Geodesic Distance Function-Based Approach for Node Feature Augmentation on Graphs

Amitoz Azad, Yuan Fang

Comments: Accepted at KDD 2024 Research Track

Subjects: Machine Learning (cs.LG)

[112] arXiv:2407.01199 [pdf, other]

Title: Deep Learning Based Tool Wear Estimation Considering Cutting Conditions

Zongshuo Li, Markus Meurer, Thomas Bergs

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Signal Processing (eess.SP)

[113] arXiv:2407.01200 [pdf, other]

Title: Deep Learning Approach for Enhanced Transferability and Learning Capacity in Tool Wear Estimation

Zongshuo Li, Markus Meurer, Thomas Bergs

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Signal Processing (eess.SP)

[114] arXiv:2407.01214 [pdf, html, other]

Title: Revisiting Random Walks for Learning on Graphs

Jinwoo Kim, Olga Zaghen, Ayhan Suleymanzade, Youngmin Ryou, Seunghoon Hong

Comments: 51 pages, 14 figures

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[115] arXiv:2407.01250 [pdf, html, other]

Title: Metric-Entropy Limits on the Approximation of Nonlinear Dynamical Systems

Yang Pan, Clemens Hutter, Helmut Bölcskei

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Dynamical Systems (math.DS)

[116] arXiv:2407.01258 [pdf, html, other]

Title: Physics-Inspired Deep Learning and Transferable Models for Bridge Scour Prediction

Negin Yousefpour, Bo Wang

Subjects: Machine Learning (cs.LG)

[117] arXiv:2407.01262 [pdf, html, other]

Title: Complementary Fusion of Deep Network and Tree Model for ETA Prediction

YuRui Huang, Jie Zhang, HengDa Bao, Yang Yang, Jian Yang

Subjects: Machine Learning (cs.LG)

[118] arXiv:2407.01281 [pdf, html, other]

Title: Bridging Smoothness and Approximation: Theoretical Insights into Over-Smoothing in Graph Neural Networks

Guangrui Yang, Jianfei Li, Ming Li, Han Feng, Ding-Xuan Zhou

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Functional Analysis (math.FA)

[119] arXiv:2407.01283 [pdf, html, other]

Title: Energy-Aware Decentralized Learning with Intermittent Model Training

Akash Dhasade, Paolo Dini, Elia Guerra, Anne-Marie Kermarrec, Marco Miozzo, Rafael Pires, Rishi Sharma, Martijn de Vos

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC)

[120] arXiv:2407.01290 [pdf, html, other]

Title: Hypformer: Exploring Efficient Hyperbolic Transformer Fully in Hyperbolic Space

Menglin Yang, Harshit Verma, Delvin Ce Zhang, Jiahong Liu, Irwin King, Rex Ying

Comments: KDD 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[121] arXiv:2407.01294 [pdf, html, other]

Title: A Collaborative, Human-Centred Taxonomy of AI, Algorithmic, and Automation Harms

Gavin Abercrombie, Djalel Benbouzid, Paolo Giudici, Delaram Golpayegani, Julio Hernandez, Pierre Noro, Harshvardhan Pandit, Eva Paraschou, Charlie Pownall, Jyoti Prajapati, Mark A. Sayre, Ushnish Sengupta, Arthit Suriyawongkul, Ruby Thelot, Sofia Vei, Laura Waltersdorfer

Comments: 21 pages, 2 figures; typos corrected, reference missing fields fixed, printer-friendly version of a diagram added

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)

[122] arXiv:2407.01306 [pdf, html, other]

Title: Unveiling the Unseen: Exploring Whitebox Membership Inference through the Lens of Explainability

Chenxi Li, Abhinav Kumar, Zhen Guo, Jie Hou, Reza Tourani

Comments: 20 pages, 10 figures, 4 tables

Subjects: Machine Learning (cs.LG); Cryptography and Security (cs.CR)

[123] arXiv:2407.01310 [pdf, html, other]

Title: Multi-State-Action Tokenisation in Decision Transformers for Multi-Discrete Action Spaces

Perusha Moodley, Pramod Kaushik, Dhillu Thambi, Mark Trovinger, Praveen Paruchuri, Xia Hong, Benjamin Rosman

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

[124] arXiv:2407.01316 [pdf, html, other]

Title: Evaluating Model Performance Under Worst-case Subpopulations

Mike Li, Hongseok Namkoong, Shangzhou Xia

Comments: Earlier version appeared in the proceedings of Advances in Neural Information Processing Systems 34 (NeurIPS 2021): this https URL

Subjects: Machine Learning (cs.LG); Computers and Society (cs.CY); Machine Learning (stat.ML)

[125] arXiv:2407.01320 [pdf, html, other]

Title: Increasing Model Capacity for Free: A Simple Strategy for Parameter Efficient Fine-tuning

Haobo Song, Hao Zhao, Soumajit Majumder, Tao Lin

Comments: Accepted at ICLR 2024. Code at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

[126] arXiv:2407.01343 [pdf, html, other]

Title: Coordination Failure in Cooperative Offline MARL

Callum Rhys Tilbury, Claude Formanek, Louise Beyers, Jonathan P. Shock, Arnu Pretorius

Comments: Accepted at the Workshop on Aligning Reinforcement Learning Experimentalists and Theorists (ARLET) at the International Conference on Machine Learning, 2024

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Multiagent Systems (cs.MA)

[127] arXiv:2407.01356 [pdf, html, other]

Title: tPARAFAC2: Tracking evolving patterns in (incomplete) temporal data

Christos Chatzis, Carla Schenker, Max Pfeffer, Evrim Acar

Comments: 16 pages, 15 figures

Subjects: Machine Learning (cs.LG)

[128] arXiv:2407.01371 [pdf, html, other]

Title: Binary Losses for Density Ratio Estimation

Werner Zellinger

Journal-ref: International Conference on Learning Representations (ICLR), 2025

Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)

[129] arXiv:2407.01376 [pdf, html, other]

Title: Badllama 3: removing safety finetuning from Llama 3 in minutes

Dmitrii Volkov

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

[130] arXiv:2407.01378 [pdf, html, other]

Title: Beyond Throughput and Compression Ratios: Towards High End-to-end Utility of Gradient Compression

Wenchen Han, Shay Vargaftik, Michael Mitzenmacher, Brad Karp, Ran Ben Basat

Comments: Accepted at ACM HotNets 2024. 9 pages, 3 figures

Subjects: Machine Learning (cs.LG); Networking and Internet Architecture (cs.NI)

[131] arXiv:2407.01392 [pdf, other]

Title: Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusion

Boyuan Chen, Diego Marti Monso, Yilun Du, Max Simchowitz, Russ Tedrake, Vincent Sitzmann

Comments: Project website: this https URL

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

[132] arXiv:2407.01440 [pdf, html, other]

Title: GAT-Steiner: Rectilinear Steiner Minimal Tree Prediction Using GNNs

Bugra Onal, Eren Dogan, Muhammad Hadir Khan, Matthew R. Guthaus

Comments: Preprint for The 2024 IEEE/ACM International Conference on Computer-Aided Design (ICCAD 2024)

Subjects: Machine Learning (cs.LG)

[133] arXiv:2407.01445 [pdf, html, other]

Title: FastCLIP: A Suite of Optimization Techniques to Accelerate CLIP Training with Limited Resources

Xiyuan Wei, Fanjiang Ye, Ori Yonay, Xingyu Chen, Baixi Sun, Dingwen Tao, Tianbao Yang

Comments: 29 pages

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

[134] arXiv:2407.01456 [pdf, html, other]

Title: Information-Theoretic Foundations for Neural Scaling Laws

Hong Jun Jeon, Benjamin Van Roy

Comments: arXiv admin note: text overlap with arXiv:2212.01365

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[135] arXiv:2407.01458 [pdf, html, other]

Title: Contractual Reinforcement Learning: Pulling Arms with Invisible Hands

Jibang Wu, Siyu Chen, Mengdi Wang, Huazheng Wang, Haifeng Xu

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Science and Game Theory (cs.GT); Theoretical Economics (econ.TH)

[136] arXiv:2407.01459 [pdf, html, other]

Title: On Implications of Scaling Laws on Feature Superposition

Pavan Katta

Comments: 4 pages, 1 figure

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[137] arXiv:2407.01464 [pdf, html, other]

Title: Graph Neural Network as Computationally Efficient Emulator of Ice-sheet and Sea-level System Model (ISSM)

Younghyun Koo, Maryam Rahnemoonfar

Comments: 5 pages, 4 figures, submitted to the 2024 IEEE International Geoscience and Remote Sensing Symposium. arXiv admin note: text overlap with arXiv:2402.05291

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Numerical Analysis (math.NA)

[138] arXiv:2407.01467 [pdf, html, other]

Title: The Balanced-Pairwise-Affinities Feature Transform

Daniel Shalam, Simon Korman

Comments: arXiv admin note: substantial text overlap with arXiv:2204.03065

Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

[139] arXiv:2407.01502 [pdf, html, other]

Title: AI Agents That Matter

Sayash Kapoor, Benedikt Stroebl, Zachary S. Siegel, Nitya Nadgir, Arvind Narayanan

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[140] arXiv:2407.01521 [pdf, html, other]

Title: Improving Diffusion Inverse Problem Solving with Decoupled Noise Annealing

Bingliang Zhang, Wenda Chu, Julius Berner, Chenlin Meng, Anima Anandkumar, Yang Song

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

[141] arXiv:2407.01526 [pdf, other]

Title: Scalable Nested Optimization for Deep Learning

Jonathan Lorraine

Comments: View more research details at this https URL

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Neural and Evolutionary Computing (cs.NE); Optimization and Control (math.OC); Machine Learning (stat.ML)

[142] arXiv:2407.01595 [pdf, html, other]

Title: Fairpriori: Improving Biased Subgroup Discovery for Deep Neural Network Fairness

Kacy Zhou, Jiawen Wen, Nan Yang, Dong Yuan, Qinghua Lu, Huaming Chen

Comments: 11 pages

Subjects: Machine Learning (cs.LG); Computers and Society (cs.CY); Software Engineering (cs.SE)

[143] arXiv:2407.01596 [pdf, html, other]

Title: Maze Discovery using Multiple Robots via Federated Learning

Kalpana Ranasinghe, H.P. Madushanka, Rafaela Scaciota, Sumudu Samarakoon, Mehdi Bennis

Comments: Accepted in ISCC 2024 conference

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Robotics (cs.RO); Image and Video Processing (eess.IV)

[144] arXiv:2407.01598 [pdf, other]

Title: Long-Term Prediction Accuracy Improvement of Data-Driven Medium-Range Global Weather Forecast

Yifan Hu, Fukang Yin, Weimin Zhang, Kaijun Ren, Junqiang Song, Kefeng Deng, Di Zhang

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[145] arXiv:2407.01601 [pdf, html, other]

Title: Unveiling and Controlling Anomalous Attention Distribution in Transformers

Ruiqing Yan, Xingbo Du, Haoyu Deng, Linghan Zheng, Qiuzhuang Sun, Jifang Hu, Yuhang Shao, Penghao Jiang, Jinrong Jiang, Lian Zhao

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

[146] arXiv:2407.01603 [pdf, html, other]

Title: A Review of Large Language Models and Autonomous Agents in Chemistry

Mayk Caldas Ramos, Christopher J. Collison, Andrew D. White

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Chemical Physics (physics.chem-ph)

[147] arXiv:2407.01606 [pdf, html, other]

Title: On Discrete Prompt Optimization for Diffusion Models

Ruochen Wang, Ting Liu, Cho-Jui Hsieh, Boqing Gong

Comments: ICML 2024. Code available at this https URL

Journal-ref: Proceedings of the 41st International Conference on Machine Learning (ICML 2024)

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

[148] arXiv:2407.01607 [pdf, html, other]

Title: Multi-Epoch learning with Data Augmentation for Deep Click-Through Rate Prediction

Zhongxiang Fan, Zhaocheng Liu, Jian Liang, Dongying Kong, Han Li, Peng Jiang, Shuang Li, Kun Gai

Subjects: Machine Learning (cs.LG); Information Retrieval (cs.IR); Machine Learning (stat.ML)

[149] arXiv:2407.01608 [pdf, html, other]

Title: Deriva-ML: A Continuous FAIRness Approach to Reproducible Machine Learning Models

Zhiwei Li, Carl Kesselman, Mike D'Arch, Michael Pazzani, Benjamin Yizing Xu

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Databases (cs.DB); Human-Computer Interaction (cs.HC); Software Engineering (cs.SE)

[150] arXiv:2407.01613 [pdf, html, other]

Title: Self-adaptive weights based on balanced residual decay rate for physics-informed neural networks and deep operator networks

Wenqian Chen, Amanda A. Howard, Panos Stinis

Comments: 13 figures, 4 tables

Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Machine Learning (stat.ML)