AI without networks

Mitra, Partha P, Sire, Clément (December 2023) AI without networks. bioRxiv. (Submitted)

PDF 2023_Mitra_AI_without_networks_preprint.pdf - Submitted Version Available under License Creative Commons Attribution Non-commercial No Derivatives. Download (3MB)

Abstract

Contemporary Artificial Intelligence (AI) stands on two legs: large training data corpora and many-parameter artificial neural networks (ANNs). The data corpora are needed to represent the complexity and heterogeneity of the world. The role of the networks is less transparent due to the obscure dependence of the network parameters and outputs on the training data and inputs. This raises problems, ranging from technical-scientific to legal-ethical. We hypothesize that a transparent approach to machine learning is possible without using networks at all. By generalizing a parameter-free, statistically consistent data interpolation method, which we analyze theoretically in detail, we develop a framework for generative modeling. Given the growing usage of machine learning techniques in science, we demonstrate this framework with an example from the field of animal behavior. We applied this generative Hilbert framework to the trajectories of small groups of swimming fish. The framework outperforms previously developed state-of-the-art traditional mathematical behavioral models and contemporary ANN-based models in reproducing naturalistic behaviors. We do not suggest that the proposed framework will outperform networks in all applications, as over-parameterized networks can interpolate. However, our framework is theoretically sound, transparent, deterministic and parameter free: it does not require any compute-expensive training, does not involve optimization, has no model selection, and is easily reproduced and ported. We also propose an easily computed method of credit assignment based on this framework that could help address ethical-legal challenges raised by generative AI.

Item Type:	Paper
Subjects:	bioinformatics bioinformatics > computational biology > algorithms bioinformatics > computational biology bioinformatics > computational biology > algorithms > machine learning organs, tissues, organelles, cell types and functions > tissues types and functions > neural networks
CSHL Authors:	Mitra, Partha P.
Communities:	CSHL labs > Mitra lab
SWORD Depositor:	CSHL Elements
Depositing User:	CSHL Elements
Date:	9 December 2023
Date Deposited:	20 Dec 2023 19:36
Last Modified:	20 Dec 2023 19:36
Related URLs:	Publisher
URI:	https://repository.cshl.edu/id/eprint/41343

Actions (login required)

Administrator's edit/view item