We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IT

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Information Theory

Title: A multivariate Riesz basis of ReLU neural networks

Abstract: We consider the trigonometric-like system of piecewise linear functions introduced recently by Daubechies, DeVore, Foucart, Hanin, and Petrova. We provide an alternative proof that this system forms a Riesz basis of $L_2([0,1])$ based on the Gershgorin theorem. We also generalize this system to higher dimensions $d>1$ by a construction, which avoids using (tensor) products. As a consequence, the functions from the new Riesz basis of $L_2([0,1]^d)$ can be easily represented by neural networks. Moreover, the Riesz constants of this system are independent of $d$, making it an attractive building block regarding future multivariate analysis of neural networks.
Subjects: Information Theory (cs.IT); Functional Analysis (math.FA)
MSC classes: 68T07, 42C15, 11A25
Cite as: arXiv:2303.00076 [cs.IT]
  (or arXiv:2303.00076v1 [cs.IT] for this version)

Submission history

From: Jan Vybíral [view email]
[v1] Tue, 28 Feb 2023 20:48:03 GMT (104kb,D)

Link back to: arXiv, form interface, contact.