M T W T F S S
 
 
 
 
 
1
 
2
 
3
 
4
 
5
 
6
 
7
 
8
 
9
 
10
 
11
 
12
 
13
 
14
 
15
 
16
 
17
 
18
 
19
 
20
 
21
 
22
 
23
 
24
 
25
 
26
 
27
 
28
 
 
 
Add to My Calendar

Responsabili:

Federica Galluzzi  ed  Elena Martinengo
 

Nel calendario si indicano i seminari di geometria algebrica e altre attività di interesse, organizzate dall'Università e dal Politecnico di Torino.

On the topology and geometry of Shallow Neural Network Training

Printer-friendly versionSend by emailPDF version

Data: 

03/12/2024 - 14:00 to 15:30

Aula: 

Aula Buzano

Speaker: 

Francesco Vaccarino

Categoria: 

Seminari di Algebra e Geometria Algebrica

Afferenza: 

Politecnico di Torino

Descrizione: 

This talk aims twofold: in its first 30 minutes, we will introduce multilayer perceptrons from scratch and their training process through gradient descent (GD).
 
In the remaining time, we will show how some conservation law appears by replacing the GD with a (loss) gradient
flow and how this determines invariant sets for the training. The set is a product of quadric hypersurfaces: we will
find the number of their connected component and their topological classification. If we have time, we will show how
to use the classical Segre embedding to classify these NN up to observational equivalence under a torus action.
Joint work with Marco Nurisso and Pierrick Leroy.