Accessing the Topological Properties of Neural Network Functions.
| dc.contributor.advisor | Sinha, Dev | |
| dc.contributor.author | Masden, Marissa | |
| dc.date.accessioned | 2024-01-09T22:40:16Z | |
| dc.date.available | 2024-01-09T22:40:16Z | |
| dc.date.issued | 2024-01-09 | |
| dc.description.abstract | We provide a framework for analyzing the geometry and topology of the canonical polyhedral complex of ReLU neural networks, which naturally divides the input space into linear regions. Beginning with a category appropriate for analyzing neural network layer maps, we give a categorical definition. We then use our foundational results to produce a duality isomorphism between cellular poset of the canonical polyhedral complex and a cubical set. This duality uses sign sequences, an algebraic tool from hyperplane arrangements and oriented matroid theory. Our theoretical results lead to algorithms for computing not only the canonical polyhedral complex itself but topological invariants of its substructures such as the decision boundary, as well as for evaluating the presence of PL critical points. Using these algorithms, we produce some of the first empirical measurements of the topology of the decision boundary of neural networks, both at initialization and during training. We observing that increasing the width of neural networks decreases the variability observed in their topological expression, but increasing depth increases variability. A code repository containing Python and Sage code implementing some of the algorithms described herein is available in the included supplementary material. | en_US |
| dc.identifier.uri | https://hdl.handle.net/1794/29136 | |
| dc.language.iso | en_US | |
| dc.publisher | University of Oregon | |
| dc.rights | All Rights Reserved. | |
| dc.subject | Applied Topology | en_US |
| dc.subject | Machine Learning | en_US |
| dc.subject | Neural Networks | en_US |
| dc.title | Accessing the Topological Properties of Neural Network Functions. | |
| dc.type | Electronic Thesis or Dissertation | |
| thesis.degree.discipline | Department of Mathematics | |
| thesis.degree.grantor | University of Oregon | |
| thesis.degree.level | doctoral | |
| thesis.degree.name | Ph.D. |
Files
Original bundle
1 - 1 of 1
Loading...
- Name:
- Masden_oregon_0171A_13546.pdf
- Size:
- 5.45 MB
- Format:
- Adobe Portable Document Format