5. Reconstruction formulas and activation functions
The synthesis activation may be a tempered distribution, including ReLU. Weighted Sobolev spaces make the Fourier pairing continuous; we define them and prove their duality before using regularized synthesis. The later inverse Fourier estimates give an absolutely convergent network integral under Sobolev conditions, with an explicit example of filters that are not band pass.