Infinite-dimensional operator ridgelet transform

7. Infrastructure and roadmap🔗

This chapter collects the infrastructure that Mathlib v4.32.0 lacks and that the manuscript takes from the literature. Every manuscript item is verified, so every piece of infrastructure that a manuscript item needs is proved as well, here or in a vendored third-party development; each node below carries the Lean name that proves it.

The definition modules also record obligations that the definitions leave open on purpose (the Mathlib style of closing a definition with a junk value and stating the property as a theorem). The basis independence of the trace, of the Fredholm determinant, and of the Hilbert–Schmidt norm is one of them, and it is discharged below. What is still open is that the local stand-ins for the Section 4 and Section 6 objects used inside Section 5 and Section 7 (the anti-dual, the extended transform, and the sampled networks of the examples) are to be unified with the definitions of the reconstruction and sampling chapters.

Theorem7.1
uses 1used by 1L∃∀N

For an injective, positive, self-adjoint, trace-class P on a separable Hilbert space there is a family of Gaussian layers \mathcal N(0,2sP), s>0, with characteristic functionals e^{-s\langle P\xi,\xi\rangle}: the Gaussian series X=\sum_j\sqrt{p_j}Z_je_j of Appendix A, which converges in L^2(\Omega;H) and almost surely. Mathlib has the class of Gaussian measures but no constructor of a centred Gaussian measure with a prescribed trace-class covariance in infinite dimension.

Lean code for Theorem7.11 theorem
  • complete
    theorem OperatorRidgelet.exists_isCenteredGaussianLayers.{u_1} {H : Type u_1}
      [NormedAddCommGroup H] [InnerProductSpace  H] [CompleteSpace H]
      [SecondCountableTopology H] [MeasurableSpace H] [BorelSpace H]
      (P : H →L[] H) (hP : OperatorRidgelet.IsTraceClassCovariance P) :
       N, OperatorRidgelet.IsCenteredGaussianLayers P N
    theorem OperatorRidgelet.exists_isCenteredGaussianLayers.{u_1}
      {H : Type u_1} [NormedAddCommGroup H]
      [InnerProductSpace  H]
      [CompleteSpace H]
      [SecondCountableTopology H]
      [MeasurableSpace H] [BorelSpace H]
      (P : H →L[] H)
      (hP :
        OperatorRidgelet.IsTraceClassCovariance
          P) :
       N,
        OperatorRidgelet.IsCenteredGaussianLayers
          P N
    Existence of the Gaussian layers `𝒩(0,2sP)`, `s > 0`, for an injective, positive,
    self-adjoint, trace-class `P`: the Gaussian series construction of Appendix A. 
Theorem7.2
uses 1used by 1L∃∀N

For a positive operator the trace \sum_i\langle Pe_i,e_i\rangle has the same value along every Hilbert basis, the Fredholm determinant \prod_i(1+m_i) of a positive trace-class operator has the same value along every orthonormal eigenbasis, and the intrinsic Hilbert–Schmidt norm equals \sum_n\|Ae_n\|^2 along every Hilbert basis. These are the basis-independence obligations left open by the definitions of the trace, the determinant, and the Hilbert–Schmidt class, and the three theorems above discharge them: the chosen basis of traceOf and of fredholmDet is immaterial, and the supremum defining hsNormSq is computed by the sum along any Hilbert basis. Mathlib has no positive square root of an operator on a real Hilbert space (its continuous functional calculus is stated for complex C*-algebras), so the trace is compared along two bases through the orthonormal eigenbasis that a convergent trace provides, the multiplicity of a nonzero eigenvalue is identified with the trace of the orthogonal projection onto its eigenspace, and the Hilbert–Schmidt norm is compared through the adjoint.

Lean code for Theorem7.23 theorems
  • complete
    theorem OperatorRidgelet.traceOf_eq_traceAlong.{u_1, u_2} {H : Type u_1}
      [NormedAddCommGroup H] [InnerProductSpace  H] [CompleteSpace H]
      {P : H →L[] H} (hP : IsSelfAdjoint P)
      (hpos :  (x : H), 0  inner  (P x) x)
      (h : OperatorRidgelet.HasSummableTrace P) {ι : Type u_2}
      (b : HilbertBasis ι  H) :
      OperatorRidgelet.traceOf P = OperatorRidgelet.traceAlong b P
    theorem OperatorRidgelet.traceOf_eq_traceAlong.{u_1,
        u_2}
      {H : Type u_1} [NormedAddCommGroup H]
      [InnerProductSpace  H]
      [CompleteSpace H] {P : H →L[] H}
      (hP : IsSelfAdjoint P)
      (hpos :  (x : H), 0  inner  (P x) x)
      (h :
        OperatorRidgelet.HasSummableTrace P)
      {ι : Type u_2}
      (b : HilbertBasis ι  H) :
      OperatorRidgelet.traceOf P =
        OperatorRidgelet.traceAlong b P
    **The trace is the sum along every Hilbert basis.**  The basis chosen in the definition of
    `traceOf` is immaterial: for a positive self-adjoint operator with summable trace,
    `traceOf P = ∑ ⟪P e_i, e_i⟫` along any Hilbert basis. 
  • complete
    theorem OperatorRidgelet.fredholmDet_eq_fredholmDetAlong.{u_1, u_2}
      {H : Type u_1} [NormedAddCommGroup H] [InnerProductSpace  H]
      [CompleteSpace H] {M : H →L[] H} (hM : IsSelfAdjoint M)
      (hpos :  (x : H), 0  inner  (M x) x)
      (htr : OperatorRidgelet.HasSummableTrace M)
      (hex :  κ e' w', OperatorRidgelet.HasEigenbasis M e' w')
      {ι : Type u_2} {e : HilbertBasis ι  H} {w : ι  }
      (he : OperatorRidgelet.HasEigenbasis M e w) :
      OperatorRidgelet.fredholmDet M = OperatorRidgelet.fredholmDetAlong e M
    theorem OperatorRidgelet.fredholmDet_eq_fredholmDetAlong.{u_1,
        u_2}
      {H : Type u_1} [NormedAddCommGroup H]
      [InnerProductSpace  H]
      [CompleteSpace H] {M : H →L[] H}
      (hM : IsSelfAdjoint M)
      (hpos :  (x : H), 0  inner  (M x) x)
      (htr :
        OperatorRidgelet.HasSummableTrace M)
      (hex :
         κ e' w',
          OperatorRidgelet.HasEigenbasis M e'
            w')
      {ι : Type u_2} {e : HilbertBasis ι  H}
      {w : ι  }
      (he :
        OperatorRidgelet.HasEigenbasis M e
          w) :
      OperatorRidgelet.fredholmDet M =
        OperatorRidgelet.fredholmDetAlong e M
    **The Fredholm determinant is the product along every orthonormal eigenbasis.**  The basis
    chosen in the definition of `fredholmDet` is immaterial: for a positive self-adjoint operator
    with summable trace, `fredholmDet M = ∏ (1 + ⟪M e_i, e_i⟫)` along any orthonormal eigenbasis. 
  • complete
    theorem OperatorRidgelet.hsNormSq_eq_tsum.{u_1, u_2} {H : Type u_1}
      [NormedAddCommGroup H] [InnerProductSpace  H] [CompleteSpace H]
      (A : H →L[] H) {ι : Type u_2} (b : HilbertBasis ι  H) :
      OperatorRidgelet.hsNormSq A = ∑' (i : ι), A (b i)‖ₑ ^ 2
    theorem OperatorRidgelet.hsNormSq_eq_tsum.{u_1,
        u_2}
      {H : Type u_1} [NormedAddCommGroup H]
      [InnerProductSpace  H]
      [CompleteSpace H] (A : H →L[] H)
      {ι : Type u_2}
      (b : HilbertBasis ι  H) :
      OperatorRidgelet.hsNormSq A =
        ∑' (i : ι), A (b i)‖ₑ ^ 2
    **The Hilbert–Schmidt norm is the sum along every Hilbert basis.**  The intrinsic definition
    of `hsNormSq` as a supremum over finite orthonormal families is computed by `∑ ‖A e_i‖²` along
    any Hilbert basis. 
Theorem7.3
uses 0used by 1L∃∀N

Every complex or Hilbert-space-valued measure \Gamma of bounded variation has a polar decomposition \Gamma=h|\Gamma| with \|h\|=1 |\Gamma|-almost everywhere (the Radon–Nikodym theorem for vector measures). Mathlib has the scalar Radon–Nikodym theorem but not this form; it is proved in the project's ToMathlib modules, so the density that the sampled network of Section 6 chooses always exists.

Lean code for Theorem7.31 theorem
  • theorem MeasureTheory.VectorMeasure.exists_withDensityᵥ_variation_eq.{u_1, u_2}
      {X : Type u_1} {Y : Type u_2} [MeasurableSpace X]
      [NormedAddCommGroup Y] [InnerProductSpace  Y] [CompleteSpace Y]
      (Γ : MeasureTheory.VectorMeasure X Y)
      [MeasureTheory.IsFiniteMeasure Γ.variation] :
       g,
        (∀ᵐ (x : X) Γ.variation, g x = 1) 
          Γ = Γ.variation.withDensityᵥ g
    theorem MeasureTheory.VectorMeasure.exists_withDensityᵥ_variation_eq.{u_1,
        u_2}
      {X : Type u_1} {Y : Type u_2}
      [MeasurableSpace X]
      [NormedAddCommGroup Y]
      [InnerProductSpace  Y]
      [CompleteSpace Y]
      (Γ : MeasureTheory.VectorMeasure X Y)
      [MeasureTheory.IsFiniteMeasure
          Γ.variation] :
       g,
        (∀ᵐ (x : X) Γ.variation, g x = 1) 
          Γ = Γ.variation.withDensityᵥ g
    Polar decomposition of a finite-variation Hilbert-valued measure. 
Theorem7.4
uses 0used by 1L∃∀N

The finite-dimensional universal approximation theorem: for a continuous non-polynomial \beta:\mathbb R\to\mathbb R, finite linear combinations of \beta(\langle a,x\rangle+c) are dense in C(\mathbb R^m) for uniform convergence on compact sets. The reduction argument of Proposition 1.2.5 composes it with finite-rank projections. Mathlib does not have it; the project vendors the formalization of Runje (Apache 2.0) under NeuralNetworkProofs/.

Lean code for Theorem7.41 theorem
  • theorem UniversalApproximation.Leshno.leshno_dense {σ :   }
      ( : UniversalApproximation.Leshno.ClassM σ)
      (hnp : ¬UniversalApproximation.Leshno.IsAEPolynomial σ) :
      UniversalApproximation.Leshno.DenselyApproximates σ
    theorem UniversalApproximation.Leshno.leshno_dense
      {σ :   }
      ( :
        UniversalApproximation.Leshno.ClassM
          σ)
      (hnp :
        ¬UniversalApproximation.Leshno.IsAEPolynomial
            σ) :
      UniversalApproximation.Leshno.DenselyApproximates
        σ
    For an `M`-class non-a.e.-polynomial `σ`, `σ` densely approximates.