I honestly don’t understand this stuff, but I think @avehtari and @paul.buerkner did some work on spectral GPs.
There is also this older thread Approximate GPs with Spectral Stuff with @bbbales2 . (I hope that “spectral kernel” does not have multiple meanings in the context of GPs)