JuliaGaussianProcesses / JuliaGaussianProcesses/KernelFunctions.jl

`WendlandKernel`: Compact support -> sparse kernel matrix

Open
#550 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

new kernel
Dominant language
Julia
Stars
275
Forks
41
PR merge metrics
No merged PRs in 30d

Description

Hey 👋
I think Wendland kernels are cool, and I would like to contribute a PR. Let me know what you think :)

What's this about?

Wendland kernels have compact support. If two points are "too far away" (quantified by the lengthscale of the kernel), their covariance under a Wendland kernel is zero. This results in sparse kernel matrices, which can be leveraged to save memory and compute. In particular, Julia has built-in support for highly optimised sparse Cholesky decompositions.

Within their support, the Wendland functions are defined by a rational polynomial, the coefficients of which can be computed in closed form.

At the same time, Wendland kernels have nice theoretical properties. In particular, much like the Matérn kernels, their smoothness is controllable directly through a smoothness parameter.

For more details, and in particular for the definition of Wendland functions, refer to Chapter 9 of Scattered Data Approximation by Holger Wendland.

What do I propose?

I would like to add the WendlandKernel to KernelFunctions.jl. I already have an implementation locally for Wendland kernels with arbitrary space dimension $d$ and smoothness parameter $k$. It produces sparse kernel matrices.

Difficulties

Currently, AbstractGPs.jl does not work with sparse Cholesky factorizations. I added some extensions locally, and I am not sure if these should go to KernelFunctions.jl or if I should make a separate PR for AbstractGPs.jl.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing the proposed WendlandKernel implementation in KernelFunctions.jl and the existing kernel abstractions, then investigate how sparse kernel matrices are represented. Check the interaction with AbstractGPs.jl and determine whether sparse Cholesky support belongs in that project or a separate change; done requires agreement on this scope and a working kernel implementation.

Written by the indexing model from the issue text.

Assessment

Tech stack
julia
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.