Skip to content
Search

Radial basis function

lastmod 2020-09-24created 2014-10-3120 edits

RBF stands for Radial Basis Function, and it can be called a radial basis function; neural network, and so on.

It is a surrogate model widely used in engineering since Hardy proposed it in 1971 for interpolating multivariate data. Compared with Kriging, RBF has the advantages of being easy to build and representing strongly nonlinear systems well. However, it has the disadvantage that the user must set the form and parameters of the basis function, and the prediction performance of RBF is sensitive to these values.

The RBF provided by PIAnO delivers robust prediction performance by automatically determining the form and parameters of the basis function best suited to the system. Also, although RBF is generally known as an interpolation model (Interpolation Model), the RBF provided by PIAnO can also be used as a regression model (Regression Model) through an option.

Radial basis function kernel

In machine learning, the (Gaussian) radial basis function kernel, or RBF kernel, is a popular kernel function used in support vector machine classification. 1

The RBF kernel on two samples x and x', represented as feature vectors in some input space, is defined as2

Radial_basis_function_kernel.png

Radial_basis_function_kernel_1.png may be recognized as the squared Euclidean distance between the two feature vectors. σ is a free parameter. An equivalent, but simpler, definition involves a parameter Radial_basis_function_kernel_2.png:

Radial_basis_function_kernel_3.png

Since the value of the RBF kernel decreases with distance and ranges between zero (in the limit) and one (when x = x'), it has a ready interpretation as a similarity measure.3 The feature space of the kernel has an infinite number of dimensions; for σ= 1, its expansion is:

Radial_basis_function_kernel_4.png

See also

Favorite site

References


  1. Yin-Wen Chang, Cho-Jui Hsieh, Kai-Wei Chang, Michael Ringgaard and Chih-Jen Lin (2010). "Training and testing low-degree polynomial data mappings via linear SVM". J. Machine Learning Research 11:1471–1490. ↩

  2. Vert, Jean-Philippe, Koji Tsuda, and Bernhard Schölkopf (2004). "A primer on kernel methods". Kernel Methods in Computational Biology. ↩

  3. RBF_Interpolation_1.pdf ↩

  4. RBF_Interpolation_2.pdf ↩

  5. RBF_Introduction.pdf ↩

author Zer0 sitemap