Foundations and Trends® in Machine Learning > Vol 15 > Issue 6

Divided Differences, Falling Factorials, and Discrete Splines: Another Look at Trend Filtering and Related Problems

By Ryan J. Tibshirani, Carnegie Mellon University, USA, ryantibs@cmu.edu

 
Suggested Citation
Ryan J. Tibshirani (2022), "Divided Differences, Falling Factorials, and Discrete Splines: Another Look at Trend Filtering and Related Problems", Foundations and TrendsĀ® in Machine Learning: Vol. 15: No. 6, pp 694-846. http://dx.doi.org/10.1561/2200000099

Publication Date: 21 Jul 2022
© 2022 R. J. Tibshirani
 
Subjects
 

Free Preview:

Download extract

Share

Download article
In this article:
1. Introduction
2. Background
3. Falling Factorials
4. Smoothness Properties
5. Dual Basis
6. Matrix Computations
7. Discrete B-Splines
8. Sparse Knot Sets
9. Representation
10. Approximation
11. Trend Filtering
12. BW Filtering
13. Discussion
Acknowledgements
Appendices
References

Abstract

This monograph reviews a class of univariate piecewise polynomial functions known as discrete splines, which share properties analogous to the better-known class of spline functions, but where continuity in derivatives is replaced by (a suitable notion of) continuity in divided differences. As it happens, discrete splines bear connections to a wide array of developments in applied mathematics and statistics, from divided differences and Newton interpolation (dating back to over 300 years ago) to trend filtering (from the last 15 years). We survey these connections, and contribute some new perspectives and new results along the way.

DOI:10.1561/2200000099
ISBN: 978-1-63828-036-1
174 pp. $99.00
Buy book (pb)
 
ISBN: 978-1-63828-037-8
174 pp. $145.00
Buy E-book (.pdf)
Table of contents:
1. Introduction
2. Background
3. Falling Factorials
4. Smoothness Properties
5. Dual Basis
6. Matrix Computations
7. Discrete B-Splines
8. Sparse Knot Sets
9. Representation
10. Approximation
11. Trend Filtering
12. BW Filtering
13. Discussion
Acknowledgements
Appendices
References

Divided Differences, Falling Factorials, and Discrete Splines: Another Look at Trend Filtering and Related Problems

This monograph reviews a class of univariate piecewise polynomial functions known as discrete splines, which share properties analogous to the better-known class of spline functions, but where continuity in derivatives is replaced by continuity in divided differences. As it happens, discrete splines bear connections to a wide array of developments in applied mathematics and statistics, from divided differences and Newton interpolation, dating back 300 years, to the recent emergence of trend filtering.

In this concise yet comprehensive monograph, the author uses his recognized expertise on the subject to guide the reader through these connections. In doing so, the author provides an insightful journey through the historical and most recent developments, contributing some new perspectives and results along the way.

Written for researchers and advanced level students of applied mathematics and statistics, this monograph will be of particular interest to those using trend filtering in machine learning applications.

 
MAL-099