Filtering
In order to reduce the size of raw time series data, KAPPA-Automate applies denoising and decimation techniques. This involves applying a signal processing technique to identify/sketch a distinct trend in the time series data with inherent noise. The diagram below illustrates an identified trend (orange dots) and the raw data with inherent noise (gray dots).

While denoising squeezes the data points into a representative data trend, it does not reduce their number. In order to reduce the number of data points a decimation technique is applied to the denoised data trend. This technique produces a smaller subset of points to represent the data trend. The red and blue dots in diagram below illustrate how denoised data is decimated.

Denoising and decimation function together to identify the data trend and represent it with a fewer number of points by filtering out redundant and/or noisy data. This approach preserves characteristic features such as shut-ins and at the same time reduces the number of points from millions to a manageable size of thousands.
Three main versions of denoising algorithms are available in KAPPA-Automate. The integral filter is another method of filtering.
Technical References
KAPPA DDA Book, Chapter 16 — Permanent Gauges & amp: Intelligent Fields
SPE 139216: "New Methods Enhance the Processing of Permanent Gauge Data"
