FluidNoveltySlice:
Filter:
Classes (extension) | Libraries > FluidCorpusManipulation

FluidNoveltySlice : FluidRTUGen : UGen : AbstractFunction : Object
ExtensionExtension

Realtime Novelty-Based Slicer

Description

A realtime slicer using an algorithm assessing novelty in the signal to estimate the slicing points.

A novelty curve is derived from running a kernel across the diagonal of the similarity matrix, and looking for peaks of changes. It implements the algorithm published in 'Automatic Audio Segmentation Using a Measure of Audio Novelty' by J Foote.

The process will return an audio stream with single sample impulses at estimated starting points of the different slices.

Read more about FluidNoveltySlice on the learn platform.

Class Methods

FluidNoveltySlice.ar(in: 0, algorithm: 0, kernelSize: 3, threshold: 0.8, filterSize: 1, minSliceLength: 2, windowSize: 1024, hopSize: -1, fftSize: -1, maxFFTSize: -1, maxKernelSize, maxFilterSize)

Arguments:

in

Audio-rate signal to slice

algorithm

The feature on which novelty is computed.

0Spectrum - The magnitude of the full spectrum.
1MFCC - 13 Mel-Frequency Cepstrum Coefficients.
2Chroma - The contour of a 12-band chromagram.
3Pitch - The pitch and its confidence.
4Loudness - The true peak and loudness.

kernelSize

The granularity of the window in which the algorithm looks for change, in samples. A small number will be sensitive to short term changes, and a large number should look for long term changes.

Constraints

  • Minimum: 3
  • Maximum: maxkernelSize
  • Snaps to odd numbers
threshold

The normalised threshold, between 0 and 1, on the novelty curve to consider it a segmentation point.

Constraints

  • Minimum: 0
filterSize

The size of a smoothing filter that is applied on the novelty curve. A larger filter size allows for cleaner cuts on very sharp changes.

Constraints

  • Minimum: 1
  • Maximum: maxfilterSize
minSliceLength

The minimum duration of a slice in number of hopSize.

Constraints

  • Minimum: 0
windowSize

The window size. As sinusoidal estimation relies on spectral frames, we need to decide what precision we give it spectrally and temporally. For more information visit https://learn.flucoma.org/learn/fourier-transform/

hopSize

The window hop size. As sinusoidal estimation relies on spectral frames, we need to move the window forward. It can be any size, but low overlap will create audible artefacts. The -1 default value will default to half of windowSize (overlap of 2).

fftSize

The inner FFT/IFFT size. It should be at least 4 samples long, at least the size of the window, and a power of 2. Making it larger allows an oversampling of the spectral precision. The -1 default value will default to windowSize.

maxFFTSize

Set an explicit upper bound on the FFT size at object instantiation. The default of nil or -1 sets this to whatever the initial FFT size is

maxKernelSize

Manually sets a maximum value for kernelSize. Can only be set at object instantiation. Default value of -1 sets this to the initial value of kernelSize

maxFilterSize

Manually sets a maximum value for filterSize. Can only be set at object instantiation. Default value of -1 sets this to the initial value of filterSize

Inherited class methods

Undocumented class methods

FluidNoveltySlice.algorithms

FluidNoveltySlice.prSelectAlgorithm(sym)

Instance Methods

Inherited instance methods

Examples

Tweaking Parameters