The machine learning toolkit is at the core of kdb+/q centered machine learning functionality. This library contains functions that cover the following areas:

• An implementation of the FRESH (FeatuRe Extraction and Scalable Hypothesis testing) algorithm for use in the extraction of features from time series data and the reduction in the number of features through statistical testing.
• Cross validation and grid-search functions allowing for testing of the stability of models to changes in the volume of data or the specific subsets of data used in training.
• Clustering algorithms used to group data points and to identify patterns in their distributions. The algorithms make use of a k-dimensional tree to store points and scoring functions to analyze how well they performed.
• Utility functions relating to areas including statistical analysis, data preprocessing and array manipulation.

These sections are explained in greater depth within the FRESH, Cross Validation, Clustering and Utilities documentation.

• embedPy

The python packages required to allow successful execution of all functions within the machine learning toolkit can be installed via:

pip:

pip install -r requirements.txt

or via conda:

conda install --file requirements.txt

Place the ml library in $QHOME and load into a q instance using ml/ml.q

The following will load all functionality into the .ml namespace

q)\l ml/ml.q
q).ml.loadfile`:init.q

Examples showing implementations of several components of this toolkit can be found here. These notebooks include examples of the following sections of the toolkit.

• Pre-processing functions
• Implementations of the FRESH algorithm
• Cross validation and grid search capabilities
• Results Scoring functionality
• Clustering methods applied to datasets

Documentation for all sections of the machine learning toolkit are available here.

The machine learning toolkit is provided here under an Apache 2.0 license.

If you find issues with the interface or have feature requests, please consider raising an issue here.

If you wish to contribute to this project, please follow the contributing guide here.