Support Vector Machine Classification of environmental sound types from spectral features

Project info

• Field of studyAcoustics and Audio
• LevelMaster's thesis (S2)
• Method typeMachine Learning
• Estimated build time± 5 working days
• Toolsfitcsvm, predict, crossval, perfcurve (Statistics and Machine Learning Toolbox)
• PriceUS$25 - US$150

Research goal

Train an SVM to separate classes in environmental sound types from spectral features and assess accuracy with cross-validation.

Variables

Example result

• 0.893Test accuracy
• 0.901F1 score
• 84Support vectors
• 0.934Best CV accuracy
• 31.623Best box constraint
• 0.485Kernel scale

The RBF-kernel SVM classifies Sound class with a test accuracy of 0.893 and F1 of 0.901 using 84 support vectors; the best cross-validated accuracy of 0.934 occurs at C=31.62.

Computed from illustrative synthetic data, not from a real study.

About Support Vector Machine (fitcsvm)

fitcsvm trains a Support Vector Machine for binary classification with various kernels. It suits classification on small to medium data with complex class boundaries.

Steps

1. 1Prepare the feature matrix and class labels
2. 2Split into training and test sets with cvpartition
3. 3Fit fitcsvm with an RBF kernel and Standardize on
4. 4Tune BoxConstraint and KernelScale (or OptimizeHyperparameters)
5. 5Evaluate accuracy, confusion matrix, and AUC on the test set
6. 6Plot the decision boundary if features are two-dimensional

Assumptions to check

• Features are standardised because SVM is scale sensitive
• Hyperparameters are tuned by cross-validation on training data
• Classes are not heavily imbalanced

Reading and reporting the results

Report the kernel, hyperparameters, test metrics, and the number of support vectors. Acknowledge the limited interpretability of a black-box model.

Example MATLAB code

A short starting script with this project's variable names. The delivered version is adapted to your data and fully commented.

rng(6);
n = 300;
spectral_centroid = randn(n, 2);
sound_class = double(sum(spectral_centroid.^2, 2) > 1.4);          % circular class boundary

cv = cvpartition(sound_class, 'HoldOut', 0.25);
Xtr = spectral_centroid(training(cv), :);  ytr = sound_class(training(cv));
Xte = spectral_centroid(test(cv), :);      yte = sound_class(test(cv));

best = inf;
for C = [0.1 1 10 100]
    m = fitcsvm(Xtr, ytr, 'KernelFunction', 'rbf', 'KernelScale', 'auto', ...
        'BoxConstraint', C, 'Standardize', true);
    err = kfoldLoss(crossval(m, 'KFold', 5));
    if err < best, best = err; Cbest = C; end
end
mdl = fitcsvm(Xtr, ytr, 'KernelFunction', 'rbf', 'KernelScale', 'auto', ...
    'BoxConstraint', Cbest, 'Standardize', true);
[pred, score] = predict(mdl, Xte);
[~, ~, ~, auc] = perfcurve(yte, score(:, 2), 1);
fprintf('Best C = %g, CV error = %.3f\n', Cbest, best);
fprintf('Test accuracy = %.3f, AUC = %.3f, support vectors = %d\n', mean(pred == yte), auc, sum(mdl.IsSupportVector));
disp(confusionmat(yte, pred));

[g1, g2] = meshgrid(linspace(-3, 3, 150));
gp = predict(mdl, [g1(:) g2(:)]);
figure; gscatter(g1(:), g2(:), gp, [0.9 0.9 1; 1 0.9 0.9]); hold on;
gscatter(Xte(:,1), Xte(:,2), yte, 'br', 'ox');
xlabel('x_1'); ylabel('x_2'); title('SVM decision regions');

Packages and prices

Choose how much help you need. Each higher package includes everything in the lower ones. Prices exclude 11% VAT.

• Payment: 50% down payment before work starts, balance after the deliverables are handed over
• Tax: Prices exclude 11% VAT
• Data and academic integrity: Results are computed from your own research data; you write and stand behind your manuscript, we help with the analysis and your understanding of it
• Revisions: Up to 2 revisions are included in the price (Package 3: 3 rounds)

Frequently asked questions