Audio Model Guide

Guide for Audio Classification Model with Marty the Robot

This guide explains how to create and use an audio classification model, and have Marty the Robot respond to predictions in MartyBlocks.

Step 1: Create an audio classification model on Marty Blocks

Navigate to the Machine Learning tab, press the “Add” button at the bottom left corner, and select “New Audio Model”.

If a new dialog box comes up asking you if you are sure, press continue.

Create Audio Model

Step 2: Model Name

You can start by giving your model a new name!

Type the new model name in the “Model” input at the top.

Image for Step 2

Step 3: Data Collection

You can now start collecting data for your classes! As a general rule of thumb, the more data you give to the model the better will perform, although the quality of the data is equally important!

Just type the name of the class you want to collect data for in the “Collect Data for” input and press the “Record” button.

Repeat this process for all the classes you want to collect data for.

You can collect more samples for each class by pressing the “Record” button again.

Note that the audio model requires at least 10 samples for the Background Noise class.

Image for Step 3

Step 4: Train Model

Once you have collected enough data for your classes, you can train your model by pressing the “Train” button.

Once the training is complete, you will see the Loss graph which plots the training loss over training iterations (epochs).

Image for Step 4

Step 5: Run Model

Once you have trained your model, you can run it by pressing the “Run” button.

You will see the predictions for each class in the “Predictions” table.

Image for Step 5

Step 6: Save Model

Once you are happy with your model, you can save it by pressing the “Save” button.

Note that once your model is saved you will not be able to collect more data for it.

Image for Step 6

Step 7: Load and Run Model in MartyBlocks

You can now load your model in MartyBlocks and use it to make predictions!

First, navigate to the Code tab and scroll down to the Machine Learning blocks section.

Image for Step 7

Step 8: Load Model in MartyBlocks

Use the “Load Marty Machine model” block and select the model you want to load.

Image for Step 8

Step 9: Make classifications in MartyBlocks

Sound classifications should start automatically after importing the model. You may toggle classifications on and off using the “turn classification” block.

{{| Image for Step 9.1

Once you have executed the command to import your classification model, the class labels will be available for selection in some blocks. There are a few ways to make predictions:

Event handler: Image for Event handler

Boolean: Image for Boolean

Variable: Image for Variable

To see the value of the “sound label” variable, check the box beside the variable in the Teachable Machine menu. Image for Step 9.2

Step 10: Changing the classification rate and confidence threshold (optional)

To make changes to the rate of classifications, use the “Label once every seconds” block

To make changes to the confidence threshold, use the “set confidence threshold” block. The default confidence threshold is 0.5 (i.e. 50%).

{{:martyv2:userguides:martyblocks:teachablemachine:14.threshold.png|Image for Step 10.1

Task Runner