Skip to content

Labeling Instruction Builder

What is a Labeling Instruction?

In order to give labeling task to freelance annotators, data science team needs to define specifications of a labeling task. Those specifications need to be converted to a user-experience. In application specification builder is called labeling instruction. Labeling instruction is a list of objects that a data-scientist wants human-labelers to find in an image. Objects can have properties like color, size, shape etc. Data-scientist wants to present these properties in question-and-answer HTML form to the annotator.

Labeling instruction has two parts to it. Left panel and right panel. The left panel shows list of classes, their attributes and image-attributes. The right-panel shows how annotation-user-experience appear to the annotator (exactly).

Sample Labeling Instruction

How to create a new Labeling Instruction?

As you add a class or an attribute on left panel, you will observe same class and attributes will show up on the right panel in real time.

Step 1: Creating First Class-Type

Classes are abstract-representation of real world objects that machine learning model learns about. Each class can have a:

  1. Name: Associated real world object-class (like a car)
  2. Color
  3. Tool to be used to draw each object-instance belonging to that class
  4. Sub-attributes are the properties of that class type

New Class-type

Step 2: Adding Attributes to Class-Type

Attributes define properties of real world objects. A simple example is color of car is a property of that car. Data scientists would want to know these properties, so that they can use it to train machines that make decision.

An attribute is a question that you ask an annotator. There are four different data-types of an attribute:

  1. Text: alphanumeric data entry
  2. Multi-select Checkbox: a list of check boxes with multi-select functionality
  3. Single-select Drop down list: with single select functionality
  4. Single-select Radio button: with single selection functionality

Step 3: Final Labeling Interface

After adding all classes and attributes to a labelling interface, a complete labelling interface will look like this:

New Attribute