Voice Input

DataWedge 11.1

Overview

Voice Input enables DataWedge to convert spoken entries into keystrokes as if they were typed or acquired from a scan. Voice Input uses the Google speech recognition engine included on GMS devices. Voice-to-data capture can be useful in cases when a barcode is wet, damaged, covered with stray markings or otherwise cannot be scanned.

Voice Input options:

  • Begin voice capture with a defined start phrase or PTT button
  • Terminate voice capture with a phrase or timeout value
  • Set voice commands to navigate within the foreground app or issue specific key presses: TAB, ENTER, NEXT, PREVIOUS, ESC, Clear.
  • Limit returned data to alpha or numeric characters
  • Play an audio prompt when waiting for a start phrase or data capture
  • Validate spoken data, edit acquired data as needed
  • Works offline

This feature is supported only on Zebra GMS devices with Android Nougat and later.

Watch the DevTalk presentation on DataWedge Voice Input:

Version History

  • DataWedge 7.5 - New voice commands to navigate within the foreground app or issue specific key presses.
  • DataWedge 7.4 - Introduced voice capture activation by PTT (push-to-talk) button with new Start option voice input parameter for DataWedge Intent API.

How it Works

Voice Input relies on DataWedge profiles for configuration. Ensure that the application to receive the voice captured data is associated to the profile. The Voice Input section in the profile provides the options that control the voice data capture. See Main Features section below.

Voice data capture is activated either by a pre-defined start phrase or by pressing the PTT button. When running, Voice Input is placed in the state "waiting for start phrase" (see Figure 4). Voice data capture begins after speaking the predefined "start phrase", which then changes the state to "waiting for data" (see Figure 5). Voice capture stops when the timeout value elapses after speaking the data or after speaking an optional "end phrase", if defined. The data source can be identified as voice input to process the voice data according to any application requirements. Barcode scanning and voice input can exist in the same DataWedge profile so both data capture methods may be used interchangeably.

Watch a demo on the basics of Voice Input with DWDemo app:

Watch a demo showcasing the Send Enter command for multiple field entries:

Note: When voice input is enabled, the Google voice engine included with Google App version 11.21.9.21 (and later) plays a notification tone every few seconds to indicate that it is listening in the background. To minimize this tone, Zebra recommends creating a profile (separate from Profile0) and associating it with the required applications/activities to limit sound notifications to be heard only when the app is in the foreground.

Main Features

Voice Input features are accessible from the DataWege profile.

     

Figure 1 & 2. Voice input settings

  • Enabled - Enables voice input.

  • Data capture start option - Select trigger option for voice capture.

    • Start phrase - Sets a start phrase to trigger voice capture. Start phrase is specified in option Data capture start phrase. This feature is being deprecated and will be discontinued in a future release. As an alternative, Zebra recommends using the PTT button to trigger voice capture.
    • PTT button - Sets PTT button to trigger voice capture. Only supported on EC30, MC93, TC52/TC57, TC72/TC77, and TC8300 devices. For other devices, the PTT button may be mapped to an available button on the device.
  • Data capture start phrase - Specified phrase to start the data capture if Start phrase is selected as the Data capture start option. Numbers and special characters are not supported as part of the start phrase. The default value is "start." This feature is being deprecated and will be discontinued in a future release. As an alternative, Zebra recommends using the PTT button to trigger voice capture.

  • Data capture end phrase - Optional phrase that ends the data capture. There is no default value. This feature is being deprecated and will be discontinued in a future release. As an alternative, Zebra recommends using the PTT button to trigger voice capture.

  • End detection timeout - Sets the timeout value (in seconds) for the data capture during the “waiting for data” state. If the value is set to "0" and the end phrase is defined, it waits infinitely for the data capture. Whereas, when the end phrase is not defined, data is returned immediately. This timeout is approximate, as it may encounter a 1 to 2 second delay. The default value is "0."

  • Voice commands - Configure and set voice commands to navigate a foreground application. Commands are supported only when the device is in the "waiting for start phrase" or "press and hold PTT button to speak data" states.

  • Tab command - Sends a tab key event when speaking the specified phrase.
    • Enabled – Enable/disable the tab command.
    • Phrase - Sets the command phrase to send a tab key. The default phrase is "send tab.”
  • Enter command - Sends an enter key event when speaking the specified phrase.
    • Enabled – Enable/disable the enter command.
    • Phrase - Sets the command phrase to send an enter key. The default phrase is "send enter.
  • Move next command - Move to the next input field when speaking the specified phrase.
    • Enabled – Enable/disable the move next command.
    • Phrase - Sets the command phrase to move to the next input field. The default phrase is “move next.”
  • Move previous command - Move to the previous input field when speaking the specified phrase.
    • Enabled - Enable/disable move previous command
    • Phrase - Sets the command phrase to move to the previous input field. The default phrase is “move previous.”
  • Escape command - Send the escape (ESC) key when speaking the specified phrase.
    • Enabled – Enable/disable escape command
    • Phrase - Sets the command phrase to send an ESC key. The default phrase is "send escape.”
  • Clear command - Clear the current input field in focus when speaking the specified phrase.
    • Enabled – Enable/disable the clear command.
    • Phrase - Sets the command phrase to clear the field. The default phrase is “clear.”
  • Data type - Configures the data type to be returned, with selections of: Any, Alpha, or Numeric. The data type is required to restrict data captured according to the preferences. Data type selections:
  • Any - All scanned data is returned. For example, if the barcode ABC123 is scanned, it will return ABC123 as is.
  • Alpha - Only alpha characters are returned. For example, if the barcode ABC123 is scanned, it will return ABC only.
  • Numeric - Only digits are returned. For example, if the barcode ABC123 is scanned, it will return 123 only.
  • Start phrase waiting tone - Controls the start phrase waiting tone. It enables/disables the audio feedback for “waiting for start”, notifying that the device is waiting to start the speech engine in case the toast message notification is missed and there is a change in “waiting for data” state.

  • Data capture waiting tone - Controls the data capture waiting tone. It enables/disables audio feedback for “waiting for data”, notifying that the device is waiting to capture data in case the toast message notification is missed.

  • Offline speech recognition - Enables offline speech recognition when there is no access to the internet. This uses an offline recognition speech engine to detect the data spoken.

  • Validation window - Validates the result after speaking, displaying the spoken data and provides for editing the data on the same screen, if needed. This is useful in offline mode, since the results received in this mode might not be accurate.

img

See Limitations below.

Configuration

Voice Input Parameters

DataWedge Voice Input can be controlled programmatically with DataWedge APIs. Refer to DataWedge Voice Input Plugin in Set Config API to configure the following Voice Input parameters:

Param Name Param Values
voice_input_enabled true, false
voice_data_capture_start_option 0 - Start phrase (default)
1 - PTT button
voice_data_capture_start_phrase start (default)
voice_data_capture_end_phrase [blank] (default)
voice_end_detection_timeout 0-30 (in seconds)
voice_command_tab_enabled true
false (default)
voice_command_tab_phrase send tab (default)
voice_command_enter_enabled true
false (default)
voice_command_enter_phrase send enter (default)
voice_command_move_next_enabled true
false (default)
voice_command_move_next_phrase move next (default)
voice_command_move_previous_enabled true
false (default)
voice_command_move_previous_phrase move previous (default)
voice_command_escape_enabled true
false (default)
voice_command_escape_phrase send escape (default)
voice_command_clear_enabled true
false (default)
voice_command_clear_phrase clear (default)
voice_data_type 0 - Any
1 - Alpha
2 - Numeric
voice_start_phrase_waiting_tone true, false
voice_data_capture_waiting_tone true, false
voice_validation_window true, false
voice_offline_speech true, false

Set Voice Input Configuration Sample

Refer to DataWedge Set Config API.

Limitations

  • Voice Input is validated only with English. For use with other languages, the device must be connected to the internet.
  • Offline speech recognition provides lower accuracy levels.
  • In GMS Restricted mode with the use of App Manager's DisableGMSApps action, Voice Input will not work since it relies on Google speech recognition.
  • Do not use Google Assistant while DataWedge Voice Input is in use, as it can lead to undesirable behavior.
  • Providing numbers and other special characters as part of the data capture start phrase is not supported.
  • Voice Input is not supported if Enterprise Home Screen (EHS) is in restricted mode. However, enabling all the privilege settings in EHS will reinstate Voice Input in DataWedge.
  • If the PTT (push-to-talk) button is released during voice capture, there can be a 1 to 2 second delay to display the captured data due to the speech engine continually listening at that moment.
  • When PTT Express is enabled and running, Voice Input should not be used simultaneously, otherwise it can lead to unexpected behavior.
  • When Voice Input is enabled in an active DataWedge profile, the media volume stream is muted via the volume control of the device.

Related guides: