Skip to main content

How to configure Intelligent Tracking for Bosch cameras with FW 8.47?


1. Introduction & Overview


Never lose track of an object of interest! Intelligent Tracking automatically zooms in to and follows a selected Intelligent Video Analytics (IVA) or IVA Pro object as far as possible with the camera.


1.1 Camera-specific variants of Intelligent Tracking


Depending on the cameras, this has the following, different effects (Note that cameras are clustered via their common product platform (CPP)):


AUTODOME / MIC IP 7100i / 9000i (CPP 7.3 & 13):

  • Automatically get close-up shots of suspects for viewing and recording
  • Automatically track the suspect even outside the current preposition to see and document what he is doing
  • Ease of use: Steer the camera (pan/tilt/zoom) for the operator


FLEXIDOME IP panoramic 6000 / 7000 (CPP6):

Ease of use: Steer the virtual PTZ camera for the operator to obtain the optimal and already dewarped video of the object of interest. By recording the full resolution in parallel, no detail is lost.


DINION / FLEXIDOME IP 7000 / 8000 (CPP6/7/7.3):

Oftentimes, operators watch several cameras at once on a screen, leaving SD resolution or less for each single camera video. By using Intelligent Tracking to automatically zoom in, a close up of the suspect can automatically be shown in this small resolution, to allow the operator to faster decide on incidents. Furthermore, the motion of the ROI will aid in focusing the attention of the operator. By recording the full resolution in parallel, no detail is lost.


1.2 IVA Pro Intelligent Tracking


IVA Pro Intelligent Tracking, based on deep learning, provides an AI-based version of this Intelligent Tracking feature for CPP13 MIC/AUTODOMEs. IVA Pro Intelligent Tracking automatically detects and separates upright persons and vehicles and is robust even in crowded scenes. Robust algorithms based on artificial neural networks are trained to ignore potential disruptions caused by vehicle headlights or shadows, extreme weather, and sun reflections. Thus, a PTZ camera equipped with IVA Pro Intelligent Tracking can automatically follow persons and vehicles in traffic or inner city scenes by panning, tilting, and zooming to follow an object of interest and keep it prominently in the field of view.

When to use IVA Pro Intelligent Tracking:
IVA Pro Intelligent Tracking works with both IVA Pro Buildings and IVA Pro Traffic.

When not to use IVA Pro Intelligent Tracking:
For protection against professional intruders that are camouflaged, rolling or crawling to circumvent detection, IVA or IVA Pro Perimeter must be used. When started from IVA Pro Perimeter, IVA Pro Intelligent Tracking is automatically disabled and the normal Intelligent Tracking takes over instead.

Object classes:
IVA Pro Intelligent Tracking inherits the available classes. If only IVA Pro Buildings is available, then IVA Pro Intelligent Tracking detects, distinguishes, and tracks persons and vehicles. If IVA Pro Traffic is available, then the following object classes are available: person, bicycle, motorbike, car, bus, truck.


1.3 Trigger Modes


There are two different modes to trigger Intelligent Tracking:
Auto mode: In this mode, the camera follows any object that has triggered an alarm in the Intelligent Video Analytics application. This mode is most useful for scenarios in which the alarm cases can be clearly defined, for example, when a vehicle is driving the wrong way or when a person is present on a highway.
Click mode: In this mode, users can click on any object detected by the Intelligent Video Analytics application to enable the camera to track the movement of the selected object.


1.4 Limitations


  • IVA or IVA Pro Perimeter are needed to start Intelligent Tracking
  • IVA Pro Buildings or IVA Pro Traffic are needed to start IVA Pro Intelligent Tracking
  • MOTION+ and Intelligent Video Analytics FLOW cannot start the Intelligent Tracking
  • Intelligent Tracking may be confused if more than one object moves through the field of view.
  • Intelligent Tracking may be confused by motion in the background like wind in trees or moving water. If possible, mask out these areas.
  • AUTODOME / MIC IP 7100i / 9000i (CPP 7.3 & 13):
    o If a suspect is followed with Intelligent Tracking, another suspect may pass through undetected through the areas currently not covered by the cameras field of view.
    o If the camera needs to significantly zoom in on a faraway suspect, the object may be lost while zooming.
    o Motion towards the camera, especially with a low perspective, may appear too small to properly follow.
    o Will not work on water.
    o Motion from other objects or background, like trees in the wind, can confuse the Intelligent Tracking
    o When an object stays still for too long, it will be lost and the camera returns to its original task.


2. Visualization of Intelligent Tracking status


Visualizations

Intelligent Tracking active, waiting for object to follow

 
Icon blinking

    Blue object outline

Intelligent Tracking active and following object with blue outline

 
Blue rhomb at last object position

Intelligent Tracking active, object is lost but still waiting for reappearance

Intelligent Tracking active, object is lost


3. Configuration



AUTODOME / MIC 7000DINION / FLEXIDOME 7000 / 8000
What does Intelligent Tracking do?
Follow selected objectCamera pan / tilt / zooms to follow
selected object
Region of interest (ROI) is used to follow selected object
Zooming viaOptical zoomDigital zoom
Which Streams?All streams
No ROI streams available
2nd stream if ROI
FLEXIDOME IP panoramic 7000: Via video “Virtual PTZ”, all streams
TechnologyOptical flow based tracking algorithmBased on Intelligent Video Analytics metadata from full camera field of view
How to start Intelligent Tracking?

Live Page -> Intelligent Tracking

Auto: Follows any Intelligent Video Analytics alarm object. In case of SilentVCA follows any Intelligent Video Analytics object. This mode is most useful for scenarios where no motion is expected in the scene. Click: User clicks on any object tracked by Intelligent Video Analytics to start Intelligent Tracking of this object.

This mode is most useful for scenarios where normal scene activity is expected.

How to enable Intelligent Video Analytics?
SilentVCA: Intelligent Video Analytics metadata with default configuration and without alarmsVCA -> VCAConfiguration
Active by default outside prepositions
VCA -> VCAConfiguration
Video Analytics AlarmsDefine at least one preposition and assign it to the video analytics profile. Set VCA -> Analysis type to Intelligent Video
Analytics. The video analytics will start as soon as the corresponding prepositions are reached.
Choose a single profile, or switch between up to two profiles via scheduling or event-trigger. Set VCA → Analysis type to Intelligent Video Analytics.
What happens when object stops or is lost?
(1) Adjustment of ROI for better reacquisitionPTZ Settings -> Tracking zoom-out limit-
(2a) Case object stoppedWait for reappearing object:
PTZ Settings -> Tracking idle time
Object still tracked for VCA -> Metadata
Generation -> Stopped object time
(2b) Case object lostWait for reappearing object:
PTZ Settings -> Tracking idle time
-
(3) Wait some morePTZ Settings -> Inactivity period10 sec
(4) Go back toPTZ Settings -> InactivityPreposition if set in / for recording, full zoom out else

AUTODOME / MIC 7000DINION / FLEXIDOME 7000 / 8000
What happens when Intelligent Tracking already follows an object and a new (alarm) object is detected?
Intelligent Tracking will continue following the object and ignore any new objects.
How to stop Intelligent Tracking?
  • Live Page -> Intelligent Tracking -> Off
  • Manually steer camera / ROI
How to suppress Intelligent Tracking locally?
MaskingVirtual MasksVCA Masks
How to remove the Intelligent Tracking option from the Live Page?
LIVE Functions –> Intelligent Tracking



Stream types DINION / FLEXIOMEDescription
ROI (Region of Interest)Zoom / move manually or via Intelligent Tracking in the overall image. When
recording a ROI stream, it can be configured which preposition should be used
and moved back to after Intelligent Tracking stops.
Dual ROITwo independent ROI streams. Configure / open via two browser windows /
tabs. Only the first ROI stream will be recorded.
All othersUnchangeable field of view.




JavaScript errors detected

Please note, these errors can depend on your browser setup.

If this problem persists, please contact our support.