Artificial Intelligence and Machine Learning

Introduction

iconik gives users the ability to integrate with Artificial Intelligence/Machine Learning services to enrich their media archive. We currently support integration with transcription, facial recognition, object detection, and summarization and topic extraction services. All use of AI/ML services are optional and customer administrators of the iconik domain can choose to allow access to these features on a per-user level.

iconik comes with some services configured by default but customers can choose to disable these and use their own accounts with the supported AI services.

Transcription

Transcription services use the audio track of a video or audio file to create a textual transcript. Out of the box, iconik uses Rev AI as our transcription engine but Amazon Rekognition can also be used.

When a user sends a video file to the transcription service we extract the audio track and pass only the audio over to the service. The transcription service temporarily stores the audio file to be able to run the analysis. Once the transcription job has completed the file is deleted from the transcription service.

When using the Rev AI transcription engine it is also possible to configure Summarization and Topic Extraction. When this functionality is used the output of the transcription engine is used to create a short summary and a list of topics covered in the media file.

The resulting transcription output is stored in iconik's database, associated with the media asset and is deleted either when a user manually deletes the transcription track, or when the asset itself is deleted.

Analysis

iconik supports the Amazon Rekognition and Google Vision and Video AI services for Facial Recognition and Object Detection. As with transcription, customers can choose if they want to use the iconik managed services or bring their own accounts.

For image and video analysis we send the proxy file to the analysis service. This proxy file is smaller in size than the original file but contains the equivalent information and is therefore suitable to use as a substitute in the analysis process. The analysis service keeps a copy of the file for the duration of the analysis and the file and associated metadata is deleted once the analysis job is completed.

Training

iconik, and the services we use, do not use any customer content to train any AI models.

More information