Blue Eye - Distributed Inferencing Service Creation

Company Overview

Blue Eye is a video surveillance monitoring service provider offering businesses with state-of-the-art security solutions which utilize advanced AI algorithms and human intelligence to analyze video feeds from security cameras in real-time, helping businesses prevent theft, vandalism, and other security threats.

Project Description

In this project, students will harness the power of the Orleans framework to develop a cutting-edge distributed inferencing service. This service is designed to seamlessly integrate, enabling utilization of inferencing hardware across a variety of deployment models, including cloud-based systems, on-premises infrastructures, and colocation facilities (CoLo). The key feature of this service is its ability to effectively leverage unused computational capacity, regardless of its physical or virtual location. By building on the robust and scalable foundation provided by the Orleans framework, the service aims to offer flexible and efficient inferencing capabilities, adapting dynamically to the diverse hardware environments. This approach ensures optimal utilization of resources, enhancing the performance and scalability of inferencing tasks across multiple deployment scenarios.