CSE498, Collaborative Design, Fall 2023
Computer Science and Engineering
Michigan State University

Founded in 1916, Auto-Owners Insurance is a Fortune 500 company employing more than 4,700 associates to provide nearly 5.6 million insurance policies across 26 states. Auto-Owners Insurance has been headquartered in Lansing, Michigan for over 100 years.

One of Auto-Owners insurance offerings is home coverage. Making a claim relating to home coverage represents a significant expense for both the company and policyholders. To minimize these claims, Auto-Owners wants a way to provide homeowners with understandable and comprehensive insurance and loss prevention information for common at-risk items.

Our Help Me See! application utilizes the HoloLens 2, an advanced mixed reality headset (shown on the right), and augmented reality to inform homeowners of the insurance information surrounding common household objects.

Users select from two modes, overlay and object detection. In overlay mode, policyholders choose from a variety of common objects, such as refrigerators, toasters, and fire extinguishers. The selected object appears in holographic form in front of the user to be moved and placed within the virtual space. When a user presses the information button on the object, the loss prevention and insurance information appear next to the object.

In object detection mode, the application captures an image to analyze for insured objects that a homeowner has in their home. Detected objects have the same information button seen in the overlay mode. The insurance information can then be displayed for the given object in a similar manner to overlay mode, this time with existing objects.

Help Me See! is built in Unity and written in C#. The object detection mode utilizes Azure AI services to detect and track real world objects.