Ford Motor Company is a multinational automotive manufacturer headquartered in Dearborn, Michigan, employing 199,000 employees and producing a total of 5.9 million vehicles in the last recorded year. Ford designs and manufactures a full line of cars, trucks, SUVs and electric vehicles under both the Ford and Lincoln brands.

Every Ford vehicle comes with a printed owner’s manual containing more than 300 pages of basic information pertaining to the operation and maintenance of the vehicle. This manual is cumbersome, difficult to navigate, and has not evolved with the technology inside the vehicles.

Our Augmented Reality Owner’s Manual application provides an intuitive and accessible digital version of the owner’s manual with augmented reality (AR) capabilities.

The interior of the vehicle is displayed from the driver’s perspective using the phone’s camera. From this screen, interactive digital content is overlaid using AR, enabling users to quickly access resources.

When a user clicks on an interactive component of the augmented reality display, a list of relevant content is displayed. This content includes a digital version of the corresponding owner’s manual section, tutorial videos and answers to frequently asked questions. Alternatively, the same content is accessible through the search bar from the app’s homepage.

Authorized Ford employees create, edit and delete vehicles and manage any associated content through the web application. This content is accessed via the iOS app for the respective vehicle.

Our iOS application leverages Swift and ARKit to provide an AR experience. The web application is built using the ReactJS framework. The web application and iOS application are linked through an API and database hosted by Amazon Web Services.