Building a mixed-reality 3D avatar to streamline banking workflows

Designed specifically for Apple Vision Pro, this helpful virtual avatar simplifies everyday tasks, speeds up internal workflows, and helps employees quickly respond to customer inquiries.

Customer

Industry

Banking

Region

Client since

2024

Our client is a European-based bank known for innovative, customer-focused solutions in the finance sector.

Detailed information about the client cannot be disclosed under the terms of the NDA.

Challenge

The client needed a quicker, easier way for employees to access policy details, process claims, and handle customer inquiries. They sought an interactive, text and voice-driven AR solution for Apple Vision Pro to streamline internal processes and improve customer service efficiency.

Solution

To address these challenges, Innowise developed an AI-powered AR assistant for Apple Vision Pro, featuring a lifelike 3D avatar that employees can interact with via voice or text. Our task was designing the application’s interactive avatar and immersive interface, and integrating it with the client’s AI model. This integration allows the AR assistant to provide accurate, relevant answers to queries.

The core features we implemented include:

Voice chat

Employees can easily activate the AI assistant just by speaking a voice command. If they prefer, they can even dictate text prompts through voice recognition. This helps cut down on manual typing, speeds up conversations, and makes things much simpler, especially when employees are working on tricky or complicated tasks.

Volumetric immersive interface

One of the standout elements of our solution is the volumetric interface, where the animated assistant appears in AR as a fully interactive avatar. This floating chat window enhances the engagement level by making responses more visually appealing and contextually immersive.

Avatar widget for multi-platform use

Employees can interact with the AI assistant simultaneously through augmented reality and regular “plain-screen” web applications. This setup ensures employees can easily integrate the assistant into their daily workflow without any disruptions.

Comprehensive chat interface

We implemented a structured chat system with:

Scrollable chat history to track past conversations.
A clear input field for text or voice interaction.
The ability to handle multiple response types.

Support for multiple data types

Bank-related queries often require different types of responses. Our solution supports:

Text responses for standard inquiries.
Document attachments (e.g., opening PDFs in a new window upon interaction).
Image responses to illustrate certain explanations.

Voiceover and animated avatar responses

The AI assistant delivers all responses through natural-sounding voiceovers, creating a fluid, human-like conversation. The system dynamically syncs lip movements and body animations that automatically match the generated speech.

Technologies

Devices

Apple Vision Pro

Front-end

Swift

AR development

Unity, XR Interaction Toolkit, visionOS

Team

Technical Artist

3D Animator

UI/UX Designer

Business Analyst

Project Manager

Results

Thanks to the AI-powered AR assistant, the client saw significant improvements in internal efficiency and customer service quality. Employees now handle customer claims 20% faster, making the entire process simpler and less stressful. With instant voice activation and intuitive, lifelike interactions, staff can easily access policy details, answer inquiries swiftly, and streamline their daily tasks.

Project duration

January 2025 - Ongoing

20%

faster response time

15%

increase in employee productivity

Related cases

Contact us

Book a call or fill out the form below and we’ll get back to you once we’ve processed your

What happens next?

Once we’ve received and processed your request, we’ll get back to you to detail your project needs and sign an NDA to ensure confidentiality.

After examining your wants, needs, and expectations, our team will devise a project proposal with the scope of work, team size, time, and cost estimates.

We’ll arrange a meeting with you to discuss the offer and nail down the details.

Finally, we’ll sign a contract and start working on your project right away.