WebRTC mobile app development

Innowise delivered a feature-rich mobile WebRTC solution for AI-powered video conferencing and call analyses.

Customer

Industry

Information Technology

Region

Client since

2022

Our client, a tech company based in Europe, specializes in digital communication solutions. Operating in a competitive global market, they strive to enhance digital interactions for individuals and businesses.

Detailed information about the client cannot be disclosed under the provisions of the NDA.

Challenge

The client reached out with a sophisticated video conferencing platform already in place, rich with AI-powered functionalities aimed at transforming online communications. Their platform had features like real-time call transcription, sentiment analysis during dialogues, in-depth conversation analytics, and more.

These features enhance communication by offering deeper insights into conversations, gauging emotional tones, and providing concise meeting summaries. By analyzing real-time activity, users can identify and address any engagement gaps, ensuring smooth and productive interactions throughout.

Despite having a robust web version of their platform, the client faced hurdles in addressing the mobile-centric audience. The lack of a dedicated mobile video conferencing solution constrained their growth in this segment.

The primary issues highlighted by the client were:

Feature parity: The need for the mobile app to offer the same comprehensive suite of features as the web version, ensuring a consistent experience across devices.

AI integration: Integration of AI algorithms to analyze mobile call records, extract insights, gauge the mood of conversations, and provide summary snapshots of discussions for mobile users.
Authentication flexibility: Incorporating secure login methods, especially integrating with popular platforms like Google and Apple, to boost user adoption.
Optimized video stream: Managing the video feed’s quality dynamically to ensure call fluidity, given the diversity of mobile devices and network conditions.

Given these requirements, the client approached Innowise to craft a mobile application that mirrored the web platform’s strengths but with the added agility and features tailored for mobile users.

Solution

Our video conferencing app development company embarked on designing a customized mobile application tailored for AI-powered video conferencing. Over 4 months, we have developed the mobile version and integrated real-time transcription, gesture recognition, meeting summaries, scheduling customization, call synchronization, and mobile-optimized meeting notes accessibility.

Custom calendar & schedule management

Addressing the requirements posed by the client, our development team created a custom calendar widget instead of relying on off-the-shelf solutions. Several factors influenced this decision:

Layout rules: The mobile app required intricate visual representation rules. Meetings should be depicted based on their durations, priorities, and topics for intuitive comprehension. Any overlaps or concurrent meetings needed to be distinctly visible to the user. Handling overlaps required us to develop algorithms to position each meeting accurately and avoid visual clutter. This granularity of control was hard to achieve with pre-built solutions.
Integration with existing solutions: Recognizing that users often rely on other platforms for their scheduling, our solution offers integrations with Google Calendar and other scheduling tools on demand.
Deep linking and instant meeting joining: The mobile app enables users to share a meeting link with anyone, even those without the application. Clicking on this link opens up the application, or if the recipient doesn’t have the app installed, it initializes the meeting in the optimized browser version.

Enriched call experience with AI integration

The application provides an interactive call experience tailored to the preferences and needs of each participant. Beyond the conventional offerings of video and sound, the app is notable for its AI-driven gesture and mood recognition. During calls, the system detects and interprets specific gestures and face expressions made by users. For instance, waving at the camera or giving a thumbs-up can be instantly recognized by the application, which then can translate these gestures into chat emojis, providing a visual cue to all participants about an individual’s reactions.

Our team implemented a preference-based adaptive video system. Depending on the user’s preferences and network conditions, the video quality dynamically adjusts. This ensures that, irrespective of bandwidth limitations, users have smooth call experience.

All incoming calls are recorded and stored on the system’s back-end. This data not only serves as a record but is also analyzed by AI to provide insights into the dynamics of the call. Whether it’s understanding the mood of the conversation through AI-analyzed transcriptions or recognizing the level of participant engagement, the system provides valuable feedback to users post-call.

Call recording & post-call analysis

With the importance of post-meeting analysis in mind, our solution incorporated call recording features. Not only can users record their sessions but they can also review them with varied playback speeds. AI further amplifies this experience by breaking down the call into distinct segments based on topics.

For those who prefer a concise overview, the AI system generates a summary, highlighting the pivotal points of discussion, decisions made, and action items agreed upon. This feature is particularly advantageous for those who might have missed the meeting or need a quick refresher.

The app provides trend analysis over time. By accumulating data from consecutive meetings, users can track recurring themes, frequently discussed topics, or persistent issues. This is instrumental for long-term projects where tracking progress and identifying consistent pain points guide strategic decisions.

Another feature is speaker identification. The AI system can discern different voices and tag them, simplifying the process of tracking speakers’ contributions during a meeting for better clarity. This is particularly useful in larger meetings with multiple participants.

Moreover, to assist in the preparation for future meetings, the app offers predictive analysis. By examining past meetings, it can suggest potential topics or questions that might arise, helping participants to be better prepared.

All these analytical tools, once confined to desktop platforms, have been presented in the mobile application, ensuring that users can tap into insights anytime, without compromising on intuitiveness.

Technologies & tools

Back-end

Dart, BloC, REST, GraphQL

Front-end

Dart, Flutter, AutoRoute, Easy Localization

Communication Protocols

WebRTC, WebSockets

Routing and Navigation

AutoRoute

Localization

Easy Localization

State Management

BloC

Process

Our WebRTC mobile app development approach was in strict alignment with the Agile methodology, emphasizing iterative delivery, adaptability, and regular feedback cycles. The process was detailed as follows:

Discovery phase: We commenced by reviewing the list of features the client desired. After a thorough examination, our experts assessed the feasibility of each feature and subsequently created individual tickets for them. The absence of a concrete technical specification required our team to reference the web version, ensuring the mobile experience retained the core features.
UI/UX design: Although the client provided the web designs, our role was pivotal in translating those designs into a mobile-friendly interface.
Development: This phase was split into sprints, with each ending in a client demonstration. Since the backend was already in place, our developers had to liaise closely with the client’s backend team, ensuring compatibility between existing infrastructure and our mobile adaptations.
Testing & QA: Testing was an ongoing process conducted in parallel with development, ensuring any emerging bugs or glitches were promptly addressed.
Deployment & maintenance: With the application developed, our next step was its launch, followed by our commitment to its continuous support and refinement based on user feedback.

The hallmark of our collaboration was using the mobile WebRTC solution itself as a video conferencing tool to communicate with the client. Initially, we used its web version, and as our project progressed, our meetings transitioned to the mobile version we created. Jira facilitated our task tracking and sprint planning, ensuring transparency in our operations.

Team

Project Manager

Flutter Developers

Mobile Team Lead

QA Engineer

Front-end

Expected results

Following the mobile video conferencing app launch, we expect strong adoption from the existing user base. The mobile-first approach will allow users to join meetings from anywhere, making participation more accessible than ever. Quick-invite links will streamline the process of adding new participants.

We anticipate a noticeable increase in new user registrations. This will reflect the app’s market appeal and solidify its position. In turn, we expect enhanced visibility and interest, leading to further investment opportunities.

Project duration

May 2022 - September 2022

60%

mobile app adoption among existing users

15-20%

reduction in bandwidth use per call

Related cases

Contact us

Book a call or fill out the form below and we’ll get back to you once we’ve processed your request.

Name

Company

Phone

Message

Send us a voice message

Attach documents

Upload file

You can attach 1 file up to 2MB. Valid file formats: pdf, jpg, jpeg, png.

By clicking Send, you consent to Innowise processing your personal data per our Privacy Policy to provide you with relevant information. By submitting your phone number, you agree that we may contact you via voice calls, SMS, and messaging apps. Calling, message, and data rates may apply.

You can also send us your request
to contact@innowise.com

What happens next?

Once we’ve received and processed your request, we’ll get back to you to detail your project needs and sign an NDA to ensure confidentiality.

After examining your wants, needs, and expectations, our team will devise a project proposal with the scope of work, team size, time, and cost estimates.

We’ll arrange a meeting with you to discuss the offer and nail down the details.

Finally, we’ll sign a contract and start working on your project right away.