How Solvd developed a Learning Management System with multiplayer VR & AR for TriPointLab

Contact Us

About project

Industry

Education

Platform

Web, Mobile, Desktop (Cross-Platform)

Company Profile

TriPointLab is a dynamic American company that specializes in the development and implementation of innovative medical education technologies. The company owns a comprehensive education platform that encompasses the human body and its systems. It includes multiple applications that are focused on the enhancement of the students’ knowledge and learning experience.

The client's Challenges and Goals

  • In 2016 Solvd was approached by TriPointLab for designing and implementing a   highly complex project.
  • They were looking for an innovative partner to create a VR/AR-enabled learning management platform. The platform was expected to become an educational system to be used actively in the future training of surgeons. It had to provide a fully immersive real-time VR/AR learning process that allows instructors to lead a group of students on-site or remotely; regardless which device they were using.
  • Since the platform was required to work in the virtual space for multiple users simultaneously, it needed to have complex network logic. Also, the subject field required medically accurate 3D modeling, largely based on real human data.

Project Details

  • Engagement Model

    Outsource

  • Service:
    • Learning Management System Development
    • VR LMS
    • 3D Modeling
  • Effort
    • 5 engineers (including a VR specialist with a medical background)
    • 1 3D artist
    • 1 project manager
    • 2 designers

Technologies Used

  • Unity 3D

  • .NET Core

  • Entity Framework

  • SQL Server

  • Docker

  • Swagger

  • ARKit

  • GoogleVR

  • ARCore

  • SteamVR

  • OculusVR

  • Microsoft HoloLens

  • Microsoft Azure

Solution & Results

We had to take some risks to build the solution by utilizing a new industry-leading technology stack, but it paid off with both cost-savings and increased feature capabilities.Besides general AR/VR technologies, we also implemented an AI-based computer vision for object detection on the live video in order to identify which students participated in practicing surgery the most.

results image

Solvd built a product all the way from TriPointLab’s initial idea to a tangible enterprise solution. Pushed by deadlines and dedicated to the Apple ARKit release, our team worked efficiently and effectively, delivering portions of the working product to dynamically adapt to our client’s vision and requirements. TriPointLab received a final product that met all of the requirements that were specified in their initial vision. Our resulting solution contains:

  • VR clients for desktop (Oculus Rift) and mobile (iOS, Android)
  • Mobile AR clients (iOS, Android)
  • Kiosk – an app for exhibitions and museums (3D desktop / VR desktop)
  • A solution for recognizing activities performed in a surgery practice room
  • Real-time and mobile user analytics integration
  • Setup and integration for ad providers
  • 360-degree test automation: mobile, web, API, localization, fitness gear integration

Examples of system components

  • system component

    Kiosk application – exhibited at The Tech Museum of Innovation with a 10-year contract

  • system component

    AR application for students so they can preview all the elements available for the lecture

  • system component

    Full 3D anatomy models for students teaching

A quote from our Customer

I’ve outsourced programming needs to many development firms over the years, from single contractors to larger groups, though I’ve never come across a company quite like Solvd. Instead of finding myself responsible for specifying, tasking and managing, Solvd has found an ingenious way to seamlessly provide this level of service - riding on top of the FTEs we have working on the actual code. A business analyst works with me to understand our road map and applies a broad vision to make sure the team is executing properly. A managing partner is always available to make sure any blocks are removed, and production continues smoothly. Our code ends up very scalable and conforms to best practices. I can’t recommend this group enough to any startup or established firm in need of quality developers who can be counted on to stick with a project and deliver world-class results."
Matthew Hasel
CEO at TriPointLab

A quote from Solvd’s team:

Developing the TPL was an exciting journey for our team, as we delved into the intricate details of human anatomy to create highly detailed 3D models and scans. Our aim was to bring an immersive virtual experience to life while creating a versatile cross-platform product that makes it easy for thousands of students to study the human body from the inside."
Denis Avramenko
Solutions Architect at Solvd

Need an effective AR/VR solution for your business? Look no further.

Solvd is here to help