AR+concierge™
“Say hello to my little friend!”
AR+concierge™
The AR+concierge™ is an adaptable and innovative solution, offering personalized 3D animated or static avatars designed to enhance user interaction. Whether the goal is immersive engagement at a point-of-sale, a reception area, a retail store, or an event location, AR+concierge™ adjusts to the specific context. Each user experiences tailored, direct interaction, making the service feel unique and individualised.
With scalable AI capabilities, AR+concierge™ acts as a dynamic, intelligent representative, capable of delivering information, guidance, and even interactive games, all tailored to the user’s specific needs. This flexibility allows for limitless experiential possibilities, only constrained by the creativity applied to its implementation
examples - *orby for BP UK POC (2018); AuRaki for #WeAreTheMainstream (2022) ©2018-2022 iSPARX.group Limited all rights reserved
OpApp
Place your concierge & Points Of Interest (POI) with the Operator App (OpAPP) - a bespoke solution of the AR+concierge™ package.
POI can be larger than life locations like a huge animated mascot or structure on or over a location or building or a small item on a shelf in a store… there are endless opportunities.
CMS
Our proprietary Content Management System (CMS) allows admins to edit content, media & placement.
This is an exciting feature of the AR+concierge™ package - the ability to dynamically set & effect locations with interactive augmented reality content, streaming live & on demand 360° media & multi player installations.
RTAnalytics
Real Time Analytics - a view of measured interactive & live analytics in easy to read graphics on a secure website.
You can track dwell times, transactions & user preferences in real time while maintaining security & confidentiality. Your concierge becomes an entity that the user can confide in.
iSPARX™ AR + GPT-4o: The Next Generation of Artificial Intelligence in Augmented Reality
GPT-4 and GPT-4 Turbo
OpenAI's GPT-4 is a powerful multimodal model that excels at handling text and image inputs, producing accurate and insightful text outputs. With its enhanced general knowledge and reasoning capabilities, GPT-4 surpasses previous models in solving complex problems. GPT-4 is available through the OpenAI API, and like GPT-3.5 Turbo, it's optimized for chat while remaining adaptable to traditional completion tasks using the Chat Completions API.
PT-4o: A Multimodal Leap Forward
GPT-4o represents the latest advancement, a multimodal model that can process not only text and images but also other types of input like audio and video. This expanded capability opens up new possibilities for creating even more immersive and interactive AR experiences.
Harnessing GPT-4o for iSPARX™ AR+
By integrating GPT-4o into the AR+ project, iSPARX™ is poised to redefine the augmented reality landscape. The AR+concierge™, powered by GPT-4o, will become an even more intelligent and responsive virtual guide. Consumers can engage in natural conversations with the AR+concierge™, seeking information, advice, and assistance within AR experiences.
Advantages for iSPARX™ Clients
Enhanced User Experience: The integration of GPT-4o will enable clients to create AR experiences that feel more like natural interactions, leading to deeper engagement and satisfaction for consumers.
Streamlined Content Creation: The AR+ web interface and CMS, when combined with the intuitive capabilities of GPT-4o, will empower clients to easily build and manage their AR experiences, regardless of their technical background.
Increased Accessibility: The ability of GPT-4o to process multiple input modalities (text, image, audio, potentially video) will make AR experiences more accessible to a wider audience, including those with diverse abilities and preferences.
The Future of iSPARX™ AR with GPT-4o
The fusion of iSPARX™ AR technology with the cutting-edge AI capabilities of GPT-4o marks a significant step towards the realization of truly intelligent and interactive augmented reality experiences. As GPT-4o continues to evolve, the potential for innovation within the iSPARX™ AR+ platform is boundless.
iSPARX™ AR+Generative AI on OpenAI and Azure Cloud Services - Artificial Intelligence
Generative AI on OpenAI and Azure Cloud Services provides access to powerful generative AI models, enabling you to test, tune, and deploy them for use in your AI-powered applications.
A multimodal model is a type of model capable of processing information from multiple modalities, including images, videos, and text. For instance, you can provide the model with a photo of a plate of cookies and ask it to generate a recipe for those cookies.
OpenAI API
OpenAI offers a family of generative AI models designed for multimodal use cases. The OpenAI API grants access to advanced models capable of handling a variety of tasks. For specifications of the OpenAI API models, see Model information.
Supported use cases
The OpenAI API supports the following use cases by model:
Natural Language Tasks: Designed to handle natural language tasks, multi turn text and code chat and code generation.
Multimodal Prompts: Supports multimodal prompts, allowing you to include text, images, and videos in your prompt requests and receive text or code responses.
Ai Analytics & Analysis: telemetrics, user analytics, heat maps & preferences.
*developed for a BP POC
- the first AR+concierge™ - Orby.
Orby flew around a Roadmaster BP outlet in Melbourne leading customers to featured products & redeemable digital games & prizes.
iSPARX™ was provided a short brief - retail, AR engagement (“probably 200 retail locations - tops!”).
To our surprise the brief was a POC for BP with consideration for scale & installation of the BP Global network & 18,500 outlets… with 6 weeks to deliver a POC functional App tested at a location - Melbourne; 3 x 2 week sprints; multiple sets of International flights across 3 continents & with an entourage of 12 (6 x iSPARX™, 2 x Two Goats, 2 x EY & 2 key BP contacts).
#WeAreTheMainstream
AuRaki is an AR+concierge™ made by artist HORI as an artistic installation AS SEEN at TVNZ, STUFF, Mediaworks & other major media outlets in Aotearoa - a cultural capability tool.
Ōtaki-based artist Hohepa ‘Hori’ Thompson and iSPARX™ launched the We Are the Mainstream project in November 2022, involving a digital art character named Auraki, waiting outside some of New Zealand’s largest media companies to be invited in.
The character remained inside the building for three months and offered tools and support to help media staff gain a better understanding of te ao Māori and be more culturally aware in the work that they do.
Auraki is viewable through the Hori app on mobile devices, and will offer questions to media staff regarding cultural competency surrounding te ao Māori every day.
*AR+concierge™
is designed to suit your customer preferences…
We designed AR+concierge™ to give your customers the best possible experience suited to their needs and preferences.
Our interactive guides use augmented reality technology to provide assistance in engaging, visual ways. You can customize 3D concierges with helpful voices and conversations to inform patrons, offer recommendations, and respond dynamically based on what's happening.
With our easy-to-use web tools, you have complete control over tailoring your concierges' interactions. See what resonates through collected analytics and optimize content over time.
AR+concierge™ aims to redefine customer service by blending immersive technology with data-driven personalisation. The goal is to build genuine rapport with patrons in today's tech-focused but still human-centered world.
Your customized concierges become trusted local guides - more appealing and assisting than static signage or pre-recorded messages.
We're excited to help you create next-gen experiences that wow your customers and keep them coming back. Just let us know if you have any other questions!
ready to work with us?
Tech
Arc
Advanced Technology Architecture for AR+Concierge™
Advanced Technology Architecture for AR+Concierge™
1. Cloud Infrastructure
Amazon Web Services (AWS)
S3: For storing models/assets as Unity objects and other static content.
EC2: For hosting the application backend and processing requests.
Lambda: For serverless computing and handling API requests.
RDS: For relational database management.
CloudFront: For content delivery and caching.
Cognito: For user authentication and authorisation.
DynamoDB: For fast and flexible NoSQL database services.
2. Database and Data Management
SupaBase
Real-time and scalable data storage and management.
AWS RDS/DynamoDB
Relational and NoSQL databases for storing user data, session data, and other transactional information.
Firebase
Backend-as-a-Service (BaaS) for real-time database, authentication, and cloud storage.
3. Content Delivery and Streaming
JW Player
Video hosting and streaming services for 2D and 360° content.
360° HLS HTTP Live Streaming
High-level streaming for immersive 360-degree video experiences.
2D HLS HTTP Live Streaming
Standard streaming for 2D video content.
4. Augmented Reality Frameworks
ARKit (Apple)
Framework for developing AR applications on iOS.
ARCore (Google)
Platform for building AR experiences on Android.
Unity
Game engine for developing the AR experience, managing bundles, and assets.
5. Location and Mapping
MapBox
Advanced mapping and location services integrated for spatial awareness and navigation.
GeoSpatial Creator
Tool for creating geospatial experiences and anchoring AR content in real-world locations.
AnchorLocks
System for locking AR content to specific real-world locations for consistent user experience.
Magnetic Field Mapping
Utilising Earth's magnetic field for indoor positioning and navigation.
Indoor Positioning System (IPS)
Technology for locating people or objects inside buildings, typically through Wi-Fi, BLE beacons, or UWB.
6. Proximity and Interaction
UWB Beacons
Ultra-wideband beacons for precise location tracking and interactions within the AR environment.
BLE Beacons
Bluetooth Low Energy beacons for proximity-based interactions and notifications.
7. User Interface and Experience
Squarespace
Website building platform for marketing, informational purposes, and user engagement.
Vimeo
Video hosting and sharing platform for content distribution.
8. Social Media and Networking
Instagram
Integration for social media sharing and user engagement.
LinkedIn
Professional networking platform for business-related interactions.
9. Mobile Platforms and Development
Apple App Store
Distribution platform for iOS apps.
Google Play Store
Distribution platform for Android apps.
iOS
Operating system for Apple mobile devices.
Android Xcode
Integrated development environment for building Android applications.
Apple Developer
Suite of tools and resources for developing iOS applications.
10. Security and Compliance
TLS/SSL
Secure transmission of data in transit.
AWS IAM
Identity and Access Management for secure access to AWS resources.
GDPR Compliance
Ensuring data privacy and protection according to regulations.
11. Analytics and Monitoring
AWS CloudWatch
Monitoring and logging services for AWS resources.
Google Analytics
Tracking and analysing user interactions and behaviours.
Mixpanel
Advanced product analytics to understand user engagement.
12. Integration and API Management
API Gateway (AWS)
Managing and scaling APIs.
GraphQL
Flexible API query language for efficient data fetching.
RESTful APIs
Standard APIs for interacting with backend services.
Vertex AI on Gemini API
Advanced AI and machine learning services for multimodal applications.
13. AI and Machine Learning
AI Multimodality
Incorporating multiple data types (text, image, audio) for a comprehensive AI experience.
LLM Chat GPT-4.0
Large Language Model for advanced natural language processing and conversational AI.
14. Continuous Integration and Deployment
AWS CodePipeline
Automating the build, test, and deploy phases of the application lifecycle.
Jenkins
Open-source automation server for continuous integration and delivery.
Bundles and Asset Management
Bundles: Stored on Unity, swappable at decision points.
Text Assets: Held as .json strings.
Models/Assets: Stored on AWS S3 as Unity objects.
Videos: Planned to be hosted on JW Player.
URLs/Links: Configured on the server, specifying text and additional information like animations.
Server Configuration: Managed via iSPARX™ allowing configuration of assets.
Security and API
AWS Services: Primarily using the Oregon region.
API Calls: From the app to AWS, secured with TLS for in-transit data transmission.
This advanced architecture incorporates modern technologies and services to build a robust, scalable, and secure AR+Concierge™ platform, with enhanced AI capabilities and comprehensive data management.
ready to work with us?