AR+concierge™

“Say hello to my little friend!”

AR+concierge™

The AR+concierge™ is an adaptable and innovative solution, offering personalized AR+IQ Agent - as a 3D animated or static avatars designed to enhance user interaction. Whether the goal is immersive engagement at a point-of-sale, a reception area, a retail store, or an event location, AR+concierge™ adjusts to the specific context. Each user experiences tailored, direct interaction, making the service feel unique and individualised.

With scalable AI capabilities, AR+concierge™ acts as a dynamic, intelligent representative, capable of delivering information, guidance, and even interactive games, all tailored to the user’s specific needs. This flexibility allows for limitless experiential possibilities, only constrained by the creativity applied to its implementation

OpApp

Place your concierge & Points Of Interest (POI) with the Operator App (OpAPP) - a bespoke solution of the AR+concierge™ package.

POI can be larger than life locations like a huge animated mascot or structure on or over a location or building or a small item on a shelf in a store… there are endless opportunities.

CMS

Our proprietary Content Management System (CMS) allows admins to edit content, media & placement.

This is an exciting feature of the AR+concierge™ package - the ability to dynamically set & effect locations with interactive augmented reality content, streaming live & on demand 360° media & multi player installations.

RTAnalytics

Real Time Analytics - a view of measured interactive & live analytics in easy to read graphics on a secure website.

You can track dwell times, transactions & user preferences in real time while maintaining security & confidentiality. Your concierge becomes an entity that the user can confide in.

The Next Generation of Artificial Intelligence: Broadening Applications

Artificial Intelligence (AI) is rapidly evolving, with advanced models demonstrating capabilities that extend far beyond their initial design. These models, often multimodal, are adept at processing diverse forms of input and generating insightful outputs, pushing the boundaries of what's possible across various industries.

Multimodal AI: A Transformative Capability

Modern AI models are increasingly multimodal, meaning they can process and understand information from multiple sources simultaneously. This includes, but is not limited to, text, images, audio, and video. This expanded capability is a significant leap forward, enabling AI to interact with and interpret the world in a more comprehensive manner. The ability to integrate and synthesize information from different modalities opens up new avenues for creating highly immersive and interactive experiences in a wide range of applications.

Leveraging Advanced AI for Enhanced Experiences

By integrating advanced AI capabilities, platforms like iSPARX™ AR+IQ are poised to redefine their respective landscapes. For instance, an intelligent virtual guide, powered by such AI, can become even more responsive and insightful. Users can engage in natural conversations with these AI-driven guides, seeking information, advice, and assistance within various digital and augmented experiences.

Advantages for Diverse Applications

Enhanced User Experience

The integration of advanced AI enables the creation of experiences that feel more natural and intuitive. This leads to deeper engagement and greater satisfaction for users across different sectors, from education and entertainment to retail and healthcare.

Streamlined Content Creation

AI can significantly streamline the process of content creation and management. When combined with intuitive interfaces and content management systems, AI empowers users to easily build and manage complex digital experiences, regardless of their technical background. This democratizes access to powerful tools and reduces the barriers to entry for innovation.

Increased Accessibility

The multimodal processing capabilities of advanced AI make digital experiences more accessible to a wider audience. By accommodating diverse input modalities (text, image, audio, and potentially video), AI can cater to individuals with varying abilities and preferences, fostering inclusivity in technology.

The Future of AI Integration

The fusion of specialized technologies, such as iSPARX™ AR technology, with cutting-edge AI capabilities marks a significant step towards the realization of truly intelligent and interactive digital experiences. As AI continues to evolve, the potential for innovation across all platforms is boundless. This ongoing evolution promises a future where AI is not just a tool, but a seamless and integral part of our daily interactions and professional endeavors.

Generative AI and Cloud Services

Generative AI, often hosted on robust cloud services, provides access to powerful models that can be tested, tuned, and deployed for use in a multitude of AI-powered applications. These services offer the infrastructure and tools necessary to harness the full potential of generative AI, enabling rapid development and deployment of innovative solutions.

As an example, a multimodal model could process a photo of a product and generate detailed specifications, design variations, or even marketing copy for that product. This illustrates the versatility and broad applicability of modern AI systems.

Accessing Advanced AI Models

Leading AI providers offer a range of generative AI models designed for various use cases. Access to these advanced models is typically provided through Application Programming Interfaces (APIs), which allow developers to integrate AI capabilities directly into their own applications. These APIs grant access to sophisticated models capable of handling a wide variety of tasks, from natural language processing to complex image generation and analysis.

Supported use cases

AI APIs supports the following use cases by model:

  • Natural Language Tasks: Designed to handle natural language tasks, multi turn text and code chat and code generation.

  • Multimodal Prompts: Supports multimodal prompts, allowing you to include text, images, and videos in your prompt requests and receive text or code responses.

  • Ai Analytics & Analysis: telemetrics, user analytics, heat maps & preferences.

*developed for a BP POC

- the first AR+concierge™ - Orby.

Orby flew around a Roadmaster BP outlet in Melbourne leading customers to featured products & redeemable digital games & prizes.

iSPARX™ was provided a short brief - retail, AR engagement (“probably 200 retail locations - tops!”).

To our surprise the brief was a POC for BP with consideration for scale & installation of the BP Global network & 18,500 outlets… with 6 weeks to deliver a POC functional App tested at a location - Melbourne; 3 x 2 week sprints; multiple sets of International flights across 3 continents & with an entourage of 12 (6 x iSPARX™, 2 x Two Goats, 2 x EY & 2 key BP contacts).

#WeAreTheMainstream

AuRaki is an AR+concierge™ made by artist HORI as an artistic installation AS SEEN at TVNZ, STUFF, Mediaworks & other major media outlets in Aotearoa - a cultural capability tool.

Ōtaki-based artist Hohepa ‘Hori’ Thompson and iSPARX™ launched the We Are the Mainstream project in November 2022, involving a digital art character named Auraki, waiting outside some of New Zealand’s largest media companies to be invited in.

The character remained inside the building for three months and offered tools and support to help media staff gain a better understanding of te ao Māori and be more culturally aware in the work that they do.

Auraki is viewable through the Hori app on mobile devices, and will offer questions to media staff regarding cultural competency surrounding te ao Māori every day.

*AR+concierge™

is designed to suit your customer preferences…

We designed AR+concierge™ to give your customers the best possible experience suited to their needs and preferences.

Our interactive guides use augmented reality technology to provide assistance in engaging, visual ways. You can customize 3D concierges with helpful voices and conversations to inform patrons, offer recommendations, and respond dynamically based on what's happening.

With our easy-to-use web tools, you have complete control over tailoring your concierges' interactions. See what resonates through collected analytics and optimize content over time.

AR+concierge™ aims to redefine customer service by blending immersive technology with data-driven personalisation. The goal is to build genuine rapport with patrons in today's tech-focused but still human-centered world.

Your customized concierges become trusted local guides - more appealing and assisting than static signage or pre-recorded messages.

We're excited to help you create next-gen experiences that wow your customers and keep them coming back. Just let us know if you have any other questions!


ready to work with us?


Tech

Arc

Advanced Technology Architecture for AR+Concierge™

Advanced Technology Architecture for AR+Concierge™

1. Cloud Infrastructure

  • Amazon Web Services (AWS)

  • S3: For storing models/assets as Unity objects and other static content.

  • EC2: For hosting the application backend and processing requests.

  • Lambda: For serverless computing and handling API requests.

  • RDS: For relational database management.

  • CloudFront: For content delivery and caching.

  • Cognito: For user authentication and authorisation.

  • DynamoDB: For fast and flexible NoSQL database services.

2. Database and Data Management

  • SupaBase

  • Real-time and scalable data storage and management.

  • AWS RDS/DynamoDB

  • Relational and NoSQL databases for storing user data, session data, and other transactional information.

  • Firebase

  • Backend-as-a-Service (BaaS) for real-time database, authentication, and cloud storage.

3. Content Delivery and Streaming

  • JW Player

  • Video hosting and streaming services for 2D and 360° content.

  • 360° HLS HTTP Live Streaming

  • High-level streaming for immersive 360-degree video experiences.

  • 2D HLS HTTP Live Streaming

  • Standard streaming for 2D video content.

4. Augmented Reality Frameworks

  • ARKit (Apple)

  • Framework for developing AR applications on iOS.

  • ARCore (Google)

  • Platform for building AR experiences on Android.

  • Unity

  • Game engine for developing the AR experience, managing bundles, and assets.

5. Location and Mapping

  • MapBox

  • Advanced mapping and location services integrated for spatial awareness and navigation.

  • GeoSpatial Creator

  • Tool for creating geospatial experiences and anchoring AR content in real-world locations.

  • AnchorLocks

  • System for locking AR content to specific real-world locations for consistent user experience.

  • Magnetic Field Mapping

  • Utilising Earth's magnetic field for indoor positioning and navigation.

  • Indoor Positioning System (IPS)

  • Technology for locating people or objects inside buildings, typically through Wi-Fi, BLE beacons, or UWB.

6. Proximity and Interaction

  • UWB Beacons

  • Ultra-wideband beacons for precise location tracking and interactions within the AR environment.

  • BLE Beacons

  • Bluetooth Low Energy beacons for proximity-based interactions and notifications.

7. User Interface and Experience

  • Squarespace

  • Website building platform for marketing, informational purposes, and user engagement.

  • Vimeo

  • Video hosting and sharing platform for content distribution.

8. Social Media and Networking

  • Instagram

  • Integration for social media sharing and user engagement.

  • LinkedIn

  • Professional networking platform for business-related interactions.

9. Mobile Platforms and Development

  • Apple App Store

  • Distribution platform for iOS apps.

  • Google Play Store

  • Distribution platform for Android apps.

  • iOS

  • Operating system for Apple mobile devices.

  • Android Xcode

  • Integrated development environment for building Android applications.

  • Apple Developer

  • Suite of tools and resources for developing iOS applications.

10. Security and Compliance

  • TLS/SSL

  • Secure transmission of data in transit.

  • AWS IAM

  • Identity and Access Management for secure access to AWS resources.

  • GDPR Compliance

  • Ensuring data privacy and protection according to regulations.

11. Analytics and Monitoring

  • AWS CloudWatch

  • Monitoring and logging services for AWS resources.

  • Google Analytics

  • Tracking and analysing user interactions and behaviours.

  • Mixpanel

  • Advanced product analytics to understand user engagement.

12. Integration and API Management

  • API Gateway (AWS)

  • Managing and scaling APIs.

  • GraphQL

  • Flexible API query language for efficient data fetching.

  • RESTful APIs

  • Standard APIs for interacting with backend services.

  • Vertex AI on Gemini API

  • Advanced AI and machine learning services for multimodal applications.

13. AI and Machine Learning

  • AI Multimodality

  • Incorporating multiple data types (text, image, audio) for a comprehensive AI experience.

  • LLM Chat GPT-4.0

  • Large Language Model for advanced natural language processing and conversational AI.

14. Continuous Integration and Deployment

  • AWS CodePipeline

  • Automating the build, test, and deploy phases of the application lifecycle.

  • Jenkins

  • Open-source automation server for continuous integration and delivery.

Bundles and Asset Management

  • Bundles: Stored on Unity, swappable at decision points.

  • Text Assets: Held as .json strings.

  • Models/Assets: Stored on AWS S3 as Unity objects.

  • Videos: Planned to be hosted on JW Player.

  • URLs/Links: Configured on the server, specifying text and additional information like animations.

  • Server Configuration: Managed via iSPARX™ allowing configuration of assets.

Security and API

  • AWS Services: Primarily using the Oregon region.

  • API Calls: From the app to AWS, secured with TLS for in-transit data transmission.

This advanced architecture incorporates modern technologies and services to build a robust, scalable, and secure AR+Concierge™ platform, with enhanced AI capabilities and comprehensive data management.


ready to work with us?