See what’s new
in MirageXR
Featured
Improved calibration. We improved exception handling for merged planes in the calibration process
New action editor. We redesigned the user interface for the action augmentation editor
chatGPT support for characters. Character models now have chatGPT support and can store a prompt.
Added
Changed
We redesigned the user interface for the audio editor
We remove the second (turquoise) task-station diamond indicating the position of the next step
We removed the lines leading from the aura to the task station
We improved the dialogue messages when publishing to Moodle
We added rotation handles to the action augmentation
Character augmentations can now also be placed onto 3D objects, and no longer have to be placed directly onto the spatial map, remediating a “GetRemainingDistance” error that would be flagged every frame otherwise
We renamed the ‘apply’ button to ‘done’ in the calibration dialogue to be more precise
Fixed
We fixed bugs in the video augmentation that would overwrite the currently selected video when cancelling the camera dialogue
We fixed both create and view tutorials, including fixing the way the tutorial activity for the viewing tutorial is downloaded from a resource folder
We fixed the help tutorial for publishing activities
We fixed an error with deregistering event handlers during application shutdown
We fixed a bug where broken 3D models from Sketchfab would trigger an error
We fixed a bug where a Moodle upload of an existing resource would result in an error when asking the user whether to overwrite or clone, now issuing only a warning
We fixed a bug in the Sketchfab search, which would produce errors when you search a second time
We fixed a bug in the label augmentation where default values for ‘turn to user’ would not be set, thus only storing the value correctly when the toggle switch would be turned on/off twice
We fixed the materials for some character models, which seemed not to be set to the right rendering pipeline
We fixed a bug in character models complaining about a missing FollowMeToggle
Enterprise
The MoodleUrl can now be set from the brand configuration file unless there already is a user preference set overriding which URL to use
We excluded Sentry settings and sentry client settings via .gitignore so that auth tokens and DSN values are not stored on GitHub
Developer
We migrated the project to Unity 2022 LTS (2022.3.7f1)
We decommissioned the IBM Watson assistant service and replaced it with openAI’s chatGPT
We upgraded online error handling to the full Sentry package, improving breadcrumbs and the stack trace, as well as adding session and user info for authenticated users
We implemented a slider for verbosity levels for in-app bug tracking
We reduced StyleCop to documentation checks in the MirageXR assembly, and disabled a large portion of warnings on external projects and packages
We removed the dummy video in the root directory from the video augmentation, which was used to simulate video recording in-editor on Hololens before we introduced the file picker upload
We fixed the calibration PlayMode test and several others that were suffering from multiple audio listeners being created in the scene
We improved the test and build pipelines for Android and Windows
We renamed the editor folders of all content types (to ‘editors’), to avoid confusion with the reserved folder name of Unity
We created an openAI manager, primarily as interface for character models, but with further reaching plans
We fixed the build for Hololens 2
Added
The Ghost augmentation now additionally records finger movement on HoloLens 2 into the data model, but does not yet display it.
We improved accessibility by implementing an experimental feature for image captions.
Changed
Character models can now react to control commands parsed from any dialogue text returned from the AI (%%trigger%% and %%trigger:step=5%%).
The editor 3D grid and the snap-to-grid placement support are now active by default.
We redesigned the user interface of the label editor.
We redesigned the user interface for the audio augmentation editor panel.
We refactored the autosave functionality, which stores data locally immediately, which had shown some erratic behavior, sometimes missing saving changes.
Fixed
We improved handling of 3D models to prevent them from slipping under the floor level. On rare occasions, as a result of calibration or tracking errors, models may still end up under the floor level, but this can now be fixed using the markerless calibration.
We fixed a bug with re-editing image augmentations, where confirming without changing the image would produce an exception.
The handle for rotating an action glyph (left and right) is now switched on again.
Activity title and description can no longer be edited in view mode.
We removed the zombie ‘home’ button on the aura from the mobile UI.
Values for gaze triggers are now properly saved for Action augmentations.
We refactored the Sketchfab communication, reducing debug log output and phasing out reporting of hard exceptions from expired credentials.
We fixed a few bugs for the label augmentation: Minimizing the edit panel no longer makes the whole menu disappear, re-editing of the step target now recovers the stored value correctly, and pre-selects it in the list; labels of old activities are imported correctly again, and, additionally, label text is now displayed in the list of augmentations, making it easier to identify the right item.
Enterprise
We set up sponsorship support for our GitHub project – please donate large and plenty 🙂
We fixed the xAPI implementation, also modifying the underlying i5 service, which prevented LRS communication from running, also improving the overall error handling (e.g. LRS selection under profile triggered an error).
We fixed the sensor communication framework (VestService.cs and vestconfig.json), which failed to find its config file, and set http://test.mosquitto.org:1883 as default service, which can be used to test communication with sensors from within activities.
We improved the update and clone dialogue messages for the Moodle cloud uploads.
We fixed a bug, where login with the Moodle username (instead of the registered email) would allow logging in, but prevent publishing. Users now need to log in with the registered email address.
Activities that exist only locally (and are not uploaded to the cloud) now no longer try to increase the Moodle hit counter, previously yielding an error.
We added the possibility to configure the calibration marker to the BrandManager.
Developer
We implemented a new Exception Manager that captures exceptions globally and logs them live to Sentry.io for improved online error reporting.
We reorganized the folder structure and location of project files to be more logical.
We improved debug logging, now supporting the setting of different levels of verbosity.
We changed the glTF plugin implementation to gltfast, which also resolves issues with animations.
xAPI calls are now suppressed when running in the editor, to avoid spamming the record store, while still maintaining their execution for testing purposes.
To ease in-editor testing, we now assume a random world-origin position during play-mode. This makes it easier to spot problems in restoring positions following calibration.
We introduced one-button dialogues.
We switched the CI pipeline to scheduled builds, to prevent disk space on the container from overflowing quickly in periods of heightened commits.
We added several new wiki pages and updated existing ones (Exception Manager, Experience Manager, Events, Character Model, Compiling MirageXR, File Organisation, UI 2.0).
Added
We added a logout button for Sketchfab for the worldspace UI.
Changed
Fixed
Developer
Downloads
Added
Changed
Fixed
Enterprise
Developer
Added
Changed
Fixed
Developer
Added
Changed
Fixed
Enterprise
Developer
Added
Changed
Fixed
Enterprise
Developer
Downloads
Added
Changed
Fixed
The activity list now correctly updates when returning to it after a new activity was created.
Enterprise
Developer
Downloads
Added
MirageXR now uses voice prompts “Hey Presto”, “Hey Mirage” and “Sim Sala Bim” to start voice interaction. Voice interaction has also been improved by adding visual cues for spoken words.
Character augmentations can now be fitted with an IBM Watson assistant, improving user interaction.
MirageXR now includes the popular XR painting tool Tiltbrush! The new augmentation allows adding 3D-painting elements to the training procedures.
Most visual augmentations can now be used as a trigger for the next action step.
Gaze triggers can now be used to jump to any action step.
Near-touch interaction added for dialogues on HoloLens2.
3D object manipulation is now possible through widgets at the object’s boundaries.
Added a toggle to the mobile video editor panel that allows a user to input the orientation of a video augmentation.
Changed
The MirageXR in-app tutorial has been updated, improving performance and maintainability.
Special characters like ampersand (&) are now disallowed in activity names, as this could cause problems with Moodle.
Some unnecessary voice lines were removed from the MirageXR voice assistant Maggie.
The glyph trigger option was moved to the editor panel.
On loading or creating a new step, the step will be labeled as the current step (in orange, not gray).
Disabled shadows on HoloLens and improved their quality on other platforms.
Icons and splash screens were updated.
The rotation of the character augmentation was improved on mobile devices.
The default placement of UI elements on HoloLens was optimized.
The drawing augmentation button was removed on mobile platforms.
The augmentation panel on task stations was changed from list to a grid view.
Fixed
A bug where audio would not replay on ghost augmentations was fixed.
The spawn point is now correctly visible on HoloLens 2 for both eyes. The custom shader was replaced with a wireframe sphere.
Editing ghost augmentations will now also replace old audio with the new one.
The Home button on the Aura has been moved slightly up to avoid being under the floor line.
The Pick&Place augmentation no longer forgets the target sphere size.
Deleting a model used by Pick&Place now works correctly.
The GhostTrack animation and its sound are now synchronised.
The Sketchfab thumbnail is now correctly displayed.
The video editor now opens correctly for editing.
A visual bug where action steps could not be deleted was fixed.
An issue with the audio augmentation where the loop and trigger options would interact badly was fixed.
The rotation and scale of the Image augmentation are no longer resetting on load.
An issue where the Aura would jump up when sitting was fixed.
The calibration guide is no longer causing errors when selecting “Don’t show again”.
Private activities are now displayed correctly on Android.
The bounding box on the measure tool was disabled, as it was causing errors.
Enterprise
No changes
Developer
Some old folders and files have been removed or moved.
Dropdown and guide text of character augmentations is replaced by Unity native UI elements.
Downloads
Added
Auto progression to the next action step has been added as an option to the audio and video augmentations, complementing the already existing auto progression option for character models.
New ‘stand here’ glyph added.
Improved xAPI support now adds context and results where needed.
New xAPI vocabulary now logs learner behavior data for all augmentations.
Changed
The task station’s context menus are now rotated slightly towards the user, bringing the outer panels closer to the eye (Windows Holographic).
Hover guide text has been added to the character augmentation menus to explain its components.
Unavailable character augmentation animations will no longer be shown in the drop-down menu.
Augmentation spawn point is now visualized (known bug: renders only on one eye on Hololens).
Image marker size can be set allowing for more accurate image tracking.
Ghost augmentation can be replayed without changing the action step (audio replay option still to follow).
Empty rows of the action list no longer block interaction with virtual objects behind.
The audio augmentation editor was simplified.
Fixed
Improved virtual keyboard on windows holographic platforms, including resolving a bug that caused the keyboard to close prematurely.
Pick and place no longer forgets the 3D model when there are multiple action steps.
Activity thumbnail images can be previewed again.
Augmentation buttons are now correctly deleted for an action step if the corresponding augmentation has been deleted.
Video recorded on a mobile device no longer plays back distorted on Hololens.
Enterprise
No changes
Developer
Updated Unity version to 2020.3.13f1
Updated MRTK version to 2.7.2
Reduced the space requirements for pipeline builds
Updated NuGet package
Downloads
Added
Female avatar for the ghost track augmentation.
Voice commands “next” and “back” allow switching between steps (only on Hololens).
Label trigger functionality now available also on iOS and Android.
Characters now process 3D models as obstacles and will avoid bumping into them.
Characters are now resizable.
‘Loading’ interstitial when loading or creating an activity.
Character models will now be included in the ARLEM zip file.
Auto-progression for character augmentation: checkbox now allows moving automatically to the next action step once animation or audio finished playing (whichever takes longer).
Changed
The activity will be reset when the last step is completed.
Deadline date format is corrected.
Orkestra support removed (for now).
Improved glyphs for ‘act’ augmentation (scissors, all box glyphs).
Fixed
Reduced loading time for new activities.
Marker augmentation now also works on Android and iOS.
The Pick and place augmentation now also supports 3D models (alternative to the standard ‘arrow’ shape).
Improved character movement on mobile devices.
Closing the augmentation panel now brings up the list of augmentations again.
Character position will no longer break when switching between action steps.
Next task station is again locked in edit mode.
Floor line from the aura to the activity list is visible again.
Ghost origin will be loaded correctly.
Model augmentation (Sketchfab) now also works on mobile devices.
Mobile UI icons are now no longer hidden by android system icons.
The image presentation animation no longer appears only with keep alive over several action steps.
Enterprise
New ‘support’ button (in the Moodle login panel) opens a defined support forum in a browser.
New plugin augmentation allows packaging of 3rd party mini-apps as prefabs in the ARLEM zip file.
Developer
Android CI pipeline added.
Separate TestFlight link for development builds.
Sketchfab client secret now in untracked config file ‘SketchfabClient.json’ (excluded from tracking via .gitignore; you need to manually copy the SketchfabClient.json to your project folder).
Downloads
Added
Augmentations can now be kept alive between action steps.
New character models were added to the character augmentation.
Changed
The ghost model is replaced with a better avatar model.
Calibration now restarts the current activity.
A warning is given when a user tries to download a model with a large file size.
Character augmentation settings panel has been refactored.
Character models now handle occlusion by the spatial map.
It is possible to add different audio, animation, path and movement to the character in each action step.
The Image Marker augmentation has been re-enabled on Hololens 1 and Hololens 2 However, it is still disabled on iOS and Android.
Fixed
The iOS or android apps no longer show a Vuforia license error when first launched.
Pick and place now stays in edit/play mode when changing action steps.
Keyboard predictive text now works correctly for Hololens 1 and Hololens 2.
The Keyboard no longer dismisses itself on Hololens 1 and Hololens 2.
A bug causing some sketchfab models to not be loaded has been resolved.
Task stations are correctly spaced apart when loading an activity without calibrating.
Task stations no longer rotate when they are moved.
Fixed Moodle repository upload limit to allow for activity models with more than 64kb.
Enterprise
No changes
Developer
Vuforia License key has been changed.
Downloads
Added
New voice commands for moving the action list: “Move action list” and the activity list: “Move activity list” (Only on Hololens)
Pagination for the model augmentation
Dialog recorder for character augmentation
Basic lip-sync for character augmentation
Authors of activities can delete them from the server directly from the app (only on Hololens)
Improved update of activities stored in the cloud.
Activities from course assignments listed first now (with deadlines displayed).
A new animation “Image Display” added to the character augmentation. The user can assign an image annotation to this animation, and the character will show up the image.
Gaze trigger for label augmentations.
Changed
The ghost model is replaced with a better avatar model.
Terms of use and privacy policy are updated.
Fixed
Sketchfab models do not remain in the ARLEM folder anymore after deleting.
Only the first video could be displayed in each step even if the users had several video augmentations.
First/Last step buttons and the next and previous step buttons of the Action list now function correctly.
Login UI is now placed in the correct place at the start of the app.
The annotation menu is no longer crashing when all steps are deleted.
Character augmentation models without a dialog recorder function are no longer causing a crash after loading the activity.
Ghost is no longer losing arms on Android and iOS
Enterprise
Terms of use added
Improved repository functionality
Developer
Vuforia updated to version 9.8.5.
xAPI updated and tincan removed.
The empty dialogues in CI pipeline build were fixed.
Platform compatibility is updated for iOS Version 11.0+ (ARKit required), for Android Version 7.0+, and UWP (Windows Holographic) 10.0.17134.0+
Downloads
Added
New annotation menu which is linked to the task stations
New Image marker augmentation which allows the user to take a photo of an object or an image target and thus allow to move task stations with the marker around.
New Character augmentation which allows a character to follow a path, follow the player or play various actions in place.
New VFX augmentation with 19 different VFX effects.
Wekit:// protocol is registered. The play button on Moodle plugin will open the activity on MirageXR.
The users can update their activities or clone a new copy of the activities of the other authors.
Privacy system is added to the ARLEM files. It is possible to set an ARLEM file as private or public by the user or by the admin of the Moodle site.
New Audio recorder/player with time slider
Spatial audio with configurable settings (Radius and loop)
New calibration marker which will be activated with gazing
Thumbnail contains holographic contents.
The authentication can be saved and the user will be logged in automatically at the start.
The activities which are used in the user courses will be displayed on top of the activity list.
Changed
Native keyboards are replaced with the old keyboard.
The local/downloaded activities can be deleted.
Fixed
Label augmentation was not displayed on Hololens.
Tutorial manager got stuck.
The number of action steps was not updated.
Image and video augmentation did not work sometimes on iOS.
OpenID Connect was fixed for iOS and Android.
Ghost and its audio did not have the same frame rate and could not be matched.
Enterprise
No changes
Developer
Improvement suggestions by Roslyn analyzer were applied to the project.
Calibration unit test is added.
Platformmanager and ARManager will not allow AR foundation to be initiated on Hololens.
The activity and workplace json files will be stored on the database on Moodle server.
Orkestra integration
Platform compatibility is updated for iOS Version 11.0+ (ARKit required), for Android Version 7.0+, and UWP (Windows Holographic) 10.0.17134.0+
Downloads
Added
Support for iOS
Near interaction support for UI
3D Model augmentation
Sketchfab connection for importing models
Additional action glyphs and a scrollable grid for selecting them
Activity cover thumbnail
Walkthrough tutorial introduces to the basic functionality on first start
Optional thumbnail photo now provides preview of Learning Experiences
Config panel for Moodle login information
Display app version number on activity list
OpenID connect support for Sketchfab
Realign button near aura to recentre panels if lost / stuck in wall
Image and video augmentation support added for iOS and Android
Display file size before cloud download of Learning Experiences
Changed
Connects to Moodle server for ARLEM files and content
UI panels more compact
New UI for image and video players
Improved mesh display of spatial map in edit mode on Android / iOS
Improved activity list paging to improve display performance
Task card closer to task station
Video always uses audio
new icons and splash screen
Fixed
Surface magnetism solvers added to keep holograms out of the walls
Workplace calibration fixed, activities now can again be transferred across devices / places
Activity List properly refreshes now when new activities are created
Improved keyboard handling (device specific and improved Hololens keyboards)
Fixed all offsets of all augmentations
Ghost sometimes got stuck when moving to next action
Sometimes small spheres appeared randomly scattered in the activity
Upload uses Activity Title
Glyphs can be rotated
Loading previously saved ARLEM failed
In some situations, labels would be empty
Enterprise
New repository service (via Moodle)
White Label capability
Developer
Developer workflow documented in Wiki
Updated to MRTk 2.5
Intelligent rendering via PlatformManager allows building platform-specific UI
BrandManager allows customising look and feel via config file
CI release pipeline and notifications
CI installer builds for HoloLens 1 and 2
Automatic build version numbering
More unit tests added
Platform compatibility is updated for iOS Version 11.0+ (ARKit required), for Android Version 7.0+, and UWP (Windows Holographic) 10.0.17134.0+
Downloads
Added
Support for HoloLens 2
Support for Android
Unit tests
CI pipeline
Home pathway that leads to the main menu
Task stations are now visualized as a diamond
Changed
Updated to MRTK
Combined player and recorder into one common editor
Redesigned user interface: updated aura visuals, updated pathway visuals, redesigned the action list menu, updated text label visuals
Streamlined activity download and activity starting with an activity download menu
Replaced circular edit menu with own editor menus for each annotation
Menus do not follow the user’s head movement anymore but can be placed in a fixed position in space
Tweaked scaling of objects
Updated to new logo
Fixed
Annotation positions can now be saved in the correct format independent of the user’s culture settings
Event order of central event manager improved
Performance improvements & code refactoring
Enterprise
No changes
Developer
No changes