Live Simulation Pulse
The Work-in-Progress Spatial Computing Lab Twin through a Self-Hosted Pixel Streaming Instance.
UE5-Core
https://gitlab.nrp-nautilus.io/cyberarch/cyberarch-core
Ongoing development to integrate the latest Unreal Engine features toward serious game applications across a variety of academic departments and research topics for practical applications and public outreach. The Core Project is primarily used to develop a platform called the Cyber-Archeology Warehouse, but several derivations utilize this project to focus on Cognitive City Twins, Climate Games, SunCAVE automatic virtual environment, and much more.
Cyber-Archeology Modkit
Alongside many popular games exist an SDK or “Modkit” to make User-Generated Content more accessible. One popular example of this is Unreal Editor for Fortnite (UEFN). The goal of the Cyber-Archeology Modkit is to initially support more complex community made environments that could possibly feature larger datasets from various sources like LiDAR and Photogrammetry. In the future I would like to see our Modkit become a tool to author new content for the SunCAVE.
To begin this process, the SimpleUGC Plugin was modified to provide a simple interface for creators to Create, Package, and Upload Mods directly in the Editor. Although a few hosting solutions exist such as mod.io, CurseForge, and Nexus. One requirement for our platform is that we must host the content on our own Infrastructure. Thankfully, an open-source solution Thunderstore was found to rival the previous platforms that we will continue to modify to our needs.
Chemistry Simulation Dashboard
https://gitlab.nrp-nautilus.io/cyberarch/ai4mears
A Standalone Unreal App built on the UE5-Core Application running Natively on the Meta Quest was created to interact with a web interface to trigger and visualize simulations. The Dashboard is a Multi-Page WebApp built with Python, Dash, and Plotly deployed on the Nautilus Kubernetes Cluster. The Submission page allows new simulation parameters to be set prior to scheduling a job on the cluster. As the job runs, newly calculated results are sent to Unreal Engine and stored in CouchDB by utilizing Message Queuing Telemetry Transport (MQTT). Within the WebApp various Dash Components broadcast javascript events that can be received by Unreal’s Blueprint System to trigger visualizations in-game.
NanoVerse VR
An Early Pilot Project built on the UE5-Core Application focused on educational interactive storytelling of the COVID-19 Vaccination at the nanometer scale.
Space Weather Visualization
Coronal Mass Ejection Radiation
An Early Pilot Project built on the UE5-Core Application in collaboration with the UCSD Center for Astrophysics and Space Sciences (CASS). The Solar Group uses interplanetary scintillation (IPS) observation data from the Institute for Space-Earth Environmental Research (ISEE) in Nagoya, Japan to forecast and model CMEs. They were motivated to present a new way to view IPS data and results using virtual reality. The Unreal VDB pipeline for the data was successfully created by members of Qi, SDSC, and CASS. While I was mostly responsible for building the Desktop/VR Application’s UI/UX, and Deploying Pixel Streaming to Desktop and XR.