A data visualization and analytics application built to understand Hololens virtual reality data and fNIR optical brain imaging sensor data. By combining both of these technologies, we hoped to gain a better understanding of the cognitive load a user is under when using a virtual reality device.
Node.js with express was used to create a web platform that a user can interact with in the browser. P5.js was used to visualize the many different aspects of the data, and create interactive visualizations to explore. Python was also used in some parts of the data processing pipeline to perform further calculations.
By far the largest issue that arose while working on this project was the constantly changing feature requests and adaptations from the rest of the team. To accommodate this, each part of the system was built as a component, and all the components could work together as a cohesive unit to analyze the data and extract results.
An important skill that I learned during this project is how to profile an application for performance. By running a series of tests and analyzing which parts of the code were taking the longest, I was able to speed up the application significantly. In other parts of the application, I was able to implement a draw cache, so frequently rendered parts would be able to be reused.
The IEEE Virtual Reality conference is an international conference that showcases the latest research in the field of Virtual Reality. As a result of this work, our paper was published in this conference.