Lab Exercises

Prototype Your Immersive Experience

Exercise

In this exercise we were tasked to create a 360 Video, Mash Network within Maya, and a Frame VR virtual environment. These tasks were particularly interesting to me, as I intend to create a VR experience, whilst incorporating Maya Mash Network into my project.

The 360 video was very simple. My goal was to simply know how to export a 360 video successfully, with minimal assets involved. I placed a few primitive shapes in the scene, to see if the video was exporting correctly.

I experimented with the Maya Mash Network, and gathered ideas I could use in my own project, as I have ideas for locations for this feature. For example, a Mash Network would spiral around the user with an ambient noise, which would create an immersive experience for the user. The Mash Network which I created, showed the camera travelling through a wall, and the wall separating whenever the camera gets close.

Relation

My relation to these technologies varies with each one. For a 360 video, I would like to create a battle scene. This battle could be a custom made one, or a battle inspired from a film. The experience would be very hectic. I would have to be aware of this, as the user would be turning their head and moving their body a lot. This could cause the user to become disorientated or possibly nauseous. I would solve this issue, by only having the action in front of the player and prompting them to look at a certain direction at a time. Additionally, I would have to create story spheres for any 360 experiences. As a story sphere allows the creator to map out the scene more accurately than a storyboard. As the creator must be aware a 360 experience is in a 3D environment and not a 2D environment.

For the Mash Network, I am very interested in creating a gallery which would include this feature. As I have an idea for a spiralling effect, which would create an optical illusion, and include neon visuals and possibly sounds. I have ideas for the user to either walk through this feature, or the user would simply look into the network and become more immersed. However, I would have to consider if these bright lights and fast-moving images would cause a user to experience Cyber Sickness. A workaround I have for this is to have break rooms for the user, to take their time in case they do experience Cyber Sickness.

For Frame VR I would also create an art gallery, as I think this is a strength of the software. As I had the ability to easily import 3D models from Sketchfab, and custom models if needed. However, one ethical consideration I have from Frame VR is the usability of the software. Simply because I found it difficult to explore the environment and move my character in the software. This could cause people to become frustrated, and simply stop using the software.

Content

Frame VR Link: Frame (framevr.io)

Immersive User Experience and Augmented Reality

Exercise

For this exercise we were tasked to create an Augmented Reality experience. I created three Augmented Reality triggers which were able to be triggered once the trigger image was shown on a screen.

The first trigger I created contained a 3D model, which was provided for me. I setup the scene within Unity, and then was able to create a project capable of creating an Augmented Reality experience for the user. This then allowed me to upload the project to Zapworks, which would then allow the user to see the trigger image and thus the Augmented Reality object.

The second trigger was very similar to the first trigger. However, this was an animated version of the image. I created this within Unity and followed the same steps. One thing I had to be aware of was the location of the animated model. For example, the first time I created and tested the project, the animated model was too far down to be seen. I fixed this issue by raising the model on the Z axis and re-exported the project. This issue was then fixed, and I was able to see the animations.

The final trigger I created was a custom trigger. Again, with the two previous projects, I followed the same steps to create this project, and imported a custom image. I wanted to create an Augmented Reality trigger which would show an object from one of my favourite films which was the Pulse Rifle (morepolys, 2017) from Aliens (20th Century Fox). The image shows a hallway from the film and then the rifle from the film.

Relation

With Augmented Reality I would be interested in creating something that gives the user information about something. One idea I have in mind is that the user is at a restaurant and is unsure what they want to order. On the menu there are only descriptions of the food and no pictures. There would be a QR code on their table and they could scan the code and they could choose items from the menu which would be shown how they would look like in Augmented Reality. This could help the user, in case they are a picky eater or suffer from avoidant restrictive food intake disorder (ARFID). ARFID is a condition resulting in the avoidance of certain foods (Burton Murray et al., 2021). The user would be able to see the list of ingredients, and have an image of the meal, and be able to tell if they would want it or not. As there may be a chance, they will not eat something if it has a texture they do not like the taste of. This would also include an ethical consideration for people with conditions and assist them with certain decisions.

Content

Below is the QR code for my custom Augmented Reality piece and the trigger image.

VR Immersive Art

Exercise

For this exercise I experimented with Open Brush and was tasked to experiment with the software and create a VR Art piece. Firstly, I came up with ideas I could create, and decided to try and create the Colosseum. I attempted to try and import 3D models in Open Brush from Sketchfab. However, this attempt was unsuccessful. My next step was to create the Colosseum from scratch to the best of my ability. I chose to sit down within a small space to draw the piece, as I could be more accurate with the brushes sitting down. Additionally, I created the Colosseum with the Passthrough camera. As I did not want to break anything or injure myself in the environment around me. This feature made the VR headset be able to see the real-life environment around me and still be able to see the Open Brush creation.

I chose to create a type of spiralling vortex, which would immerse the user when they look into it. My reasoning for creating this type of art piece is because I hope to create a VR Optical Illusion Gallery, and this piece was a good experiment.

I found that I could mirror the axis of the environment and then I could physically grab the mirror and move it around the environment. Next, I then had the idea to see if I could spin the mirror, which was successful. I then spun the mirror horizontally, which then allowed me to easily create a vortex with the brushes. This was interesting, as it opened more opportunities for creativity with optical illusions.

Furthermore, I experimented with other additional features of Open Brush. Firstly, I found that the sky sphere and environment can be quickly changed to environments such as nighttime and space. I had also found that there is an Advanced Mode, which opens more features for the user. Features such as Flying Mode, the Sky Spheres and more brushes. These features can be useful for many people and expand their ideas for creating art within Open Brush.

Relation

For this software, I would say this is the one I relate to the least, as creating art is not my strength. However, Open Brush made it easy for me to create a piece of art which I would use in my project. I would use this medium, to create similar art pieces for a walkable art gallery, where I would incorporate sound and other visuals alongside this. With Open Brush I was able to be more creative than a standard 2D art creation program. Having the ability to move anywhere and create art from any angle allows the user to become more creative than before. Additionally, the range of brushes Open Brush provides, can make an art piece become more extravagant, with the Neon Brush and brushes that create illusion such as water and fire. These brushes can make an art piece seem alive, with these moving elements. An ethical consideration I would consider for this art piece would be wary of people with epilepsy and show warnings beforehand with any pieces of art with flashing images. Or simply reduce the number of art pieces with flashing images.

Content

Below are my created art pieces within Open Brush.

Colosseum: 3D models by nathan1230 – Sketchfab