AR-VR Exploration
This is the area where I am exploring my passion for augmented and virtual reality
Gesture-based interaction
Proximity Interaction with object using gesture
In XR space, I believe we will utilimately using some type of wearable device and using gesture to interact. We can use different gesture to control specific properties of the object
In this prototype, I explored:
-
Proximity tracing to select object in range to interact
-
Registering gesture with specific function
-
Creating dispatcher to communicate pawn-object
-
Blending between pose (the PS5 exploded view), driven by a variable.
Tools: Unreal Engine, Meta hand-tracking, Oculus Quest 2
Gesture-based interaction
Movement and spawning object
I believe gestures provide much more flexibility, intuitiveness, and customizability than controllers. And it can be a powerful method to interact in XR.
In this small experiment, I explored:
-
Registering each hand pose to spawn an object (attached to hand)
-
Attaching movement controller to right hand
-
Pointing either index or pinky finger to rotate
-
Spiderman pose to teleport
-
Tools: Unreal Engine, Meta hand-tracking, Oculus Quest 2
XR Music Visualizer
Spectrum analyzer & particle Fx
Not to far into the future, I think the music industry will move into XR instead of music videos playing on 2D screen. So I ask myself, why not making a music visualizer in XR?
In this small experiment, I explored:
-
Constructing a music analyzer:
-
Analyzing 96 bands and volumes
-
Detecting 'hits' and dividing into low, medium, and high frequency ranges.
-
-
Making a music visualizer
-
Utilizing particle effect with scripting.
-
Normalize the velocity according to bass.
-
-
AR experience via passthrough (the black screen in the video is actually passthrough on my headset, but Oculus doesn't allow recording)
Tools: Unreal Engine, Meta hand-tracking, Oculus Quest 2
STEAM Hub Design
Immersive VR review
STEAM for Vietnam is in the process of building more than 50 collaborative space for students, branded STEAM Hub, across Vietnam. I am honored to be able to collaborate with the team and make a proposal for the space, which features many learning opportunities including VEX robotics kit, 3D printers, VR headset, Chromebook...
To review the space, I put the work in VR to better experience the spatial design.
With the power of visualization in Unreal Engine 5, I have no doubt that VR bring tremendous value to the design process, even more with spatial application, by its ability to allow user experience the space in 3D, in real-time.
Tools: Unreal Engine, Oculus Quest 2, Blender
Team feature in AR
AR experience on mobile device
To help promote our National Robotics Championship 2023, I was collaborating closely with the marketing department to incorporate cutting-edge tools, such as augmented reality. It's easy to create an augmented reality (AR) experience by taking advantage of mobile devices, and we can use this to get more teams to sign up for the robotics competition.
In this prototype, I was practicing:
-
Surface tracking and placement
-
Animation and AR material
Tools: Spark Studio, Figma