The Collaboration between SpectreXR and Crunchfish continues to thrive! The new amazing version of Crunchfish’s XR Skeleton has successfully been integrated into the latest version of Spectre’s hand interaction framework – OctoXR. This integration highlights the ease and efficiency of enchancing augmented reality experiences on standard mobile devices.

Combining Crunchfish’s robust hand tracking solution and Spectre’s interaction framework we have created a demo to showcase the potential of this technology for the e-commerce market, improving the quality by offering a more immersive digital shopping experience.

The most exciting thing about using hands in augmented reality is that it allows the user to interact with the virtual world just like in real life. Our solution simulates real physical interaction with virtual objects, making it a more natural experience. The demo application shows how a sneaker can be picked up and turned around for the user to get a closer look before making a purchase.

Crunchfish’s and Spectre’s software can now be used together to make an integrated solution that makes it much faster to make interactive augmented and virtual reality applications for e-shopping, live video shopping, Virtual-Try-Ons, etc.

“Using Crunchfish’s hand tracking technology in AR, we can use the full potential of our OctoXR to give users a full AR experience by interacting with the digital content using just their hands, not touching the screen.” says Ivan Rajkovic, CEO of SpectreXR

This information was provided by the contact person above for publication 8 February 2023 at 10:00 CET.

SpectreXR and Crunchfish collaboration regarding hand tracking and interactions in AR continues to thrive!

SpectreXR and Crunchfish's collaboration continues to yield positive results with the integration of Crunchfish's XR Skeleton into SpectreXR's OctoXR hand interaction framework. This integration has made it easier to enhance AR experiences on standard mobile devices. The two companies have created a demo to showcase the potential of this technology for the e-commerce market, offering a more immersive digital shopping experience. The use of hand gestures in AR allows for a more natural interaction with the virtual world, as demonstrated in the demo app where a sneaker can be picked up and turned for a closer look. This integrated solution makes it faster to create interactive AR apps for e-shopping, live video shopping, and virtual try-ons. According to Ivan Rajkovic, CEO of SpectreXR, hand tracking technology from Crunchfish can be used to maximize the full potential of OctoXR, enabling users to interact with digital content using just their hands without touching the screen. 

SpectreXR and Crunchfish Betting Big on Hand Interactions in AR

Hand interactions in virtual reality play a crucial role in immersing users in the digital world, but achieving natural and seamless interactions can be challenging. Hand tracking and interactions in VR can still be clunky and difficult to use. In this blog post, we'll explore some techniques and best practices for improving hand interactions in virtual reality.

Use a high-quality hand tracking device
One of the most important factors in hand interactions in VR is the quality of the hand tracking device. A high-quality device will provide more accurate and responsive tracking, which will result in a more immersive and natural experience. Look for devices that use advanced tracking technology, such as optical or inertial sensors. In our experience, the best standalone VR device with integrated hand tracking is Oculus Quest 2 because losing hand tracking doesn’t happen that often (assuming your hands are in front of your device), it has a solid occlusion and it predicts well the position and behavior of the fingers it cannot see. As for other VR headsets we recommend using additional hardware such as Ultraleap. 


Optimize hand models and animations
The way that hands are represented in VR can have a big impact on the overall hand interactions. A good hand model should be anatomically correct, and the animation should be smooth and natural. Pay attention to the details like finger movement, hand gestures and physics-based interactions to make it more believable.


Provide clear visual feedback
Another important aspect of hand interactions in VR is providing clear visual feedback. This means displaying information about the state of the hand interactions, such as when the hand is gripping or pointing. This can be done through visual cues, such as changes in the color or shape of the hand model, or if possible, through haptic feedback.


Allow for customization
One size does not fit all when it comes to hand interactions in VR. Different users have different preferences and comfort levels, so it's important to allow for customization. This can include things like sensitivity settings, grip strength, and the ability to adjust the size and position of the hand model.


Test and iterate
Finally, it's important to remember that hand interactions in VR are an ongoing process. The best way to improve hand interactions is to test and iterate. Gather feedback from users and use that feedback to make adjustments and improvements.

Improving hand interactions in virtual reality is a complex task, but by using high-quality tracking devices, optimizing hand models and animations, providing clear visual feedback, allowing for customization and testing and iterating, you can create a more immersive and natural experience for your users.

Various techniques and best practices for enhancing hand interactions in virtual reality.

This blog post covers various techniques and best practices for enhancing hand interactions in virtual reality. The post highlights the importance of using high-quality hand tracking devices, optimizing hand models and animations, providing clear visual feedback, allowing for customization, and testing and iterating. By following these tips, businesses and developers can create more immersive and natural hand interactions in VR, which can improve the overall user experience. 

How to Improve Hand Interactions in Virtual Reality

Virtual reality has the power to transport users to entirely new worlds, but it's the interactions within those worlds that truly immerse users and make the experience feel real. Interactions in virtual reality are what allow users to engage with the virtual environment and make it feel like a real, living space. Without them, the experience would be limited and lack the feeling of immersion. This is why interactions play a crucial role in enhancing the user experience in virtual reality.

One of the key elements of interactions in virtual reality is realism. Users expect to be able to interact with virtual objects in a way that feels natural and intuitive, just as they would in the real world. This is where hand tracking and gesture recognition come into play. These technologies allow for the detection of hand and finger movements, enabling developers to create interactive VR experiences that respond to natural hand gestures. This eliminates the need for complex coding and allows for faster development times. 

Another important aspect of interactions in virtual reality is the ability to manipulate virtual objects. This can range from simple actions like picking up and moving an object, to more complex actions like assembling a virtual puzzle. Hand tracking technology allows for the detection of hand position and movement, enabling developers to create realistic and intuitive interactions within the virtual world. This includes grasping, reaching, and manipulating virtual objects.

In addition to these features, pre-built interactions such as button presses, sliders, and toggle switches, can be easily integrated into VR environments. This eliminates the need for developers to start from scratch and allows them to focus on creating unique and engaging VR experiences. 

As explained, interactions play a vital role in enhancing the user experience in virtual reality. They allow users to engage with the virtual environment in a natural and intuitive way and make the experience feel more real. As VR technology continues to evolve, we can expect to see even more advanced and realistic interactions being developed, further immersing users in virtual worlds. 

At SpectreXR, we understand the importance of interactions in virtual reality and strive to provide developers with the tools they need to create the most immersive and engaging virtual reality experiences. If you're a developer or a VR enthusiast interested in enhancing the user experience in virtual reality, we encourage you to check out our OctoXR at https://spectrexr.io/octo-xr.  

Interactions in virtual reality are what allow users to engage with the virtual environment and make it feel like a real, living space. 

Interactions in VR are important because they allow users to interact with and manipulate virtual environments in a natural and intuitive way. This can enhance the sense of immersion and make the experience more engaging and realistic. Interactions also allow users to perform tasks and accomplish goals within the virtual world, which can be useful for education, training, and entertainment. Additionally, interactions in VR can provide opportunities for social interaction and communication, allowing users to collaborate and connect with others in a shared virtual space.

The Importance of Interactions in Virtual Reality: Enhancing User Experience

The Oculus Quest is a revolutionary virtual reality headset that allows users to experience immersive games and apps without the need for a PC or external sensors. It’s a high-quality VR headset that’s easy to use, that offers a wide range of content, and it comes at relatively low price. One of the most exciting features of the Quest is its ability to track your hands and fingers using its onboard cameras, allowing for a more intuitive and natural VR experience. This feature was released on December 10, 2019, and since then it was used in many interesting VR solutions. In this article we decided to cover the 5 best hand tracking games that are available on Oculus Quest. It’s important to say that we tested these games only on Oculus Quest 2 so some experiences might be different on the original Quest. 

If you're looking for the best hand tracking games on the Oculus Quest 2, you can't go wrong with Cubism, Hand Physics Lab, Unplugged, Vacation Simulator and Elixir. These games all showcase the incredible potential of hand tracking in VR and provide hours of entertainment and fun. 

Cubism is a puzzle game that challenges players to manipulate 3D objects using their hands. The game's intuitive controls make it easy to pick up and play, and its colorful, minimalist art style is a joy to behold. It’s important to mention that Cubism has a passthrough mode which lets you solve the puzzles while still completely aware of your surroundings. Whether you're a seasoned VR veteran or a newcomer to the world of hand tracking, you'll love the challenge and satisfaction of solving Cubism's increasingly complex puzzles. 

Hand Physics Lab is a physics-based sandbox game that lets players experiment with a wide variety of objects and materials. From building structures and machines to creating intricate Rube Goldberg contraptions, Hand Physics Lab offers endless possibilities for creativity and exploration. Its intuitive hand tracking controls make it easy to interact with objects and experiment with different materials, making it a must-play for anyone looking to unleash their inner scientist in VR. It’s also a great game for the first time users of hand tracking.

It's a Guitar Hero but in VR. We think that’s the best description for Unplugged: Air Guitar. Players use their hands to simulate playing a guitar, following along with on-screen prompts to hit notes and strum chords. The game includes a variety of different songs and difficulty levels, and of course, tracks your progress and scores. It’s a fun and immersive way to experience playing a guitar. And don’t worry, you don't have to have any musical experience or a guitar. Unplugged is a great choice for music enthusiasts or anyone looking for a unique and entertaining VR experience.

Vacation Simulator is a lighthearted VR game that lets players explore a colorful, fantastical world filled with interesting characters and activities. From lounging on the beach to playing mini-games and exploring hidden secrets, Vacation Simulator will offer you a relaxing and enjoyable VR experience that's perfect for unwinding after a long day. Its intuitive hand tracking controls make it easy to interact with the game's vibrant world, making it a must-play for fans of casual VR games.

Elixir is a game that utilizes hand tracking to allow players to experience the sensation of casting spells, mixing chemicals, and transforming their fingers into other objects. The game is set in a surreal world where players follow the guidance of a sorceress as they navigate dangerous and magical situations in order to land a job in a magical laboratory. The use of hand tracking helps to create a sense of presence and allows players to safely experiment with scenarios that might be uncomfortable in real life. The game includes a variety of interactive elements, including poking monsters in the eye, rubbing a dragon's belly, snuffing out candle flames, and punching giant fireflies out of the sky.

In conclusion, the Oculus Quest's hand tracking capabilities open up a world of possibilities for immersive and intuitive VR experiences. Whether you're looking for a challenging puzzle game, a physics-based sandbox, an escape room adventure, or a rhythm game, there's a hand tracking game on the Oculus Quest that's sure to appeal to you. So why not try out one of these amazing hand tracking games today and discover the magic of VR for yourself!

5 best VR games that showcase the potential of hand tracking and provide hours of entertainment and fun. 

The Oculus Quest is a virtual reality headset that allows users to experience immersive games and apps without the need for a PC or external sensors. Its hand tracking feature, released in December 2019, allows for a more intuitive and natural VR experience. In this article, we cover the 5 best hand tracking games on the Oculus Quest 2: Cubism, Hand Physics Lab, Unplugged: Air Guitar, Vacation Simulator, and Elixir. These games showcase the potential of hand tracking in VR and provide hours of entertainment and fun. 

The 5 Best Hand Tracking VR Games on Oculus Quest

Crunchfish and SpectreXR have joined forces to provide a complete solution for the AR/VR market. The incorporation of Crunchfish's XR Skeleton into SpectreXR's OctoXR product enables users to interact with virtual objects in a realistic manner by utilizing hand-tracking technology and advanced software developed by both parties. This collaboration reduces the time and complexity involved in developing interactive AR software systems and apps, and it marks an important step forward in incorporating hand interactions into AR technology. 

While OctoXR allows users to add interactions with virtual elements quickly, Crunchfish XR Skeleton adds hand-tracking capabilities to AR/VR devices by analyzing the image stream from the camera sensor(s) and then tracking 21 points on each hand with high precision. This set of 42 coordinates is then used to interact with virtual objects. 

It is very complex to design and develop virtual objects in AR/VR. The objects appear in three dimensions and must look and feel as real as possible, which necessitates advanced software and very specific skills.

"One of our most important long-term goals has always been to bring OctoXR into AR technology, and when Crunchfish introduced their XR Skeleton, we knew that this integration was a big step towards that," said Ivan Rajkovic, CEO at SpectreXR. 

“I was very impressed by how fast XR Skeleton could be integrated into OctoXR and get to a working demo. The combination of Crunchfish’s XR Skeleton and OctoXR enables a powerful solution that may shorten the time to market for many of our customers”, says Joakim Nydemark, CEO at Crunchfish Gesture Interaction.

For more information on how to work with us, please contact:

Ivan Rajković, CEO of SpectreXR
+385 98 9858 830
ivan@spectrexr.io

Joakim Nydemark, CEO of Crunchfish Gesture Interaction AB
+46 706 35 16 09
joakim.nydemark@crunchfish.com

SpectreXR and Crunchfish have partnered to offer a comprehensive solution for the AR/VR market that enables users to interact with virtual objects in a realistic way using hand tracking technology.

The integration of Crunchfish's XR Skeleton into SpectreXR's OctoXR allows for seamless interaction with virtual objects in AR/VR, making it possible to enable any AR/VR device with a powerful object interaction solution in a short amount of time. This partnership will significantly reduce the time and complexity involved in developing interactive AR/VR software systems and apps, bringing hand interactions into AR technology.

Bringing Hand Tracking and Interactions into AR: SpectreXR partners with Crunchfish

Virtual Reality (VR) technology has come a long way in recent years, and one of the most impressive developments has been the ability to track hand movements in real-time. This technology allows for highly realistic hand interactions in VR, which has a number of benefits for training and other use cases.

One of the key benefits of VR training with hand interactions is the increased realism. When using VR controllers, there is a disconnect between the user's real hands and the virtual hands being controlled. This can make it difficult to fully engage with the VR environment and can even lead to discomfort.

However, with hand tracking technology, users can see their own hands in the VR environment and interact with virtual objects in a natural and intuitive way. This makes the experience much more immersive and engaging, which can help to improve the effectiveness of training programs.

There are a number of different use cases for VR training with hand interactions. For example, it can be used to train surgeons on new techniques, or to simulate complex industrial processes for workers. It can also be used in the military to train soldiers for combat situations, or in the aviation industry to train pilots on emergency procedures.

In addition to these more traditional use cases, VR training with hand interactions is also being used by a number of big companies in creative ways. For instance, Walmart is using VR technology to train its employees on customer service and other skills. By using VR to simulate real-life situations, Walmart is able to provide its employees with a more engaging and effective training experience.

Another example is the use of VR technology by the car manufacturer Audi. Audi is using VR to train its assembly line workers on new processes and procedures, which has helped to increase efficiency and reduce errors. This demonstrates the potential of VR training with hand interactions to improve the effectiveness of employee training across a wide range of industries.

In conclusion, the ability to track hand movements in real-time has opened up a whole new world of possibilities for VR technology. The increased realism of hand interactions in VR has a number of benefits for training and other use cases, and is already being embraced by a number of big companies. As VR technology continues to evolve, we can expect to see even more innovative uses for hand tracking in the future.

VR technology that tracks hand movements in real-time allows for more realistic training experiences, improving the effectiveness of training and has a number of benefits for various use cases.

Virtual reality (VR) technology has made significant advancements in recent years, including the ability to track hand movements in real-time. This technology allows for realistic hand interactions in VR, which can improve the effectiveness of training programs and has a number of benefits for various use cases. Some examples include training surgeons, simulating industrial processes for workers, and training pilots on emergency procedures. In addition, big companies such as Walmart and Audi are using VR to train employees on customer service and new processes, respectively, in an effort to increase efficiency and reduce errors. Overall, the potential of VR training with hand interactions to improve employee training across industries is significant.

The Benefits and Use Cases of VR Training with Hand Interactions

As more and more companies begin to adopt virtual reality (VR) technology, the need for realistic and intuitive hand interactions within VR environments has become increasingly important. That's why hand tracking is one of the key areas of development. From optical tracking to electromyography (EMG) sensors, there are a number of technologies and techniques being used to improve the accuracy and responsiveness of hand tracking in VR. This technology has the potential to greatly enhance the VR experience, allowing users to interact with virtual objects in a more natural and intuitive way. In this blog post, we will explore some of the latest advances in hand tracking for VR and how they are helping to enhance the user experience.

One of the main challenges with hand tracking in VR is the need for accurate and real-time tracking of the user's hand movements and gestures. Traditional VR controllers, while effective for some tasks, can be awkward and unnatural to use, limiting the immersion of the VR experience. By using advanced sensors and algorithms, hand tracking technology is able to accurately capture the movements of the user's hands and translate them into virtual actions. In order for hand interactions in VR to feel natural and intuitive, the VR system must be able to accurately and quickly detect and respond to the user's hand movements. This requires sophisticated tracking algorithms and hardware, and is an area where ongoing research and development is needed.

While researching the latest advances in hand tracking for VR one thing was popping out - electromyography (EMG) sensors. EMG sensors are small sensors that can be placed on the user's skin to detect the electrical signals generated by the muscles in the hand. By using EMG sensors, VR systems can accurately track the user's hand movements and gestures in real-time, providing a more natural and responsive hand tracking experience.

Another emerging technology that is being used to improve hand tracking in VR is optical tracking. Optical tracking involves the use of cameras or other sensors to detect the movement and position of the user's hands. This can be done using markers placed on the user's hands, or by using advanced computer vision algorithms to track the movement of the hands in the 3D space. Optical tracking can provide high-precision hand tracking, and is an important technology for improving the accuracy and responsiveness of hand interactions in VR.

In addition to these technologies, there are also a number of other advances in hand tracking for VR that are worth exploring. For example, there are new algorithms and techniques being developed for improving the accuracy and reliability of hand tracking, as well as new hardware devices and sensors that are being designed specifically for VR applications.

A company that is at the forefront of this technology is Leap Motion. They have developed a hand tracking system that uses a combination of infrared cameras and LED lights to capture the movements of the user's hands. This system is able to track the position, orientation, and movement of the user's hands with incredible accuracy, allowing them to interact with virtual objects in a natural and intuitive way.

Another company, Manus VR, has developed a hand tracking system that uses sensors mounted on the user's wrists and fingers to capture the movements of their hands. This system is able to track the movements of the user's fingers individually, allowing for even more precise and realistic interactions with virtual objects.

Although it should be noted, having your hands tracked in VR is just a half of the business. The second part is to add realistic interactions and that's where OctoXR shines the best. But that's a topic we'll cover in another blog post.

Overall, the future of hand tracking in VR looks bright, and there are a number of exciting advances on the horizon. By continuing to push the boundaries of hand tracking technology, we can create more realistic and immersive VR experiences that provide users with a truly interactive and engaging virtual world.

Get the inside scoop on the latest advances in VR hand tracking, from cutting-edge technologies to real-world applications.

In this blog post, we delve into the exciting world of virtual reality hand tracking. From cutting-edge technologies to real-world applications, we cover the latest advances in this rapidly-evolving field. Discover how hand tracking is revolutionizing VR experiences and learn about the companies and researchers driving these innovations. Get ready to immerse yourself in the future of VR hand tracking!

Exploring the Latest Advances in Hand Tracking for VR

Virtual reality (VR) technology is rapidly advancing, and with it, the ability to interact with virtual environments using your hands. This has opened up a world of possibilities for VR applications, from gaming to medical training and beyond. If you're a developer interested in creating VR applications with hand interactions, this beginner's guide is for you.

First, let's define what we mean by hand interactions in VR. Hand interactions refer to the ability for users to manipulate virtual objects and environments using only their hands, in a natural and intuitive way. This can be achieved through the use of VR headsets that are equipped with sensors and cameras that track the movement and position of the user's hands. These sensors send data to the VR system, which then translates the hand gestures into appropriate actions in the virtual environment.

To develop hand interactions for VR applications, you'll need to have a solid understanding of VR technology and its underlying principles. This will involve learning about VR hardware, such as headsets and controllers, as well as the software tools and platforms used to create VR experiences. Additionally, you'll need to have some familiarity with programming languages and frameworks commonly used for VR development, such as C++, C#, Unity, and Unreal Engine. In this guide, we’ll focus on Unity. Unity is a popular game engine that provides a powerful and versatile platform for creating VR experiences. It offers a range of tools and features specifically designed for VR development, including support for hand interactions. 

Once you have a basic understanding of Unity and VR technology, you can begin to focus on developing hand interactions specifically. Unity provides a range of tools and features that can help with this, including support for different types of VR hardware and sensors, and the ability to customize and fine-tune hand interactions.

One key aspect of developing hand interactions using Unity is the use of scripts. These are small programs written in C# that control the behavior of your VR application, including how it responds to hand gestures and movements. To create hand interactions, you'll need to write scripts that interpret data from the VR hardware, and use that data to generate appropriate responses in the virtual environment. This can involve complex algorithms and systems, but Unity and its ecosystem provide a range of tools and resources that can help make the process easier. One of these tools is definitely OctoXR, a no-code/low-code plugin for Unity that lets you create most realistic hand interactions in just a few steps.  

Another important aspect of developing hand interactions using Unity is testing and debugging. As with any software development project, it's important to test your VR application thoroughly, to ensure that it works as expected and provides a seamless and enjoyable experience for users. Unity provides a range of tools and features that can help with this, including the ability to test your VR application in real-time, and to identify and fix any issues or bugs that may arise.

Although OctoXR solves most of the challenges of hand interactions, we will mention a few. One of the challenges is ensuring that the virtual environment responds to the user's hand gestures in a realistic and believable way. This requires a deep understanding of both the hardware and software aspects of VR development, as well as an ability to design and implement complex algorithms and systems.

Another challenge is the need to optimize the VR experience for different users and devices. VR hand interactions can be computationally intensive, and may require significant processing power to run smoothly. As a result, you'll need to ensure that your VR application is optimized for a range of different devices and hardware configurations, in order to provide a seamless and enjoyable experience for all users.

Overall, developing hand interactions for VR applications is a complex and challenging task, but one that can provide a wealth of opportunities for innovation and creativity. By mastering the skills and technologies involved, you can create immersive and engaging VR experiences that allow users to interact with virtual environments in a natural and intuitive way. Whether you're interested in gaming, medical training, or any other application, VR hand interactions offer endless possibilities for exploration and discovery.

A guide on how to create realistic hand interactions for virtual reality applications in Unity

A beginner's guide to developing hand interactions for VR applications. In this blog post, we will provide a guide on how to create realistic hand interactions for virtual reality applications in Unity. Whether you are a VR developer looking to improve your skills or a complete beginner interested in learning about VR development, this guide is for you. Follow along as we explore the key concepts and techniques for creating immersive and intuitive hand interactions for VR applications.

A Beginner's Guide to Developing Hand Interactions for VR Applications

The history of hand tracking in virtual reality (VR) goes back several decades, with early efforts dating back to the 1980s and 1990s. At that time, VR was still in its infancy, and the technology to accurately track hand movements in real-time was not yet available.

One of the first notable attempts at hand tracking in VR was the DataGlove, developed by VPL Research in the late 1980s. The DataGlove used sensors and motion-capture technology to track the movement of the user's hand and fingers, allowing them to interact with virtual objects in a limited way. However, the technology was still primitive and the DataGlove was not widely adopted.

As VR technology continued to evolve, so did hand tracking. In the 2000s, companies like Ultraleap and Sixense began developing their own hand-tracking systems, using a combination of sensors and machine learning algorithms to achieve more accurate and responsive tracking. In recent years, hand tracking has become an increasingly important part of VR technology, with the Oculus Quest including the ability to track hand movements without additional sensors.

Since the Oculus Quest first added hand tracking as a feature, many users have been impressed by the accuracy and responsiveness of the system. It allows them to interact with virtual objects and environments in a more natural and intuitive way, without the need for any additional sensors or equipment. The Oculus hand tracking got even better with the newer version of the device. 

One of the biggest advantages of Oculus Quest hand tracking is that it opens up new possibilities for VR experiences. For example, instead of using a traditional game controller, users can simply use their hands to play games or navigate menus. This can make the VR experience more immersive and engaging, as it feels more like you're actually interacting with the virtual world.

In addition to gaming, hand tracking on the Oculus Quest has also been used for other purposes, such as education and virtual reality training. For example, it can be used to teach people how to perform certain tasks in a virtual environment, allowing them to practice and learn without the need for costly and time-consuming physical simulations.

Overall, Oculus Quest 2 hand tracking has been well-received by users and has the potential to revolutionize the way we use VR. It's still a relatively new technology, so there may be some limitations and bugs, but it's an exciting development that has the potential to greatly enhance the VR experience.

Apart from Oculus there are now numerous devices that support hand tracking like Pico 4 or Varjo XR-3, VR-3 and VR-2. As the technology continues to advance, we can expect to see even more impressive and immersive hand tracking capabilities in VR headsets and other devices. Hand tracking in VR offers a more intuitive and immersive experience, making it an important aspect of the future of virtual reality technology.

Learn about the history of hand tracking in virtual reality, from the early days of the DataGlove to the latest developments like Oculus Quest hand tracking. 

Explore the history of hand tracking in virtual reality, from the early days of the DataGlove to the latest developments in VR technology. Learn about the key players and milestones in the evolution of hand tracking, and discover the potential of this exciting technology for the future of VR.

 Brief History of Hand Tracking in Virtual Reality

As virtual reality (VR) technology continues to advance, hand interactions are becoming increasingly important for creating immersive and engaging experiences. This technology allows for highly realistic hand interactions in VR, which has a number of benefits for training and other use cases. In order to optimize hand interactions in VR, it is important to consider factors such as usability, naturalness, and performance.

1. Use realistic and intuitive hand models 
One of the key aspects of creating effective hand interactions in VR is using hand models that are realistic and intuitive for users. This means using high-quality 3D models that accurately represent the shape and movements of the human hand, and designing the interactions in a way that is natural and easy to understand.

2. Consider the context of the VR experience 
Another important factor to consider when optimizing hand interactions in VR is the context in which they will be used. For example, a VR game may require more complex and dynamic hand interactions than a VR training application. By understanding the specific needs and requirements of the VR experience, you can design hand interactions that are tailored to the intended use.

3. Take advantage of existing hand tracking technology
There are a number of hand tracking technologies available today that can be used to improve the accuracy and responsiveness of hand interactions in VR. These include optical tracking, inertial tracking, and electromyography (EMG) sensors. By incorporating these technologies into your VR experience, you can provide users with more realistic and responsive hand interactions.

4. Invest in user testing and feedback
One of the best ways to optimize hand interactions in VR is to conduct user testing and gather feedback from real users. This can help you identify any issues or challenges with the hand interactions, and make adjustments to improve the user experience.

5. Use haptic feedback to enhance realism
Haptic feedback, or the use of touch sensations to communicate information, can be a powerful tool for improving hand interactions in VR. By incorporating haptic feedback into the VR experience, you can make the hand interactions feel more realistic and immersive for users.

6. Provide clear and concise instructions
In order for users to effectively interact with their hands in VR, it is important to provide clear and concise instructions on how to do so. This can include on-screen prompts, tutorials, or other forms of guidance that help users understand the hand interactions and how to use them.

7. Create a smooth and natural hand movement system
In order to create realistic and engaging hand interactions in VR, it is important to design a movement system that is smooth and natural. This means avoiding jerky or unnatural movements, and using motion capture or other techniques to accurately reproduce the movements of the human hand.

8. Use hand interactions to enhance immersion
One of the key benefits of hand interactions in VR is that they can help to enhance the immersion of the VR experience. By designing hand interactions that are intuitive and engaging, you can help users feel more connected to the VR environment and the content they are experiencing.

9. Avoid overloading the user with too many hand interactions
While hand interactions can be a powerful tool for enhancing VR experiences, it is important to avoid overloading the user with too many interactions. This can lead to confusion and frustration, and may detract from the overall user experience.

10. Continuously refine and improve the hand interactions
Finally, it is important to continuously refine and improve the hand interactions in VR in order to provide the best possible user experience. This can include implementing new technologies, gathering user feedback, and making ongoing adjustments to the hand interactions based on user needs and preferences.

By following these tips, you can optimize the hand interactions in your VR experience and provide users with a more engaging and immersive experience. And if you are looking to simplify your development process, you should consider using OctoXR. 

If you are interested in working with us or just want to chat, contact us by email or join our Discord. 

Learn how to enhance the user experience and take your VR application to the next level with our 10 tips for optimizing hand interactions in VR

Virtual reality (VR) technology is constantly evolving, and hand interactions are becoming increasingly important for creating immersive and engaging experiences. In this blog post, we will share 10 tips for optimizing hand interactions in VR. From using realistic hand models to incorporating haptic feedback, these tips will help you enhance the user experience and take your VR application to the next level.

10 Tips For Optimizing Hand Interactions In VR

To better understand the tool that we developed, reader needs to understand the concept of hand tracking technology, what preceded it, and why is it a more immersive and realistic way of interaction in VR, at least in our humble opinion.

Hand tracking is slowly but surely becoming an integral feature of recent generations of immersive virtual reality devices. It allows users to interact with all sorts of virtual elements without the need to use controllers. Sensors and cameras on VR headsets track users' hands and then use the data they gather to create a real-time virtual embodiment of them. 

Before, hand tracking technology in VR was introduced through the first and second iterations of the Oculus Quest, and interactions with the virtual environment were usually performed with hand-held controllers. The user's hands were visualized in the applications in a limited array of poses based on finger position, assumed from contact with triggers and buttons on these controllers. 

Hand tracking can be used for more than just picking up objects or firing weapons at enemies: it also makes interactions with other people feel more real as well as it allows for faster communication between users. With hand tracking enabled on your device, all kinds of things become possible ranging from simple gestures like clapping hands together ("high five") or even communicating in sign language.

In comparison with controllers, hand tracking technology offers three significant advantages:

1. Increased immersion and presence
Research has shown that we have an almost supernatural sense of the positions and shape of our hands when they are shielded or out of sight, and when our hands are removed from our visual worlds, it is a reminder of our disembodiedness. We spend most of our time during various daily tasks moving and twisting our hands, so removing them from the visual scene or not showing the exact movement of our hands in a virtual environment (which is the case when using controllers in VR) has several consequences for our visuomotor behavior.

2. More effective interaction
The main goal of virtual reality is to enable the user to interact with a computer-generated environment in a natural way. An example of such an interaction in its simplest form can be moving the user’s head to experience a wide visual world. But more modern VR experiences usually involve some form of manual interaction like pushing a button or carrying an object. Accurate hand tracking potentially allows for far more precise and better interactions compared to controllers, adding not only to the user’s immersion but even the accuracy of his movements, which seems particularly crucial in the training context.

3. More effective communication
Recent research has shown that individuals have difficulty recognizing many key emotions in body images that have had their hands removed, emphasizing how important information about the shape of the hand is in communication experiences. The value of hand gestures for communication in virtual environments is increasing as real-time face tracking and visualization are technically very difficult due to the extremely high temporal and spatial resolution required to detect and track micro-expressions.

One of the most exciting things about using hands in VR is enabling users to interact with the virtual world more like they do in real life. The core of this is the ability to grab and manipulate objects. We noticed that there is no out-of-the-box solution on the market for quick and easy implementation of tracking and interaction (especially physics) with hands in VR. Without OctoXR, grabbing an object with hands in VR is preceded by weeks or more of development that are now converted to just a few minutes.

OctoXR is a low-code Unity game engine plugin that allows its users to significantly reduce the development time of their realistic and physics-based hand interactions. 

Developing a solution in virtual reality is a time-consuming and complicated process, especially when trying to interact using hands. OctoXR allows the user to facilitate and shorten the process of creating applications within virtual reality using hand tracking. 

The plugin offers a range of features such as physical interactions with objects, a ready-made solution for capturing objects from a distance or proximity, pre-built solutions for moving in virtual reality such as teleportation and continuous movement, inverse kinematics, VR user interface, and gesture recognition that allows the user to further personalize desired interactions. Our plugin includes a library of interaction components that are modular, composable, and scalable that you can integrate into your existing architecture or run standalone. OctoXR takes complicated and undocumented parts of virtual reality and offers them as ready-made solutions which allow a user who does not necessarily have a background in development to turn an idea into reality much faster and easier than ever before.

OctoXR - low code VR hand interaction plugin

1. Kinematic grab
The kinematic grab feature lets you create joint-based objects which collide with the environment or kinematic grabbables for a more game-like feel in just a few clicks! Create grab points with a single click and fine-tune their position in the editor. With the OctoXR interactable module, grabbing stuff has never been easier.

2. Hand physics
This feature lets you easily create and edit a physics-enabled hand rig that makes a VR hand interact with other physically simulated objects in the scene. It will also automatically respond to collisions between any desired hand part and other objects. You can use provided scripts and extend them to make your custom behaviors and interactions based on physical or trigger collisions between hands and other objects.

3. Distance grab
Distance grab lets you detect distant grabbables with raycasting and interact with them from afar using the distance grabbing module or grab what's within the range of your hand using the proximity interactor.

4. Bad hand positioning 
Hand tracking can sometimes act out, with the OctoXR plugin you can stop your hands when things go wrong, preventing your interactions from messing up. Our bad hand tracking detection system allows your hands to stop in place with visual feedback, so your users can know exactly what's going on.

5. Gesture recognition
Making apps with gesture recognition is made easier than ever. You can create gestures with a single click of a button. Created gestures are saved in the projects Asset’s folder. You can then choose which gestures you wish to load in your scene. After you load gestures, with a simple drag and drop technique you attach functionalities to specific gestures. Gestures are recognized by comparing current hand bone positions with the ones saved with every gesture. If a gesture is recognized, the gesture detector fires a recognized event and executes attached functionalities.

6. Locomotion
Developing a good locomotion technique in VR has always been a big issue. Especially using hand tracking. OctoXR offers two readymade solutions: continuous locomotion (or walking) and teleport locomotion. There are a couple of predefined teleportation modes: pinch teleport and gesture teleport. You can create your own gestures you wish to use for teleport and attach them to gesture teleport. But if you feel you need even more freedom to develop your own type of teleport, you can simply inherit the teleport base class and by overriding, a couple of lines of code have your own brand-new teleport.

7. OctoXR UI
We developed the “oculus home like” UI manipulation that all Oculus developers are used to. Simply attach UIPointer to the hand and insert OctoInputModule prefab in the scene and it just works.

8. Inverse kinematics
The inverse kinematics feature provides support for models using the Unity humanoid rig. We integrated head, arm and finger tracking. 

Hand tracking in VR is a game-changer. Many companies are already using it to make their games more immersive, accessible and fun. It's an important part of the future of virtual reality, and OctoXR will help you get there sooner than you think. We believe that by giving people a powerful tool like this, we can make the future of VR so much more exciting and fun. If you have any questions about or feedback on the topic please feel free to reach out. 

For more info about OctoXR make sure to check here.

Create precise and realistic hand tracking solutions in VR with minimal effort

Developing a solution in virtual reality is a time-consuming and complicated process, especially when trying to interact using hands. OctoXR allows the user to facilitate and shorten the process of creating applications within virtual reality using hand tracking. The plugin offers a range of features such as physical interactions with objects, a ready-made solution for capturing objects from a distance or proximity, pre-built solutions for moving in virtual reality such as teleportation and continuous movement, inverse kinematics, VR user interface, and gesture recognition that allows the user to further personalize desired interactions.

Corporate training and development programs have followed traditional paths, usually with a combination of written materials, classroom lectures, outdated videos, online courses, and hands-on observation of an instructor regardless of whether the topic is production training, sales pitching, or leadership coaching. But as companies transform their businesses to be more digital, especially due to the corona crisis, the rise of virtual reality (VR) technology provides an opportunity to reshape traditional training methods to better serve a more digitally connected and diverse workforce. By using VR training, it is possible to create scenarios that are not only more engaging and immersive but also more effective and safer than traditional training methods.

Each day companies are faced with the challenge of upgrading existing employee skills to increase production performance and to train new hires to be production-ready with the basic technical, safety, and quality skills. According to go2HR  more than 40% of employees who receive poor job training leave their positions within the first year, so it is not uncommon for companies such as BMW to invest around 373 million Euro a year in employee training.

Huge sums of money are being invested in training across the globe, yet in many cases, the training procedures are not only outdated, slow and many times unsafe but do not clearly outline the complexity of the technical tasks they should teach. Longer training times, employees under-performing, and safety risks can have a hazardous domino effect on the industrial employer. Virtual Reality technology can not only close the gap between outdated training methods but also increase worker production, safety, efficiency, satisfaction, and overall task performance rates in the long run – when compared to training with traditional methods.

According to the Artillery Intelligence report , enterprise VR will grow from $829 million in 2018 to $4.26 billion in 2023, a 39 percent compound annual growth rate. This includes any spending on VR technology from enterprise buyers, including deployed hardware, software running on VR headsets, and VR creation tools (e.g. Unity or Unreal). Employee training will be a key use case in industrial segments and retail.

The benefits of VR for improving learning outcomes has been clear for some time. Companies across many industries have adopted the technology to train their employees better. Enterprises have seen dramatic cuts in costs and time spent training.

Using the headset and controllers or hand gestures, trainees look, speak, and move freely in a 3D virtual space, interacting with simulated real-world tools, machinery, and other trainees and instructors. Virtual reality is enabling workplace scenarios that were once too difficult, expensive, or dangerous to train for, become vastly more practical, cost-effective, and safe in an immersive simulation.  When combined with real-life simulations and learning curriculum developed by experts, the result is trainees learning in the best way possible — through personal experience — significantly improving learning retention, job performance, team collaboration, workplace safety, and cost.

Real-life situations and training scenarios can be created not only to make learning more interactive but also to bring students and trainees together, no matter where the location – improving the efficiency of training and potentially reducing the time required to train staff up to standard.

Another advantage of VR is that it’s more in-depth compared to other training methods. As mentioned earlier, training in real-world scenarios is anecdotal. In contrast, actions in VR can be quantified so you can understand exactly how each action was performed. The result is a data-rich, contextual timeline of all the actions which took place during the session. This provides a reinforced feedback loop that results in continual improvements, making VR simulations an integrated component of the enterprises learning strategy.

One of the biggest advantages of using VR to train employees is the ability to iterate. By understanding which behaviors lead to success, you can encourage and redesign the training programs. This provides additional feedback and a deeper understanding of human behavior. The systematic approach to improving learning ensures that processes are followed to deliver best practices to the employees.

Put another way, let your employees make expensive and dangerous mistakes in VR and not in real-world scenarios where the stakes are much higher.

Discover the potential of VR training for learning and development, from cost-effective simulations to immersive and engaging experiences.

Corporate training and development programs have followed traditional paths, usually with a combination of written materials, classroom lectures, outdated videos, online courses, and hands-on observation of an instructor regardless of whether the topic is production training, sales pitching, or leadership coaching.

Virtual Reality Training: The Future of Learning and Development

Augmented reality is a powerful tool that consumers no longer just desire, but expect. Brands who have implemented AR in advertising, sales, education, product design, customer entertainment are now experiencing performance benefits and seeing increases in conversion rates. Through the use of AR, brands can offer their shoppers detailed product information in a more interesting and engaging way, allowing consumers to see more of the benefits that a product can provide.

Based on a Zappar report around the brain analysis of people using AR, brand awareness can increase by up to 70% through the use of augmented reality. No wonder brands are implementing AR campaigns like never before. In order to build a sense of loyalty and a lasting impression on their customers, brands have found that AR is able to do this in an effective and long-term way. AR ads are more successfully remembered by consumers because of their interactiveness and ability to be shared.

To define what we mean by AR advertising, these are paid media placements that allow consumers to activate their smartphone camera and superimpose branded animations in the real world. This is usually to promote or visualize a given advertiser’s products.

Advertising is one of the most lucrative AR subsectors, on pace to reach $1.41 billion this year and $8.02 billion by 2024, with a 54,43% compound annual growth rate.

With numbers like these, it’s no wonder that that ad revenue for AR has reached well over the billion-dollar mark. Brands are recognizing the value of this kind of advertising and taking advantage of its campaign performance.

As is the case across the global economy, mobile AR sectors will be impacted unevenly by ongoing global lockdowns. Given that software mostly fares well in shelter-in-place life, the impact on mobile AR will be mostly positive.

For example, quarantine-friendly consumer AR like social lenses are trending up; and social distancing compels enterprise remote-AR support. These factors will boost near-term adoption while exposing the technology… which in-turn supports its longer-term sustained adoption.

Brand advertisers are also attracted to AR’s business case that continues to be validated in ROI metrics and one of the best metrics is conversion rate. Higher conversion rates indicate that consumers are satisfied with a large part of the marketing strategy and content that is being presented to them. The main reason why AR advertisements achieve high conversion rates is immersive product try-on that encourages informed purchases. Although every ‘high’ conversion rate is unique to each industry, a twenty to eighty percent, which was measured conversion rate on AR ads, is over ten times higher than the average conversion rate across all industries on the search network.

As mentioned, campaigns such as L’Oréal’s AR showcases have seen increased conversion rates, and have continued to work with brands such as Poplar in order to successfully create even more. Plus, brands like the pizza chain Papa Johns have joined in and gained a 25% conversion rate with their AR campaigns.

The proof of AR is in its conversions. While many brands are still using AR to engage their followers and increase brand awareness, the benefits of AR as a conversion tool are only increasing.

As more and more brands continue to report on successful conversion rates, we can expect the adoption of AR to move away from simple engagement into an active channel in the marketer’s toolkit to drive higher conversions and sales.

Augmented reality is a powerful tool that consumers no longer just desire, but expect. Brands who have implemented AR in advertising, sales, education, product design, customer entertainment are now experiencing performance benefits and seeing increases in conversion rates.

Through the years, Spectre company was a part of numerous conferences and summits where we presented solutions and benefits that virtual, augmented, and mixed reality, along with other new technologies like 5G or artificial intelligence, bring to the industry and business development. After a large number of domestic conferences, it was time to showcase our solutions and products on the international stage.

The two biggest conferences that we did were the ones with Huawei Technologies Co. The first one was the Fourth China CEEC Conference in Belgrade, where we were a part of the Huawei 5G use case presentation team with our augmented and mixed reality products. Using Hololens, we showed how mixed reality technologies can speed up and enhance product design and development. Almost every industry nowadays is responding to a growing need to deliver greater innovation, faster and more effectively, at better prices. 

That means finding a way to develop products more quickly and more efficiently, reducing time to market while taking cost and complexity out of the process. Few days after the conference, our colleagues from Huawei shared a video with us that shows our presentation broadcasting on China national television with 650 million viewers every day, it was a pretty sweet commercial reach.

After the success we had in Belgrade, we were invited to participate in Digital Transformation Forum in Kyiv in November of 2019. There we showcased how the implementation of 5G networks will impact augmented and mixed reality. Specifically, we presented a solution that shows what innovative improvements we can make in education and collaboration between students using AR and MR technologies alongside 5G. Visualizing content in 3D that was previously only learned through the book reduces learning time, gives students much better knowledge retention and more confidence to act on what they learned. We are especially glad that we had a chance to show our demo to some members of the Ukrainian government.

There were a lot of plans for 2020. roadshow with Huawei Technologies Co., but unfortunately, everything got postponed due to the COVID-19 burst that shook the world. While we wait for the new conferences and forums, we are working hard to develop even more applications and products using virtual, augmented, and mixed reality technologies.

Showcasing possibilities of augmented and mixed reality solutions. 

Through the years, Spectre company was a part of numerous conferences and summits where we presented solutions and benefits that virtual, augmented, and mixed reality, along with other new technologies like 5G or artificial intelligence, bring to the industry and business development.

Huawei and Spectre on digital transformation

Have you ever stood in front of historic ruins or monument and closed your eyes, imagining what the scene before you would have looked like centuries ago? Thanks to virtual reality, seeing places as they were in their heyday is becoming possible. History isn’t meant to stay on the page — it comes alive through storytelling and shared experiences. The historical context of a place is a powerful conduit to cultural appreciation in the present. That's why the city of Valpovo and its Tourist board have decided to create an interesting and immersive experience that will bring the figure and works of Matija Petar Katančić and the inhabitants of Valpovo from the end of the 18th century closer to their visitors, especially the younger generations. 

For the purposes of the application, we created 3D models of the main Valpovo square, the Prandau-Normann castle, medieval tower, the Church of the Immaculate Conception of the Blessed Virgin Mary, the old school located next to the church, the birth house of Katančić and the Valpovo beer brewery.

Unfortunately, the only relevant pictorial source from that era that shows to some extent how Valpovo was spatially arranged is a drawing of Valpovo on a guild diploma from the beginning of the 19th century.

A drawing of Valpovo on a guild diploma from the end of the 18th century

In addition to the object models, we created various 3D models of characters important for the history of Valpovo as well as a few secondary male and female characters. The users of the application will be able to meet Matija Petar Katančić, ban Ivan Morović (“ban” is a noble title from Croatia’s history) and Friedrich Stegmann, the beer brewer that was working in the historic Valpovo brewery. 

Various forms of interaction have been developed for users at the locations featured in the application. On Valpovo square, users can see what crafts and service activities the townsfolk of Valpovo were engaged in or what the market looked like. They also have the opportunity to draw water from the “Đeram”, an old type of well characteristic to this area. At school, they can solve a mini knowledge quiz, while, for example, at a brewery, they will help the brewer arrange a beer order that has been reduced due to a lack of hops. In the medieval tower, the user is given a chance to solve a puzzle and help Ban Ivan Morović to find the lost sword that he needs for battle. The house where Matija Petar Katančić lived as a child gives the user an insight into the life of the inhabitants of Valpovo 200 years ago - how they lived, how their houses were decorated,  what they ate and what they did for a living. In the church, the user will see the Baroque style influence present in the Valpovo church, and have the cultural value of the organ (a keyboard instrument), altar and other significant church elements thoroughly explained.

This type of solution allows the user to travel back in time and create a memorable and unique experience. It also enriches the tourist and educational experience in the city of Valpovo. It enables the town and its Tourist Board to introduce their visitors, especially younger generations, to the character of Matija Petar Katančić and the life of the inhabitants of Valpovo 200 years ago in an interesting, new and immersive way,.

Katancic's Time Machine VR

Thanks to virtual reality, seeing places as they looked in their heyday is becoming possible.

KK.03.2.2.01. – Application for iOS and Android operating systems and applications for holographic computers with augmented reality components and 360º virtual walks and customization for people with visual and hearing impairments.Project beneficiary: SPECTER j.d.o.o. Project duration: 14.09.2017.-14.03.2019. Project value: 1.169,673.20 HRK, EU co-financing: 1.032,851.88 HRK Contact for more information info@spectre.hr

In 2016, Spectre started applying for the EU Competitiveness and Cohesion Fund 2014-2020 The innovation of SMEs, and then in 2017, it received approval for funds for the project Croatia for All – Croatia for everyone. The overall goal of this project is to strengthen technological solutions that will help people with disabilities to overcome everyday obstacles and lead them to better assimilation in the social environment in which they move and live. The goal of technological innovations achieved through this project during the project duration of 18 months, starting from September 14, 2017, will be the focus of Spectre, which will create at least two new jobs in a given period.

The project includes the development of applications for iOS and Android operating systems with augmented reality components and 360 virtual walks and is also adapted for people with visual and hearing impairments. The project is also developing an application for the holographic computer Microsoft HoloLens, which is also one of the first developments of applications of this type in Croatia. This approach allows the user to project images and content from augmented reality on the glasses screen. Thus, it is possible to achieve a perception of the world that the user sees and the space in which it is located in parallel with the projection of a transparent image on the screen of glasses.

By fulfilling the conditions of all prepared documentation, the company Specter was among the projects approved for co-financing from European Union funds, namely the Fund Competitiveness and Cohesion of the financial period from 2014 to 2020 in the group: Innovation of SMEs. In that financial period, a total of HRK 1.169,673.20 will be invested, of which the amount of aid granted is HRK 1.032,851.88.

The project was co-financed by the European Union from the European Regional Development Fund.

More information on EU funds can be found on the websites of the Ministry of Regional Development and European Union Funds: www.strukturnifondovi.hr

The content of the site is the sole responsibility of the user – Spectre

Croatia For Everyone KK.03.2.2.01. - Application for iOS and Android operating systems and applications for holographic computers with augmented reality components and 360º virtual walks and customization for people with visual and hearing impairments.Project beneficiary: SPECTRE j.d.o.o.

A great idea and a strong will to succeed are just not enough in today’s world. If you’re an entrepreneur who’s looking to scale and grow, you will want to look into funding your start-up business. One of the biggest challenges for small business owners is finding the funds and the right partners to grow their businesses. Surveys show that a lack of capital is one of the most common reasons why small businesses fail.

Securing an investor who is committed to your long-term success and has an interest in your industry and mission will add value far beyond capital backing. While capital and cash flow will extend the runaway to success, your business should collect the benefits of business mentors that you got alongside with investment. We were lucky enough to find those qualities in our present partners from Fil Rouge Capital, whose experience and knowledge will drive us in all the right directions.

About a year ago as we were working on some products for our clients, we noticed that we are spending a significant amount of time working on hand interaction features, and that was the time an idea started to form and the OctoXR was born. OctoXR is a Unity 3D plugin that simplifies the development of VR, AR, and MR applications and experiences for developers and users. The tool was conceived as an addition to the Unity 3D development platform and is based on a low-code / no-code mode of visual development. This solves the problem of the need for a high degree of programming knowledge in the development of VR, AR, and MR applications and solutions. By developing its modules and technologies for hand control, physics, multi-user networking, in-display debugging tools, visual programming, and many other features, the product will significantly contribute to the faster and easier development of XR applications in the global market.

A great idea and a strong will to succeed are just not enough in today’s world. If you’re an entrepreneur who’s looking to scale and grow, you will want to look into funding your start-up business.

Activities within the `Emergency medical training 3D` project focused on early-stage innovation development to conduct technical and commercial validation of an innovative concept for 3D emergency education training to minimize potential technical and commercial risks. Through the conducted research, the applicant realized that virtual and augmented reality, due to their immersiveness, represents a decisive opportunity to create new or improve existing skills in employees. Through this project, comprehensive commercial and technical verification and validation of research results with commercial potential were undertaken.

The planned duration of the project is 12 months, within which an attempt was made to prove that technological risks associated with the product can or cannot be solved or whether the technological risk is such that the proposed technology can or cannot function in the environment. The project was implemented through 6 key points to try to demonstrate technical feasibility as follows: code development, 3D modeling and testing, interface design, video animation, and optimization and testing of video call module and multi-user interaction functionality. In addition to the technical feasibility demonstration activities, a CBA, an intellectual property protection plan, and a development concept and strategy will be developed.

The total value of the project is HR 556,904.48, of which HRK 389.751,32 is financed from grants and HRK 167.153,16 represents the applicant’s own participation.

After the project ended, Spectre d.o.o. started working with the Institute of Emergency Medicine Osijek – baranja county on developing virtual reality applications for staff training.

Spectre d.o.o. plans to continue the development of the project by applying to the ERDF to fund innovation and R&D projects.

Activities within the `Emergency medical training 3D` project focused on early-stage innovation development to conduct technical and commercial validation of an innovative concept for 3D emergency education training to minimize potential technical and commercial risks. 

SpectreXR and Crunchfish Betting Big on Hand Interactions in AR

Related articles

How to Improve Hand Interactions in Virtual Reality

The Importance of Interactions in Virtual Reality: Enhancing User Experience