Played with the 3 Newton's motion laws in RealityKit. ECS is fun! #spatialcomputing #xr #realitykit #visionos #ecs

Tried 1m^3 voxels. The size is not particularly useful in AR/VR for close-range interactions. It seriously decreases spatial awareness, and it's quite tiring to move around. Mentally, the appropriate size was the one where the offset is reachable in a single step. Which is 0.5m for me.

Tried to use Minecraft-sized voxels in my previous RealityKit experiment. It won’t be practical for indoor use, but I can see some use cases for this size if you're designing in the field. #spatialcomputing #visionos #realitykit #spatialdesign

Tried small voxels. 👍 Felt comfortable, compact. You don't need to move your head too much. 👎 Tap accuracy decreased with the target size, obviously. 🔊 Added a touch sound. Love how audio is spatialized by default in VisionOS, no need for plugins or extra setup.

Prototyped a little VisionOS game based on the previous RealityKit experiment. I plan to juice it (or lose it) and release it on the App Store. Stay tuned! #swiftui #realitykit #visionpro #spatialcomputing

Added an emission shader to my last prototype. Looks nice too. And useful, if you're hacking around late at night! Love how gracefully VisionOS handles body and object occlusion. #spatialcomputing #visionos #swiftui #realitykit #spatialdesign

Made another prototype to explore how you can create a voxel with hand-tracking. When you push the main voxel, it generates “wireframe” voxels along its path. Tools: XCode + RealityKit + SwiftUI Device: Apple Vision Pro #spatialcomputing #visionos #realitykit #swiftui #prototyping

Thought to try the Glass UI in AR/VR. During a quick test, it became obvious that it wouldn't work well. Which is ironic, since it might be seen as something inspired by spatial UI.

Recently, I have been working quite extensively with C++ and Unreal, so I thought it would be a good idea to learn more about the language from its creator. That is, Bjarne Stroustrup! It was a big surprise to discover that C++ has friends. Would never have thought about this! #cpp #programming

A while ago, I made a few prototypes while exploring different navigation patterns with finger-based interactions. Thought some of these ideas would work well as a musical instrument (or as an input system that drives the MIDI communication).

Added APKs of these experiments with spatial hover effects on interactive surfaces to my XR prototypes collection. 🎮 If you have Meta Quest, feel free to try it! ⬇️ GitHub -- github.com/Volorf/xr-pr...

It was a fun year! Happy New Year 🥳

Motion effects exploration for spatial touch interactions using a proximity algorithm. #programming #interactiondesign

BFS + Queue

Switching from JavaScript to C++ is a piece of cake.

Here is another haptic feedback experiment with hand tracking. This time there are more boxes! Or cuboids, for greater scientific rigor. #prototyping #hapticfeedback #xr #spatialcomputing

a bunch of studies for my upcoming haptic in AR experiment

Blocks are one of my favourite musical gears from ROLI. Bought this one many years ago. Still use it. Love its modularity and the idea of enhancing a physical object with digital augmentations. Also, it looks beautiful!

A few people asked about my previous prototype: what would happen if you interacted with many boxes? Prototyped how it might look with different motion patterns.

Made a quick haptic feedback prototype for hand-tracking interactions with a voxel. Felt fun and engaging. It's another level of immersiveness (unfortunately, the video is not able to convey this). #prototyping #xr #spatialcomputing #hapticdesign #spatialux

One of the most requested features for BoxelXR was the ability to create volumes. Just finished the algorithmic part of the interaction. Will see soon how it works with the hands! #spatialcomputing #xrdevelopment

Love KodeLife. It's great for quick prototyping.

Here are my debugging scripts that I use for my previous demo. They are very useful. It not only helps test math and the correctness of algorithms quickly, but also forces you to decouple key systems of your app from each other to make it work. #spatialcomputing #xrdevelopment #xrdesign

saw nice trees in key gardens

Added an APK of the prototype to my XR collection. Feel free to try it! github.com/Volorf/xr-pr...

Started experimenting with hand-tracking-based interactions for my little voxel editor – BoxelXR. There are many things to tune, but overall it feels good. Though it would require some decent work in sound design to compensate for the lack of haptic feedback. #spatialcomputing #xr #mixedreality

Wrote an article about math I use to design and develop interactive experiences for AR/VR. I tried to focus on the practical aspects of it and keep it as simple as possible. Hope you will find it helpful! medium.com/@olegfrolov/... #uiprogramming #3dmath #spatialdesign #xr #interactiondesign

Balanced Stepper III Another interaction experiment with a stepper. The main idea behind this piece of UI is that the interaction mechanics favor restoring the balanced default value (zero in this example). #swiftui #interactiondesign #uidesign #uxdesign #prototyping

Balanced Stepper II

Made a Balanced Stepper. I was exploring a fusion between a slider and a stepper. Came up with an interesting interaction pattern. #swiftui #interactiondesign #uidesign #uxdesign #prototyping

Cross Product visualisation for Essential Math for Spatial Computing. I use it this operation a lot when I need to reconstruct some local 3D space base only two available directions.

VolumeUI demo + sounds. The APK is available on GitHub. #volumeui #interactiondesign #spatialcomputing

scalar multiplication of vectors demo

vector subtraction demo

The dot product has many powerful properties. My favourite one is this: when you multiply a normalised target vector by an arbitrary vector, you get a number, which you can use to scale the target vector and get a projection vector of the arbitrary vector onto the target one! #spatialmath #3dmath

A vector addition demo as a part of my upcoming talk about Essential Math for Spatial Computing at Design Engineering Meetup.

Tested some of the components of my VolumeUI library in VR. Thought it would be nice to add RGB corners to the backplate as well. So, did it. All components will support some types of RGB animations. #spatialcomputing #xrdesign #volumeui #virtualreality #unity3d #uidesign #uilibrary #3dmath

Added RGB border to the backplate too!

Made a modal panel demo with UI elements from my VolumeUI library. The coolest part of the lib is that you can bind all interactables to anything with the "pressing" factor, which is a normalized value (0.0-1.0) that tells how much the user pressed the button.

Added a backplate to my Volumetric UI framework. Like other UI elements, it's also parametric, meaning you can change its size without worrying that it will be unpleasantly distorted (a common mistake in XR).

Timing and easings are great tools to enhance #ui experience, but sometimes it's better not to have them at all. If your users use something quite often, do not make them wait for your animations to finish. Used this principle to design the Camera Experience for @gorillatag.bsky.social

Now you can attach some visuals to the button. It could be anything that has Transform (text, sprites, meshes etc.)

some shader-based mesh transformations for a UI plate.

This is how I used vertex color to map vertices for spatial transformations in the vertex shader. Of course, there was a way to leverage just one channel to get all these semantic markings, but it would make visual debugging much harder for the human eye.

Added button interaction to my 3D UI library. A few UI elements left before I release it 😊

Such a pity that UE doesn’t support import

parametric 3D button.

When building an AR/VR experience, you need to test it frequently on the device. But once the experience is validated and you start working on implementation details, doing that might feel quite tedious. That said, I made a Direct Touch Debugger to simplify this process 🙌

The pressing animation is also processed in the shader.

Added pressing states, toggle group processing, sounds, and pointer/direct touch support to my VolumeUI library (will release once it's finished). #unity3d #uilibrary #3dmath #shader #xr #vr