Community
VRED Forum
Welcome to Autodesk’s VRED Forums. Share your knowledge, ask questions, and explore popular VRED topics.
cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

Grab and move objects with vrhands?

15 REPLIES 15
Reply
Message 1 of 16
patrik7LNB2
956 Views, 15 Replies

Grab and move objects with vrhands?

Researching if it would be possible to in VRED to grab and move (transform) objects with VR hands in a natural way.

I know how to move objects with the laser, but actually grabbing and moving them is so much more intuitive.

Has anyone actually succeeded in doing this in VRED in a good way?

 

I was thinking to maybe set the object to be moved as a child/constrained to the touching VRhand with a sensor-Vset, but is that the best way?

 

Any thoughts? :slightly_smiling_face:

15 REPLIES 15
Message 2 of 16
patrik7LNB2
in reply to: patrik7LNB2

Sorry, double post on the same subject. Mod can remove/hide this one if possible. Sorry again.

Message 3 of 16
vredeye
in reply to: patrik7LNB2

interested in the same topic , where is the double post ? 

Message 4 of 16
vredeye
in reply to: vredeye

i know that we can use controllers to control the functionalities in vred, what are the possibilities to do the same with hand gestures ? is this possible with the vred apis exisitng currently ? 

Message 5 of 16

Hello,

 

Yes, it's possible by utilizing the 'getPinchStrengh' method along with constraints, collisions and timers.

 

See:

https://help.autodesk.com/view/VREDPRODUCTS/2025/ENU/?guid=VRED_Python_Documentation_Python_API_V2_c...

 

 

Message 6 of 16

thanks will check
Message 7 of 16

tried to get this  vrdTrackedHand

getPinchStrength() but get an error that , it requires a parameter but i see in the api documentation , this function just returns a value 

is there any example in the examples , i couldnt find any though 

 

Message 8 of 16

Hi, here is an example.

 

# Check RH pinch strength - while virtual hands are in view of HMD

rh_tracked = vrDeviceService.getRightTrackedHand()
print(rh_tracked.getPinchStrength())
Message 9 of 16

using pico headset with vred , in pico headset there is standard handtracking setting. if we enable it i assume it will work for vred ? or do we need to program the grabbing of objects manually with python ? any tips ?

Message 10 of 16

My example was for the Varjo XR-3 HMD which has integrated hand tracking functionality.
I don't have experience with Pico headsets, but the link below has some tips for Setting up Hand Tracking for Other Devices.

https://help.autodesk.com/view/VREDPRODUCTS/2025/ENU/?guid=VRED_Preferences_ER_Interaction_Preferenc...

Message 11 of 16

I implemented something like this for handtracking and controllers before. I had to struggle with the hierarchy of the nodes. Because when you want to move a wheel and you select it with the laserpointer, you maybe select a screw and then you have to go up the hierarchy until you selected the whole wheel. It was easy to do this with the controllers with the touchpad, but with handtracking you need to control the hierarchy with a extra menu. You can also prepare your scene so that there are no hierarchy problems. I can help you, if you want to implement something like that. 

Message 12 of 16

thanks for that , this doesnt work for pico controllers , i think i need to find out why 

Message 13 of 16

Which Pico device do you have? I'm thinking about implementing custom hand tracking for the Quest 3, maybe the implementation will also work for the Pico glasses.

Message 14 of 16
kpmkhajaC26TK
in reply to: patrik7LNB2

I have PICO 4 Enterprise version

Message 15 of 16

Hi. the gifs you have attached , i am able to do the hand movements separately with pico controller.

but how is it possible to do this with python vred ? i couldnt see any examples in vred examples. ?

do we use external apis like ultraleap ? or opencv ?

I was able to do the handtracking very easily with opencv

 

the sample code i am able to do the control like sectioning with the controllers ( pico controller 4 ) but not able to connect the blue hands ( currently these dont move )  i.e i assume i have to connect the coordinates of the controllers to the left and right hand i assume. , see pic

 

kpmkhaja_0-1727318185022.png

 

Message 16 of 16
vredeye
in reply to: patrik7LNB2

finally looks like getPinchStrength was not working in Pico but did work in Varjo headset , thanks.

any idea if getPinchStrength which returns if the object is grabbed or not , the base vrdTrackedHand , does it return the world coordinates ? like the controller coordiantes from vrOpenVRController.getWorldMatrix ?

Can't find what you're looking for? Ask the community or share your knowledge.

Post to forums  

Autodesk Design & Make Report