topic Re: How do I integrate a camera with a vive tracker? in VRED Forum

How do I integrate a camera with a vive tracker?

Anonymous — Sun, 01 Sep 2019 14:51:37 GMT

I'm trying to create a mixed reality so that a 3d model exists on a real screen by attaching a vive tracker to a real camera.

For example, you might want to create a screen that overlaps a 3d car on a real car. The background is chroma keyed so that it receives the actual camera screen.

In order to work with the actual "GoPro" camera screen, I'm going to create a virtual camera in vred to work with the tracker.

// Development environment
: VRED 2020.1
: HTC Vive biz edition
: vive tracker
: gopro (real camera)
: DISPLAY -> OPENVR HMD

//Questions
In the OpenVRTracker.vpb code, I replaced findnode with the camera I created.
Change the tracker visible to True and not touch anything else.

In the attached image, you can see the tracker attached toward the front of the camera. The tracker is attached to the top of the actual camera, so I want to turn the tracker's three legs to the top, not the front.

I would be grateful if you could tell me python code or api function.

AND I would like to know if there is a better way to link the camera and tracker.
If you have a good example to reference, I'd like to know the example name.

vr/attachToTracker.py
camera-fixed-object.py

I also referenced the example above, but attaching a camera node behaved strangely.
As in the example, a box or a normal object works well, but it works strangely with only a camera attached.
In the code, I changed the objects (box, teddy, and so on) to camera nodes.

Thanks.

Re: How do I integrate a camera with a vive tracker?

Christian_Garimberti — Mon, 02 Sep 2019 15:37:42 GMT

Hi,

try to put the camera inside the MatrixTracker0 node, not outside.

and in the script leave the findNode with the "MatrixTracker0" node.

Maybe this solve the alignment problem.

Best

Chris

Re: How do I integrate a camera with a vive tracker?

Anonymous — Tue, 03 Sep 2019 15:33:15 GMT

Hi, Chris.

Thanks for the answer.

//perspective cam = cam A

//created cam = cam B

I put the cam B under matrixtracker0(see attached), adjusted the position to 0,0,0, and matched the axis by adjusting the rotation. I adjusted it by looking at the cam B, x, y, and z axes with the cam A.

After the adjustment, I switch to the camera('camt', I made) and the screen moves around quickly and moves away. I think it is influenced by the 'moved' function, but I don't know how to modify the code.

Thanks

Re: How do I integrate a camera with a vive tracker?

Christian_Garimberti — Wed, 04 Sep 2019 11:33:13 GMT

Maybe is not your camera the problem....

Have you checked what is explained here? https://forums.autodesk.com/t5/vred-forum/vive-tracker-orientation-issue-vred-2019/m-p/8766581

Best

Chris

Re: How do I integrate a camera with a vive tracker?

Anonymous — Tue, 10 Sep 2019 03:05:48 GMT

Unfortunately, the same problem occurs despite changing the settings.

I think it is because this code is deprecated.

The 'vrOpenVrController' module has been deprecated. (see attachments)

(This means 'openvrTracker' example is also deprecated.)

The documentation says to use 'vrDevice' instead. (VRED 2020.1)

By the way, using 'vrDevice' I can't use the code right now. There are many missing or changed methods.

So I tried the 'attachtotracker' example code, not the 'openvrtracker' example, but it's not working as I wanted.

Attaching an object to the tracker works, but attaching the camera does not work properly.

I'm thinking about the idea of which combination to apply.

Please let me know if you have the same concerns or you already know.

Best

Aiden