Using Rokoko Dual mocap cam / Import animation with HumanIK

[moiamy]

Hello

Currently testing the rokoko dual cam motion capture.

Import of the FBX files ok (Mixamo anim is the sitting position)

I would like to apply the movement to my character while using this retargeting workflow 

the process is :

1. Use namespace to add prefix for the rokoko joints hierarchy 
2. Create a new character in HumanIK
3. Use the load skeleton definition with HIK template

Then I got this validation error (like Human IK expect a T pose)

Is there a workaround for that ? Do I need absolutely a tpose ? 

Thanks for your help

[moiamy]

Here is my template.xml export 

<config_root>
    <match_list>
        <item key="Reference" value=""/>
        <item key="Hips" value="Hips"/>
        <item key="LeftUpLeg" value=""/>
        <item key="LeftLeg" value=""/>
        <item key="LeftFoot" value="LeftFoot"/>
        <item key="RightUpLeg" value=""/>
        <item key="RightLeg" value=""/>
        <item key="RightFoot" value="RightFoot"/>
        <item key="Spine" value=""/>
        <item key="LeftArm" value="LeftArm"/>
        <item key="LeftForeArm" value="LeftForeArm"/>
        <item key="LeftHand" value="LeftHand"/>
        <item key="RightArm" value="RightArm"/>
        <item key="RightForeArm" value="RightForeArm"/>
        <item key="RightHand" value="RightHand"/>
        <item key="Head" value="Head"/>
        <item key="LeftToeBase" value=""/>
        <item key="RightToeBase" value=""/>
        <item key="LeftShoulder" value="LeftShoulder"/>
        <item key="RightShoulder" value="RightShoulder"/>
        <item key="Neck" value="Neck"/>
        <item key="LeftFingerBase" value=""/>
        <item key="RightFingerBase" value=""/>
        <item key="Spine1" value="Spine1"/>
        <item key="Spine2" value="Spine2"/>
        <item key="Spine3" value="Spine3"/>
        <item key="Spine4" value="Spine4"/>
        <item key="Spine5" value=""/>
        <item key="Spine6" value=""/>
        <item key="Spine7" value=""/>
        <item key="Spine8" value=""/>
        <item key="Spine9" value=""/>
        <item key="Neck1" value=""/>
        <item key="Neck2" value=""/>
        <item key="Neck3" value=""/>
        <item key="Neck4" value=""/>
        <item key="Neck5" value=""/>
        <item key="Neck6" value=""/>
        <item key="Neck7" value=""/>
        <item key="Neck8" value=""/>
        <item key="Neck9" value=""/>
        <item key="LeftUpLegRoll" value=""/>
        <item key="LeftLegRoll" value=""/>
        <item key="RightUpLegRoll" value=""/>
        <item key="RightLegRoll" value=""/>
        <item key="LeftArmRoll" value=""/>
        <item key="LeftForeArmRoll" value=""/>
        <item key="RightArmRoll" value=""/>
        <item key="RightForeArmRoll" value=""/>
        <item key="HipsTranslation" value=""/>
        <item key="LeftHandThumb1" value=""/>
        <item key="LeftHandThumb2" value=""/>
        <item key="LeftHandThumb3" value=""/>
        <item key="LeftHandThumb4" value=""/>
        <item key="LeftHandIndex1" value=""/>
        <item key="LeftHandIndex2" value=""/>
        <item key="LeftHandIndex3" value=""/>
        <item key="LeftHandIndex4" value=""/>
        <item key="LeftHandMiddle1" value=""/>
        <item key="LeftHandMiddle2" value=""/>
        <item key="LeftHandMiddle3" value=""/>
        <item key="LeftHandMiddle4" value=""/>
        <item key="LeftHandRing1" value=""/>
        <item key="LeftHandRing2" value=""/>
        <item key="LeftHandRing3" value=""/>
        <item key="LeftHandRing4" value=""/>
        <item key="LeftHandPinky1" value=""/>
        <item key="LeftHandPinky2" value=""/>
        <item key="LeftHandPinky3" value=""/>
        <item key="LeftHandPinky4" value=""/>
        <item key="LeftHandExtraFinger1" value=""/>
        <item key="LeftHandExtraFinger2" value=""/>
        <item key="LeftHandExtraFinger3" value=""/>
        <item key="LeftHandExtraFinger4" value=""/>
        <item key="RightHandThumb1" value=""/>
        <item key="RightHandThumb2" value=""/>
        <item key="RightHandThumb3" value=""/>
        <item key="RightHandThumb4" value=""/>
        <item key="RightHandIndex1" value=""/>
        <item key="RightHandIndex2" value=""/>
        <item key="RightHandIndex3" value=""/>
        <item key="RightHandIndex4" value=""/>
        <item key="RightHandMiddle1" value=""/>
        <item key="RightHandMiddle2" value=""/>
        <item key="RightHandMiddle3" value=""/>
        <item key="RightHandMiddle4" value=""/>
        <item key="RightHandRing1" value=""/>
        <item key="RightHandRing2" value=""/>
        <item key="RightHandRing3" value=""/>
        <item key="RightHandRing4" value=""/>
        <item key="RightHandPinky1" value=""/>
        <item key="RightHandPinky2" value=""/>
        <item key="RightHandPinky3" value=""/>
        <item key="RightHandPinky4" value=""/>
        <item key="RightHandExtraFinger1" value=""/>
        <item key="RightHandExtraFinger2" value=""/>
        <item key="RightHandExtraFinger3" value=""/>
        <item key="RightHandExtraFinger4" value=""/>
        <item key="LeftFootThumb1" value=""/>
        <item key="LeftFootThumb2" value=""/>
        <item key="LeftFootThumb3" value=""/>
        <item key="LeftFootThumb4" value=""/>
        <item key="LeftFootIndex1" value=""/>
        <item key="LeftFootIndex2" value=""/>
        <item key="LeftFootIndex3" value=""/>
        <item key="LeftFootIndex4" value=""/>
        <item key="LeftFootMiddle1" value=""/>
        <item key="LeftFootMiddle2" value=""/>
        <item key="LeftFootMiddle3" value=""/>
        <item key="LeftFootMiddle4" value=""/>
        <item key="LeftFootRing1" value=""/>
        <item key="LeftFootRing2" value=""/>
        <item key="LeftFootRing3" value=""/>
        <item key="LeftFootRing4" value=""/>
        <item key="LeftFootPinky1" value=""/>
        <item key="LeftFootPinky2" value=""/>
        <item key="LeftFootPinky3" value=""/>
        <item key="LeftFootPinky4" value=""/>
        <item key="LeftFootExtraFinger1" value=""/>
        <item key="LeftFootExtraFinger2" value=""/>
        <item key="LeftFootExtraFinger3" value=""/>
        <item key="LeftFootExtraFinger4" value=""/>
        <item key="RightFootThumb1" value=""/>
        <item key="RightFootThumb2" value=""/>
        <item key="RightFootThumb3" value=""/>
        <item key="RightFootThumb4" value=""/>
        <item key="RightFootIndex1" value=""/>
        <item key="RightFootIndex2" value=""/>
        <item key="RightFootIndex3" value=""/>
        <item key="RightFootIndex4" value=""/>
        <item key="RightFootMiddle1" value=""/>
        <item key="RightFootMiddle2" value=""/>
        <item key="RightFootMiddle3" value=""/>
        <item key="RightFootMiddle4" value=""/>
        <item key="RightFootRing1" value=""/>
        <item key="RightFootRing2" value=""/>
        <item key="RightFootRing3" value=""/>
        <item key="RightFootRing4" value=""/>
        <item key="RightFootPinky1" value=""/>
        <item key="RightFootPinky2" value=""/>
        <item key="RightFootPinky3" value=""/>
        <item key="RightFootPinky4" value=""/>
        <item key="RightFootExtraFinger1" value=""/>
        <item key="RightFootExtraFinger2" value=""/>
        <item key="RightFootExtraFinger3" value=""/>
        <item key="RightFootExtraFinger4" value=""/>
        <item key="LeftInHandThumb" value=""/>
        <item key="LeftInHandIndex" value=""/>
        <item key="LeftInHandMiddle" value=""/>
        <item key="LeftInHandRing" value=""/>
        <item key="LeftInHandPinky" value=""/>
        <item key="LeftInHandExtraFinger" value=""/>
        <item key="RightInHandThumb" value=""/>
        <item key="RightInHandIndex" value=""/>
        <item key="RightInHandMiddle" value=""/>
        <item key="RightInHandRing" value=""/>
        <item key="RightInHandPinky" value=""/>
        <item key="RightInHandExtraFinger" value=""/>
        <item key="LeftInFootThumb" value=""/>
        <item key="LeftInFootIndex" value=""/>
        <item key="LeftInFootMiddle" value=""/>
        <item key="LeftInFootRing" value=""/>
        <item key="LeftInFootPinky" value=""/>
        <item key="LeftInFootExtraFinger" value=""/>
        <item key="RightInFootThumb" value=""/>
        <item key="RightInFootIndex" value=""/>
        <item key="RightInFootMiddle" value=""/>
        <item key="RightInFootRing" value=""/>
        <item key="RightInFootPinky" value=""/>
        <item key="RightInFootExtraFinger" value=""/>
        <item key="LeftShoulderExtra" value=""/>
        <item key="RightShoulderExtra" value=""/>
        <item key="LeafLeftUpLegRoll1" value=""/>
        <item key="LeafLeftLegRoll1" value=""/>
        <item key="LeafRightUpLegRoll1" value=""/>
        <item key="LeafRightLegRoll1" value=""/>
        <item key="LeafLeftArmRoll1" value=""/>
        <item key="LeafLeftForeArmRoll1" value=""/>
        <item key="LeafRightArmRoll1" value=""/>
        <item key="LeafRightForeArmRoll1" value=""/>
        <item key="LeafLeftUpLegRoll2" value=""/>
        <item key="LeafLeftLegRoll2" value=""/>
        <item key="LeafRightUpLegRoll2" value=""/>
        <item key="LeafRightLegRoll2" value=""/>
        <item key="LeafLeftArmRoll2" value=""/>
        <item key="LeafLeftForeArmRoll2" value=""/>
        <item key="LeafRightArmRoll2" value=""/>
        <item key="LeafRightForeArmRoll2" value=""/>
        <item key="LeafLeftUpLegRoll3" value=""/>
        <item key="LeafLeftLegRoll3" value=""/>
        <item key="LeafRightUpLegRoll3" value=""/>
        <item key="LeafRightLegRoll3" value=""/>
        <item key="LeafLeftArmRoll3" value=""/>
        <item key="LeafLeftForeArmRoll3" value=""/>
        <item key="LeafRightArmRoll3" value=""/>
        <item key="LeafRightForeArmRoll3" value=""/>
        <item key="LeafLeftUpLegRoll4" value=""/>
        <item key="LeafLeftLegRoll4" value=""/>
        <item key="LeafRightUpLegRoll4" value=""/>
        <item key="LeafRightLegRoll4" value=""/>
        <item key="LeafLeftArmRoll4" value=""/>
        <item key="LeafLeftForeArmRoll4" value=""/>
        <item key="LeafRightArmRoll4" value=""/>
        <item key="LeafRightForeArmRoll4" value=""/>
        <item key="LeafLeftUpLegRoll5" value=""/>
        <item key="LeafLeftLegRoll5" value=""/>
        <item key="LeafRightUpLegRoll5" value=""/>
        <item key="LeafRightLegRoll5" value=""/>
        <item key="LeafLeftArmRoll5" value=""/>
        <item key="LeafLeftForeArmRoll5" value=""/>
        <item key="LeafRightArmRoll5" value=""/>
        <item key="LeafRightForeArmRoll5" value=""/>
    </match_list>
</config_root>

[moiamy]

Update : I have managed to get a T-Pose by getting data from Rokoko-vision to Rokoko-studio, export FBX from there and import in Maya with process described earlier.

So now there less issues.

Just "missing required bones"

Has someone experienced that before ?

 <item key="Reference" value=""/>
        <item key="Hips" value="Hips"/>
        <item key="LeftUpLeg" value=""/>
        <item key="LeftLeg" value=""/>
        <item key="LeftFoot" value="LeftFoot"/>
        <item key="RightUpLeg" value=""/>
        <item key="RightLeg" value=""/>
        <item key="RightFoot" value="RightFoot"/>
        <item key="Spine" value=""/>
        <item key="LeftArm" value="LeftArm"/>
        <item key="LeftForeArm" value="LeftForeArm"/>
        <item key="LeftHand" value="LeftHand"/>
        <item key="RightArm" value="RightArm"/>
        <item key="RightForeArm" value="RightForeArm"/>
        <item key="RightHand" value="RightHand"/>
        <item key="Head" value="Head"/>
        <item key="LeftToeBase" value=""/>
        <item key="RightToeBase" value=""/>

[moiamy · Accepted solution]

I have found a workaroud :replace the joints names according to this list (left coming from Rokoko, and right what maya expect)

rokoko:RightThig	rokoko:RightUpLeg
rokoko:RightShin	rokoko:RightLeg
rokoko:LeftThig	rokoko:LeftUpLeg
rokoko:LeftShin	rokoko:LeftLeg
rokoko:Root	rokoko:Reference
rokoko:Spine1	rokoko:Spine
rokoko:Spine2	rokoko:Spine1
rokoko:Spine3	rokoko:Spine2
rokoko:Spine4	rokoko:Spine3