Cryptomatte with husk

[cvnc]

Attempting to render out cryptomatte with the husk render command but having no luck. Using the sick render command outputs an exr that has the cryptomatte metadata and the required AOV's. The generated exr via husk has no cryptomatte metadata but does have the cryptomatte AOV's.

Have attached a hip file. Houdini 19.5, Arnold 7.1.4.1, HtoA 6.1.4.1.

[Stephen.Blair · Accepted solution]

set LD_LIBRARY_PATH to point to the dsolib folder of Houdini
so
export LD_LIBRARY_PATH="${HDSO}"
before running husk or houdini

[cvnc]

Thanks Stephen that worked a treat! What's the reason for needing to set it, I wrongly thought those libraries would be loaded already I suppose. To set this up on a farm, can I target a bunch of specific libraries to preload rather than the entire folder?

[cvnc]

And I just answered my own question looking through the help docs searching for `dsolib` 😄 

https://help.autodesk.com/view/ARNOL/ENU/?guid=arnold_for_houdini_ah_htoa_6x_ah_HtoA_6_0_2_0_html

[david.ostler2WSX9]

@Stephen.Blair, It seems like there was an update a while back.  Loading a specific lib instead of HDSO.  I can't seem to find it.  If my memory is correct will you please remind me what lib we point LD_LIBRARY_PATH to?

[nickchamberlain]

I'm having the same issue, I can't seem to get husk to render out cryptomattes correctly but sick currently does. (sick also drastically changes the look of my scene so I can't really viably use it)

[manuel_hm]

I am running with the same issue. Currently using husk because renders do match 1:1 my lookdev scene. I want to have crypto matte in the husk rendered .exr and not different render settings with sick just for crypto. How can I achieve this with husk?

[mehdi-daghfous]

Hi Stephen,

We are trying to make cryptomatte work with husk and I see this has been a known issue for a while. I also know cryptomattes were working fine with husk in older versions.

Currently "arnold" type render products don't seem to work for us, so we need them to remain raster type. We also can't use sick unless we setup deadline libraries for it. 

Is there any version of Arnold that works with H20.0.653 where this bug is fixed? 

[Stephen.Blair]

It's been working for quite awhile. Months, close to a year, if not more. 

But you have to use the Arnold product type. There's no way around that. 

[mehdi-daghfous]

For some reason arnold render type doesn't seem to play well with deadline. 
It used to work fine with raster before. Is there any reason why it's not the case anymore? Will it ever work again with raster?

[mehdi-daghfous]

Actually it seems it's not just deadline as we ran a few more tests. When we use "arnold" render type but set the output path override in husk (as opposed to render product name), we don't have any AOVs even locally. We tried htoa 7.3.1.0 and 7.3.1.1. This is easy to reproduce once we know where to look. 
Otherwise, using output path from the render product seems to work appart from the cryptomattes looking really weird with missing data sometimes. Will have to study that a bit more. 

[Stephen.Blair]

---

@mehdi-daghfous wrote:

Actually it seems it's not just deadline as we ran a few more tests. When we use "arnold" render type but set the output path override in husk (as opposed to render product name), we don't have any AOVs even locally. We tried htoa 7.3.1.0 and 7.3.1.1. This is easy to reproduce once we know where to look. 
Otherwise, using output path from the render product seems to work appart from the cryptomattes looking really weird with missing data sometimes. Will have to study that a bit more. 

---

Yes, the problem with Override Path is a known issue. It didn't sound like you were going to be able to use Arnold product type so I didn't think to mention it.

[mehdi-daghfous]

Thanks, it seems it is currently the reason we can't use arnold type. 

The deadline submitter ROP we have now only works with an override path so we cannot have crypto at all with Arnold. 

[Stephen.Blair]

I would add the studio name to the list of affected customers, if I knew. Can I use the first studio name I find if I google your user name?

[mehdi-daghfous]

Yes and thanks again!

[apps88EMR]

We are running into this issue as well.  Even with the HDSO lib in LD_LIBRARY_PATH, enabling Arnold Render Type fails in Husk with this stack trace. We've tried disabling the dummy raster product and with just HDSO in LD_LIBRARY_PATH as well. I've included the logs, if you have any tips it's greatly appreciated. 

-------------------

2024-06-12 18:39:23: 0: STDOUT: [18:39:23] Adding dummy raster product

2024-06-12 18:39:23: 0: STDOUT: WARNING | signal caught: SIGSEGV -- Invalid memory reference

2024-06-12 18:39:23: 0: STDOUT: 84032: Fatal error: Segmentation fault (sent by pid 84032)

2024-06-12 18:39:23: 0: STDOUT: -- TRACEBACK BEGIN --

2024-06-12 18:39:23: 0: STDOUT: Traceback from karma 20.0.688 (Compiled on linux-x86_64-gcc9.3):

2024-06-12 18:39:23: 0: STDOUT: stackTrace(UTsignalHandlerArg) <libHoudiniUT.so>

2024-06-12 18:39:23: 0: STDOUT: signalCallback(UTsignalHandlerArg) <libHoudiniUT.so>

2024-06-12 18:39:23: 0: STDOUT: UT_Signal::UT_ComboSignalHandler::operator()(int, siginfo_t*, void*) const <libHoudiniUT.so>

2024-06-12 18:39:23: 0: STDOUT: UT_Signal::processSignal(int, siginfo_t*, void*) <libHoudiniUT.so>

2024-06-12 18:39:23: 0: STDOUT: pthread_sigmask <libpthread.so.0>

2024-06-12 18:39:23: 0: STDOUT: pthread_sigmask <libpthread.so.0>

2024-06-12 18:39:23: 0: STDOUT: AiUnknownFunction1 <libai.so>

2024-06-12 18:39:23: 0: STDOUT: AiUnknownFunction1 <libai.so>

2024-06-12 18:39:23: 0: STDOUT: _L_unlock_13 <libpthread.so.0>

2024-06-12 18:39:23: 0: STDOUT: pxrInternal_v0_23__pxrReserved__::XUSD_RenderVar::sourceName() const [clone .cold] <libHoudiniUSD.so>

2024-06-12 18:39:23: 0: STDOUT: pxrInternal_v0_23__pxrReserved__::XUSD_RenderSettings::delegateRenderProducts(int) const <libHoudiniUSD.so>

2024-06-12 18:39:23: 0: STDOUT: pxrInternal_v0_23__pxrReserved__::XUSD_HuskEngine::delegateRenderProducts(pxrInternal_v0_23__pxrReserved__::XUSD_RenderSettings const&, int) <libHoudiniUSD.so>

2024-06-12 18:39:23: 0: STDOUT: HUSD_RenderSettings::updateFrame(HUSD_RenderSettingsContext&, int, int, bool, bool, bool) <libHoudiniUSD.so>

2024-06-12 18:39:23: 0: STDOUT: std::runtime_error::what() const <husk>

2024-06-12 18:39:23: 0: STDOUT: std::runtime_error::what() const <husk>

2024-06-12 18:39:23: 0: STDOUT: std::runtime_error::what() const <husk>

2024-06-12 18:39:23: 0: STDOUT: __libc_start_main <libc.so.6>

2024-06-12 18:39:23: 0: STDOUT: std::runtime_error::what() const <husk>

2024-06-12 18:39:23: 0: STDOUT: -- TRACEBACK END --

-------------------

LD_LIBRARY_PATH

/mnt/Apps/hfs20.0.688/dsolib:/Volumes/dev/external/installed/usr/local/lib:/Volumes/dev/external/installed/usr/lib:/Volumes/dev/external/installed/usr/local/lib64:/Volumes/dev/external/installed/usr/local/lib:/Volumes/dev/external/installed/usr/lib:/Volumes/dev/external/installed/usr/local/lib64:$LD_LIBRARY_PATH

[Stephen.Blair]

Cryptomatte causes a crash? No reports of that. It either works or not, that's the problem users reported.

From that log, it doesn't look like Arnold even finished loading. Or mabye the log verbosity is set really low?

[apps88EMR]

I'll start a new thread as it appears to be a different problem. 

[mikaelCG9GH]

You could add our studio aswell in the list. Lorevfx