Vault license manager chokes, license request are more than there are users?

[gunnar_larsson]

I have an environment with a number of installations (clients), a jobserver, a Vaultserver and a license server.

Recently I notice a lot of "Failure to aquire license" on clients, and what´s worse - the jobprocessor gets a lot of errors with "Login failure".

In all there are 11 Inventor NLM licenses which could simultaneously take a vault license via automatic login..

Including the vault license the jobprocessor takes, that should match the 12 Vault NLM-licenses, right?. 

But I am mystified. While there are still Inventor licenses available, the Vault licenses are all occupied.

Something is wrong. Could anyone advise me here, what to look for to determine what.please?

This is the adlm server status:

-------- Status -------- Flexible License Manager status on Thu 10/18/2012 09:40

[Detecting lmgrd processes...] License server status: 27000@se-got-cad01     License file(s) on se-got-cad01: E:\Network_License\License\MHC.lic:

se-got-cad01: license server UP (MASTER) v11.9

Vendor daemon status (on se-got-cad01):

  adskflex: UP v11.9 Feature usage info:

Users of 85753VLTM_2012_0F:  (Total of 12 licenses issued;  Total of 12 licenses in use)

  "85753VLTM_2012_0F" v1.000, vendor: adskflex   floating license

AutodeskVault se-got-cad01 se-got-cad01 (v1.0) (se-got-cad01/27000 401), start Thu 10/18 9:26    

AutodeskVault se-got-cad01 se-got-cad01 (v1.0) (se-got-cad01/27000 202), start Thu 10/18 9:26    

AutodeskVault se-got-cad01 se-got-cad01 (v1.0) (se-got-cad01/27000 2201), start Thu 10/18 9:28    

AutodeskVault se-got-cad01 se-got-cad01 (v1.0) (se-got-cad01/27000 2501), start Thu 10/18 9:28    

AutodeskVault se-got-cad01 se-got-cad01 (v1.0) (se-got-cad01/27000 2601), start Thu 10/18 9:28    

AutodeskVault se-got-cad01 se-got-cad01 (v1.0) (se-got-cad01/27000 1205), start Thu 10/18 9:28    

AutodeskVault se-got-cad01 se-got-cad01 (v1.0) (se-got-cad01/27000 2701), start Thu 10/18 9:28    

AutodeskVault se-got-cad01 se-got-cad01 (v1.0) (se-got-cad01/27000 2801), start Thu 10/18 9:28    

AutodeskVault se-got-cad01 se-got-cad01 (v1.0) (se-got-cad01/27000 2901), start Thu 10/18 9:29    

AutodeskVault se-got-cad01 se-got-cad01 (v1.0) (se-got-cad01/27000 3001), start Thu 10/18 9:29    

AutodeskVault se-got-cad01 se-got-cad01 (v1.0) (se-got-cad01/27000 3101), start Thu 10/18 9:29    

AutodeskVault se-got-cad01 se-got-cad01 (v1.0) (se-got-cad01/27000 3201), start Thu 10/18 9:29

Users of 85987VLTM_2013_0F:  (Total of 12 licenses issued;  Total of 0 licenses in use)

Users of 85578INVNTOR_F:  (Total of 1 license issued;  Total of 1 license in use)

  "85578INVNTOR_F" v1.000, vendor: adskflex   floating license

    sezeglu HPZ400W-A8679 HPZ400W-A8679 (v1.000) (se-got-cad01/27000 2303), start Thu 10/18 9:28

Users of 85814PDSP_F:  (Total of 8 licenses issued;  Total of 8 licenses in use)

  "85814PDSP_F" v1.000, vendor: adskflex   floating license

ficeeni HPZ400-A8651 HPZ400-A8651 (v1.000) (se-got-cad01/27000 2001), start Thu 10/18 9:27    

secmish HPZ400-A8653 HPZ400-A8653 (v1.000) (se-got-cad01/27000 1801), start Thu 10/18 9:27    

sezchol HPZ400-A8652 HPZ400-A8652 (v1.000) (se-got-cad01/27000 103), start Thu 10/18 9:27    

sezfrsa HPZ400-A8642 HPZ400-A8642 (v1.000) (se-got-cad01/27000 1601), start Thu 10/18 9:27    

sezleni HPZ400W-A10074 HPZ400W-A10074 (v1.000) (se-got-cad01/27000 1001), start Thu 10/18 9:27    

seznigu HPZ400W-A8680 HPZ400W-A8680 (v1.000) (se-got-cad01/27000 701), start Thu 10/18 9:27    

sezpats HPZ400-A8644 HPZ400-A8644 (v1.000) (se-got-cad01/27000 1303), start Thu 10/18 9:27    

sezrosv Z400W-A10073 Z400W-A10073 (v1.000) (se-got-cad01/27000 502), start Thu 10/18 9:27

Users of 85815PDSU_F:  (Total of 2 licenses issued;  Total of 1 license in use)

  "85815PDSU_F" v1.000, vendor: adskflex   floating license

secstjn HP8540W-A8648 HP8540W-A8648 (v1.000) (se-got-cad01/27000 1401), start Thu 10/18 9:27

Users of PLIST:  (Total of 1 license issued;  Total of 0 licenses in use)

Users of 85963PDSU_2013_0F:  (Total of 2 licenses issued;  Total of 0 licenses in use)

Users of 85796PDSU_2012_0F:  (Total of 2 licenses issued;  Total of 1 license in use)

  "85796PDSU_2012_0F" v1.000, vendor: adskflex   floating license

    secstjn HP8540W-A8648 HP8540W-A8648 (v1.0) (se-got-cad01/27000 1501), start Thu 10/18 9:27

Users of 85730ACD_2012_0F:  (Total of 10 licenses issued;  Total of 0 licenses in use)

Users of 85875ACDMAC_2012_0F:  (Total of 10 licenses issued;  Total of 0 licenses in use)

Users of 85678ACAD_E_2012_0F:  (Total of 10 licenses issued;  Total of 0 licenses in use)

Users of 85762INVPRORS_2012_0F:  (Total of 10 licenses issued;  Total of 0 licenses in use)

Users of 85837NAVSIM_2012_0F:  (Total of 10 licenses issued;  Total of 0 licenses in use)

Users of 85677ECSCAD_2012_0F:  (Total of 10 licenses issued;  Total of 0 licenses in use)

Users of 85607SHOWCASE_2011_0F:  (Total of 10 licenses issued;  Total of 0 licenses in use)

Users of 85615ALSK_2011_0F:  (Total of 10 licenses issued;  Total of 0 licenses in use)

Users of 85580MBXPRO_2011_0F:  (Total of 10 licenses issued;  Total of 0 licenses in use)

Users of 85545AMECH_PP_2011_0F:  (Total of 10 licenses issued;  Total of 0 licenses in use)

Users of 85503MAXDES_2011_0F:  (Total of 10 licenses issued;  Total of 0 licenses in use)

Users of 85579INVNTOR_2011_0F:  (Total of 11 licenses issued;  Total of 0 licenses in use)

Users of 85000DESNST_2011_0F:  (Total of 2 licenses issued;  Total of 0 licenses in use)

Users of 85567INVPRO_2011_0F:  (Total of 2 licenses issued;  Total of 0 licenses in use)

Users of 85536ACD_2011_0F:  (Total of 10 licenses issued;  Total of 0 licenses in use)

Users of 85538ACAD_E_2011_0F:  (Total of 10 licenses issued;  Total of 0 licenses in use)

Users of 85569INVPRORS_2011_0F:  (Total of 10 licenses issued;  Total of 0 licenses in use)

Users of 85601NAVSIM_2011_0F:  (Total of 10 licenses issued;  Total of 0 licenses in use)

Users of 85581ECSCAD_2011_0F:  (Total of 10 licenses issued;  Total of 0 licenses in use)

Users of 83900MBXPRO_2010_0F:  (Total of 10 licenses issued;  Total of 0 licenses in use)

Users of 71800AMECH_PP_2010_0F:  (Total of 10 licenses issued;  Total of 0 licenses in use)

Users of 70600INVPRORS_2010_0F:  (Total of 10 licenses issued;  Total of 0 licenses in use)

Users of 70000MAXDES_2010_0F:  (Total of 10 licenses issued;  Total of 0 licenses in use)

Users of 85577INVNTOR_2010_0F:  (Total of 11 licenses issued;  Total of 0 licenses in use)

Users of 70500INVPRO_2010_0F:  (Total of 2 licenses issued;  Total of 0 licenses in use)

Users of 71200ACD_2010_0F:  (Total of 10 licenses issued;  Total of 0 licenses in use)

Users of 71700ACAD_E_2010_0F:  (Total of 10 licenses issued;  Total of 0 licenses in use)

Users of 71500NAVSIM_2010_0F:  (Total of 10 licenses issued;  Total of 0 licenses in use)

Users of 82600ECSCAD_2010_0F:  (Total of 10 licenses issued;  Total of 0 licenses in use)

Users of 85962PDSP_2013_0F:  (Total of 8 licenses issued;  Total of 0 licenses in use)

Users of 85795PDSP_2012_0F:  (Total of 8 licenses issued;  Total of 8 licenses in use)

  "85795PDSP_2012_0F" v1.000, vendor: adskflex   floating license

ficeeni HPZ400-A8651 HPZ400-A8651 (v1.0) (se-got-cad01/27000 2101), start Thu 10/18 9:27    

secmish HPZ400-A8653 HPZ400-A8653 (v1.0) (se-got-cad01/27000 1901), start Thu 10/18 9:27    

sezchol HPZ400-A8652 HPZ400-A8652 (v1.0) (se-got-cad01/27000 302), start Thu 10/18 9:27    

sezfrsa HPZ400-A8642 HPZ400-A8642 (v1.0) (se-got-cad01/27000 1701), start Thu 10/18 9:27    

sezleni HPZ400W-A10074 HPZ400W-A10074 (v1.0) (se-got-cad01/27000 1101), start Thu 10/18 9:27    

seznigu HPZ400W-A8680 HPZ400W-A8680 (v1.0) (se-got-cad01/27000 801), start Thu 10/18 9:27    

sezpats HPZ400-A8644 HPZ400-A8644 (v1.0) (se-got-cad01/27000 904), start Thu 10/18 9:27    

sezrosv Z400W-A10073 Z400W-A10073 (v1.0) (se-got-cad01/27000 602), start Thu 10/18 9:27

Users of 85573INVBUN_2011_0F:  (Total of 8 licenses issued;  Total of 0 licenses in use)

Users of 70400INVBUN_2010_0F:  (Total of 8 licenses issued;  Total of 0 licenses in use)

Users of 85998INVNTOR_2013_0F:  (Total of 1 license issued;  Total of 0 licenses in use)

Users of 85768INVNTOR_2012_0F:  (Total of 1 license issued;  Total of 1 license in use)

  "85768INVNTOR_2012_0F" v1.000, vendor: adskflex   floating license

sezeglu HPZ400W-A8679 HPZ400W-A8679 (v1.0) (se-got-cad01/27000 2403), start Thu 10/18 9:28

 Regards

Gunnar_L

[DarrenP]

it could be that someone logged in under 2 different vault accounts on the same machine

[gunnar_larsson]

Thanks.

That´s what I thought, but it seems it´s not the whole truth. There was a vault session running on the jobserver with another name logged in. This session has now been shut down. The next few days will show if that was the whole problem.

In tests before, we´ve seen 12 occupied Vault licenses (which is the limit), while as few as 8-9 Inventor logged in.

The result of that has been that the jobserver (jobprocessor) did not get a license when trying to do a job, which then fails and has to be resubmitted. Not all users has the rights to do that, or indeed thinks about having to do it it. It will then create a confusion in the handling of things.

We tried turning all instances of Inventor and the jobprocessor (and the vaultsession) off. Still there was 3 vault licenses occupied for about half an hour.

When finally it was cleared, we started the Inventor users on by one an checked the licenses taken. Each one took an Inventor and a vault license, as expected.

Up to 10 Inventor users is all OK, but when a relase process starts, something seem to occupy vault licenses, or they are not released soon enough after the job has finished. It could be that being to close to and occasionally exceeding the limit for available licenses, creates som kind of havoc. 

[minkd]

My understanding of the way the job processor works is:

1) poll the server to see if a job is in queue (no license is required for this).

2) if a job is obtained, login to the vault specified in the job (a vault license is acquired)

3) do whatever processing is required (may acquire a CAD license for the duration of the job if a CAD app is required to do the job)

4) logoff from the vault (the vault license is released)

5) go to step #1.

Based on the symptoms you are seeing, I suspect that some failure is occuring in #3 which might be causing #4 not to happen; but not so fatal an error that it can't continue back at #1.  If that is the case, the license won't be released for 30 -35 minutes.  However, if another job starts processing, it will just re-use the license causing it not to expire.

The net effect of this would be that you would now always have 1 license out to each job processor, even when there are no jobs to process; until the license times out after 30-35 minutes of inactivity.

Of course, this is only a hypothesis ... but if it matches up with what you are seeing, then I recommend opening a support case so it can be investigated and hopefully fixed.

-Dave

[gunnar_larsson]

Thanks Dave.

It seems You are right.

The fault, or part of it, lied in the config on the jobserver and the usage of it. After correcting a few things, the fault has not reoccured.

There were 2 different logins to Vault on the jobserver.

The Jobprocessor was using "Jobuser" as login, while the Vaultconsole used "Administrator".

Inventor was at some point used on the jobserver machine to do some "quick changes" and was then set to use Autologin to Vault at start.

That was later forgotten about and the user for the autologin was also "Administrator", causing Inventor to take an extra license when the jobprocessor sent a job (dwfx create).

So, jobprocessor = 1, Vaultconsole = 1, Inventor that crashed on the job = 1. Sum = 3 occupied licensed ?

Could that be  the case?

(I thought that "Administrator" would share 1 license still while using Inv. + Vconsole, and that the sum would be 2. Still a little mystery.)

//Gunnar L.

[minkd]

A license is needed for each username & client-host.

So if you login as the same user in multiple clients (Vault Explorer, Inventor w/ Vault add-in, AutoCAD w/ Vault add-in, etc), you will only consume 1 license (same user, same client host).

If you login to two different clients on the same machine using different users (Vault Explorer as "Administrator", Inventor w/ Vault Add-in as "gunnar"), you will consume 2 licenses.

If you login to a client (Vault Explorer) as the same user from two different machines, you will consume 2 licenses.

But in any case, when you log out, the license should be released immediately.  In the case where you are logged into multiple clients, you must log out of all of them before it is released.

If the job processor has to be idle for 30-35 minutes before the license is released, then I think there is a problem in the job processor.

-Dave