topic Re: InvMark by TFI & Cadac, Inventor Performance Hardware Benchmark Tool with Leaderboard in Inventor Forum

InvMark by TFI & Cadac, Inventor Performance Hardware Benchmark Tool with Leaderboard

Neil_Cross — Fri, 16 Apr 2021 14:35:59 GMT

Dear all - it's a pleasure to hand over to you, InvMark for Autodesk Inventor, a comprehensive hardware benchmarking solution designed entirely by myself, developed & hosted by Cadac Group, offered to the Autodesk community completely free of charge.

You can download InvMark for free from here

InvMark has been under intense continuous development for over 14 months, ensuring we release a fully featured and stable solution representative of the experience and knowledge behind it. It runs as an addin within Autodesk Inventor, and is currently supported on Inventor 2021 and 2022.

InvMark has over a dozen test scenarios, including large 1000 part assembly pattern and constraint tests, large assembly drawing computation, FEA, Dynamic Simulation, multi style and context sensitive graphics tests, ray tracing and much much more.

InvMark grades your workstation/laptop and generates an InvMark score, along with a single-core and multi-core score based on how it performed on feature sets that leverage the CPU in different ways. Each individual test is also graded separately allowing for finite comparisons between tests and hardware on a test by test basis.

InvMark has a public leaderboard where you can upload your score and compete against others in the Autodesk community, or visually compare your workstation to see how its performance sits against todays modern hardware.

The leaderboard is feature rich with a full score report card available for each test, along with full system specs and reference data. Once logged in, you can see your historical uploads as only your highest score makes it to the leaderboard.

My introductory video announcing the release is here:

We have also integrated a unique feature which enthusiasts may find especially fascinating, our hardware sensor logging. Every InvMark test (unless disabled) will log all available hardware sensors, every second, to a local CSV file. This file contains CPU clock frequencies per core, temperature, RAM usage, GPU load, VRAM load, fan speeds if available, if your system has a sensor we log the data for you to convert to a graph for evaluation.

I have created an extensive InvMark tutorial here which includes an overview of all tests, an explanation of all features along with a guide for how to use the hardware logging graph.

Thanks for your interest if you intend on trying out InvMark, we'll see you on the leaderboard 😉

InvMark by TFI & Cadac, Inventor Performance Hardware Benchmark Tool with Leaderboard

Neil_Cross — Fri, 16 Apr 2021 14:42:07 GMT

FYI if you experience installer issues, see this first and verify you've checked this before contacting us https://youtu.be/ilAC-JSRoy4?t=303

Re: InvMark by TFI & Cadac, Inventor Performance Hardware Benchmark Tool with Leaderboard

Neil_Cross — Fri, 16 Apr 2021 15:28:11 GMT

If anyone has an off-the-shelf desktop PC which is branded, it will currently show as a 'custom desktop PC' on the leaderboard as I need to add the brand name as a recognised trigger. Please let me know if you have such a desktop as I'll need to add that in i.e. Corsair desktops, Origin PC, Maingear etc.

Re: InvMark by TFI & Cadac, Inventor Performance Hardware Benchmark Tool with Leaderboard

tgregory3G7FA — Fri, 16 Apr 2021 15:31:02 GMT

After I run the test I don't have an "Upload Score" option

If I click on Leaderboard it says No Benchmarks yet. And to download the tool. But I already have it installed.

Re: InvMark by TFI & Cadac, Inventor Performance Hardware Benchmark Tool with Leaderboard

Neil_Cross — Fri, 16 Apr 2021 15:37:29 GMT

can you go into c:\temp\logs and email me the benchmark.log to tfi@tficad.tips

Re: InvMark by TFI & Cadac, Inventor Performance Hardware Benchmark Tool with Leaderboard

Raider_71 — Fri, 16 Apr 2021 15:50:12 GMT

I get a "Files are modified. Test will not run" error

Re: InvMark by TFI & Cadac, Inventor Performance Hardware Benchmark Tool with Leaderboard

Neil_Cross — Fri, 16 Apr 2021 15:59:56 GMT

If you get to the end of the test and the upload button isn't there, it means one or more of the tests failed to run correctly on your system.

We know of one issue but we cannot reproduce it, the issue is after you see the graphics card assembly appear, we save that to C:\Temp\Import, some people are reporting that this save is failing. If you check your log file at C:\Temp\Logs and look down until you see an exception, if the exception appears under the STP file import then you have that issue. I'm trying to work on it but currently I cannot reproduce it

Re: InvMark by TFI & Cadac, Inventor Performance Hardware Benchmark Tool with Leaderboard

Neil_Cross — Fri, 16 Apr 2021 16:06:25 GMT

re-install

We cache the dataset at the time its compiled, if any of the files are modified in any way even a metadata change, I call stop on the test. It's the anti-cheat mechanism. If any files are edited, moved, deleted, saved even if nothing has changed, it kicks in.

Re: InvMark by TFI & Cadac, Inventor Performance Hardware Benchmark Tool with Leaderboard

Neil_Cross — Fri, 16 Apr 2021 17:45:37 GMT

Holy mother of god I did not see this coming. That just kicked everything down a peg!!!

Re: InvMark by TFI & Cadac, Inventor Performance Hardware Benchmark Tool with Leaderboard

ysald.zuidema — Fri, 16 Apr 2021 17:48:52 GMT

I have this error in the log file:

2021-04-16 19:36:47.9972 [INFO]Exception thrown with message: System.Runtime.InteropServices.COMException (0x80004005): Unspecified error (Exception from HRESULT: 0x80004005 (E_FAIL))
at PerformanceAddin.InvMarkCtrl._1TDqsydBBaSPfDMo3YzmBPDCumy(Int64& timeCreateModel, Int64& timeRunLargeAssemblyOccurrences, Int64& timeMakeDrawing, Int64& timeRunPattern, Int64& timeRunFEA, Int64& timeRunDynamicSim, Tuple`2& timeRunOrbitTest, Int64& timeRunImport, Int32 runs)
at PerformanceAddin.InvMarkCtrl._e0oYCscof9HbdCziReZU9z9Hci1()

Re: InvMark by TFI & Cadac, Inventor Performance Hardware Benchmark Tool with Leaderboard

Neil_Cross — Fri, 16 Apr 2021 18:04:32 GMT

Can you try just running the data translation test on its own and let me know if you get a Save As dialog box appear when the graphics card shows on screen?

This is happening on a very small percentage of computers and I can't reproduce it at the moment, but when it happens it stops the save test from occuring which means you cant upload as the test didnt complete. I working to try and understand what the commonality is between all the systems that are doing this, I think its something in Windows but as I cant reproduce it on any of the dozen PCs Ive got here it's not the easiest one. But let me know if your data translation test fails on its own?

Re: InvMark by TFI & Cadac, Inventor Performance Hardware Benchmark Tool with Leaderboard

ysald.zuidema — Fri, 16 Apr 2021 18:14:18 GMT

Just tested it.

It tooks around 30 seconds when the save as dialog appears.

Re: InvMark by TFI & Cadac, Inventor Performance Hardware Benchmark Tool with Leaderboard

Neil_Cross — Fri, 16 Apr 2021 18:18:55 GMT

Yea I've obviously ran this on dozens of different computers, never saw that problem but now a couple of people are reporting this one thing happening. I've no idea what it is at the moment, it isn't permissions to the folder, it isnt application options, and as I cant reproduce it I cant begin to fix it yet. I need to make that happen here before I can begin to do that. Working on it.

Re: InvMark by TFI & Cadac, Inventor Performance Hardware Benchmark Tool with Leaderboard

mcgyvr — Fri, 16 Apr 2021 18:34:42 GMT

@Neil_Cross wrote:

Holy mother of god I did not see this coming. That just kicked everything down a peg!!!

Yep... @Neil_Cross Gonna need to more room on the scale.. Legrand just about pegged them all to the max with that on what day 1... "You're gonna need a bigger boat" 😂

Re: InvMark by TFI & Cadac, Inventor Performance Hardware Benchmark Tool with Leaderboard

ysald.zuidema — Fri, 16 Apr 2021 18:43:01 GMT

Just give it another run, but then i dont get the save as folder.

Is there something we can share to beating the error?

I am working on inventor 2021.3

2021-04-16 20:35:25.9623 [INFO]===================================================
2021-04-16 20:35:25.9623 [INFO]==== PERFORMANCEaddin started ====
2021-04-16 20:35:25.9623 [INFO]===================================================
2021-04-16 20:35:26.9079 [INFO]==== ALL addins (75) deactivated ====
2021-04-16 20:35:28.1794 [INFO]Addin Translator: STEP has status ACTIVE
2021-04-16 20:35:28.4986 [INFO]==== STARTED IMPORT FOREIGN MODEL for run 2 ====
2021-04-16 20:35:28.5355 [INFO]==== Active folder c:\temp\import ====
2021-04-16 20:35:28.5355 [INFO]Old benchmark files deleted
2021-04-16 20:35:29.3683 [INFO]Creating empty assembly took : 0.832 s
2021-04-16 20:36:04.1443 [INFO]Import STEP took : 34.776 s
2021-04-16 20:36:04.3288 [INFO]Exception thrown with message: System.Runtime.InteropServices.COMException (0x80004005): Unspecified error (Exception from HRESULT: 0x80004005 (E_FAIL))
at PerformanceAddin.InvMarkCtrl._1TDqsydBBaSPfDMo3YzmBPDCumy(Int64& timeCreateModel, Int64& timeRunLargeAssemblyOccurrences, Int64& timeMakeDrawing, Int64& timeRunPattern, Int64& timeRunFEA, Int64& timeRunDynamicSim, Tuple`2& timeRunOrbitTest, Int64& timeRunImport, Int32 runs)
at PerformanceAddin.InvMarkCtrl._e0oYCscof9HbdCziReZU9z9Hci1()

Re: InvMark by TFI & Cadac, Inventor Performance Hardware Benchmark Tool with Leaderboard

Neil_Cross — Fri, 16 Apr 2021 18:45:49 GMT

@mcgyvr wrote:

Yep... @Neil_Cross Gonna need to more room on the scale.. Legrand just about pegged them all to the max with that on what day 1... "You're gonna need a bigger boat" 😂

Haha yea it's all fair game though, if that's the new performance ceiling and that's the new bar to measure against, then that's what everything else is measured against pure and simple! If a workstation is capable of that kind of performance now then everything else is graded accordingly and in perspective/context to that new bar.

Re: InvMark by TFI & Cadac, Inventor Performance Hardware Benchmark Tool with Leaderboard

Neil_Cross — Fri, 16 Apr 2021 18:47:26 GMT

@ysald.zuidema wrote:

Just give it another run, but then i dont get the save as folder.

Is there something we can share to beating the error?

Honestly at this point I don't even know where to begin with it, something is interjecting with the save of the new assembly on a small number of PCs. My suspicion is that its something to do with the third party translation document that accompanies the STP file import, its a HTM file, but I cant reproduce. I'm trying but I don't know what to ask you to try at this point!

Re: InvMark by TFI & Cadac, Inventor Performance Hardware Benchmark Tool with Leaderboard

ysald.zuidema — Fri, 16 Apr 2021 18:56:37 GMT

i had Aldi manualy imported the step file, and than i dont have any issue.

With the program i see that the pc is running to import the step file, but it is not vissible on the screen

Re: InvMark by TFI & Cadac, Inventor Performance Hardware Benchmark Tool with Leaderboard

ysald.zuidema — Fri, 16 Apr 2021 18:57:36 GMT

i had manualy imported the step file, and than i dont have any issue.

With the program i see that the pc is running to import the step file, but it is not vissible on the screen

Re: InvMark by TFI & Cadac, Inventor Performance Hardware Benchmark Tool with Leaderboard

Neil_Cross — Fri, 16 Apr 2021 19:03:19 GMT

its not the import of the STP which is the issue, its when it saves it, I can see in the log that the STP file did actually import... if it doesnt appear on screen i dunno what that is either... but if the log states import then a time then it happened. I'm messing with my PC settings to try and make this happen but I'm pishing into the wind a bit