Collecting Performance Data

ronald_huveneers

I'm starting to collect a more detailed performance information from the onshape check. I have seen the topic where there are screenshots posted, but there is more information in the background that can't easily be captured, and isn't easily modified / charted.

How you can help (Instructions for Chrome):

1. Close as many windows as possible for best performance.
   
2. Go to https://cad.onshape.com/check
3. Wait for the check to fully complete
4. Right click on the page, and click Inspect
5. Make sure you are in the Console
6. Paste this and press enter:
   A = angular.element(document.getElementsByClassName('os-compatibility-section')).controller().$scope.ctrl; B = JSON.stringify({ "allChecksPassed": A.allChecksPassed(), "isSupportedDesktopBrowser": A.isSupportedDesktopBrowser(), "userAgent": A.browserSupportInfo.userAgent, "platform": A.browserSupportInfo.platform, "isMobilePlatform": A.isMobilePlatform(), "isCoreWebGLSupported": A.isCoreWebGLSupported(), "areExtensionsMissing": A.areExtensionsMissing(), "floatTextureSupported": A.floatTextureSupported, "anistropicSupported": A.anistropicSupported, "are32BitIndicesSupported": A.are32BitIndicesSupported, "coreWebGLSupportMissingOrIncomplete": A.coreWebGLSupportMissingOrIncomplete(), "coreWebGLSupportHasOtherProblem": A.coreWebGLSupportHasOtherProblem(), "glVendor": A.getRenderInfoString(A.rendererInfo.glVendor), "glRenderer": A.getRenderInfoString(A.rendererInfo.glRenderer), "performanceError": A.performanceError, "performanceResult": A.performanceResult, "isDebugCapabilityEnabled": A.isDebugCapabilityEnabled, "oAllWebSocketChecksPass": A.doAllWebSocketChecksPass() }); copy(B);
   
7. This will automatically copy the performance results to your clipboard.
8. Go to this google sheet and paste in the result.
9. Click submit
10. Nothing more

No personal data is captured, the results will get parsed and results will be posted later

john_rousseau

Hi @ronald_huveneers. Thanks for the interest in gathering Onshape performance data. From a security perspective, running a block of javascript that someone posted online and then following a random link to paste the resulting data is not a great idea. Although your intentions are the best, I recommend that people do not do this just out of good security hygiene.

lougallo

Why not just download the report which is a json file and send it to some place. 

ronald_huveneers

I agree on the security aspect, and some people might not be able to perform it.

As regarding for the report, it's only visible if there is an issue, and it doesn't include all data that I use.

Results are here: https://docs.google.com/spreadsheets/d/15C_AZFi_HzQJYzyKUjGGAEHwh_uWohB30MMPRpwc5T8/edit?usp=sharing

Parsed results are on the "Parsed result" tab in the bottom.

daniel_cook

What's the point of the process if I can ask? I mean I would fully understand if Onshape themselves were doing this to try and improve.

It seems a little complicated compared to a simple Google Sheet / Form and having someone just enter in their data in directly.

Without comparing the results to a "reference" data set for some kind of benchmark, do we know what 800 million or 150 million triangles relates back to in a real world model? Or is that the next step in the project?

The benchmark also doesn't record for several other real world parameters (CPU, RAM, VRAM) that all have major impacts.

To be fair, I added in some entries with a few configuration variables.

ronald_huveneers

I am mainly looking for when buying a next laptop combination the estimated performance will be.

Looking to optimize some settings to use OnShape, I think you are the one with the Radeon card, it was interesting to see that firefox was giving a double of speed improvement.

It also seems above a certain number of Triangles / Lines it just says "100%" and doesn't compute it.

daniel_cook

ronald_huveneers said:

I am mainly looking for when buying a next laptop combination the estimated performance will be.

Looking to optimize some settings to use OnShape, I think you are the one with the Radeon card, it was interesting to see that firefox was giving a double of speed improvement.

It also seems above a certain number of Triangles / Lines it just says "100%" and doesn't compute it.

Just some comments on the Firefox performance - it wasn't actually Firefox providing the benefit - Firefox typically gives much slower results than Chrome in Onshape, albeit Firefox is more memory conservative and I find it more stable. Additionally you can't (or it's super rare, at least for now) find a laptop rocking anything like a performance AMD GPU because they are significantly more power hungry than Nvidia GPU's.

The major speed difference was that I was running Firefox with native OpenGL drivers which for whatever reason seem to work much better for these cards, and you can feel Onshape is MUCH smoother when working with large models. The downside however is that OpenGL is poorly supported with Firefox / Chrome and sometimes it will be unstable, other times it will fail to render the viewport at all from browser update to update. I.e. when it runs it's fantastic, just can't rely on it for production work all the time.

Chrome and Firefox (at least for now) use what is called ANGLE which is basically a translation layer between WebGL and DirectX (the API most used for 3D graphics in Windows).

ronald_huveneers

Thanks for that info. That explains the 2 results in FireFox with such large differences.