We are getting performance issues with VP, we have number of entities in number of 1000 to 2000, while the client works just fine, when I do commit I experience multiple issues:
it requires already 16GB of ram, otherwise it fails on parse error (reported before). 16GB is really super big and it looks to me like for some reasons you are loading everything in memory, we will need soon 32GB ram for modeling tool LOL
My commit is running at moment already for around 10 minutes and after this time I received following message in vp.log:
[2019/04/10 15:04:40] [error] v.cds.a - getDataAsInputStream : java.net.SocketException: Unexpected end of file from server vp.log-20190410.log (28.1 KB)
The uploaded file with extension log is actually a zip file.
Ok, so the commit didn’t finished and failed on Java heap space, I am going to increase to 32GB , but its becoming overkill… is there any optimization to be done on this?
The few lines appended from previous vp.log attached:
[2019/04/10 15:16:21] [error] v.bwe.fr : SendCommitAliveMessageAction fail.
[2019/04/10 15:16:21] [message] Exception in thread “pool-6-thread-2”
[2019/04/10 15:16:21] [message] java.lang.OutOfMemoryError: Java heap space
[2019/04/10 15:16:21] [message] Exception in thread “pool-6-thread-1”
[2019/04/10 15:16:21] [message] java.lang.OutOfMemoryError: Java heap space
[2019/04/10 15:16:21] [message] java.lang.OutOfMemoryError: Java heap space
[2019/04/10 15:16:21] [message] at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.addConditionWaiter(Unknown Source)
[2019/04/10 15:16:21] [message] at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(Unknown Source)
[2019/04/10 15:16:21] [message] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(Unknown Source)
[2019/04/10 15:16:21] [message] at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(Unknown Source)
[2019/04/10 15:16:21] [message] at java.base/java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
[2019/04/10 15:16:21] [message] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
[2019/04/10 15:16:21] [message] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
[2019/04/10 15:16:21] [message] at java.base/java.lang.Thread.run(Unknown Source)
[2019/04/10 15:16:21] [message] java.lang.OutOfMemoryError: Java heap space
[2019/04/10 15:16:22] [warning] v.dtm.d: Parse error
at v.dtm.c.a(:372)
at v.dtm.c.a(:309)
at v.dtq.j.a(:186)
at v.dtq.j.b(:169)
at v.bwb.e.(:87)
at v.bwb.d.a(:37)
at v.bwb.k.a(:139)
at v.bwb.k.a(:83)
at v.bvv.dz.b(:1013)
at v.bvv.bi.a(:673)
at v.bvv.bx.a(:1760)
at v.bvv.bx.a(:1751)
at v.bwv.gx.b(:2050)
at v.bwv.gx.a(:1826)
at v.bwv.gt.run(:578)
at java.base/java.lang.Thread.run(Unknown Source)
Caused by: java.lang.OutOfMemoryError: Java heap space
[2019/04/10 15:16:22] [error] error message from server v.dtm.d: Parse error
[2019/04/10 15:16:22] [message] Opening Project: /home/zangetsu/.config/VisualParadigm/ws/teamwork_client/projects/Z100/Z100.vpp
[2019/04/10 15:16:23] [message] Open Project "/home/zangetsu/.config/VisualParadigm/ws/teamwork_client/projects/Z100/Z100.vpp", Time Used: 1 seconds, Memory: 16384.0 MB (17179869184), Project File Size: 93.39 MB (97925120), Diagram Count: 58
Well, not able to finish commit: [2019/04/10 16:07:15] [error] Commit without vpp error Cannot commit due to checkin session timeout. Please re-checkin again.
Sorry, there are some XML files stored in your project, and since the XML contains some useless newline/tab chars, so, the XML becomes very large.
Committing project may be failed to open those XML.
The newline/tab chars problem should be fixed in 1, 2 months before. But, seems there is another bug that, committing project will reproduce the newline/tab chars.
We will fix it asap.
Before the fixing, you can fix your project (reduce the XML size) by Help > About dialog, Utilities tab, click the Compact Project button to fix your project.
After that, I think you will be able to commit the project. Sorry for any inconvenient.
Thanks for your quick reply,
and hope to hear you can commit the project.
And the fixing is ready.
Please update the software to latest patch build ( 20190430au or later) to get the problem fixed.
Details about update to latest patch can be found at
@peter.wong - still we need for regular work around 500-1000GB of RAM, which looks ok, but when we do commit of the project to Team server, 4GB is not enough, see our analysts are having machines with 8GB of ram, so can assign only 4GB… this process looks to me supe high consuming, can this be optimized in some way?
With 10GB heapspace I cannot finish the task, we are now stack and cannot on regular hardware work with repository…(as I stated other guys have laptops with 8GB, so max is 4GB for visual paradigm)
UPDATE: wITH 20gb heap space it works… but other team members cannot commit at moment, only me on my high ram machine.
And I noticed one thing, after compact and update/commit process, the size of project again doubled…:
[2019/04/16 13:47:41] [message] Operating system: Linux 4.14.65-gentoo running on amd64
[2019/04/16 13:47:41] [message] Java VM: 9.0.1 Java HotSpot™ 64-Bit Server VM, vendor 9.0.1+11 Oracle Corporation
[2019/04/16 13:47:41] [message] User: zangetsu, language: en
[2019/04/16 13:47:41] [message] Installation ID: b902c1c62a4e4999e62613596234644c
[2019/04/16 13:47:41] [message] Memory: current=256M, max=20480M
[2019/04/16 13:47:42] [message] Apply workaround for GTK + JDK 9 issue, scale factor: 1.5
[2019/04/16 13:47:43] [message] start startup getLicenseKey on 16-Apr-2019
[2019/04/16 13:47:43] [message] getLicenseKey in local …
[2019/04/16 13:47:43] [message] finish startup getLicenseKey
[2019/04/16 13:47:43] [message] Workspace: /home/zangetsu/.config/VisualParadigm/ws
[2019/04/16 13:47:44] [message] Opening Project: /home/zangetsu/.config/VisualParadigm/ws/.vpprefdata/.systemproject.vpp
[2019/04/16 13:47:49] [message] Connect to repository [Success]
[2019/04/16 13:47:50] [message] Opening Project: /home/zangetsu/.config/VisualParadigm/ws/teamwork_client/projects/Z100/Z100.vpp
[2019/04/16 13:47:53] [message] Open Project “/home/zangetsu/.config/VisualParadigm/ws/teamwork_client/projects/Z100/Z100.vpp”, Time Used: 3 seconds, Memory: 768.0 MB (805306368), Project File Size: 44.43 MB (46592000), Diagram Count: 42
[2019/04/16 13:48:00] [message] Teamwork revision in XML: 172
[2019/04/16 13:48:00] [message] Teamwork revision in VPP: 172
[2019/04/16 13:48:03] [message] Teamwork revision in Server: 174, 174
[2019/04/16 13:48:05] [message] Teamwork revision in server latest VPP: 174
[2019/04/16 13:48:08] [message] Opening Project: /home/zangetsu/.config/VisualParadigm/ws/teamwork_client/projects/Z100/Project8345453574213787617.vpp
[2019/04/16 13:50:01] [message] Saved project “Z100” to “/home/zangetsu/.config/VisualParadigm/ws/teamwork_client/projects/Z100/Project8345453574213787617.vpp”.
[2019/04/16 13:50:05] [message] Opening Project: /home/zangetsu/.config/VisualParadigm/ws/teamwork_client/projects/Z100/Z100.vpp
[2019/04/16 13:50:07] [message] Open Project “/home/zangetsu/.config/VisualParadigm/ws/teamwork_client/projects/Z100/Z100.vpp”, Time Used: 3 seconds, Memory: 20416.0 MB (21407727616), Project File Size: 95.17 MB (99792896), Diagram Count: 43
[2019/04/16 13:53:08] [message] Teamwork revision in XML: 174
[2019/04/16 13:53:08] [message] Teamwork revision in VPP: 174
[2019/04/16 13:53:08] [message] Teamwork revision in Server: 174, 174
[2019/04/16 13:53:08] [message] Teamwork revision in server latest VPP: 174
[2019/04/16 13:53:09] [message] Opening Project: /home/zangetsu/.config/VisualParadigm/ws/teamwork_client/projects/Z100/Z100.vpp
[2019/04/16 13:53:09] [error] error message from server null
[2019/04/16 13:53:09] [message] Open Project “/home/zangetsu/.config/VisualParadigm/ws/teamwork_client/projects/Z100/Z100.vpp”, Time Used: 1 seconds, Memory: 20416.0 MB (21407727616), Project File Size: 95.17 MB (99792896), Diagram Count: 43
[2019/04/16 13:54:19] [message] Teamwork revision in XML: 174
[2019/04/16 13:54:19] [message] Teamwork revision in VPP: 174
[2019/04/16 13:54:19] [message] Teamwork revision in Server: 174, 174
[2019/04/16 13:54:20] [message] Teamwork revision in server latest VPP: 174
[2019/04/16 13:54:20] [error] error message from server null
[2019/04/16 13:54:20] [message] Opening Project: /home/zangetsu/.config/VisualParadigm/ws/teamwork_client/projects/Z100/Z100.vpp
[2019/04/16 13:54:21] [message] Open Project “/home/zangetsu/.config/VisualParadigm/ws/teamwork_client/projects/Z100/Z100.vpp”, Time Used: 1 seconds, Memory: 20416.0 MB (21407727616), Project File Size: 95.17 MB (99792896), Diagram Count: 43
Ok, I did process with new build, it looks working, but the commit process took almost 30 minutes.
[2019/04/16 14:01:35] [message] Teamwork revision in server latest VPP: 174
[2019/04/16 14:01:37] [message] Opening Project: /home/zangetsu/.config/VisualParadigm/ws/teamwork_client/projects/Z100/Project6904830310391449974.vpp
[2019/04/16 14:29:48] [message] Saved project “Z100” to “/home/zangetsu/.config/VisualParadigm/ws/teamwork_client/projects/Z100/Project6904830310391449974.vpp”.
I did again the compact of project, did 2 changes on single diagram and now the commit was much faster, but there are some warnings about extra project file founds…
[2019/04/16 14:33:21] [message] Open Project “/home/zangetsu/.config/VisualParadigm/ws/teamwork_client/projects/Z100/Z100.vpp”, Time Used: 1 seconds, Memory: 20480.0 MB (21474836480), Project File Size: 40.08 MB (42022912), Diagram Count: 43
[2019/04/16 14:33:30] [message] Saved project “Z100” to “/home/zangetsu/.config/VisualParadigm/ws/teamwork_client/projects/Z100/Z100.vpp”.
[2019/04/16 14:33:31] [message] Teamwork revision in VPP: 175
[2019/04/16 14:33:32] [message] Teamwork revision in Server: 175, 175
[2019/04/16 14:33:32] [message] Teamwork revision in server latest VPP: 175
[2019/04/16 14:33:34] [message] Opening Project: /home/zangetsu/.config/VisualParadigm/ws/teamwork_client/projects/Z100/Project11994239120170123603.vpp
[2019/04/16 14:34:28] [message] Saved project “Z100” to “/home/zangetsu/.config/VisualParadigm/ws/teamwork_client/projects/Z100/Project11994239120170123603.vpp”.
[2019/04/16 14:34:29] [warning] Extra project file found in diff: ersyn.xml
[2019/04/16 14:34:29] [warning] Extra project file found in diff: modeltransform/elements.xml
[2019/04/16 14:34:29] [warning] Extra project file found in diff: modeltransform/m/DBColumn.xml
[2019/04/16 14:34:29] [warning] Extra project file found in diff: modeltransform/m/DBForeignKeyConstraint.xml
[2019/04/16 14:34:29] [warning] Extra project file found in diff: modeltransform/m/DBIndex.xml
[2019/04/16 14:34:29] [warning] Extra project file found in diff: modeltransform/m/DBUniqueConstraint.xml
[2019/04/16 14:34:29] [warning] Extra project file found in diff: modeltransform/m/EntityRecord.xml
[2019/04/16 14:34:29] [warning] Extra project file found in diff: modeltransform/m/EntityRecordCell.xml
[2019/04/16 14:34:29] [warning] Extra project file found in diff: modeltransform/m/EntityRecordColumn.xml
[2019/04/16 14:34:29] [warning] Extra project file found in diff: modeltransform/m/EntityRecordContainer.xml
[2019/04/16 14:34:29] [warning] Extra project file found in diff: modeltransform/m/TaggedValue.xml
[2019/04/16 14:34:29] [warning] Extra project file found in diff: modeltransform/m/TaggedValueContainer.xml
[2019/04/16 14:34:29] [warning] Extra project file found in diff: persistentModelFiles/PrintingFramework
[2019/04/16 14:34:29] [warning] Extra project file found in diff: projectPropertiesFiles/DiagramGenerator
[2019/04/16 14:34:29] [warning] Extra project file found in diff: projectPropertiesFiles/OptionCodeGeneration
[2019/04/16 14:34:29] [warning] Extra project file found in diff: projectPropertiesFiles/OptionImporter
[2019/04/16 14:34:29] [warning] Extra project file found in diff: projectPropertiesFiles/OptionReport
[2019/04/16 14:34:29] [warning] Extra project file found in diff: projectPropertiesFiles/VPUMLTreeOptions
[2019/04/16 14:34:33] [message] Opening Project: /home/zangetsu/.config/VisualParadigm/ws/teamwork_client/projects/Z100/Z100.vpp
[2019/04/16 14:34:34] [message] Open Project “/home/zangetsu/.config/VisualParadigm/ws/teamwork_client/projects/Z100/Z100.vpp”, Time Used: 1 seconds, Memory: 20480.0 MB (21474836480), Project File Size: 95.17 MB (99792896), Diagram Count: 43
What is this? And also please notice after commit the size of project again from 40 to 95 MB
LOL
