Uploaded image for project: 'PUBLIC - Liferay Portal Community Edition'
  1. PUBLIC - Liferay Portal Community Edition
  2. LPS-84779

Upgrade to 7.1: Bad performance for v1_1_0.UpgradeJournalArticleLocalizedValues

    Details

    • Type: Bug
    • Status: Closed
    • Resolution: Won't Fix
    • Affects Version/s: 7.1.10 DXP FP1, 7.1.X, Master
    • Fix Version/s: None
    • Component/s: ~[Archived] WCM
    • Labels:

      Description

      Steps to reproduce it:

      1. Startup DXP 7.0 with the following configuration or similar:
         locales=ar_SA,bg_BG,ca_AD,ca_ES,de_DE,en_AU,en_GB,en_US,es_ES,eu_ES,fi_FI,fr_FR,hi_IN,hu_HU,in_ID,iw_IL,ja_JP,pt_BR,pt_PT,zh_CN
        locales.enabled=ar_SA,bg_BG,ca_AD,ca_ES,de_DE,en_AU,en_GB,en_US,es_ES,eu_ES,fi_FI,fr_FR,hi_IN,hu_HU,in_ID,iw_IL,ja_JP,pt_BR,pt_PT,zh_CN
      2. Create 100000 journal articles adding a title and a description per each language for every journal article.
      3. Upgrade to master/7.1.

      Tests were completed with the following CPU and RAM memory:

      • CPU: 2 sockets of 8 cores
      • 20G memory Java8 process

      Results:
      The process v1_1_0.UpgradeJournalArticleLocalizedValues takes 512 minutes (8:30 hours):

      2018-08-11 22:10:10.514 INFO  [main][UpgradeProcess:93] Upgrading com.liferay.journal.internal.upgrade.v1_1_0.UpgradeJournalArticleLocalizedValues
      INFO - Upgrading com.liferay.journal.internal.upgrade.v1_1_0.UpgradeJournalArticleLocalizedValues
      2018-08-11 22:10:10.529 INFO  [main][LoggingTimer:73] Starting com.liferay.portal.kernel.dao.db.BaseDBProcess#runSQLTemplateString
      INFO - Starting com.liferay.portal.kernel.dao.db.BaseDBProcess#runSQLTemplateString
      22:10:35.980 [elasticsearch[zOUeWq7][scheduler][T#1]] INFO  org.elasticsearch.monitor.jvm.JvmGcMonitorService - [gc][young][45260][409] duration [988ms], collections [1]/[1.5s], total [988ms]/[5.2m], memory [8.7gb]->[2.9gb]/[17.3gb], all_pools {[young] [5.8gb]->[11mb]/[5.8gb]}{[survivor] [355.1mb]->[354.3mb]/[361.5mb]}{[old] [2.5gb]->[2.5gb]/[13gb]}
      2018-08-11 22:31:33.771 INFO  [main][LoggingTimer:39] Completed com.liferay.portal.kernel.dao.db.BaseDBProcess#runSQLTemplateString in 1283242 ms
      INFO - Completed com.liferay.portal.kernel.dao.db.BaseDBProcess#runSQLTemplateString in 1283242 ms
      2018-08-11 22:31:33.775 INFO  [main][LoggingTimer:73] Starting com.liferay.journal.internal.upgrade.v1_1_0.UpgradeJournalArticleLocalizedValues#updateJournalArticleDefaultLanguageId
      INFO - Starting com.liferay.journal.internal.upgrade.v1_1_0.UpgradeJournalArticleLocalizedValues#updateJournalArticleDefaultLanguageId
      2018-08-11 23:11:46.132 INFO  [main][LoggingTimer:39] Completed com.liferay.journal.internal.upgrade.v1_1_0.UpgradeJournalArticleLocalizedValues#updateJournalArticleDefaultLanguageId in 2412357 ms
      INFO - Completed com.liferay.journal.internal.upgrade.v1_1_0.UpgradeJournalArticleLocalizedValues#updateJournalArticleDefaultLanguageId in 2412357 ms
      2018-08-11 23:11:46.136 INFO  [main][LoggingTimer:73] Starting com.liferay.journal.internal.upgrade.v1_1_0.UpgradeJournalArticleLocalizedValues#updateJournalArticleLocalizedFields
      INFO - Starting com.liferay.journal.internal.upgrade.v1_1_0.UpgradeJournalArticleLocalizedValues#updateJournalArticleLocalizedFields
      23:29:19.459 [elasticsearch[zOUeWq7][scheduler][T#1]] WARN  org.elasticsearch.monitor.jvm.JvmGcMonitorService - [gc][young][49977][422] duration [1s], collections [1]/[1.2s], total [1s]/[5.3m], memory [8.8gb]->[3.2gb]/[17.3gb], all_pools {[young] [5.6gb]->[99.2mb]/[5.7gb]}{[survivor] [363.8mb]->[349.4mb]/[402mb]}{[old] [2.7gb]->[2.8gb]/[13gb]}
      2018-08-12 06:05:43.156 INFO  [main][LoggingTimer:39] Completed com.liferay.journal.internal.upgrade.v1_1_0.UpgradeJournalArticleLocalizedValues#updateJournalArticleLocalizedFields in 24837020 ms
      INFO - Completed com.liferay.journal.internal.upgrade.v1_1_0.UpgradeJournalArticleLocalizedValues#updateJournalArticleLocalizedFields in 24837020 ms
      2018-08-12 06:42:45.543 INFO  [main][UpgradeProcess:107] Completed upgrade process com.liferay.journal.internal.upgrade.v1_1_0.UpgradeJournalArticleLocalizedValues in 30755028ms
      INFO - Completed upgrade process com.liferay.journal.internal.upgrade.v1_1_0.UpgradeJournalArticleLocalizedValues in 30755028ms
      

      Expected results:
      The execution should take much less time.

      Technical Analysis:
      The slowest processes updateJournalArticleLocalizedFields (414 minutes) and updateJournalArticleDefaultLanguageId (40 minutes) don't use multithreading to speed up the process however it seems suitable (something similar what we did in LPS-81667)

        Attachments

          Activity

            People

            Assignee:
            alberto.chaparro Alberto Chaparro
            Reporter:
            alberto.chaparro Alberto Chaparro
            Participants of an Issue:
            Recent user:
            Marta Elicegui
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:
              Days since last comment:
              2 years, 26 weeks, 2 days ago

                Packages

                Version Package