Results 1 to 8 of 8
  1. #1
    Untangler
    Join Date
    Apr 2010
    Posts
    50

    Default Extremely high CPU during daily report generation

    I am seeing very high cpu load during report generation that is causing connections and sessions to drop while the reports are generated.

    Is it possible to set the report generation activities as low priority or throttle the generation to prevent the impact to the Router?

    Code:
    Event: SystemStatEvent
    
    Event Time: 2020-07-13 01:50:21.432.
    
    Event Summary:
    The current system state is: [ Load (1-minute): 28.66, Load (5-minute): 9.53, Load (15-minute): 3.55, Memory Free: 4525MB, Disk Free: 263747MB, Swap Used: 1748MB ]
    
    Event Details:
    active hosts         = 28
    cpu system           = 0.2631579
    cpu user             = 0.2545169
    disk free            = 257G
    disk free percent    = 59%
    disk total           = 434G
    disk used            = 176G
    disk used percent    = 41%
    load1                = 28
    load15               = 3
    load5                = 9
    mem buffers          = 0
    mem cache            = 12M
    mem free             = 4G
    mem free percent     = 58%
    mem total            = 7G
    mem used             = 3G
    mem used percent     = 42%
    swap free            = 21G
    swap free percent    = 93%
    swap total           = 23G
    swap used            = 1G
    swap used percent    = 7%
    time stamp           = 2020-07-13 01:50:21.432
    
    This is an automated message sent because this event matched Alerts Rule "Server load is very high".

  2. #2
    Untangle Ninja sky-knight's Avatar
    Join Date
    Apr 2008
    Location
    Phoenix, AZ
    Posts
    24,945

    Default

    This is the way reporting works.

    There is however one twist here... that LOAD number is not just CPU, it's threads waiting for resources in total. High drive IO can cause high load too, and given reports are involved that's very possible. Is your unit equipped with an SSD?

    This is an essential sign you've outgrown your hardware.
    Rob Sandling, BS:SWE, MCP
    NexgenAppliances.com
    Phone: 866-794-8879 x201
    Email: support@nexgenappliances.com

  3. #3
    Untangler
    Join Date
    Apr 2010
    Posts
    50

    Default

    I've been avoiding the SSD since the DB writes tend to be a little rough on that. I also have some PTSD from the first line of UT appliances with SSD that burned out early.

  4. #4
    Untangler jcoffin's Avatar
    Join Date
    Aug 2008
    Location
    Sunnyvale, CA
    Posts
    9,012

    Default

    The early SSD, including the ones used in the u10, were very sensitive to write cycles. Changes to Untangle database writes, new OS (debian buster) and great improves to SSD drives have done away with those issues. I'm using M2 drive on my home Untangle.
    Attention: Support and help on the Untangle Forums is provided by
    volunteers and community members like yourself.
    If you need Untangle support please call or email support@untangle.com

  5. #5
    Untangle Ninja sky-knight's Avatar
    Join Date
    Apr 2008
    Location
    Phoenix, AZ
    Posts
    24,945

    Default

    Quote Originally Posted by Archness View Post
    I've been avoiding the SSD since the DB writes tend to be a little rough on that. I also have some PTSD from the first line of UT appliances with SSD that burned out early.
    I understand that perfectly, but it hasn't been a real problem in two years, swap that thing for an SSD and I think you'll find your LOAD issues vanish.
    Rob Sandling, BS:SWE, MCP
    NexgenAppliances.com
    Phone: 866-794-8879 x201
    Email: support@nexgenappliances.com

  6. #6
    Untangler
    Join Date
    Apr 2010
    Posts
    50

    Default

    I'll look at doing it this weekend.

    I think I'll need about 2-3 hours to clone the disk over.

  7. #7
    Untangler jcoffin's Avatar
    Join Date
    Aug 2008
    Location
    Sunnyvale, CA
    Posts
    9,012

    Default

    It is fast to take a backup of settings, install fresh on the new drive, and restore. 15 mins tops.
    Attention: Support and help on the Untangle Forums is provided by
    volunteers and community members like yourself.
    If you need Untangle support please call or email support@untangle.com

  8. #8
    Untangle Ninja sky-knight's Avatar
    Join Date
    Apr 2008
    Location
    Phoenix, AZ
    Posts
    24,945

    Default

    Quote Originally Posted by jcoffin View Post
    It is fast to take a backup of settings, install fresh on the new drive, and restore. 15 mins tops.
    Yeah, but you lose the retained reports.
    Rob Sandling, BS:SWE, MCP
    NexgenAppliances.com
    Phone: 866-794-8879 x201
    Email: support@nexgenappliances.com

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

SEO by vBSEO 3.6.0 PL2