Re: Memory usage for Domino

[Chris Whisonant <chris.whisonant@xxxxxxxxx>]

Rob, what exactly are you trying to accomplish? Are you trying to size a new
server? Or is this just an exercise in determining best practices, etc...?

---------------------------------------------------

Thanks,
Chris
Personal Blog: http://cwhisonant.blogspot.com
Work Blog: http://www.bleedyellow.com/blogs/lotusnut


On Mon, Jul 25, 2011 at 10:41 AM, <rob@xxxxxxxxx> wrote:

> Meat at bottom.
>
> Earlier in this thread I had posted
> Server.Users = 391
> Server.Users.Active15Min = 219
> Server.Users.Active1Min = 82
> Server.Users.Active30Min = 262
> Server.Users.Active3Min = 119
> Server.Users.Active5Min = 153
> Server.Users.Peak = 392
> Server.Users.Peak.Time = 07/25/2011 08:56:45 EDT
>
> With Mexico coming on line now I am showing:
>  Server.Users.1MinPeak = 99
>  Server.Users.1MinPeakTime = 07/25/2011 08:58:27 EDT
>  Server.Users.5MinPeak = 210
>  Server.Users.5MinPeakTime = 07/25/2011 10:03:59 EDT
>  Server.Users.Active = 1
>  Server.Users.Active15Min = 293
>  Server.Users.Active1Min = 83
>  Server.Users.Active30Min = 333
>  Server.Users.Active3Min = 135
>  Server.Users.Active5Min = 169
>  Server.Users.Peak = 469
>  Server.Users.Peak.Time = 07/25/2011 10:07:43 EDT
>
> System    Pool    Reserved    Max   -----DB-----  ---Non-DB---
>  Pool   Size (M)  Size (M)  Active  Fault  Pages  Fault  Pages
>   1     8949.41   4663.05   +++++     .0     .0     .8    2.1
>   2    20182.21     81.73    1918   14.5  824.8  397.6   2081
>   3      522.23       .29      29     .0    2.8    5.8   36.8
>   4    17090.37      1.11    1306   45.0   2755   42.2   99.0
>   5     5479.75       .02     157   10.7  481.7  404.1   3602
>
> 1.5MB for ($Inbox) times x 2 times 333Users gets 999MB.  Which is really
> close to a 1GB per server shot from the hip I dimly recall getting from
> somewhere.
>
> On a server that is for databases other than mail I did a show users and
> pasted that data into Excel and sorted it.  I've got 19 databases with
> varying numbers of current user per database.  Now I've got to find their
> default view and crank out the math.  Right?
>
> Rob Berendt
> --
> Group Dekko
> Dept 1600
> Mail to:  2505 Dekko Drive
>          Garrett, IN 46738
> Ship to:  Dock 108
>          6928N 400E
>          Kendallville, IN 46755
> http://www.dekko.com
>
>
>
>
>
> From:   Walter Scanlan <wscanlan@xxxxxxxxxx>
> To:     Lotus Domino on the iSeries / AS400 <domino400@xxxxxxxxxxxx>
> Cc:     domino400-bounces+wscanlan=us.ibm.com@xxxxxxxxxxxx
> Date:   07/25/2011 09:54 AM
> Subject:        Re: Memory usage for Domino
> Sent by:        domino400-bounces+rob=dekko.com@xxxxxxxxxxxx
>
>
>
> 1.2 GB sounds right based on what you see,  Sorry what do you mean,  how
> does that play with some of the figures in show stat?
>
> Now that you know the "cost" of an average session  1.5 MB, (which by the
> way is about average for a mail server),  you could look at REAL workload.
>
> while you have 400 users defined, if you look at  Server.Users.Active30Min
>
>  that give you a better idea of "real" memory requirements.
>
> Lets assume that with 400 users the  Server.Users.Active30Min = 300, then
> 1.5 times x 2 times 300 gets 900 Mb of memory to support this server.
>
>
>
> Walter Scanlan
> Senior Software Engineer
> Office: 1 720 342 5837
> Cell: 507-990-4539
>
>
>
>
> From:   rob@xxxxxxxxx
> To:     Lotus Domino on the iSeries / AS400 <domino400@xxxxxxxxxxxx>,
> Date:   07/25/2011 08:48 AM
> Subject:        Re: Memory usage for Domino
> Sent by:        domino400-bounces+wscanlan=us.ibm.com@xxxxxxxxxxxx
>
>
>
> Ok.  That helps.  That median file was 2.9MB for ($Inbox).  I picked 10
> files, including that one.  The size of that view ranged from 148,864 to
> 3,754,048 with the average being 1,540,978.  Some people are really
> religious in moving stuff out of inbox into other views - others aren't.
> Me?  I have over 1,500 unread messages in my inbox let alone all the stuff
>
>
> I've read.
>
> So if I take 1.5MB x 2 x 400Users I get 1.2GB.  That's easier to swallow
> than 10.4GB.
>
> How does that play with some of the figures from show stat, etc?
>
> Rob Berendt
> --
> Group Dekko
> Dept 1600
> Mail to:  2505 Dekko Drive
>          Garrett, IN 46738
> Ship to:  Dock 108
>          6928N 400E
>          Kendallville, IN 46755
> http://www.dekko.com
>
>
>
>
>
> From:   Walter Scanlan <wscanlan@xxxxxxxxxx>
> To:     Lotus Domino on the iSeries / AS400 <domino400@xxxxxxxxxxxx>
> Cc:     domino400-bounces+wscanlan=us.ibm.com@xxxxxxxxxxxx
> Date:   07/25/2011 09:16 AM
> Subject:        Re: Memory usage for Domino
> Sent by:        domino400-bounces+rob=dekko.com@xxxxxxxxxxxx
>
>
>
> Don't Add ALL the views.  only the "default" view, for a mail file that is
>
>
>
> $INBOX.
>
> Users do NOT open all the views in a mail file at once, and rarely open
> views other than $inbox and calendar.
>
> Just track the size of $inbox.
>
>
>
> Walter Scanlan
> Senior Software Engineer
> Office: 1 720 342 5837
> Cell: 507-990-4539
>
>
>
>
> From:   rob@xxxxxxxxx
> To:     Lotus Domino on the iSeries / AS400 <domino400@xxxxxxxxxxxx>,
> Date:   07/25/2011 08:09 AM
> Subject:        Re: Memory usage for Domino
> Sent by:        domino400-bounces+wscanlan=us.ibm.com@xxxxxxxxxxxx
>
>
>
> Thank you Walter.
>
> In my Admin (we're a daos shop) if I sort by "Logical Size" the largest
> mail file is 6.2GB.  It's physical size is only 42MB.   The view indexes
> of this database consume 5 MB of disk space, which is 0% of the entire
> space used by this database.
> The largest physical file is 624MB and it's logical size is 1.3GB.  The
> view indexes of this database consume 85 MB of disk space, which is 7% of
> the entire space used by this database.
> The median physical file is 51MB.  The view indexes of this database
> consume 13 MB of disk space, which is 4% of the entire space used by this
> database.
> The median logical size is 240MB.  The view indexes of this database
> consume 7 MB of disk space, which is 3% of the entire space used by this
> database.
> 13MB x 2 x 400 users = 10.4GB?
>
> We archive mail that is over 6 months old.  We put no size or other type
> restrictions.  We've brought that up to management but their concern was
> that a major customer might send us a drawing and we wouldn't want to
> reject it (how big do we need to make the check for the disk drives?).
>
> We have 453 mail files.  It's 9am here.  Which is only 7am in Mexico and
> Texas where an additional significant percentage of our users are.
> Mem.MaxSharedMemory_MB = 4080
> Mem.PhysicalRAM = 54,760,833,024
> Mem.PhysicalRAM_MB = 52224
> Platform.Memory.FaultsPerSec = 305.3
> Platform.Memory.FaultsPerSec.Avg = 374.6
> Platform.Memory.FaultsPerSec.Peak = 20,326.6
> Platform.Memory.PagesPerSec = 4,779.3
> Platform.Memory.PagesPerSec.Avg = 3,223.4
> Platform.Memory.PagesPerSec.Peak = 326,166.7
> Platform.Memory.RAM.TotalMBytes = 16,789.6
> Platform.Memory.WaitToIneligible = 0
> Server.Users = 391
> Server.Users.Active15Min = 219
> Server.Users.Active1Min = 82
> Server.Users.Active30Min = 262
> Server.Users.Active3Min = 119
> Server.Users.Active5Min = 153
> Server.Users.Peak = 392
> Server.Users.Peak.Time = 07/25/2011 08:56:45 EDT
>
>
> Rob Berendt
> --
> Group Dekko
> Dept 1600
> Mail to:  2505 Dekko Drive
>          Garrett, IN 46738
> Ship to:  Dock 108
>          6928N 400E
>          Kendallville, IN 46755
> http://www.dekko.com
>
>
>
>
>
> From:   Walter Scanlan <wscanlan@xxxxxxxxxx>
> To:     Lotus Domino on the iSeries / AS400 <domino400@xxxxxxxxxxxx>
> Cc:     domino400-bounces+wscanlan=us.ibm.com@xxxxxxxxxxxx
> Date:   07/25/2011 08:25 AM
> Subject:        Re: Memory usage for Domino
> Sent by:        domino400-bounces+rob=dekko.com@xxxxxxxxxxxx
>
>
>
> I am sure you will not like parts of my answer but I will attempt to
> provide an answer to your questions.
>
> For the first part. 512 MB is the MINIMUM Memory requirement
>
> Workload defines Memory requirements beyond the minimum
>
> Some Domino servers require 68 GB of RAM (Yes that is an actual customer
> deployment).
>
> The second question,  How do I determine the memory requirements for "MY"
> workload.
>
> As
>
> http://www-10.lotus.com/ldd/dominowiki.nsf/dx/4.8_Domino_on_IBM_i_Tips#Memory
>
>
>
>
>
> states,  The faulting/paging rates determine how much memory is
> over-committed.
>
> Keeping Base pool (assuming default configuration) below 100 faults 300
> pages per CPU per second is the goal (the lower the better , but above
> these numbers user connections may fail and performance will be poor).
>
> The reason the mention of largest view,
>        For HUGE mail files and large application deployments the view is
> the largest memory cost.
>                Example.  the $INBOX is loaded into memory each time the
> user opens his/her mail file,  That view is x size, requiring x space in
> memory.
>                                As the mail file grows, the $INBOX grows
> (in an unmanaged mail file), resulting is MORE memory required to do the
> same work as a smaller mail file.
>
>                        For applications with complex views or large
> document counts the views can require a LOT of memory
>
>        To see the size of any view (index) from the administration
> client, Files tab, right click on any database and select manage views.
>
>
> Note: in the above the inbox is 18 Mb, if this mail file were on server it
>
>
>
>
>
> would have a VERY large per user cost.
>        If this were an "average mail file" on a server with 1000 users,
> this server would require 36 GB!!!!!! of memory.
>
> In this case rather than installing 18 GB of memory action would be taken
> to manage the mail files to avoid this performance cost.
>
>
> I don't have a way to Sort the databases by view index size but for a
> given type of database (ie. mail file) the largest database has a the
> largest indexes.
>
> By comparison The same mail file with a Managed inbox.
>
>
> Note; if this were the average mail file with 2.8 Mb inbox on a server
> with 1000 users the server would require 5.6 GB , still a very large
> server but 1/6th the original requirement.
>
>
>
> Walter Scanlan
> Senior Software Engineer
> Office: 1 720 342 5837
> Cell: 507-990-4539
>
>
>
>
> From:   rob@xxxxxxxxx
> To:     domino400@xxxxxxxxxxxx,
> Date:   07/25/2011 07:03 AM
> Subject:        Memory usage for Domino
> Sent by:        domino400-bounces+wscanlan=us.ibm.com@xxxxxxxxxxxx
>
>
>
> Is the general memory recommendation still 512MB per Domino server?
> https://www-304.ibm.com/support/docview.wss?uid=swg27013080
>
> I also noticed this differing recommendation:
>
> http://www-10.lotus.com/ldd/dominowiki.nsf/dx/4.8_Domino_on_IBM_i_Tips#Memory
>
>
>
>
>
>
> "2 times the amount of space needed for views in that application
> dedicated for the Domino server".  I am curious as to how you base your
> memory consumption for a server based on the stuff of a database used
> (perhaps) by a single user?  For example, my NOTES01 server is where my
> users mail files are.  If I determine that jsmith.nsf view size was xMB so
>
>
>
>
>
>
> I give it 2xMB memory?  Regardless of the number of users?
> Also, how do you determine the size of the views of a database?  I don't
> suppose there's a way for the Domino Administrator to sort by database
> view size?
> It's an Amy Hoerle article.
>
>
> Rob Berendt
> --
> Group Dekko
> Dept 1600
> Mail to:  2505 Dekko Drive
>          Garrett, IN 46738
> Ship to:  Dock 108
>          6928N 400E
>          Kendallville, IN 46755
> http://www.dekko.com
>
> _______________________________________________
> This is the Lotus Domino on the iSeries / AS400 (Domino400) mailing list
> To post a message email: Domino400@xxxxxxxxxxxx
> To subscribe, unsubscribe, or change list options,
> visit: http://lists.midrange.com/mailman/listinfo/domino400
> or email: Domino400-request@xxxxxxxxxxxx
> Before posting, please take a moment to review the archives
> at http://archive.midrange.com/domino400.
>
>
> _______________________________________________
> This is the Lotus Domino on the iSeries / AS400 (Domino400) mailing list
> To post a message email: Domino400@xxxxxxxxxxxx
> To subscribe, unsubscribe, or change list options,
> visit: http://lists.midrange.com/mailman/listinfo/domino400
> or email: Domino400-request@xxxxxxxxxxxx
> Before posting, please take a moment to review the archives
> at http://archive.midrange.com/domino400.
>
>
> _______________________________________________
> This is the Lotus Domino on the iSeries / AS400 (Domino400) mailing list
> To post a message email: Domino400@xxxxxxxxxxxx
> To subscribe, unsubscribe, or change list options,
> visit: http://lists.midrange.com/mailman/listinfo/domino400
> or email: Domino400-request@xxxxxxxxxxxx
> Before posting, please take a moment to review the archives
> at http://archive.midrange.com/domino400.
>
>
> _______________________________________________
> This is the Lotus Domino on the iSeries / AS400 (Domino400) mailing list
> To post a message email: Domino400@xxxxxxxxxxxx
> To subscribe, unsubscribe, or change list options,
> visit: http://lists.midrange.com/mailman/listinfo/domino400
> or email: Domino400-request@xxxxxxxxxxxx
> Before posting, please take a moment to review the archives
> at http://archive.midrange.com/domino400.
>
>
> _______________________________________________
> This is the Lotus Domino on the iSeries / AS400 (Domino400) mailing list
> To post a message email: Domino400@xxxxxxxxxxxx
> To subscribe, unsubscribe, or change list options,
> visit: http://lists.midrange.com/mailman/listinfo/domino400
> or email: Domino400-request@xxxxxxxxxxxx
> Before posting, please take a moment to review the archives
> at http://archive.midrange.com/domino400.
>
>
> _______________________________________________
> This is the Lotus Domino on the iSeries / AS400 (Domino400) mailing list
> To post a message email: Domino400@xxxxxxxxxxxx
> To subscribe, unsubscribe, or change list options,
> visit: http://lists.midrange.com/mailman/listinfo/domino400
> or email: Domino400-request@xxxxxxxxxxxx
> Before posting, please take a moment to review the archives
> at http://archive.midrange.com/domino400.
>
>
> _______________________________________________
> This is the Lotus Domino on the iSeries / AS400 (Domino400) mailing list
> To post a message email: Domino400@xxxxxxxxxxxx
> To subscribe, unsubscribe, or change list options,
> visit: http://lists.midrange.com/mailman/listinfo/domino400
> or email: Domino400-request@xxxxxxxxxxxx
> Before posting, please take a moment to review the archives
> at http://archive.midrange.com/domino400.