4. Cache Statistics Reference
This chapter describes specific statistics that are written by GemStone and GBS tools. The lists of statistics are provided here for convenience when using VSD; VSD can read files with any arbitrary set of statistics, and the particular set of statistics that are present in a data file are specific to the tool that generated them.
The references in this chapter are separated by how they are collected; GemStone server product statistics, statistics available when statmonitor performs System monitoring on available platforms, and statistics generated by GBS.
- GemStone Server process Statistics
- System Statistics on Linux
- System Statistics on Solaris
- System Statistics on AIX
- GBS Statistics
When you are browsing a statistical data file, you may look up the definition in the Statistics Information window. See the section Meaning of statistics for more information.
4.1 GemStone Server process Statistics
This section lists statistics that are generated by the GemStone/S 64 Bit server. This includes the following process types:
- Stone
- Gem
- SPC monitor (Shared Page Cache Monitor)
- Pgsvr (AIO, Free Frame, or remote Gem Page Server)
- Statmon
- All (all of the above, excluding Statmonitor)
Some statistics are platform-specific, and have platforms listed. Note that no host statistics are available for the Macintosh.
Note
This statistical reference include statistics that are generated by recent versions of GemStone/S 64 bit and in some older versions,. Any specific statmonitor data file will not include all these statistics.
AbortCount (Gem)
The number of aborts executed by a Gem process (or by an application linked to a Gem) since the Gem was most recently started.
AbortInProgress (Gem)
A boolean that indicates if the session is currently performing an abort operation.
AioCkptCount (Pgsvr)
The number of dirty pages written from the shared page cache to disk to satisfy a checkpoint.
AioDirtyCount (Pgsvr)
The number of dirty pages written from the shared page cache to disk by Stone’s AIO page server during normal operation.
AioNumEmptyBuffers (Stone)
The number of internal AIO buffers that are currently empty. The stone will block when starting a tranlog write unless at least 3 buffers are empty.
AioRateLimit (Pgsvr)
The current I/O rate being used by the page server, expressed in I/O operations per second. The page server will perform no more than this number of I/O operations per second on average.
AioRateMax (Pgsvr)
The current maximum I/O rate being used by the page server, expressed in I/O operations per second. The page server will perform no more than this number of I/O operations per second on average.
AioWriteFailures (Pgsvr)
Total number of write errors detected by this page server, including write errors that succeeded on retry.
AllOtherSleepTime (All, on Solaris only)
The number of milliseconds the process has been sleeping for some reason not tracked by any other stat.
AsyncWritesInProgress (Pgsvr)
Is zero or one for an aio page server. It is one when the aiopgsvr is doing checkpoint io. Always zero for a stone and a page server that is not an aio page server and in GemStone/S 6.3 and later.
BackupHighWaterPage (Stone)
The lowest page ID for which the GC reclaim gems will temporarily ignore because a full backup is in progress. Pages with IDs less than this value will be reclaimed normally. Page IDs equal to or greater than this value will not be reclaimed. The session performing the full backup will increase this value as the full backup progresses.
BackupRecordPagesWrittenByGem (SPC monitor)
BackupRecordPagesWrittenByStone (SPC monitor)
The number of backup record pages in the cache because of a write done by a Gem or by the Stone, respectively.
BitlistPagesWrittenByGem (SPC monitor)
BitlistPagesWrittenByStone (SPC monitor)
The number of bitlist pages in the cache because of a write done by a Gem or by the Stone, respectively. A bitlist page is a form of a bit array.
BitmapPageReads (All)
The number of bitmap pages read by the process since it was last started. These page reads are actual disk reads and not reads from the shared page cache.
BmCHeapPages (Gem, Stone)
The number of temporary bitmap pages allocated in private heap memory to store bitmap structures.
BmInternalPagesWrittenByGem (SPC monitor)
BmInternalPagesWrittenByStone (SPC monitor)
The number of bitmap internal pages in the cache because of a write done by a Gem or by the Stone, respectively.
BmLeafPagesWrittenByGem (SPC monitor)
BmLeafPagesWrittenByStone (SPC monitor)
The number of bitmap leaf pages in the cache because of a write done by a Gem or by the Stone, respectively.
CacheScanCount (SPC Monitor)
Number of times the shared page cache monitor statistics thread has scanned the entire shared page cache.
CHeapSizeKB (All)
The size (in KB) of the C heap area; that is, the total size of results of UtlMalloc for which UtlFree has not been called. This statistic is computed only in slow or fastdebug executables.
CheckpointCount (Stone)
The number of checkpoints that have been written since the Stone repository monitor was last started. Writing a checkpoint implies that all of the data and meta information needed to recover the data corresponding to the commit record associated with the checkpoint have been written to the disk(s) containing the extent(s) that make up the repository. Thus, the last checkpoint in the transaction log determines how much data in the log must be recovered when there is a system crash.
In full logging mode, the checkpoints are controlled completely by the STN_CHECKPOINT_INTERVAL configuration parameter. In partial logging mode, a checkpoint may be written more often if the size of the transaction exceeds the value set by the configuration parameter STN_TRAN_LOG_LIMIT. If partial logging is in use, a rapidly increasing CheckpointCount indicates that STN_TRAN_LOG_LIMIT may be set too small.
CheckpointState (Stone)
This internal statistic indicates the state of the checkpoint process:
6 — dispose alloc pages shadowed
These values are provided for information only and are subject to change without notice.
CleanSlotsInRecoveryCount (SPC monitor)
The current number of slots being recovered which were owned by a process which shutdown cleanly.
CleanSlotsRecoveredCount (SPC monitor)
The total number of slots the shared cache monitor has recovered because a client process shutdown cleanly.
CleanSlotThreadTimeRunningMs (SPC monitor)
Approximate real time in milliseconds that the clean slot recovery thread in the shared page cache monitor has spent doing work.
ClientAbortInProgress (Pgsvr)
A boolean indicating if the page server's client Gem is currently performing an abort operation.
ClientLostOtsSent (Pgsvr)
The number of Lost OT root signals sent from the stone to the page server's client.
ClientPageReads (Pgsvr)
The number of pages that have been transmitted by a page server to its client. This statistic is implemented only for cache slots used by a page server.
ClientPageWrites (Pgsvr)
The number of pages that have been transmitted by a client to its page server. This statistic is implemented only for cache slots used by a page server.
ClientPid (Gem, Pgsvr)
The process ID of the client process associated with a Gem or page server process.
ClientSigAbortsSent (Pgsvr)
The number of SigAborts sent from the stone to the page server's client.
ClockHandFrameId (Pgsvr)
The shared page cache frame ID that the page server clock hand currently references.
CodeCacheSizeBytes (Gem)
The total size in bytes of copies of GsNMethods that are in the code generation area and ready for execution, as of the end of mark/sweep.
CodeCacheSizeKBytes (Gem)
Total size in kilobytes of copies of GsMethods that are in the code generation area and ready for execution, as of the end of mark/sweep.
CodeGenClearSendCachesCount (Gem)
Total number of times the gem has cleared all method send caches in code gen. (2x)
CommitCount (Gem)
The number of commits executed by a Gem process (or application linked to a Gem) since the Gem was most recently started.
CommitQueueAddedToRunQueueCount (Stone)
The number of times sessions from the commit queue were added to the run queue.
CommitQueueAddedToRunQueueSessionCount (Stone)
The number of sessions from the commit queue which were added to the run queue.
CommitQueueSessionNotReadyCount (Stone)
The number of times the stone was ready to assign the commit token to a session in the commit queue but no session was not ready to receive the token.
CommitQueueThreshold (Stone)
The current setting of the STN_COMMIT_QUEUE_THRESHOLD configuration parameter. This setting determines how large the commit queue must be before the stone will defer commit record disposal. A value of -1 indicates this feature is disabled and commit record disposal will never be deferred.
CommitRecordCount (Stone)
The number of outstanding commit records that are currently being maintained by the system. A number larger than the STN_SIGNAL_ABORT_CR_BACKLOG configuration option indicates that there is a process in a transaction that is preventing the Stone from reclaiming (garbage collecting) the resources associated with those commit records. Large values are usually accompanied by continuing growth in the size of the repository.
CommitRecordDisposalsDeferredCount (Stone)
The number of times the stone deferred commit record disposal because the number of sessions in the commit queue exceeded the STN_COMMIT_QUEUE_THRESHOLD setting.
CommitRecordDisposalState (Stone)
An internal statistic used to analyze the commit record disposal routines.
CommitRecordPagesWrittenByGem (SPC monitor)
CommitRecordPagesWrittenByStone (SPC monitor)
The number of commit record pages in the cache because of a write done by a Gem or by the Stone, respectively.
CommitRecordReleases (Stone)
Number of times stone has released a session's reference to a commit record due to an abnormal event. Routine events that cause commit records to be released such as commit, abort, and logout are not included in this statistic.
CommitRecordsReadCommitBeforeCommitQueueCount
The number of commit records read by the session before it requested the commit token during a commit operation.
CommitRecordsReadCommitInCommitQueueCount
Number of commit records read by the session after it has requested but not yet received the commit token.
CommitRecordsReadCommitWithoutTokenCount (Gem)
The number of commit records read while processing a commit and the gem is waiting for the commit token (2x)
CommitRecordsReadCommitWithTokenCount (Gem)
The number of commit records read while processing a commit and the Gem has the commit token.
CommitsSinceLastEpoch (Stone)
Number of commits, excluding reclaim commits by GcGems, since the start of the currently open epoch.
CommitTokenSession (Stone)
The session ID of the gem holding the commit token. If no gem is holding the commit token, the value will be zero.
CompressedLogPagesWrittenByGem (SPC monitor)
CompressedLogPagesWrittenByStone (SPC monitor)
The number of compressed log pages in the cache because of a write done by a Gem or by the Stone, respectively.
ContinueTransactionCount (Gem)
Total number of times the session executed the ''System continueTransaction'' method.
CountBagInteriorPagesWrittenByGem (SPC monitor)
CountBagInteriorPagesWrittenByStone (SPC monitor)
The number of count bag interior pages in the cache because of a write done by a Gem or by the Stone, respectively.
CountBagLeafPagesWrittenByGem (SPC monitor)
CountBagLeafPagesWrittenByStone (SPC monitor)
The number of count bag leaf pages in the cache because of a write done by a Gem or by the Stone, respectively.
CountMapLeafPagesWrittenByGem (SPC monitor)
CountMapLeafPagesWrittenByStone (SPC monitor)
These statistics are obsolete; the page kind is no longer used.
CrashedSlotsInRecoveryCount (SPC monitor)
The current number of slots being recovered which were owned by a crashed process.
CrashedSlotsRecoveredCount (SPC monitor)
The total number of slots the shared cache monitor has recovered because a client process shutdown abnormally.
CrashedSlotThreadTimeRunningMs (SPC monitor)
Approximate real time in milliseconds that the crashed slot recovery thread in the shared page cache monitor has spent doing work.
CrPageLocateForDisposeCount (Stone)
Number of times a commit record page was not found in the stone's commit record cache at commit record disposal time.
DataFaultSleepTime (All, on Solaris only)
The number of milliseconds the process has been faulting in data pages.
DataPageReads (All)
The number of data pages read by the process since it was last started. These page reads are actual disk reads and not reads from the shared page cache.
DataPagesWrittenByGem (SPC monitor)
DataPagesWrittenByStone (SPC monitor)
The number of data pages in the cache because of a write done by a Gem or by the Stone, respectively.
DeadDataPagesWrittenByGem (SPC monitor)
DeadDataPagesWrittenByStone (SPC monitor)
The number of dead data pages in the cache because of a write done by a Gem or by the Stone, respectively. Dead data pages are intended for disposal.
DeadNotReclaimedKobjs (Stone)
The same as DeadNotReclaimedObjs, but in units of 1000s of objects. This statistic is present for server versions that did not support a sufficiently large value range.
DeadNotReclaimedObjs (Stone)
DeadNotReclaimedObjs is the number of objects that have been determined to be dead (current sessions have indicated they do not have a reference to the objects) but have not yet been reclaimed.
DeadObjsReclaimedCount (Stone)
The total number of dead objects reclaimed since the Stone repository monitor process was last started. For a system in “steady state” for a particular application, look for a uniform discovery rate per garbage collection epoch. Increasing the duration of the epoch should increase this value, but that could also cause larger swings in the amount of free space in the repository.
DecompressionKbIn (Pgsvr)
Total size of data decompressed before decompression, expressed in kilobytes.
DecompressionKbOut (Pgsvr)
Total size of data decompressed after decompression, expressed in kilobytes.
DeferCkptCompleteCount (Stone)
The number of pending commit operations for which the checkpoint will allow itself to be deferred before it completes.
DepMapKeysChanged (Gem)
The total number of objects with DependencyMap changes committed by this session.
DirtyListSize (Gem)
The number of modified committed objects in the temporary object memory dirty list.
DirtyPageSweepCount (Pgsvr)
The number of times the page server has swept the cache for dirty pages or frames to add to the free list.
EmptyBmLeafPagesWrittenByGem (SPC monitor)
EmptyBmLeafPagesWrittenByStone (SPC monitor)
The number of empty bitmap leaf pages in the cache because of a write done by a Gem or Stone, respectively.
EpochForceGc (Stone)
This statistic is 1 when a user has requested that Epoch garbage collection be started manually, and is otherwise zero.
EpochGcCount (Stone)
The number of times that the Epoch garbage collection process was run by the Admin GcGem since the Admin GcGem was started. For a system in steady state, look for uniform periods between runs or a uniform run rate.
EpochLastDuration (Stone)
The duration of the last completed epoch garbage collection operation in seconds.
EpochNewObjs (Stone)
EpochNewKobjs (Stone)
The number of new objects that were created during the last epoch. In some versions, in units of 1024.
EpochPossibleDeadObjs (Stone)
EpochPossibleDeadKobjs (Stone)
The number of possible dead objects found by the last Epoch garbage collection. In some versions, in units of 1024.
EpochScannedObjs (Stone)
EpochScannedKobjs (Stone)
The number of objects scanned by the last Epoch garbage collection. In some versions, in units of 1024.
ExportedSetSize (Gem)
The number of objects in the ExportSet. The ExportSet is a collection of objects for which the Gem process has handed out an Oop to GemBuilder or Topaz. Objects in the ExportSet are prevented from being automatically garbage collected in the Gem’s temporary object memory. The ExportSet is used to guarantee referential integrity for objects only referenced by an application, that is, objects that have no references to them within the Gem.
The application program is responsible for timely removal of objects from the ExportSet. The contents of the ExportSet can be examined using hidden set methods defined in class System. In general, the smaller the size of the ExportSet, the better the performance is likely to be. There are a couple of reasons for this relationship. The ExportSet is one of the root sets used for garbage collection. The larger the ExportSet, the more likely it is that objects that would otherwise be considered garbage are being retained. One threshold for performance is when the size of the export set exceeds 2K objects. When its size is smaller than 2K objects, the export set is stored as a single disk page. When its size is larger than 2K, the export set occupies more than one page and is likely to cause additional I/O.
ExportedSetSizePinnedInMemory (Gem)
The number of objects in the ExportSet that cannot drop out of temporary object memory nor be garbage collected by in-memory collection of temporary objects. Will include any objects represented in ExportedSetSize that are not committed. Can be less than ExportedSetSize if ((System gemConfigurationAt:GemDropCommittedExportedObjs) == true).
ExtentFlushCount (All)
The cumulative number of file flush operations performed on any extent by the process. Note that extents residing on raw partitions do not require flushing. On UNIX systems, file flushes are performed by calling the fsync() function. During a checkpoint, each extent is flushed once, except for the primary extent which is flushed twice. Most extent flushes are performed by the AIO page servers.
ExtentGrowTimeMs (Stone)
Total amount of real time in milliseconds the stone has spent increasing the size of the repository by growing the extent(s).
ExtentGrowTimePerGrow (Stone)
Average amount of real time in microseconds it takes the stone to perform a single grow operation on an extent.
ExtentGrowTotal (Stone)
Number of times the stone has increased the size of the repository by growing the extent(s).
ForcedDisconnects (Stone)
Number of session logouts for which stone forced the disconnect of OOB socket.
FragmentBmPagesWrittenByGem (SPC monitor)
FragmentBmPagesWrittenByStone (SPC monitor)
The number of bitmap fragment pages in the cache because of a write done by a Gem or by the Stone, respectively.
FramesAddedToFreeList (All)
The number of frames added to the free list since the session (for Gems), shared page cache, or Stone started.
FramesFromFindFree (All)
The number of times the process acquired a page frame in the shared page cache by scanning the cache entries. The process tries to find free frames this way instead of taking them from the free list when the number free is below the value set by the GEM_FREE_FRAME_LIMIT configuration option. While scanning for free frames under those conditions is desirable from a system perspective, it represents additional overhead for the particular session.
FramesFromFreeList (All)
The number of times the process acquired a page frame in the shared page cache from the list of free frames.
FreeFrameCacheSize (All)
The number of frames that the process will add or remove from the shared free frame list in a single operation. A value of zero indicates that free frames are not cached and will be added or removed from the shared free frame list one at a time.
FreeFrameCount (SPC monitor)
The number of unused page frames in the shared page cache. This statistic gives some indication of the utilization of the cache, but it is not tunable. This statistic is valid (non-zero) only for the shared page cache monitor process slot.
FreeFrameLimit (All)
When the number of free frames in the shared page cache is less than the FreeFrameLimit, the Gem scans the cache for a free frame rather than use one from the free frame list, so that the Stone process can use the remaining free frames.
FreeOops (Stone)
FreeOopsK (Stone)
The number of free OOPs in the free list that have not been allocated to a Gem and committed. In some versions, in units of 1024.
FreePages (Stone)
The size of the free page pool for the repository. Free space in the repository is calculated at 16 KB (for GemStone/S 64 Bit) for each page in the free pool.
FreePagesPoolSize (Stone)
The number of pages in the freePool that the Stone maintains for its own use.
FreePceCacheEntries (All)
Number of free PCEs (Page Cache Entries) currently in the free PCE cache of the process. The capacity of the free PCE cache is equal to the capacity of the free frame cache.
GarbageCollectionState (Gem)
The state of a garbage collection task in the Admin GcGem or a user performing a garbage collection operation. Values are defined as follows:
0 - Garbage collection not active
7 - Write possible dead objects to tranlog
GcHighWaterPage (Stone)
The lowest page ID for which the GC reclaim gems will temporarily ignore because a garbage collection operation is in progress. Pages with IDs less than this value will be reclaimed normally. Page IDs equal to or greater than this value will not be reclaimed. The session performing the garbage collection will increase this value as the operation progresses
GciRpcKeepAlivePacketCount (Gem)
Number of keep-alive packets received from the GCI client on a remote host.
GciRpcLastCommandServiced (Gem)
The numeric identifier of the last command executed by this gem on behalf of its RPC client. Not used by linked gems.
GciRpcTimeInClientRequests (Gem)
Approximate total number of real milliseconds spent executing requests from the GCI client. Not used by linked gems.
GciRpcTimeInLastCommand (Gem)
Approximate number of real milliseconds spent executing the last command from this gem's RPC client. Not used by linked gems.
GcLockKind (Stone)
Indicates the state of the garbage collection lock and why it is being held:
GcVoteState (Stone)
GcVoteState tracks the progress of a number of phases within garbage collection. Possible values are:
1 - Processing possible dead symbols (in older versions: voting on possible dead set).
2 - Waiting for all gems to vote (in older versions: vote complete, waiting for WSUS).
3 - Gems have finished voting (in older versions:WSUS in progress).
4 - Write-set-union sweep in progress (in older versions: WSUS complete).
5 - Write-set-union sweep completed.
Note that all of these phases must complete before the PossibleDead objects can be “promoted” to DeadNotReclaimed objects. The Admin GcGem is responsible for performing the possible dead write set union sweep, and must be running for this to occur.
For details about the voting phase of garbage collection, refer to the System Administration Guide for your version of GemStone.
GcWsUnionSize (Stone)
The number of objects in the write set union used to finalize possible dead objects. All objects in the WSU must be scanned to determine if any objects reference one or more possible dead objects.
GcWsUnionSweepCount (Stone)
The total number of sweeps of the possible dead write set union that have been done by the Admin GcGem since it started.
GemsInCacheCount (SPC monitor)
The total number of Gems using the shared page cache whose process slot you are viewing. This is useful for distinguishing Gems using a local shared page cache from those using a remote shared page cache.
GemTempObjCacheSizeKb (Gem)
The value of the session's GEM_TEMPOBJ_CACHE_SIZE_KB configuration parameter.
GlobalDirtyPageCount (SPC monitor)
The total number of pages in the shared cache that are dirty but not yet eligible for asynchronous writing to the disk because they have not yet been committed. If this value is very large, then very large transactions may be filling the cache. Otherwise, if the Stone repository monitor is running on this cache, the Stone’s private page cache size may be too small. This statistic is available only for the shared page cache monitor’s slot (currently Slot 0).
GlobalStat00 — GlobalStat47 (Stone)
User-defined statistics that can be written and read by any Gem on any Gem server; that is, these statistics are stored in the shared page cache of the Stone, rather than that of the machine on which the Gem is running. There are 48 global cache statistic slots available.
GsMsgCount (Stone)
The number of messages processed by the Stone on behalf of Gems. This statistic can help determine how busy the Stone is.
GsMsgSessionId (Stone)
The session identifier of the Gem for which the Stone is currently processing a message.
IndexProgressCount (Gem)
Used to monitor the status of certain index operations:
1 - Identity index audit in progress.
2 - Equality index audit - auditing root terms.
3 - Equality index audit - auditing NSC counts.
4 - Equality index audit - auditing btree counts.
5 - IndexManager>>removeAllIndexes in progress.
The ProgressCount statistic is also used to indicate the progress of some of these operations. When it is used, it starts at the number of path terms to be checked and is decremented each time the audit of a path term has completed.
InvalidPagesWrittenByGem (SPC monitor)
InvalidPagesWrittenByStone (SPC monitor)
The number of invalid (i.e. empty) pages in the cache because of a write done by a Gem or by the Stone, respectively.
KernelFaultSleepTime (All, on Solaris only)
The number of milliseconds the process has been faulting in kernel pages.
LastCommandFromClient (Pgsvr)
The numeric index of the last message sent to the page server by its client.
LastCommitRecordReleaseReasonCode (Stone)
A code indicating the reason the stone released the commit record reference for a session as follows:
2 - Logout processing when the logout was not requested.
LastCommitRecordReleaseSessionId (Stone)
The session ID of the last session for which the stone released the commit record reference due to an abnormal event.
LastErrorNumber (Gem)
The number of the last error processed by the session. Fatal errors are not reported in this statistic.
LastMarkSweepReasonCode (Gem)
An internal code which indicates the reason for the last Mark/Sweep operation.
LastScavengeReasonCode (Gem)
An internal code which indicates the reason for the last scavenge operation.
LastSessionFatalError (Stone)
The session ID of the last session that reported a fatal error to the stone.
LastSessionIdStopped (Stone)
The session ID of the last session that was sent a stop session message.
LastSessionIdTerminated (Stone)
The session ID of the last session that was forcibly logged off by the stone.
LastSigTermGemPid (Stone)
The process ID of the last local session to which the stone sent a SIGTERM signal to the gem process.
LastSigTermGemSessionId (Stone)
The session ID of the last local session to which the stone sent a SIGTERM signal to the gem process.
LastSigTermPageServerSessionId (Stone)
The session ID of the last remote session to which the stone sent a SIGTERM signal to the page server process.
LastSigTermPgsvrPid (Stone)
The process ID of the last remote session to which the stone sent a SIGTERM signal to the page server process.
LastSleepTimeBetweenScans (SPC monitor)
Number of milliseconds the shared page cache monitor statistics thread slept after the last complete scan of the cache.
LastSleepTimeWithinScan (SPC monitor)
Number of milliseconds the shared page cache monitor statistics thread last slept while in the loop that computes cache statistics. The thread will sleep for a short interval each time it scans 100,000 cache frames.
LastSmcQueueSize (Stone)
The size of the SMC (Shared Memory Communication) queue when it was last processed by the stone.
LocalCacheAllocatedPceCount (Gem, Stone)
The number of page cache entries that the process has allocated for collision chains.
LocalCacheOverflowCount (Gem, Stone)
The number of times that a page was moved from private cache to the shared cache because the private cache was full.
LocalCachePceCountLimit (Gem, Stone)
The maximum number of page cache entries that the process will allocate before performing a reclaim.
LocalCachePceReclaimCount (Gem, Stone)
The number of page cache entry reclaim operations performed by the process.
LocalCacheStalePcesRemovedCount (Gem, Stone)
The number of stale page cache entries that the process has removed from its private page cache lookup table. Stale PCEs occur when a reference to page in the shared cache becomes invalid because the page is removed from the cache by another process.
LocalCacheValidPcesRemovedCount (Gem, Stone)
The number of valid page cache entries removed by a reclaim operation.
LocalDirtyPageCount (SPC monitor)
The total number of pages in the shared cache that are dirty and eligible for asynchronous writing to the disk. The Stone’s AIO page server will write these pages to the disk. This statistic is available only for the shared page cache monitor’s slot (currently Slot 0).
LocalPageCacheHits (All)
The number of times a page lookup found the page in the shared page cache. No I/O was required to access the page.
LocalPageCacheMisses (All)
The number of times a page was not found in the shared cache and a read operation was required to get the page.
LockReqQueueSize (Stone)
The number of Gem session processes waiting for a commit to complete so that their lock request can be serviced.
LockWaitQueueSize1 — LockWaitQueueSize10 (Stone)
The number of sessions waiting for the Application object lock with the given number. (System waitForApplicationWriteLock:queue:autoRelease:)
LockWaitSleepTime (All, on Solaris only)
The number of milliseconds the process has been waiting for a user lock.
LogHighQueueSize (Stone)
The number of sessions waiting for transaction log writing to be not saturated. This queue holds mostly committing sessions.
LoginLogFlushes (Stone)
Number of times the stone's login log thread has flushed writes to the login log file.
LogLowQueueSize (Stone)
The number of lower priority sessions waiting for transaction log writing to be not saturated. This queue holds primarily sessions logging resourceIds such as possibleDead or notDead.
LogRecordPagesWrittenByGem (SPC monitor)
LogRecordPagesWrittenByStone (SPC monitor)
The number of transaction log record pages in the cache because of a write done by a Gem or by the Stone, respectively.
LogRecordsIoCount (Stone)
The number of physical write operations performed on the transaction logs since the Stone repository monitor process was last started. The minimum write to a transaction log is 512 bytes (one log record). The maximum number of bytes written in a single I/O to the transaction log is 64K. The implication for performance tuning is that to achieve the best throughput (in transactions per second) you would like to have as few as possible writes to the transaction logs. The technique for achieving this is to tune the size of the transactions so that each transaction writes one or more completely filled 64K records.
LogRecordsWritten (Stone)
The number of log records that have been written to the transaction logs since the Stone repository monitor process was last started. The size of a log record is 512 bytes.
LogSenderBlockId (Stone)
The record ID of the last transaction log record read by the log sender process.
LogWaitQueueSize (Stone)
The size of the queue that holds sessions waiting for space to become available in a transaction log. This queue should be empty or nearly so unless the space for logging transactions has been exhausted.
LosOtDeferLastReason (Stone)
An integer value indicating the most recent reason deferred sending a LostOtRoot signal to a session. The codes are defined as follows:
0 - none - no LostOtRoot signals have been deferred.
1 - the session was executing a garbage collection primitive (markForCollection, etc).
2 - the session held the commit token or was waiting in the commit queue.
3 - the session was blocked on an internal stone queue.
4 - the session was waiting in the run queue or the SMC queue.
LostOtDeferCount (Stone)
The total number of times Stone has deferred sending a LostOtRoot signal to a session.
LostOtDeferLastSession (Stone)
The session ID of the last session for which the stone deferred the sending of a LostOtRoot signal.
LostOtPagesWrittenByGem (SPC monitor)
LostOtPagesWrittenByStone (SPC monitor)
The number of lost OT pages in the cache because of a write done by a Gem or by the Stone, respectively.
LostOtsSent (Gem)
The number of Lost OT Root signals the Stone has sent to this session, although the session may be in a sleep or I/O wait state and not yet aware of having received the signal. (See LostOtsReceived (Gem), above.)
LwpCurCount (All, on Solaris only)
The current number of light weight processes that exist in the process.
LwpTotalCount (All, on Solaris only)
The total number of light weight processes that have ever contributed to the process's statistics.
MainThreadTimeRunningMs (SPC monitor)
Approximate real time in milliseconds that the main shared page cache monitor thread has spent doing work.
MaxImageSize (All, on Linux only)
The maximum (high water) size of the process's image in kilobytes.
MaxVotingSessions (Stone)
Maximum number of sessions that can concurrently vote on possible dead objects at the end of an MFC (markForCollection) or Epoch garbage collection.
MeSpaceAllocatedKBytes (Gem)
(Only in 3.1.0.5)Memory allocated for remSet, in-memory oopMap and map entries, at end of mark/sweep. (31x)
MeSpaceAllocatedBytes (Gem)
The number of bytes allocated for remSet, in-memory oopMap, and map entries.
MeSpaceUsedKBytes (Gem)
Memory in use for remSet, in-memory oopMap and in-use map entries, at end of mark/sweep. (31x)
MeSpaceUsedBytes (Gem)
The number of bytes occupied by remSet, in-memory oopMap, and in-use map entries.
MessagesToStnProcessingCommit (Gem)
The number of messages sent to the Stone while the gem is processing its part of the commit.
MessagesToStnStoneCommit (Gem)
The number of messages sent to the Stone while the Stone is processing its part of the commit.
MessagesToStnWaitingForCommit (Gem)
The number of messages sent to the Stone while waiting for the commit token.
MessagesToStone (Gem, Pgsvr)
The number of messages sent from a session process to the Stone repository monitor.
MilliSecPerIoSample (All)
MilliSecPerIoSample is used as a parameter to implement the configurable I/O limit for GemStone processes. Because a process’s I/O rate currently is sampled every five I/O operations, this statistic is computed as 1000/(ioLimit ∗ 5). A value of 1 means that the process has no I/O limit. If the time in milliseconds since the last sample equals or exceeds MilliSecPerIoSample, the process can perform another I/O operation; if not, the process sleeps. MilliSecPerIoSample is particularly useful in limiting I/O rate of a process that is executing a long-running operation. If you want to calculate the current I/O limit, it is given by 1000/(MilliSecPerIoSample ∗ 5).
MinorFaults (All)
The number of times the process has had a page fault that did not need disk access.
MlLuCacheGrowCount (Gem)
Number of times that a per-class lookup cache was grown to larger table size.
MtActiveThreads (Gem)
The number of threads actively working on a multi-threaded task in a Gem executable.
MtMaxThreads (Gem)
The maximum number of threads currently configured for a multi-threaded task in a Gem executable. Set by the method that initiated the operation.
MtPercentCpuActiveLimit (Gem)
Can be set by a session to control the maximum number of active threads working on the task. Value must be between 0 and 100. When a non-zero value is set, the controller thread attempts to keep the percentCpuActive stat below this value by limiting the number of threads working on the task.
MtThreadsLimit (Gem)
Can be set by a session to control the maximum number of active threads working on the task. Must be less than or equal to MtMaxThreads.
MultObjPagesWrittenByGem (SPC monitor)
MultObjPagesWrittenByStone (SPC monitor)
The number of multiple object pages in the cache because of a write done by a Gem or by the Stone, respectively.
NetWriteThreadSocketWrites (Stone)
The number of socket write operations attempted in stone NetWrite thread.
NewGenSizeKBytes (Gem)
Used memory in the new generation at the end of mark/sweep or scavenge. (31x)
NewObjsCommitted (Gem)
The number of new objects committed by the most recent transaction committed by this process.
NewObjsCommittedNotLogged (Gem)
Number of newly created objects that were committed but not added to the tranlog because they are reachable from the NotTranloggedGlobals root object.
NewSymbolRequests (Gem)
The number of symbol creation requests by a session to the symbol creation Gem.
NextSleepTime (Pgsvr)
The number of milliseconds that the page server will sleep during the next sleep period. This value is adjusted to regulate the IO rate of the page server.
NumCacheWarmers (Stone)
The number of cache warmer gem processes currently operating on the shared cache.
NumEphemerons (Gem)
The number of live ephemerons remaining at the end of the last mark/sweep garbage collection.
NumInLoginLogQueue (Stone)
Number of sessions queued to have entries written to the stone's login log file.
NumInMainInpQueue (Stone)
The number of requests from other threads in the stone main thread input list.
NumInNetReadWorkList (Stone)
The number of tasks in the NetRead thread work list, produced by NetPoll action functions and not yet processed by the NetRead thread.
NumInNetWriteQueue (Stone)
The number of uncompleted requests in the input list to the stone NetWrite thread.
NumLiveSoftRefs (Gem)
The number of instances of SoftReference in temporary object memory found during an attempt to clear SoftReferences. This counter remains at zero until temporary object space grows to at least GEM_SOFTREF_CLEANUP_PERCENT_MEM.
NumNonNilSoftRefs (Gem)
The number of instances of SoftReference in temporary object memory with non-nil, non-special values, that were found during an attempt to clear SoftReferences. This counter remains at zero until temporary object space grows to at least GEM_SOFTREF_CLEANUP_PERCENT_MEM.
NumProcsSleepingForLock (SPC monitor)
Number of processes on this shared page cache that are currently sleeping while waiting to acquire a spin lock.
NumRefsStubbedMarkSweep (Gem)
The number of references contained in copies of committed objects that were stubbed (converted to a Pom objectId) by in-memory mark/sweep.
NumRefsStubbedScavenge (Gem)
The number of in-memory references that were stubbed (converted to a Pom objectId) by in-memory scavenge.
NumSoftRefsCleared (Gem)
The number of times that the in-memory garbage collector has cleared the value instance variable in instances of SoftReference.
NumVotingSessions (Stone)
The number of sessions that the stone has requested to vote on possible dead objects.
ObjectMemoryGrowCount (Gem)
On AIX and HPUX only, the number of times object memory was grown or shrunk by allocating a new virtual memory region with mmap(). Always zero on other platforms.
ObjectsRead (Gem)
The number of committed objects copied into VM memory since the start of this session.
ObjectsReadInBytes (Gem)
Total size in bytes of committed objects copied into VM memory since start of session.
ObjectsRefreshed (Gem)
The number of committed objects in VM memory that have been re-read from the page cache after transaction boundaries, since the start of this session.
ObjectTablePageReads (All)
The number of object table pages read by the process since it was last started. These page reads are actual disk reads and not reads from the shared page cache.
ObjsCommitted (Gem)
The number of objects committed by the most recent transaction committed by this process.
ObjsCommittedNotLogged (Gem)
The total number of objects (new and modified objects) reachable from the NotTranloggedGlobals root object which the session has committed.
OldestCrSession (Stone)
The session ID of a session referencing the oldest commit record. Note that more than one session may reference a commit record, which prevents it from being reclaimed. A value of 0 (in recent versions of GemStone/S 64 Bit) or -1 indicates that the oldest commit record is not referenced by any session.
OldestCrSessNotInTrans (Stone)
The session ID of a session that is not in a transaction that is currently referencing the oldest commit record, which may be preventing it from being reclaimed. Note that more than one session may reference a commit record. A value of 0 (in recent versions of GemStone/S 64 Bit) or -1 indicates that the oldest commit record is not referenced by any session.
OldGenPreGcSizeBytes (Gem)
OldGenPreGcSizeKBytes (Gem)
Used memory in the old generation at the start of mark/sweep. (2x, 31x)
OldGenSizeBytes (Gem)
OldGenSizeKBytes (Gem)
The number of used bytes in the old generation at the end of mark/sweep. In some versions, in units of 1024.
OmBytesFlushed (Gem)
OmKBytesFlushed (Gem)
The total number of temporary object memory bytes flushed to Pom during commit attempts for this session. In some versions, in units of 1024.
OopNumberHighWaterMark (Stone)
OopNumberKHighWaterMark (Stone)
The highest number of object identifiers allocated by the system. In some versions, in units of 1024.
OtherPageReads (All)
The number of pages read by the process that were not object table, data, or bitmap pages since the process was started. These page reads are actual disk reads and not reads from the shared page cache.
OtInternalPagesWrittenByGem (SPC monitor)
OtInternalPagesWrittenByStone (SPC monitor)
The number of object table internal pages in the cache because of a write done by a Gem or by the Stone, respectively.
OtLeafPagesWrittenByGem (SPC monitor)
OtLeafPagesWrittenByStone (SPC monitor)
The number of object table leaf pages in the cache because of a write done by a Gem or by the Stone, respectively.
PageDisposesDeferred (Stone)
The number of times a page disposal had to be deferred. This deferral can be caused by an asynchronous operation (checkpoint) being in progress on the page or by the page being attached or locked.
PageIoCount (All)
The number of page I/O (page read or page write) calls done by the process since it was last started. Each I/O call may read or write more than one page.
PageIoTimeOverallAvg (All)
The average duration of a page I/O (page read or page write) call in microseconds.
PageIoTime10SampleAvg (All)
The average duration of a page I/O (page read or page write) call in microseconds. The average is computed for the last ten I/O operations, and is updated every ten I/O operations.
PageIoTime100SampleAvg (All)
The average duration of an I/O call (page read or page write) in microseconds. The average is computed for the last 100 I/O operations, and is updated every ten I/O operations.
PageLocateCount (All)
The number of times that the process located a page. The page may have been read from disk or found in the cache.
PageManagerMaxWaitTimeMs (Stone)
Current value of the STN_PAGE_MGR_MAX_WAIT_TIME configuration option.
PageManagerStarvedCount (Stone)
Number of times the page manager session waited for service from the stone longer than STN_PAGE_MGR_MAX_WAIT_TIME milliseconds.
PageMgrCompressionEnabled (Stone)
A boolean value: true if the page manager session is compressing the list of pages that it sends to remote cache page servers, false otherwise.
PageMgrPageRemovalRetryCount (Stone)
Number of times the page manager session has retried removing one or more pages from the shared page caches because the first attempt to remove the pages failed.
PageMgrPagesNotRemovedFromCachesCount (Stone)
The total number of pages that the Page Manager was unable to remove from one or more shared page caches.
PageMgrPagesPendingRemovalRetryCount (Stone)
The current number of pages that could not be removed from shared page caches by the page manager on the first attempt and are waiting to be retried.
PageMgrPagesReceivedFromStoneCount (Stone)
The total number of pages that the Page Manager session received from the Stone to remove from shared page caches.
PageMgrPagesRemovedFromCachesCount (Stone)
The total number of pages that the Page Manager has successfully removed from all shared page caches.
PageMgrPrintTimeoutThreshold (Stone)
The time threshold in seconds used by the page manager to decide if a message should be printed to its log file indicating that a remote cache page server was slow to respond.
PageMgrRemoteCachePgsvrTimeout (Stone)
Number of seconds the page manager session will wait to receive a response from a remote cache page server.
PageMgrRemoveFromCachesCount (Stone)
The total number of times that the Page Manager has attempted to remove pages from shared page caches.
PageMgrRemoveFromCachesPageCount (Stone)
The total number of pages that the Page Manager has attempted to remove from shared page caches. This statistic includes pages processed by page removal retry operations, which occur whenever a page cannot be removed from a shared page cache on the first attempt.
PageMgrRemoveMaxPages (Stone)
The maximum number of pages the Stone will return to the page manager session in a single batch.
PageMgrRemoveMinPages (Stone)
The minimum batch size of pages that the page manager will process. The page manager will request pages to process from the Stone only if the Stone cache statistic PagesWaitingForRemovalInStoneCount exceeds this value.
PageMgrRemovePagesFromCachesPollCount (Stone)
The number of times that the Page Manager called poll() or select() to determine which cache page servers have completed removing pages from their shared caches. This statistic represents the value during the most recent page disposal operation and is not cumulative. It varies between zero (when there are no remote shared caches on the system) and the number of remote shared page caches.
PageMgrTimeWaitingForCachePgsvrs (Stone)
The total amount of real time in milliseconds that the page manager has spent waiting to receive data from remote cache page servers.
PageReads (All)
The number of pages read by the process since it was last started. These page reads are actual disk reads and not reads from the shared page cache. Note that a single operation may read more than one page.
PageReadsProcessingCommit (Gem)
The number of pages read while the Gem is processing its part of the commit.
PageReadsStoneCommit (Gem)
The number of pages read while the Stone is processing its part of the commit.
PageServersInCacheCount (SPC monitor)
The total number of page servers attached to the shared cache.
PagesNeedReclaimSize (Stone)
The amount of reclaim work that is pending, that is, the backlog waiting for the Reclaim GcGem to reclaim.
PagesNeedRemovingThreshold (Stone)
Threshold for page manager to process the backlog described by PagesWaitingForRemovalInStoneCount. (2x)
PagesNotFoundInCacheCount (SPC monitor)
The number of pages needing to be removed from the cache that were not found in the cache. This statistic is updated by the cache page server on remote caches, or by the page manager on the Stone’s shared page cache.
PagesNotRemovedFromCacheCount (Pgsvr)
The number of pages the page server was unable to remove from the cache. Requests to remove pages come from the stone. This statistic is updated by the cache page server on remote caches, or by the page manager on the Stone’s shared page cache.
PagesRemovedDirtyFromCacheCount (SPC monitor)
The number of pages successfully removed from the cache by the cache page server or the Page Manager at the Stone’s request. This statistic is updated by the cache page server on remote caches, or by the page manager on the Stone’s shared page cache.
PagesRemovedFromCacheCount (SPC monitor)
The total number of pages successfully removed from the cache by the cache page server or the Page Manager at the stone's request.
PagesWaitingForRemovalDeferred (Stone)
Number of deferred persistent pages waiting to be processed by the Page Manager gem.
PagesWaitingForRemovalInStoneCount (Stone)
The number of pages in the Stone that are waiting to be removed from the shared page cache by the Page Manager.
PagesWaitingForRemovalPersist (Stone)
Number of persistent pages waiting to be processed by the Page Manager gem.
PagesWaitingForRemovalTemp (Stone)
Number of temporary pages waiting to be processed by the Page Manager gem.
PageWaitQueueSize (Stone)
The size of the queue that holds sessions waiting to be allocated free pages. This queue should be empty or nearly so unless the repository is below its free space threshold.
PageWrites (All)
The number of pages written by the process since it was last started. These page writes are actual disk writes and not just writes into the shared page cache. Unless a large data load is in process, the number should be low for all processes except the Stone’s AIO page server process.
PcesAddedToFreeList (All)
Number of PCEs (Page Cache Entries) this process added to the free PCE list.
PcesRemovedFromFreeList (All)
Number of PCEs (Page Cache Entries) this process removed from the free PCE list.
PercentCpuUsed (All, on Linux and Solaris only)
PermGenObjsChanged (Gem)
Number of objects in perm gen that were changed by another process at the last transaction boundary.
PermGenObjsChangedTotal (Gem)
Total number of objects in perm gen that were changed by another process during the life of the session.
PermGenSizeBytes (Gem)
PermGenSizeKBytes (Gem)
The number of used bytes in the perm generation at the end of mark/sweep. Perm generation holds copies of Classes. In some versions, in units of 1024.
PersistentPagesCommittedCount (Gem)
The total number of pages made persistent (committed) by the session. This statistic is updated during commit processing.
PersistentPagesDisposed (Stone)
The number of persistent pages (pages already checkpointed) that have been disposed of while in the Stone’s private cache.
PgsvrWaitQueueSize (Stone)
The number of remote sessions in the Page Server Wait Queue. This queue is used to finalize sessions which are logging out.
PinnedPagesCount (All)
The number of pages the process has pinned (locked) in the shared cache. Pages may be pinned by more than one process at the same time.
PinnedPrivatePagesCount (All)
The number of pages that the process has pinned (locked) in its private page cache.
PomGenSizeBytes (Gem)
PomGenSizeKBytes (Gem)
The number of used bytes in the pom generation at the end of mark/sweep. Pom generation holds clean copies of committed objects. In some versions, in units of 1024.
PossibleDeadObjs (Stone)
PossibleDeadKobjs (Stone)
The number of objects previously marked as dereferenced in the repository, but for which sessions currently in a transaction might have created a reference in their object space. An object is not declared (“promoted to”) dead until each active session verifies the absence of such references during its next commit or abort. In some versions, in units of 1024.
PossibleDeadSymbols (Stone)
The number of symbols found to be not referenced in a markForCollection.
PostCheckpointPages (Pgsvr)
The count of pages written out by the page server during post-checkpoint processing.
PreemptedBitmapPages (Pgsvr)
The number of bitmap pages removed from the shared page cache by this page server.
PreemptedCommitRecordPages (Pgsvr)
The number of commit record pages removed from the shared page cache by this page server.
PreemptedDataPages (Pgsvr)
The number of data pages removed from the shared page cache by this page server.
PreemptedObjectTablePages (Pgsvr)
The number of object table pages removed from the shared page cache by this page server.
PreemptedOtherPages (Pgsvr)
The number of pages removed from the shared cache by this page server that were not data, object table, commit record, or bitmap pages.
PrimitiveNumber (Gem)
The primitive number currently being executed by the session, or 0 if the session is not in a primitive. The session only sets this value for long-running primitives. A non-zero value also indicates the session is immune from termination due to the STN_GEM_TIMEOUT mechanism.
Note: the PrimitiveNumber stat is set to 9999 if the session has executed System class >> disableStoneGemTimeout
ProcessesWaitingForQueueLocks (SPC monitor)
Number of processes attached to the shared cache that are spinning while attempting to acquire a queue lock.
ProcessId (All)
The operating system processId for the process associated with this shared page cache process slot.
ProcessName (All)
This statistic identifies the process kind (Gem, Stone, page server, or shared page cache monitor).
ProgressCount (Gem)
ProgressKobjs (Gem)
You can use this statistic to monitor the progress of certain Repository methods that may run for extended periods.
- During objectAudit, ProgressCount is set to the number of live data pages at end of the object table scan, then decremented as data pages are scanned.
- During _findPagesContainingOops:, ProgressCount is set to the total number of pages in the repository and decremented as pages are processed.
- During markForCollection, ProgressCount is incremented as live objects are marked during the marking phase, reset to zero, and incremented as possible dead objects are computed.
- During epoch garbage collection, ProgressCount is incremented as live objects within epoch are marked, then reset to zero.
- During fullBackupTo: and restoreFromBackup:, ProgressCount tracks the number of objects written to or restored from the backup file(s).
- During objectAudit, ProgressCount is incremented as the object table is scanned, then decremented as data pages are scanned.
- While reading and writing an FDC file of OOPs, ProgressCount is incremented as OOPs are read or written.
RcRetryQueueSize (Stone)
The number of sessions waiting for the RcRetry object lock. (System waitForRcWriteLock:)
RebuildScavPagesForCommitCount (Gem)
The total number of times the gem rebuilt its list of scavengeable pages while processing a commit.
RecentActiveProcessCount (SPC monitor)
The number of active processes attached to the shared page cache. This statistic is computed every half second and has decays quickly.
ReclaimCount (Stone)
The number of reclaims performed by a Reclaim GcGem process since the Stone repository monitor was last started.
ReclaimedPagesCount (Stone)
The number of pages reclaimed by a Reclaim GcGem process since the Stone repository monitor process was last started. The count indicates the number of pages that have been or will soon be placed back into the repository’s pool of free pages.
ReclaimedSymbols (Stone)
The number of symbols that have been reclaimed since the stone was started.
RecoverFreeFrameWaitTime (Stone)
The time in seconds spent by the main recovery thread waiting for free frames in the shared page cache. Recovery performance may be improved by increasing the size of the shared page cache.
RecoverNumBufsForSessions (Stone)
The number of logEntryBuffers used to hold records for sessions not yet committed.
RecoverReadThreadWaitTime (Stone)
The time in seconds that the reader thread spent waiting for the main recovery thread to catch up processing the log buffers.
RecoverReclaimOopsWaitTime (Stone)
The time in seconds spent by the main recovery thread waiting for oops to be reclaimed. Recovery performance may be improved by adding more reclaim gems.
RecoverTimeLag (Stone)
The difference in commit time (restoreLogCommitTime - originalCommitTime), gives a relative idea of how hot a hot standby is.
RecoverTranlogBlockId (Stone)
The block ID of the transaction log currently being replayed during system recovery or restore.
RecoverTranlogFileId (Stone)
The file ID of the transaction log currently being replayed during system recovery or restore.
RejectedProcsCount (SPC monitor)
The total number of processes which attempted to connect to the shared page cache but were rejected because the maximum number of processes had already attached.
RemoteCachesNeedServiceCount (Stone)
The number of remote caches that require service from the Page Manager. Caches need service when they are starting or shutting down.
RemoteSharedPageCacheCount (Stone)
The total number of remote shared page caches attached to the system.
RemoteSharedPageCacheMax (Stone)
Current setting of the STN_MAX_REMOTE_CACHES configuration parameter
RepBkupRestPagesWrittenByGem (SPC monitor)
RepBkupRestPagesWrittenByStone (SPC monitor)
These statistics are obsolete; the page kind is no longer used.
ResponsesSentEarly (Stone)
Number of times the stone was able to send a response to the client gem or page server without using the semaphore.
ResponsesSentNormal (Stone)
Number of times the stone sent a response to the client gem or page server using the semaphore.
Root40PagesWrittenByGem (SPC monitor)
Root40PagesWrittenByStone (SPC monitor)
The number of root 4.0 pages in the cache because of a write done by a Gem or by the Stone, respectively.
RootPagesWrittenByGem (SPC monitor)
RootPagesWrittenByStone (SPC monitor)
The number of root pages in the cache because of a write done by a Gem or by the Stone, respectively.
RSSData (All, on Linux only)
On Linux, the data resident set size. On other platforms, the combined data and stack resident set size.
RSSKBytes (All, on Linux and Solaris only)
RunQueueSize (Stone)
The number of Gem session processes waiting for service from the Stone repository monitor.
SamplesSkipped (Statmonitor)
Number of times statmonitor did not record statistics as a scheduled point in time.
ScavengeOverflows (Gem)
Number of times an in-memory GC scavenge operation could not be completed because old space was full. The scavenge will be promoted to a mark/sweep GC.
ScavsPromToMkSwCount (Gem)
Number of times a scavenge operation was promoted to a Mark/Sweep operation.
SessionPerformingBackup (Stone)
The session ID of the session that is performing a full backup; 0 if a full backup is not in progress.
SessionStat00 — SessionStat47 (Gem)
These are computed by user code to define statistics associated with a session. There are 48 session cache statistic slots available.
SessionWithGcLock (Stone)
The sessionId of the session holding the GcLock. A value of 1 indicates that the lock is held by Stone recovery or restore; 0 means that the lock is not issued.
ShadowedPagesCount (Gem)
The number of data pages added to the reclaim list due to commits by this Gem. This statistic is only updated during a commit.
SigAbortsReceived (Gem)
The number of times the Stone has signaled this session to abort, that it has received and recognized.
SigAbortsSent (Gem)
The number of times the Stone has signaled this session to abort, although the session may be in a sleep or I/O wait state and not yet aware of having received the signal. (See SigAbortsReceived (Gem), above.)
SignalsReceived (All, on AIX and Solaris only)
The total number of operating system signals this process has received.
SleepDuringDisposeTempPageCount (Gem)
Total number of times the Gem slept while waiting to dispose of a temporary page. Each tick of the counter represents 5 milliseconds of sleep. If you encounter excessive counts, please report them to GemStone Technical Support.
SlotsCrashedCount (SPC monitor)
The total number of slots for which the shared cache monitor has attempted recovery because a client process shutdown abnormally.
SlotsTotalCount (SPC monitor)
The maximum number of processes that can concurrently attach to the shared page cache.
SpinLockCount (SPC monitor)
The current setting of the SHR_SPIN_LOCK_COUNT parameter. It determines how many times a process will attempt to acquire a spin lock before sleeping on a semaphore.
SpinLockFreeFrameSleepCount (SPC monitor)
The number of times the process was forced to sleep on a semaphore while attempting to acquire the free frame list spin lock.
SpinLockFreePceSleepCount (SPC monitor)
The number of times the process was forced to sleep on a semaphore while attempting to acquire the free page cache entry spin lock.
SpinLockHashTableSleepCount (SPC monitor)
The number of times the process was forced to sleep on a semaphore while attempting to acquire a hash table spin lock.
SpinLockNewSymSleepCount (SPC monitor)
The number of times a process was forced to sleep on a semaphore waiting for the NewSymbols spinLock.
SpinLockOtherSleepCount (SPC monitor)
The number of times the process was forced to sleep on a semaphore while attempting to acquire a shared counter spin lock.
SpinLockPageFrameSleepCount (SPC monitor)
The number of times the process was forced to sleep on a semaphore while attempting to acquire a page frame spin lock.
SpinLockSmcQSleepCount (SPC Monitor)
Number of times a session was forced to sleep on a semaphore waiting for the Smc spinLock. The SMC queue allows sessions to communicate with the Stone via shared memory. (2x)
StatsThreadTimeRunningMs (SPC monitor)
Approximate real time in milliseconds that the statistics thread in the shared page cache monitor has spent doing work.
StnAioCompleted1Suspend (Stone)
Number of AIO requests completed after one call to aio_suspend(). (2x)
StnAioCompletedNoSleep (Stone)
Number of AIO requests that were completed without sleeping. The AIO thread in stone will sleep for a short time if aio_suspend() returns prematurely several times. (2x)
StnAioCompletedNoSuspend (Stone)
Number of AIO requested completed without calling aio_suspend(). (2x)
StnAioCompletionFailures (Stone)
The number of aio_write() operations for which either aio_error() or aio_return() reported that the AIO failed.
StnAioLastSuspendCount (Stone)
Number of times that aio_suspend() was called to complete the last AIO request. (2x)
StnAioMainTimeInAioWrite (Stone)
Total real time in milliseconds that the main thread spent executing the aio_write() call. aio_write() is used to initiate asynchronous writes to the tranlog and should not block.
StnAioNumWriteThreads (Stone)
Value of the STN_NUM_AIO_WRITE_THREADS Stone configuration parameter, which determines how many threads are dedicating to writing to the tranlog.
StnAioSuspendPrematureReturn (Stone)
Total number of times the aio_suspend() call indicated an AIO completed, but the aio_error() call returned EINPROGRESS, indicating the AIO is not complete. (2x)
StnAioSuspendTimeoutCount (Stone)
Total number of times the aio_suspend() timer expired because no completed AIO requests were found. (2x)
StnAioSyncWritesAfterCancel (Stone)
Total number of times the AIO wait thread performed a blocking write because an async IO was cancelled. (2x)
StnAioTimeInFsyncMs (Stone)
Number of real milliseconds the AIO wait thread in stone spent blocked by the fsync() call when flushing data to the tranlog.
StnAioTotalSleepCount (Stone)
Total number of times the AIO wait thread in stone went to sleep while waiting for an AIO to complete. (2x)
StnAioWaitLastTime (Stone)
Time in microseconds that it took the AIO thread to complete the last AIO request. (2x)
StnAioWaitsForWork (Stone)
The number of times the Stone’s AIO wait thread waited on semaphore for more work.
StnAioWaitTotalTime (Stone)
Approximate total real time in milliseconds that the AIO wait thread spent waiting for asynchronous I/O requests to complete.
StnAioWriteEAGAIN (Stone)
Total number of times the aio_write() call returned a status of EAGAIN to the main thread in stone. (2x)
StnAioWriteFailures (Stone)
The number of aio_write() calls by the Stone main thread which failed with other than EAGAIN. Stat should normally be zero.
StnAioWriteThreadsIdle (Stone)
Number of tranlog write threads in the Stone process that are currently idle.
StnCrBacklogThreshold (Stone)
Current setting of the STN_CR_BACKLOG_THRESHOLD Stone configuration parameter.
StnGetLocksCount (Stone)
The total number of times the Stone retrieved the lock set and passed it to a remote gem.
StnLoopCount (Stone)
The total number of times the Stone has executed its service loop. If this number remains unchanged for a significant period (for example, ten seconds or so), the Stone has hung.
StnLoopHibernateCount (Stone)
The total number of times the Stone went to sleep waiting for a network event to occur. This state occurs when StnLoopState is set to 17.
StnLoopNoWorkThreshold (Stone)
Current setting of the STN_LOOP_NO_WORK_THRESHOLD stone configuration parameter.
StnLoopsNoWork (Stone)
Number of times the stone has executed its main service loop and found no work to perform. This counter is reset to zero each time the stone performs work.
StnLoopsSinceSleep (Stone)
Number of times the stone has executed its main service loop since sleeping. This counter is reset to zero each time the stone sleeps while waiting for work.
StnLoopState (Stone)
An integer that identifies where, in the Stone control loop, the Stone process is currently executing. For a meaningful statistic, set your sample rate to faster than a second. For state definitions, consult GemStone technical support.
StnMainWaitsForFreeAio (Stone)
The number of times the stone main thread waited for free AIO buffers to become available.
StnMessagesNeedWakeUpCount (Stone)
Number of requests sent to the stone when the stone was sleeping and was awoken.
StnMessagesNoWakeUpCount (Stone)
Number of requests sent to the stone when the stone was already awake.
StnRemoteCachePgsvrTimeout (Stone)
Current value of the STN_REMOTE_CACHE_PGSVR_TIMEOUT stone configuration parameter. (2x)
StnSmcSpinLockCount (Stone)
Current value of the STN_SMC_SPIN_LOCK_COUNT stone configuration parameter.
StnTranQToRunQThreshold (Stone)
Current setting of the STN_TRAN_Q_TO_RUN_Q_THRESHOLD stone configuration parameter.
StoneCommitState (Stone)
This internal statistic is used to determine the state of the Stone’s commit processing.
SwapCount (All, on AIX and Solaris only)
The number of times the process swapped out of memory to disk.
SymbolCreationQueueSize (Stone)
The number of sessions waiting for a Symbol creation request to be processed.
SystemClockStuckCount (Statmonitor)
Number of time the system returned the same timestamp consecutively.
SysTime (All)
The number of milliseconds the process has been using the CPU to execute system calls.
TargetFreeFrameCount (SPC monitor)
The minimum number of unused page frames the free frame page server(s) will attempt to keep in the cache. The free frame count can still fall below this value if the cache contains mostly dirty pages, which free frame page servers cannot preempt.
TargetPercentDirty (Pgsvr)
The percent of dirty pages that AIO page servers try to maintain in the shared cache. If the dirty pages are below this target then the I/O rate will be limited on the next scan. If the dirty pages are above this target then the I/O rate will be set to AioRateMax.
TempObjSpacePercentUsed (Gem)
The approximate percentage of the total reserved temporary object memory for this session which is in use. Sessions are likely to encounter an out of memory error if this value approaches or exceeds 100%. This statistic is only updated at the end of a mark/sweep operation.
TempPagesDisposed (Stone)
The number of temporary pages (pages allocated since the last checkpoint) that have been disposed.
TextFaultSleepTime (All, on Solaris only)
The number of milliseconds the process has been faulting in text pages.
ThreadCount (All, on AIX and Linux only)
Number of threads currently active in this process. An instruction is the basic unit of execution in a processor, and a thread is the object that executes instructions. Every running process has at least one thread.
TimeInCommitRecordDisposal (Stone)
The total amount of real time in milliseconds that the Stone has spent disposing commit records. Commit records disposed during repository startup are not included in this statistic.
TimeInFramesFromFindFree (All)
The cumulative number of milliseconds that the Gem or Stone has spent scanning the shared page cache for a free frame since the session (for Gems) or Stone started.
TimeInGetPagesForPageMgr (Stone)
Real time in milliseconds spent by the stone processing requests from the page manager session for lists of pages to remove from shared page caches.
TimeInMarkSweep (Gem)
The real time in milliseconds spent in in-memory garbage collector mark/sweeps.
TimeInPgsvrNetReads (Stone, Gem)
The cumulative amount of real time in milliseconds that a session or Stone has spent reading network data from a page server.
TimeInPgsvrNetWrites (Stone, Gem)
The cumulative amount of real time in milliseconds that a session or Stone has spent writing network data to a page server.
TimeInProcessPagesFromPageMgr (Stone)
Real time in milliseconds spent by the stone processing the list of pages from the page manager session which were removed from shared page caches.
TimeInStnGetLocks (Stone)
The total time spent by the Stone retrieving the lock set and passing it to a remote gem.
TimeInStonePageDisposal (Stone)
The elapsed real time in milliseconds the Stone spent performing page disposal operations.
TimeInUpdateUnionsCommit (Gem)
The total real time the gem spent updating its unions while waiting for the commit token.
TimeInUserActions (Gem)
Approximate total number of real milliseconds spent executing user action code.
TimeInWaitsForOtherReaders
The real number of milliseconds the process spent waiting for the read of another process to complete.
TimeLastEpochGc (Stone)
Time the last epoch garbage collection operation was completed by the Admin GcGem, expressed in seconds since January 1, 1970, 00:00:00 UTC.Time to end of the currently open epoch is computed from here.
TimePerformingCommit (Stone)
The number of milliseconds of real time the Stone has spent performing commit processing, not including time taken by asynchronous writes to the transaction log.
TimePerformingReadIo (Pgsvr)
The total amount of real time in milliseconds the page server has spent reading pages from disk.
TimePerformingReadRequests (Pgsvr)
The total amount of real time in milliseconds the page server has spent performing read requests for its client. This statistic includes time reading pages from disk and time searching the shared page cache for pages.
TimeProcessingCommit (Gem)
The cumulative amount of time in milliseconds that the Gem session process has spent doing the processing for commits while it has the commit token.
TimeStoneCommit (Gem)
The cumulative amount of time in milliseconds that the Gem session process has waited for the Stone repository monitor to complete commits by this session.
TimeWaitingForCommit (Gem)
The cumulative amount of time in milliseconds that the Gem session process has spent waiting for its turn to commit, that is, the time waiting for the commit token and the Stone’s processing time for serialization.
TimeWaitingForIo (All)
The total real time in milliseconds that the process has spent waiting for I/O calls that read or write pages to complete. Only page I/O is included in this statistic. Other types of I/O (such as transaction log writes by the Stone process) are not included.
TimeWaitingForStone (Gem, Pgsvr)
The total time the session spent waiting for a response from the Stone.
TimeWaitingForSymbols (Gem)
Cumulative elapsed time in milliseconds waiting for symbol creation requests to be processed.
TimeWritingStats (Statmon)
The elapsed time in milliseconds that the statmonitor spent collecting and writing the statistics.
TotalAborts (Stone)
The number of abort operations, including read-only commits, performed system-wide since the Stone was started.
TotalBmPageReads (SPC Monitor)
Total number of bitmap pages read by all processes currently attached to the shared page cache.
TotalCommits (Stone)
The total number of commits (excluding read-only commits) performed by all processes since the Stone repository monitor was last started.
TotalDataPageReads (SPC Monitor)
Total number of data pages read by all processes currently attached to the shared page cache.
TotalFramesAddedToFreeList (SPC Monitor)
TotalKFramesAddedToFreeList (SPC Monitor)
Total number of frames added to the free list by all processes currently attached to the shared page cache. In some versions, in units of 1024.
TotalFramesFromFindFree (SPC Monitor)
Total number of frames found by scanning the cache for all processes currently attached to the shared page cache.
TotalFramesFromFreeList (SPC Monitor)
TotalKFramesFromFreeList (SPC Monitor)
Total number of frames taken from the free list by all processes currently attached to the shared page cache. In some versions, in units of 1024.
TotalFramesFromFreeList (SPC monitor)
Total number of frames taken from the free list by all processes currently attached to the shared page cache.
TotalFramesInFreeFrameCaches (SPC monitor)
Total number of free frames present in the free frame caches of all processes currently attached to the shared page cache.
TotalLocalPageCacheHits (SPC Monitor)
TotalLocalPageCacheKHits (SPC Monitor)
Total number of local page cache hits for all processes currently attached to the shared page cache. In some versions, in units of 1024.
TotalLocalPageCacheMisses (SPC Monitor)
TotalLocalPageCacheKMisses (SPC Monitor)
Total number of local page cache misses for all processes currently attached to the shared page cache. In some versions, in units of 1024.
TotalMiscPageReads (SPC Monitor)
Total number of miscellaneous pages read by all processes currently attached to the shared page cache.
TotalOtherPages (SPC monitor)
Total number of pages present in the shared page cache which are of a page kind other than object table, data, bitmap or commit record.
TotalOtPageReads (SPC Monitor)
Total number of object table pages read by all processes currently attached to the shared page cache.
TotalPageReads (SPC Monitor)
Total number of pages read by all processes currently attached to the shared page cache.
TotalPageWrites (SPC Monitor)
Total number of pages written by all processes currently attached to the shared page cache.
TotalPcesAddedToFreeList (SPC Monitor)
TotalKPcesAddedToFreeList (SPC Monitor)
Total number of PCEs (Page Cache Entries) added to the free list by all processes currently attached to the shared page cache. In some versions, in units of 1024.
TotalPcesInFreePceCaches (SPC Monitor)
Total number of free PCEs (Page Cache Entries) present in the free PCE caches of all processes currently attached to the shared page cache.
TotalPcesRemovedFromFreeList (SPC Monitor)
TotalKPcesRemovedFromFreeList (SPC Monitor)
Total number of PCEs (Page Cache Entries) removed from the free list by all processes currently attached to the shared page cache. In some versions, in units of 1024.
TotalProcsInCacheCount (SPC monitor)
he total number of processes currently connected to the cache, including crashed processes that have not yet had their cache slot recovered.
TotalSessionsStopped (Stone)
The total number of stop session requests initiated by a gem or by the stone.
TotalSigAbortsSent (Stone)
Total number of SigAbort signals the stone has sent to sessions since the stone has been running.
TotalSigTermsSentToGems (Stone)
Total number of times the stone has sent a SIGTERM signal to a gem process.
TotalSigTermsSentToPageServers (Stone)
Total number of times the stone has sent a SIGTERM signal to a page server process.
TotalWaitsForOtherReader (SPC Monitor)
Total number of PageRead operations avoided by all processes currently attached to the shared page cache.
TotEphemeronsFired (Gem)
Total number of ephemerons whose key has been garbage collected. Only updated at the end of a mark/sweep GC.
TranlogFileId (Stone)
The file id of the transaction log to which the most recent tranlog entry was written.
TranlogKBytesWritten (Gem)
Total number of KB written to the tranlog by stone on behalf of this session.
TranlogRecordKind (Gem)
The kind of tranlog record last written to the tranlog by stone on behalf of this session.
TranlogRecordsWritten (Gem)
Total number of physical tranlog records written to the tranlog by stone by this session.
TranlogsFull (Stone)
A flag indicating if all configured tranlog partitions or directories are full; 1 means full.
TransactionLevel (Gem)
Indicates if the session is in a transaction. Possible values are:
1 indicates the session is in a transaction.
0 indicates that the session is not in a transaction, but allows a consistent view for
reads. Session is subject to sigAbort or lostOT
TteCrPageFreeCount (Stone)
Total number of free commit record page entries in the stone's internal commit record cache.
TteCrPageFreePoolSize (Stone)
Total number of commit record page entries allocated in the stone's internal commit record cache.
UpdateUnionsCommitCount (Gem)
The total number of times the gem updated its unions while waiting for the commit token. This count will be at least one for every commit.
VolCSW (All)
The number of voluntary context switches done by the process. Note that this counter is always 0 on HP-UX.
VoteNotDead (Gem)
The number of objects that the Gem process removed from the possible dead set the last time that it voted on the possible dead.
VoteNotDeadObjs (Stone)
VoteNotDeadKobjs (Stone)
The total number of objects that have been voted 'not-dead' by all Gem processes thus far in the voting cycle. In some versions, in units of 1024.
WaitCpuTime (All, on Solaris only)
The number of milliseconds the process has been waiting for a CPU due to latency.
WaitingForSessionToVote (Stone)
The sessionId of a session which the system is waiting for to complete the voting on possible dead objects. A zero value indicates that it is not waiting.
WaitsForOtherReader (All)
The number of PageRead operations avoided by waiting for read already in progress by another process.
WorkingSetClearedCount (Gem)
Number of times the working set was cleared at a transaction boundary because a large number of objects in the working set were changed by another session.
WorkingSetObjsChanged (Gem)
Number of objects in the working set that were changed by another process at the last transaction boundary.
WorkingSetObjsChangedTotal (Gem)
Total number of objects in the working set that were changed by another process during the life of the session.
4.2 System Statistics on Linux
This section lists statistics that are generated when statmonitor on Linux is started using options that specify to include system statistics.
Note
The set of system statitics that can be collected varies by server product and version. Not all statistics may be generated by statmonitor in any particlar version of GemStone.
ActiveMemoryKB
The amount of memory that has been used more recently and usually not reclaimed unless absolutely necessary.
AllocatedSwapKB
The number of kilobytes of swap space have actually been written to. Swap space must be reserved before it can be allocated.
CommittedAsKB / CommittedASKB
The amount of memory presently allocated on the system, including memory allocated by processes that has not yet been used.
HugePagesRsvdKB
The amount of memory in the huge pages pool for which a commitment to allocate from the pool has been made, but no allocation has yet been made.
HugePagesSurpKB
The amount of memory in the huge pages pool above the value in /proc/sys/vm/nr_hugepages.
InactiveMemoryKB
The amount of memory which has been less recently used. It is more eligible to be reclaimed for other purposes.
KernelDataReclaimableMemoryKB
The amount of memory used by the kernel for caching data structures that may be reclaimed.
KernelDataUnreclaimableMemoryKB
The amount of memory used by the kernel for caching data structures that cannot be reclaimed.
LockedMemoryKB
The amont of memory that has been locked using mlock(2) or similar calls. Locked memory cannot be swapped.
NfsUnstableMemoryKB
The amount of memory used by NFS pages sent to the server, but not yet committed to stable storage.
PacketsOutboundDiscarded
The number of outbound packets that were chosen to be discarded even though no errors had been detected to prevent their being transmitted. One possible reason for discarding such a packet could be to free up buffer space.
PacketsOutboundErrors
The number of outbound packets that could not be transmitted because of errors.
PacketsReceivedErrors
The number of inbound packets that contained errors preventing them from being deliverable to a higher-layer protocol.
PercentCpuActive
The percentage of the total available time that has been used to execute user or system code.
PercentCpuIOWait
The percentage of the total available time that has been spent waiting for disk I/O to complete.
PercentCpuNice
The percentage of the total available time that has been used to execute user code in low priority mode.
PercentCpuOther
The percentage of the total available time that has been used to execute tasks which do not belong to any other category.
PercentCpuSystem
The percentage of the total available time that has been used to execute system (i.e. kernel) code.
Processes
The number of processes in the computer at the time of data collection. Notice that this is an instantaneous count, not an average over the time interval. Each process represents the running of a program.
4.3 System Statistics on Solaris
This section lists statistics that are generated when statmonitor on Solaris on SPARC or Solaris on x86 is started using options that specify to include system statistics.
Note
The set of system statitics that can be collected varies by server product and version. Not all statistics may be generated by statmonitor in any particlar version of GemStone.
ActiveQueueLength
The average number of operations being performed on a system I/O device.
Operations go into the active queue when they are taken from the wait queue because the system bus and device are ready. They leave it when the device completes the operation.
ActiveQueueResponseTime
The average milliseconds and operation stays in the queue. Its calculated by dividing the queue length by total number of operations taken out of the queue.
Operations go into the active queue when they are taken from the wait queue because the system bus and device are ready. They leave it when the device completes the operation.
ActiveQueueServiceTime
The average active queue service time in milliseconds. Its calculated by dividing the time the queue was busy by total number of operations taken out of the queue.
Operations go into the active queue when they are taken from the wait queue because the system bus and device are ready. They leave it when the device completes the operation.
ActiveQueueUtilization
A percentage that represents how much of the queue is being used. Its calculated by dividing the time the queue was busy by the total time available.
Operations go into the active queue when they are taken from the wait queue because the system bus and device are ready. They leave it when the device completes the operation.
AllocatedSwap
The number of megabytes of swap space have actually been written to. Swap space must be reserved before it can be allocated.
AnonymousPagesFreed
The total number pages that contain heap, stack, or other changeable data that have been removed from memory and added to the free list.
AnonymousPagesPagedIn
The total number pages that contain heap, stack, or other changeable data that have been allocated in memory and possibly copied from disk.
AnonymousPagesPagedOut
The total number pages that contain heap, stack, or other changeable data that have been removed from memory and copied to disk.
ConnectionFailures
The total number of times TCP connections failed to be established. At the lowest level this means that they have made a direct transition to the CLOSED state from the SYN-SENT state or the SYN-RCVD state, or a direct transition to the LISTEN state from the SYN-RCVD state.
ConnectionsActive
The total number of times a client socket has explicitly connected to a listening server socket.At the lowest level this means that a socket has made a direct transition to the SYN-SENT state from the CLOSED state.
ConnectionsEstablished
Current number of established TCP socket connections on the machine. At the lowest leve this means that a socket's current state is either ESTABLISHED or CLOSE-WAIT.
ConnectionsPassive
The total number of times a listening server socket has accepted a connection from a client. At the lowest level this means that a socket has made a direct transition to the SYN-RCVD state from the LISTEN state.
ConnectionsReset
The total number of times established TCP connections have been closed.At the lowest level this means a direct transition to the CLOSED state from either the ESTABLISHED state or the CLOSE-WAIT state.
CopyOnWriteFaults
The total number of times a private copy of a shared page needed to be made due to a write to the shared page.
ExecPagesFreed
The total number readonly pages that contain code or data that have been removed from memory and returned to the free list.
ExecPagesPagedIn
The total number readonly pages that contain code or data that have been copied from disk to memory.
ExecPagesPagedOut
The total number readonly pages that contain code or data that have been removed from memory and will need to be paged in when used again.
FailedMutexEnters
The total number of times a thread entering a mutex had to wait for the mutex to be unlocked.
FailedReaderLocks
The total number of times readers failed to obtain a readers/writer locks on their first try. When this happens the reader has to wait for the current writer to release the lock.
FailedWriterLocks
The total number of times writers failed to obtain a readers/writer locks on their first try. When this happens the writer has to wait for all the current readers or the single writer to release the lock.
FileSystemPagesFreed
The total number of pages, that contained the contents of a file due to the file being read from a file system, that have been removed from memory and put on the free list.
FileSystemPagesPagedIn
The total number of pages that contain the contents of a file due to the file being read from a file system.
FileSystemPagesPagedOut
The total number of pages, that contained the contents of a file due to the file being read from a file system, that have been removed from memory and copied to disk.
HalfOpenDrops
The total number of half open connections dropped. Non-zero values usually indicate a SYN flood attack.
HalfOpenQueueFull
The total number of connection refused due to the help open listen queue (q0) being full.
HATMinorFaults
The total number of hat faults. You only get these on systems with software memory management units.
InterruptsAsThreads
The total number of interrupts as threads. This does not include clock interrupts.
KeepAliveProbes
The total number of times a probe needed to be sent out due to a keep alive timer expiring.
MajorPageFaults
The total number of times a page fault required disk io to get the page. A page fault occurs when a process refers to a virtual memory page that has been paged out.
PageFreeReclaims
The total number of page reclaims done from the free list. These reclaims are much cheaper than those that need to go to disk.
PageIns
The total number of times pages have been brought into memory from disk by the operating system's memory manager.
PageOuts
The total number of times pages have been flushed from memory to disk by the operating system's memory manager.
PageReclaims
The total number of page reclaims; both from the free list and from disk. Page reclaims are caused by a reference to a page that has been stolen from a process by the page daemon.
PagesFreedAutomatically
The total number of pages that have been added to the free list be either the pager daemon or automatically.
PagesPagedIn
The total number of pages that have been brought into memory from disk by the operating system's memory manager.
PagesPagedOut
The total number of pages that have been flushed from memory to disk by the operating system's memory manager.
PagesScanned
The total number pages examined by the pageout daemon. When the amount of free memory gets below a certain size, the daemon start to look for inactive memory pages to steal from processes. A high scan rate is a good indication of needing more memory.
PagesSwappedIn
The total number of swapped out pages that have been brought back into memory from disk.
PagesSwappedOut
The total number of pages that have been moved from memory to disk due to a swap out operation.
PercentCpuActive
The percentage of the total available time that has been used to execute user or system code.
PercentCpuIOWait
The percentage of the total available time that has been spent waiting for disk I/O to complete.
PercentCpuSwapWait
The percentage of the total available time that has been spent waiting for paging and swapping to complete.
PercentCpuSystem
The percentage of the total available time that has been used to execute system (i.e. kernel) code.
PercentCpuWaiting
The percentage of the total available time that has been spent waiting for I/O, paging, or swapping.
PhysicalBlockWrites
The total number of physical block I/O write operations, both synchronous and asynchronous.
Processes
The number of processes in the computer at the time of data collection. Notice that this is an instantaneous count, not an average over the time interval. Each process represents the running of a program.
ProtectionFaults
The total number of times memory has been accessed in a way that was not allowed. This results in a segementation violation and in most cases a core dump.
ReceivedDuplicateBytes
The total number of TCP data bytes received in duplicate segments. Incoming data may be duplicated when an acknowledgment is lost or delayed and the other end retransmits a segment that actually arrived correctly the first time. This situation can be a sign that the remote systems are retransmitting too quickly and needs tuning or a patch.
ReceivedOutOfOrderBytes
The total number of TCP data bytes received in the wrong order. If this value is high compared to (ReceivedInorderBytes > ReceivedInorderBytes) then it could be a sign of routing problems.
ReceivedPartialDuplicateBytes
The total number of TCP data bytes received in partially duplicated segments. Incoming data may be duplicated when an acknowledgment is lost or delayed and the other end retransmits a segment that actually arrived correctly the first time. This situation can be a sign that the remote systems are retransmitting too quickly and needs tuning or a patch.
Recoverable / RecoverableErrors
The total number of errors that have occured on the I/O device that are recoverable.
RetransmittedTcpBytes
The total number of bytes resent in TCP data segments. If this value is more than 30% of (SentTcpBytes > SentTcpBytes) you may have some bad network hardware, a congested route that is dropping packets, or and operating system that needs a patch.
SchedulerWaitCount
The total number of times the system scheduler has removed a thread from the run queue because it was waiting for a resource.
SegmentsReceived
The total number of TCP segments that have been received, including those received in error. This count includes segments received on currently established connections.
SegmentsRetransmitted
The total number of retransmitted TCP segments, that is, segments transmitted containing one or more previously transmitted bytes. If this value is more than 30% of (SegmentsSent > SegmentsSent) you may have some bad network hardware, a congested route that is dropping packets, or an operating system that needs a patch.
SegmentsSent
The total number of TCP segments that are sent, including those on current connections, but excluding those containing only retransmitted bytes.
SwapIns
The total number of times a process that had been swapped out to disk is brought back into memory.
SwapOuts
The total number of times an idle process has been swapped out from memory to disk. If this ever happens its a sign that free memory stayed low long enough to trigger swapping.
SystemMinorFaults
The total number of minor page faults in kernel code. Minor page faults do not require disk access.
TotalCSW
The total number of context switches from one thread to another on the computer. Thread switches can occur either inside of a single process or across processes. A thread switch may be caused either by one thread asking another for information, or by a thread being preempted by another, higher priority thread becoming ready to run.
TotalIVolCSW
The total number of times a thread was forced to give up the cpu even though it was still ready to run.
UnreservedSwap
The number of megabytes of swap space that are free. If this value goes to zero new processes can no longer be created.
UserMinorFaults
The total number of minor page faults in non-kernel code. Minor page faults do not require disk access.
WaitQueueLength
The average number of operations in the driver's wait queue for a system I/O device. Operations go into the wait queue when they are performed on the I/O device and leave it when both the system bus and device are ready to activate the operation.
WaitQueueResponseTime
The average milliseconds and operation stays in the queue. Its calculated by dividing the queue length by total number of operations taken out of the queue. Operations go into the wait queue when they are performed on the I/O device and leave it when both the system bus and device are ready to activate the operation.
WaitQueueServiceTime
The average wait queue service time in milliseconds. Its calculated by dividing the time the queue was busy by total number of operations taken out of the queue. Operations go into the wait queue when they are performed on the I/O device and leave it when both the system bus and device are ready to activate the operation.
WaitQueueUtilization
A percentage that represents how much of the queue is being used. Its calculated by dividing the time the queue was busy by the total time available. Operations go into the wait queue when they are performed on the I/O device and leave it when both the system bus and device are ready to activate the operation.
4.4 System Statistics on AIX
This section lists statistics that are generated when statmonitor on AIX is started using options that specify to include system statistics.
Note
The set of system statitics that can be collected varies by server product and version. Not all statistics may be generated by statmonitor in any particlar version of GemStone.
ConnectionsEstablished
Current number of established TCP socket connections on the machine. At the lowest leve this means that a socket's current state is either ESTABLISHED or CLOSE-WAIT.
DiskReads
The total number of read operations on the disk. If this counter is always 0 then 'diskperf -y' needs to be run.
DiskWrites
The total number of write operations on the disk. If this counter is always 0 then 'diskperf -y' needs to be run.
PacketsOutboundErrors
The number of outbound packets that could not be transmitted because of errors.
PacketsReceivedErrors
The number of inbound packets that contained errors preventing them from being deliverable to a higher-layer protocol.
PageFaults
The total number of Page Faults by the threads executing in this process. A page fault occurs when a thread refers to a virtual memory page that is not in its working set in main memory. This will not cause the page to be fetched from disk if it is on the standby list and hence already in main memory, or if it is in use by another process with whom the page is shared.
PageIns
The total number of times pages have been brought into memory from disk by the operating system's memory manager.
PageOuts
The total number of times pages have been flushed from memory to disk by the operating system's memory manager.
PagesPagedIn
The total number of pages that have been brought into memory from disk by the operating system's memory manager.
PagesPagedOut
The total number of pages that have been flushed from memory to disk by the operating system's memory manager.
PercentCpuActive
The percentage of the total available time that has been used to execute user or system code.
PercentCpuIOWait
The percentage of the total available time that has been spent waiting for disk I/O to complete.
PercentCpuSystem
The percentage of the total available time that has been used to execute system (i.e. kernel) code.
Processes
The number of processes in the computer at the time of data collection. Notice that this is an instantaneous count, not an average over the time interval. Each process represents the running of a program.
SharedMemoryKB
The amount of memory enabled for sharing between multiple processes via shmat(2) and mmap(2) with the MAP_SHARED attribute set.
TotalCSW
The total number of context switches from one thread to another on the computer. Thread switches can occur either inside of a single process or across processes. A thread switch may be caused either by one thread asking another for information, or by a thread being preempted by another, higher priority thread becoming ready to run.
4.5 GBS Statistics
This section lists statistics that are generated when GBS is configured to write statistics.
Note
The set of GBS statistics varies by version. Not all statistics may be generated in any particular version of GBS.
bytesSentByStoreTraversal (GbsSession)
The number of bytes sent cumulatively by store traversal calls
The number of entries in the client map (stObjectCache)
gciCallProtectInvocations (GbsSessionManager)
The number of accesses to the GciCallProtect semaphore (a GbxCInterface shared variable)
mainStatSampleTime (GbsSessionManager)
The amount of time spent sampling manager and session main statistics
nbEndResultNoProgress (GbsSession)
The number of times GciNbEnd() was called when the result wasn't ready and no progress was made
objectsTraversed (GbsSession)
The total number of objects (with or without a value buffer) received by traversal call
sessionProtectInvocations (GbsSession)
The number of times the sessionProtect semaphore has been invoked