Patch-ID# 123044-01

NOTE:
***********************************************************************
READ THE TERMS OF THE AGREEMENT ("AGREEMENT") IN THE LEGAL_LICENSE.TXT
FILE CAREFULLY BEFORE USING THIS SOFTWARE. BY USING THE SOFTWARE, YOU
AGREE TO THE TERMS OF THIS AGREEMENT. IF YOU DO NOT AGREE TO ALL OF THE
TERMS, PROMPTLY DESTROY THE UNUSED SOFTWARE.
***********************************************************************

Keywords: qmaster scheduler qmon qstat qconf qconf memory usage root security
Synopsis: N1 Grid Engine 6.0_x86: maintenance patch
Date: May/04/2006


Install Requirements: Additional instructions may be listed below                      
                      
Solaris Release: 10_x86

SunOS Release: 5.10_x86

Unbundled Product: N1 Grid Engine

Unbundled Release: 6.0

Xref: See patch matrix below

Topic: 

Relevant Architectures: x86

BugId's fixed with this patch: 4737342 4769608 6207868 6218877 6239470 6242169 6250603 6250692 6252469 6252525 6253860 6255111 6256590 6260656 6264592 6265154 6266392 6266450 6267238 6267245 6267932 6268707 6268799 6269305 6269411 6273006 6273217 6274467 6275789 6277909 6278147 6278727 6279402 6279409 6279523 6280698 6281440 6281462 6282996 6283308 6285898 6286510 6286533 6287847 6287850 6287862 6287865 6287867 6287935 6287945 6287946 6287953 6287955 6287958 6288156 6288588 6288626 6289455 6291016 6291023 6291033 6292742 6292751 6292926 6293411 6294052 6294397 6294875 6295165 6295791 6298056 6298233 6299345 6299351 6299939 6299982 6301047 6303671 6304466 6304471 6304490 6305095 6306229 6306834 6307557 6313445 6314019 6315111 6316995 6317028 6317048 6318018 6318660 6319223 6319228 6319231 6319233 6320683 6320869 6322498 6327427 6328703 6329832 6332876 6332877 6333407 6333467 6336519 6338314 6339756 6342005 6346696 6346704 6348299 6348478 6348516 6348517 6349818 6349972 6351728 6353526 6353638 6354143 6354164 6355263 6359054 6363823 6364440 6365380 6366691 6368747 6382156 6383513 6384682 6384698 6384709 6384812 6387206 6389526 6390494 6391238 6397383 6397987 6398008 6398723 6400729 6401993 6407513 6411230 6412215

Changes incorporated in this version: 4737342 6287945 6291033 6319223 6359054 6363823 6364440 6365380 6368747 6382156 6383513 6384682 6384698 6384709 6384812 6387206 6389526 6390494 6391238 6397383 6397987 6398008 6398723 6400729 6401993 6407513 6411230 6412215

Patches accumulated and obsoleted by this patch: 120439-03 121963-01

Patches which conflict with this patch: 

Patches required with this patch: 

Obsoleted by: 

Files included with this patch: 

<install_dir>/bin/sol-amd64/qacct
<install_dir>/bin/sol-amd64/qalter
<install_dir>/bin/sol-amd64/qconf
<install_dir>/bin/sol-amd64/qdel
<install_dir>/bin/sol-amd64/qhost
<install_dir>/bin/sol-amd64/qmake
<install_dir>/bin/sol-amd64/qmod
<install_dir>/bin/sol-amd64/qmon
<install_dir>/bin/sol-amd64/qping
<install_dir>/bin/sol-amd64/qsh
<install_dir>/bin/sol-amd64/qstat
<install_dir>/bin/sol-amd64/qsub
<install_dir>/bin/sol-amd64/qtcsh
<install_dir>/bin/sol-amd64/sge_coshepherd
<install_dir>/bin/sol-amd64/sge_execd
<install_dir>/bin/sol-amd64/sge_qmaster
<install_dir>/bin/sol-amd64/sge_schedd
<install_dir>/bin/sol-amd64/sge_shadowd
<install_dir>/bin/sol-amd64/sge_shepherd
<install_dir>/bin/sol-amd64/sgepasswd
<install_dir>/examples/jobsbin/sol-amd64/work
<install_dir>/lib/sol-amd64/libXltree.so
<install_dir>/lib/sol-amd64/libcrypto.so.0.9.7
<install_dir>/lib/sol-amd64/libdrmaa.so
<install_dir>/lib/sol-amd64/libspoolb.so
<install_dir>/lib/sol-amd64/libspoolc.so
<install_dir>/lib/sol-amd64/libssl.so.0.9.7
<install_dir>/utilbin/sol-amd64/adminrun
<install_dir>/utilbin/sol-amd64/berkeley_db_svc
<install_dir>/utilbin/sol-amd64/checkprog
<install_dir>/utilbin/sol-amd64/checkuser
<install_dir>/utilbin/sol-amd64/db_archive
<install_dir>/utilbin/sol-amd64/db_checkpoint
<install_dir>/utilbin/sol-amd64/db_deadlock
<install_dir>/utilbin/sol-amd64/db_dump
<install_dir>/utilbin/sol-amd64/db_load
<install_dir>/utilbin/sol-amd64/db_printlog
<install_dir>/utilbin/sol-amd64/db_recover
<install_dir>/utilbin/sol-amd64/db_stat
<install_dir>/utilbin/sol-amd64/db_upgrade
<install_dir>/utilbin/sol-amd64/db_verify
<install_dir>/utilbin/sol-amd64/filestat
<install_dir>/utilbin/sol-amd64/fstype
<install_dir>/utilbin/sol-amd64/gethostbyaddr
<install_dir>/utilbin/sol-amd64/gethostbyname
<install_dir>/utilbin/sol-amd64/gethostname
<install_dir>/utilbin/sol-amd64/getservbyname
<install_dir>/utilbin/sol-amd64/infotext
<install_dir>/utilbin/sol-amd64/loadcheck
<install_dir>/utilbin/sol-amd64/now
<install_dir>/utilbin/sol-amd64/openssl
<install_dir>/utilbin/sol-amd64/qrsh_starter
<install_dir>/utilbin/sol-amd64/rlogin
<install_dir>/utilbin/sol-amd64/rsh
<install_dir>/utilbin/sol-amd64/rshd
<install_dir>/utilbin/sol-amd64/sge_share_mon
<install_dir>/utilbin/sol-amd64/spooldefaults
<install_dir>/utilbin/sol-amd64/spooledit
<install_dir>/utilbin/sol-amd64/spoolinit
<install_dir>/utilbin/sol-amd64/testsuidroot
<install_dir>/utilbin/sol-amd64/uidgid

Problem Description:

6412215 encryption and/or decryption of passwords fails because crypto engine is not seeded 
6411230 Job Sequence Number got screwed up when restarting qmaster daemon 
6407513 Scheduler hangs after a qmaster crash and restart 
6401993 qstat -u <user> crashes 
6400729 weak authentication and authorization in CSP mode 
6398723 Tickets are not reset for running jobs after disabling the ticket policy 
6398008 Off-by-one overrun in communication library 
6397987 several buffer overruns 
6397383 qmaster deadlock when reporting file cannot be written 
6391238 qrsh does not accept -o/-e/-j 
6390494 qrsh issue with interactive jobs and directory write permissions 
6389526 commlib closes wrong connection on SSL error 
6387206 CSP revocation lists are not supported 
6384812 qstat produces non-well-formed XML output 
6384709 slow scheduler performance for jobs with hard queue requests 
6384698 schedulers mem use growing, if pe jobs are running 
6384682 "qstat -j" aborts 
6383513 resource filtering in qselect broken 
6368747 Job tickets are not correctly shown in qstat for none running jobs 
6365380 possible buffer overflow in sge_exec_job() 
6364440 qconf -mhgrp <hostgroup> results in glibc error message and abort 
6363823 qsub -w w changes -sync behavior 
6319223 subordinate properties lost on qmaster restart 
6291033 Unclear share caclulation of running jobs 
6287945 Interrupting qrsh while pending does not remove job 
4737342 interactive jobs leave behind output/error files if prolog/epilog are run 
 
The following Change Request (CR) is related only to Grid Engine running
under the Microsoft Windows operating system family
 
6382156 qloadsensor.exe consumes too much time and delivers too high load values 
6359054 On hosts with 3 GB RAM, qloadsensor.exe shows only 2GB RAM 
 
(from 121963-1)
6366691 utilbin/<arch>/rsh can be used to gain root access 
 
(from 120439-03)
6355263 reschedule of a parallel job crashes the qmaster
6354164 drmaa does not work on hp11 platform
6354143 mutually subordinating queues suspend each other simultaneously
6353526 reprioritize field in qmon cluster config missing
6351728 installation of qmaster failed when using /etc/services
6349972 DRMAA crashes during some operations on bulk jobs
6349818 an additional started schedd/execd daemons may not stop if started when qmaster is down
6348517 job finish although terminate method is still running
6348516 job finish does not terminate all processes of a job
6348299 qconf -mstree aborts
6346704 qrsh -V doesn't always work.
6346696 connection to Berkeley DB RPC server can timeout
6342005 a scheduler configuration change with a sharetree can result in a usage leak
6339756 Quotes in qtask file can result in memory corruption
6338314 occasional "failed to deliver job" errors due to SIGPIPE in sge_execd
6336519 changing the cwd flag in qmon - qalter has no effect
6333467 sgemaster -migrate may not delete qmaster lock file and may break shadowd functionality
6333407 configuring the halflife_decay_list crashes the qmaster
6332877 qstat -pe filter does not work
6332876 qstat -U does not consider queue access for job and project access for queues
6329832 qconf and qmaster accept invalid settings for queue complex_values
6328703 fstype does not recognize nfs4 share in all cases
6327427 qping core dump with enabled message content dump
6322498 calendar syntax "week  mon=0-21" corrupts SGE and may crash qmaster
6320869 sge_qmaster daemon is running on both the master and shadow nodes after a long network failure
6320683 Binary switch reversed in job category and can cause application to hang
6319233 Parsing of context variable options fails for values containing commas in single quotes
6319231 unable to delete a configuration of a non existing host
6319228 Backslash line continuation is broken for host groups
6318660 the system hold on an array task can vanish
6318018 shepherd doesn't handle qrlogin/qrsh jobs correctly
6317048 Memory leaks in drmaa library, japi_wait and drmaa_job2sge_job
6317028 Quotes in job category can result in memory corruption
6316995 qconf -mp prints error messages two times
6315111 doing a qalter -l rsc=val on running jobs breaks consumable debit
6313445 Qrsh tries to free invalid pointer
6307557 qhost returns wrong total_memory value on MacOSX 10.3
6306834 consumables as thresholds are not working correctly with pe jobs
6306229 wrong soft requests decision
6305095 qstat schema files are incomplete
6304490 qconf -as/-ah leads to segmentation fault
6304471 qlogin -R does not work like documented
6304466 qmaster crashes with large number of qconf -aattr calls
6303671 DRMAA can abort in the middle of a session if NIS becomes unavailable
6301047 qstat -s p doesn't show pending array tasks while there are tasks of this job running
6299982 Slow submission rate with drmaa_run_job()
6295791 qacct -h should not resolve hostnames
6294875 CSP: consolidate error output if cert CA on client and server don't match
6294052 suspend threshold is not working for calendar disabled queues
6293411 NFS write error on host <NFS server>: Permission denied.
6292926 qconf -mattr can crash qmaster
6292751 admin mail information is incorrect
6292742 tight integration - qrsh_exit_code file not written
6291023 qstat -j <name> doesn't print delimiter between jobs
6291016 qmon startup and queue add/modify warning messages
6289455 qstat -XML output does not match the schema
6288626 default PATH variable set for job insufficient for non-login shell jobs
6287955 strange reservation
6287946 qconf -[dm]attr gets confused by shortcuts
6287935 qmod -sq can kill a pe job in t state
6287865 qrsh default job names are not consistent with documented job name limitations
6287862 qhost -l for complexes is broken
6287850 Allow SIGTRAP to enable debugging
6287847 qstat -j shows wrong message for parallel jobs which can't be dispatched
6286510 delivery of queue based signals to execd repeated endlessly
6282996 use of IP address as host name disables unique hostname resolving
6275789 soft requirements on load values are ignored
6268799 confusing execd startup messages and delays in case of problems
6256590 qconf -mq disallows 2057 hostspecific profiles in slots configuration
6255111 Binary jobs are problematic for starter and epilog scripts
6253860 First character is lost in quoting
6250692 accounting(5) record can't be made available immediately after job finish
6242169 Multi-threaded, multi-CPU username problems
6207868 wording with qconf -cq should be changed
6287953 repeated logging of the error message: "failed building category string for job N"
 
The following Change Request (CR) is related only to Grid Engine running
under the Microsoft Windows operating system family
 
6353638 default process priority on windows freezes the whole system until job is finished
6348478 install script sets rsh_daemon to /usr/sbin/in.rshd on win32-x86
6314019 qloadsensor.exe uses up more and more handles
6279523 qlogin on windows does not work!
 
(from 120439-02)
6299939 distribution should contain all Berkeley DB utilities
6299351 qrsh fails when execd_param INHERIT_ENV=false and no ARC set in sge_execd environment
6299345 No error messages in case SSL initialization failes
6298233 no user notification or command hanging if an immediate job cannot be scheduled
6298056 INHERIT_ENV and SET_LIB_PATH are not reset by setting execd_params to NONE
 
(from 120439-01)
6295165 finished array job tasks can be rescheduled if master/scheduler daemons are stopped/started
6294397 wrong drmaa jnilib link on MacOS
6288588 jobs submitted with -v PATH do not retain $TMPDIR prefixed by N1GE as required for tight integration
6288156 sge_shepherd SEGV's when it tries to fopen the usage file
6287958 suspend not working under Mac OS X
6287867 tight integration: temporary files are not deleted at task exit
6286533 job wallclock monitoring and enforcement considers prolog/epilog runtime part of net job runtime
6285898 qconf -Xattr does not resolve fqdn hostnames
6283308 overhead with job execution could lead to overoptimistic backfilling and break resource reservation
6281462 qmaster profiling can only be turned on by restarting qmaster
6281440 resource allocation shown by qstat/qhost not consistent with resource utilization
6280698 Resource filtering with qhost broken
6279409 qconf -tsm command generates too much data (very large schedd_runlog file)
6279402 drmaa_exit() causes qmaster error logging if host is no admin host
6278727 qstat -xml -urg output contains badly formatted numbers
6278147 drmaa_job_ps() returns DRMAA_PS_QUEUED_ACTIVE for finished array job rather than DRMAA_PS_DONE
6277909 qconf -mq coredumps
6274467 qmon kills a system
6273217 race condition with qsub -sync and drmaa_wait() if job exits directly after being submitted
6273006 qstat -j "" results in a segmentation fault
6269411 Close integration cause jobscripts with multiple mprun commands to be killed.
6269305 qrsh/qsh/qlogin reject -js option
6268707 job_load_adjustements is not correctly working when parallel jobs are submitted.
6267932 high CPU load of qmaster even on empty cluster
6267245 Repeated logging of the same message produces giant logging files
6267238 Multithreaded DRMAA may crash due to use of sge_strtok()
6266450 performace bottleneck with subordinate list
6266392 Performance problem with qconf -mattr exechost XX XX global
6265154 Wildcards in PE Name Cause Unusual Behavior
6264592 drmaa_control(DRMAA_JOB_IDS_SESSION_ALL, DRMAA_CONTROL_SUSPEND|RESUME) returns INVALID_JOB error
6260656 incomplete resource reservation with array jobs
6252525 qmon: complex attributes not removeable
6252469 missleading qstat -j messages in case of resource reservation
6250603 qmon crash (segmentation fault) on Solaris64
6218877 qstat -t is broken
4769608 qalter shows wrong priority number when using negative priorities with -p option
 
The following Change Request (CR) is related only to Grid Engine running
under the Microsoft Windows operating system family
 
6239470 Avoid that sge_execd has to be started by the Domain Administrator

Patch Installation Instructions:
--------------------------------
 
tar.gz Patch Installation:
--------------------------
 
   See the patch installation instructions below before installing this
   patch!
 
   Patches in 'tar.gz' format cannot be installed with 'patchadd' on Solaris
   systems. The patch is installed by unpacking the 'tar.gz' file(s) in this
   directory in <install_dir>. <install_dir> is usually your <sge_root>
   directory. The installation of this patch later is not visible with the
   "showrev -p" command on Solaris.
 
   This patch cannot be backed out. You may want to make a backup copy of the
   files  before installing this patch since the files will be overwritten.
 
   Please read "Install Instructions" later in this file and carry out all
   steps before you unpack the 'tar.gz' file(s) included in this patch.
 
   This patch in 'tar.gz' format should not be installed if the original
   package has been installed with 'pkgadd' on Solaris. If the original 
   installation used packages ('pkgadd') utility, install the available 
   patches for N1 Grid Engine 6; refer to the patch matrix below.
 
   The patch is installed by user root by unpacking the file(s) in the
   directory where the original package has been installed:
 
      # cd <install_dir>
      # gzip -dc <patchid>/<targzfile> | tar xvpf -
 
   After installing the patch, you should correct the file permissions if
   your Sun Grid Engine installation is installed as an "admin user" system:
 
      # cd <sge_root>
      # util/setfileperm.sh <sge_root>
 
 
Patch requirements and patch matrix for N1 Grid Engine 6 packages
-----------------------------------------------------------------
 
   The patches below update a N1 Grid Engine 6 distribution to N1 Grid
   Engine 6 Update 8 (N1GE 6.0u8). The "-help" output of most commands will
   print a version string "N1GE 6.0u8" after applying the patch.
 
   All packages of a N1 Grid Engine 6 distribution must have the same patch
   level (exception for ARCo - see requirements for ARCo in the ARCo patches
   README's). Please refer to the patch matrix below which updates the
   distribution to most recent patch level.
 
   It is not supported and possible to mix different patch levels of
   binaries and the "common" package in a single N1 Grid Engine cluster.
 
   1. Patches for packages in Sun pkgadd format
   --------------------------------------------
 
      Package name*   OS*                    Architecture*    Patch-Id
      -----------------------------------------------------------------
      SUNWsgee        Solaris, Sparc, 32bit  sol-sparc        123037-01
      SUNWsgeex       Solaris, Sparc, 64bit  sol-sparc64      123038-01
      SUNWsgeex       Solaris x86            sol-x86          123039-01
      SUNWsgeeax      Solaris, x64 (AMD64)   sol-amd64        123040-01
      SUNWsgeec       all                    common           118132-08
      SUNWsgeea       all                    arco             118133-06
      SUNWsgeed       all                    doc              119846-02
 
      *Package Name = see pkginfo(1) 
      *OS           = Operating system
      *Architecture = N1 Grid Engine binary architecture string or
                      "common" = architecture independent packages
                      "arco"   = Accounting and Reporting console
                      "doc"    = PDF documentation
                      "gemm"   = Grid Engine Management Module for Sun
                                 Control Station (SCS) (tar.gz only)
 
 
   2. Patches for packages in tar.gz format
   ----------------------------------------
 
      OS*                        Architecture     Patch-Id
      -----------------------------------------------------
      Solaris, Sparc, 32bit      sol-sparc        123041-01
      Solaris, Sparc, 64bit      sol-sparc64      123042-01
      Solaris, x86               sol-x86          123043-01
      Solaris, x64 (AMD64)       sol-amd64        123044-01
      Linux kernel2.4/2.6, x86   lx24-x86         123045-01
      Linux kernel2.4/2.6, AMD64 lx24-amd64       123046-01
      IBM AIX 4.3                aix43            123047-01
      IBM AIX 5.1                aix51            123048-01
      Apple MAC OS/X             darwin           123049-01
      HP HP-UX 11                hp11             123050-01
      SGI Irix 6.5               irix65           123051-01
      Microsoft Windows          win32-x86        123052-01 
      all                        common           118092-08
      all                        arco             118093-06
      all                        doc              119861-02
      Solaris, Linux             gemm             120435-02

Special Install Instructions:
-----------------------------
 
   Content
   -------
   Patch Installation
      Stopping the N1 Grid Engine cluster to start jobs
      Shutting down the N1 Grid Engine daemons
      Installing the patch and restarting the software
   New functionality delivered with N1GE 6.0 Update 7
      Reworked "qstat -xml" output
      Reworked PE range matching algorithm in the scheduler
      New monitoring feature in qmaster
      New parameter for specialized job deletion
      New reporting parameter to control accounting file flush time
   New functionality delivered with N1GE 6.0 Update 6
      Berkeley DB database tools are included in the distribution
   New functionality delivered with N1GE 6.0 Update 4
      New "qconf -purge" option
      Berkeley DB spooling on NFSv4 under Solaris 10 supported
      Execd installation in Solaris 10 zones supported
      Faster execution daemon reconnect in CSP mode
   New functionality delivered with N1GE 6.0 Update 2
      Avoid setting of LD_LIBRARY_PATH
      DRMAA Java[TM] language binding delivered with this patch
      New qstat options to optimize memory overhead and speed of qstat
      Tuning parameter for sharetree spooling
 
 
   Patch Installation
   ------------------
 
   NOTE: This patch requires that you update your Berkeley DB database files
         if you are upgrading from N1GE 6.0u1 or 6.0.  Please read the full
         notes when applying this patch.
 
   These installation instructions assume that you are running a homogenous
   N1 Grid Engine cluster (called "the software") where all hosts share the
   same directory for the binaries. If you are running the software in a
   heterogenous environment (mix of different binary architectures), you
   need to apply the patch installation for all binary architectures as well
   as the "common" and "arco" packages. See the patch matrix above for
   details about the available patches.
 
   If you installed the software on local filesystems, you need to install
   all relevant patches on all hosts where you installed the software
   locally.
 
   By default, there should by no running jobs when the patch is installed. 
   There may pending batch jobs, but no pending interactive jobs (qrsh,
   qmake, qsh, qtcsh).
 
   It is possible to install the patch with running batch jobs. To avoid a
   failure of the active 'sge_shepherd' binary, it is necessary to move the
   old shepherd binary (and copy it back prior to the installation of the
   patch).
 
   You can not install the patch with running interactive jobs, 'qmake' jobs
   or with running parallel jobs which use the tight integration support
   (control_slaves=true in PE configuration is set).
 
   A. Stopping the N1 Grid Engine cluster to start jobs
   ----------------------------------------------------
 
   Disable all queues so that no new jobs are started:
 
      # qmod -d '*'
 
   Optional (only needed if there are running jobs which should continue to
   run when the patch is installed):
 
      # cd $SGE_ROOT/bin
      # mv <arch>/sge_shepherd <arch>/sge_shepherd.sge60
 
   It is important that the binary is moved with the "mv" command. It should
   not be copied because this could cause the crash of an active shepherd
   process which is currently running job when the patch is installed.
 
   B. Shutting down the N1 Grid Engine daemons
   -------------------------------------------
 
   You need to shutdown (and restart) the qmaster and scheduler daemon and
   all running execution daemons.
 
   Shutdown all your execution hosts. Login to all your execution hosts and
   stop the execution daemons:
 
      # /etc/init.d/sgeexecd softstop
 
   Then login to your qmaster machine and stop qmaster and scheduler:
 
      # /etc/init.d/sgemaster stop
 
   Now verify with the 'ps' command that all N1 Grid Engine daemons on all
   hosts are stopped. If you decided to rename the 'sge_shepherd' binary so
   that running jobs can continue to run during the patch installation, you
   must not kill the 'sge_shepherd' binary (process).
 
   C. Installing the patch and restarting the software
   ---------------------------------------------------
 
   Now install the patch by installing the patch with "patchadd" or by
   unpacking the 'tar.gz' files included in this patch as outlined above.
 
 
      Berkeley DB database update needed
      ----------------------------------
 
      NOTE: This update is *not* needed if you already installed N1GE 6.0u3
            or higher. The update is only needed if you are upgrading from
            N1GE 6.0u2 or earlier.
 
      After installing this patch, and before restarting your cluster you
      need to update your Berkeley DB (BDB) database in the following cases:
 
         - you choose the BDB spooling option (not needed for classic
           spooling) either locally or with the BDB RPC option, and you are
           upgrading your cluster for N1 Grid Engine 6.0 or 6.0u1 to N1 Grid
           Engine 6.0u2 or higher
 
      1. For safety reasons, please make a full backup of your existing
         configuration. To perform a backup use this command
 
            % inst_sge -bup
 
      2. Upgrade your BDB database. This is done as follows:
 
           % inst_sge -updatedb
 
      Restarting the software
      -----------------------
 
      Please login to your qmaster machine and execution hosts and enter:
 
         # /etc/init.d/sgemaster
         # /etc/init.d/sgeexecd
 
      After restarting the software, you may again enable your queues:
 
         # qmod -e '*'
 
      If you renamed the shepherd binary, you may safely delete the old
      binary when all jobs which where running prior the patch installation
      have finished.
 
 
   New functionality delivered with N1GE 6.0 Update 7
   --------------------------------------------------
 
   1. Reworked "qstat -xml" output
   -------------------------------
 
   The schema for "qstat -xml" and the "qstat -xml" output have been
   reworked to ensure consistency between them and easy parsing of them via
   JAXB. The most noticeable change will the date output. It follows now the
   XML datetime format.
 
   2. Reworked PE range matching algorithm in the scheduler
   --------------------------------------------------------
 
   The PE range matching algorithm is now adaptable and learns from the past
   decisions. This will lead to a much faster scheduling decision in case of
   pe-ranges. This can be controlled by a new scheduling configuration
   parameter: SELECT_PE_RANGE_ALG.  It allows to restore the old behavior. 
 
   See sge_conf(5) for more information.
 
   3. New monitoring feature in qmaster
   ------------------------------------
 
   The monitoring allows to get detailed statistics what the qmaster
   threads are doing and how busy they are.  The statistics can be accessed
   via "qping -f" or from the qmaster messages file.  The feature is controlled
   by two qmaster configuration parameters:
 
      MONITOR_TIME          specifying the time interval for the statistics
      LOG_MONITOR_MESSAGE   enables/ disables the logging of the monitoring
                            messages into the qmaster messages file.
 
   See sge_conf(5) for more information.
 
   4. New parameter for specialized job deletion
   ---------------------------------------------
 
   A new "execd_param" (configured in the global cluster configuration):
 
      ENABLE_ADDGRP_KILL=true
 
   can be configured to enable addition code within the execution host to
   delete jobs. If this parameter is set then the supplementary group id's
   are used to identify all processes which are to be terminated when a job
   should be deleted. It has only effect for following architectures:
 
      sol*
      lx*
      osf4
      tru64
 
   See sge_conf(5) under "gid_range" for more information.
 
   5. New reporting parameter to control accounting file flush time
   ----------------------------------------------------------------
 
   A new reporting parameter, "accounting_flush_time", controls the flush
   period for the accounting file. Previously, both the accounting and
   reporting files were flush at the same interval. Now they can be set
   independently. Additionally, buffering of the accounting file can now be
   disabled, allowing accounting data to be written to the accounting file
   as soon as it becomes available.
 
   See sge_conf(5) for more information.
 
 
   New functionality delivered with N1GE 6.0 Update 6
   --------------------------------------------------
 
   1. Berkeley DB database tools are included in the distribution
   --------------------------------------------------------------
 
   All Berkeley DB database tools are now part of the N1 Grid Engine
   distribution (not for Microsoft Windows platform)
 
     db_archive 
     db_checkpoint
     db_deadlock 
     db_dump
     db_load
     db_printlog
     db_recover
     db_stat
     db_upgrade
     db_verify
 
   The HTML documentation for these tools is part of the "common" patch and
   can be found in:
 
     <sge_root>/doc/bdbdocs
 
 
   New functionality delivered with N1GE 6.0 Update 4
   --------------------------------------------------
 
   1. New "qconf -purge" option
   ----------------------------
 
   "qconf -purge" deletes all hosts or hostgroups settings from a cluster
   queue. This facilitates the uninstallation of host or hostgroups. See
   qstat(1) for more a description how to use this parameter
 
 
   2. Berkeley DB spooling on NFSv4 under Solaris 10 supported
   -----------------------------------------------------------
 
   The Berkeley DB database now can be installed on a NFSv4 mounted
   filesystem on Solaris 10.
 
   For performance reasons it is recommended to use NFSv4 BDB spooling only
   when the NFSv4 mount provides an excellent high speed connection to the
   file server.
 
   3. Execd installation in Solaris 10 zones supported
   ---------------------------------------------------
 
   The execution daemon installation in Solaris 10 zones is supported. If an
   execution daemons is installed in the global zone and in local zones you
   need to ensure that the additional group id range (-> "gid_range" in
   cluster configuration) from the global zone and the local zones does not
   overlap. Local zones may use the same additional group id range in the
   same host.
 
   4. Faster execution daemon reconnect in CSP mode
   ------------------------------------------------
 
   The Certificate Security Protocol (CSP) has been reworked and now is fully
   integrated in the communication library layer. The allows a faster
   reconnect of execution daemons after qmaster or execution daemon restart.
 
 
   New functionality delivered with N1GE 6.0 Update 2
   --------------------------------------------------
 
   1. Avoid setting of LD_LIBRARY_PATH; inherited job environment
   --------------------------------------------------------------
 
   There are two new "execd_params" (defined in the global or local cluster
   configuration) which control the environment inherited by a job:
 
      SET_LIB_PATH
      INHERIT_ENV
 
   By default, SET_LIB_PATH is false and INHERIT_ENV is true.  If
   SET_LIB_PATH is true and INHERIT_ENV is true, each job will inherit the
   environment of the shell that started the execd, with the N1GE lib
   directory prepended to the lib path.  If SET_LIB_PATH is true and
   INHERIT_ENV is false, the environment of the shell that started the execd
   will not be inherited by jobs, and the lib path will contain only the
   N1GE lib directory.  If SET_LIB_PATH is false and INHERIT_ENV is true,
   each job will inherit the environment of the shell that started the execd
   with no additional changes to the lib path.  If SET_LIB_PATH is false and
   INHERIT_ENV is false, the environment of the shell that started the execd
   will not be inherited by jobs, and the lib path will be empty. 
   Environment variables which are normally overwritten by the shepherd,
   such as PATH or LOGNAME, are unaffected by these new parameters.
 
   2. DRMAA Java[TM] language binding delivered with this patch
   ------------------------------------------------------------
 
   The DRMAA Java language binding is now available. The DRMAA Java language
   binding library and documentation is contained in the patch for the
   "common" package.
 
   3. New qstat options to optimize memory overhead and speed of qstat
   -------------------------------------------------------------------
 
   The qstat client command has been enhanced to reduce the overall amount
   of memory which is requested from the qmaster. To enable these changes it
   is necessary to change the qstat default behavior. This is possible by
   defining a cluster-global or user-specific sge_qstat file. More
   information can be found in sge_qstat(5) manual page. In addition two new
   qstat options ("-u" and "-s") have been introduced to be used with the
   sge_qstat default file. Find more information in qstat(1).
 
   4. Tuning parameter for sharetree spooling
   ------------------------------------------
 
   A new "qmaster_param" (configured in the global cluster configuration):
 
     STREE_SPOOL_INTERVAL=<time>
 
   can be configured to control the interval for how often the sharetree
   usage is spooled. The interval can be set to any time in the following
   formats:
 
       HH:MM:SS or 
       <int>
 
   E.g.:
 
      STREE_SPOOL_INTERVAL=0:05:00
      STREE_SPOOL_INTERVAL=300
 
   This parameter is a tuning parameter only. It has the biggest effect on a
   system using classic spooling and bigger sharetrees and a slow
   filesystem.

README -- Last modified date:  Thursday, May 4, 2006

