Sun Microsystems
Products & Services
 
Support & Training
 
 

Previous Previous     Contents     Index     Next Next
Chapter 7

Other Administrative Tasks

This chapter describes how to use files and scripts to add or modify grid engine system objects such as queues, hosts, and environments.

This chapter includes the following sections:

Gathering Accounting and Reporting Statistics

The grid engine system provides two kinds of reporting and accounting facilities:

  • Accounting and Reporting Console (ARCo)

  • qacct command and the accounting file

Report Statistics (ARCo)

You can use the optional Accounting and Reporting Console (ARCo) to generate live accounting and reporting data from the grid engine system and store the data in the reporting database, which is a standard SQL database. ARCo supports the following SQL database systems:

  • PostgreSQL

  • Oracle

  • MySQL

ARCo also provides a web-based tool for generating information queries on the reporting database and for retrieving the results in tabular or graphical form. ARCo enables you to store queries for later use, to run predefined queries, and to run queries in batch mode. For more information about how to use ARCo, see Chapter 5, "Accounting and Reporting," in N1 Grid Engine 6 User's Guide. For information about how to install ARCo, see Chapter 8, "Installing the Accounting and Reporting Console," in N1 Grid Engine 6 Installation Guide.

Raw reporting data is generated by sge_qmaster. This raw data is stored in a reporting file. The dbwriter program reads the raw data in the reporting file and writes it to the SQL reporting database, where it can be accessed by ARCo.

About the dbwriter Program

The dbwriter program performs the following tasks:

  • Reads raw data from the reporting file and writes this raw data to the reporting database.

  • Calculates derived values. You can configure which values to calculate, as well as the rules that govern the calculations.

  • Deletes outdated data. You can configure how long to keep data.

When dbwriter starts up, it calculates derived values. dbwriter also deletes outdated records at startup. If dbwriter runs in continuous mode, dbwriter continues to calculate derived values and to delete outdated records at hourly intervals, or at whatever interval you specify.

You can specify in an XML file the values that you want to calculate and the records that you want to delete. Use the -calculation option of the dbwriter command to specify the path to this XML file.

For detailed information about calculating derived values, see Calculating Derived Values With dbwriter.

For detailed information about deleting outdated records, see Deleting Outdated Records With dbwriter.

Enabling the Reporting File

The reporting file contains the following types of data:

  • Host load values and consumable resources

  • Queue consumable resources

  • Job logging

  • Job accounting

  • Share-tree usage

When the grid engine system is first installed, the reporting file is disabled. To use ARCo, you must enable the reporting file for the cluster. Once enabled, the reporting file will be generated by sge_qmaster. By default, the reporting file is located in sge-root/cell/common. You can change the default with the -reporting option of the dbwriter command.

For information about configuring the generation of the reporting file, see the reporting_params parameter of the sge_conf(5) man page, and the report_variables parameter of the sge_host(5) man page.

To enable the reporting file with QMON, on the Main Control window click the Cluster Configuration button, select the global host, and then click Modify.

On the Cluster Settings dialog box, click the Advanced Settings tab.

In the Reporting Parameters field, set the following parameters:

  • Set accounting to true. true is the default value.

  • Set reporting to true.

  • Set flush_time to 00:00:15. 00:00:15 is the default value.

  • Set joblog to true.

  • Set sharelog to 00:00:00. 00:00:00 is the default value.

To enable the reporting file from the command line, use the qconf -mconf command to set the reporting_params attributes, as described in the preceding paragraph.

Once the reporting file is enabled, the dbwriter can read raw data from the reporting file and write it to the reporting database.

For more information about configuring the reporting file, see the reporting(5) man page. For complete details about installing and setting up ARCo, see Chapter 8, "Installing the Accounting and Reporting Console," in N1 Grid Engine 6 Installation Guide.

Previous Previous     Contents     Index     Next Next