gpcheckcat

The gpcheckcat utility tests Greenplum Database catalog tables for inconsistencies.

The utility is in $GPHOME/bin/lib.

Synopsis

gpcheckcat [ <options>] [ <dbname>] 
  Options:
     -g <dir>
     -p <port>
     -P <password>
     -U <user_name>
     -S {none | only}
     -O
     -R <test_name> 
     -C <catalog_name>
     -B <parallel_processes>
     -v
     -A
gpcheckcat  -l 
gpcheckcat -?

Description

The gpcheckcat utility runs multiple tests that check for database catalog inconsistencies. Some of the tests cannot be run concurrently with other workload statements or the results will not be usable. Restart the database in restricted mode when running gpcheckcat, otherwise gpcheckcat might report inconsistencies due to ongoing database operations rather than the actual number of inconsistencies. If you run gpcheckcat without stopping database activity, run it with -O option.

Note: Any time you run the utility, it checks for and deletes orphaned, temporary database schemas (temporary schemas without a session ID) in the specified databases. The utility displays the results of the orphaned, temporary schema check on the command line and also logs the results.

Catalog inconsistencies are inconsistencies that occur between Greenplum Database system tables. In general, there are three types of inconsistencies:

• Inconsistencies in system tables at the segment level. For example, an inconsistency between a system table that contains table data and a system table that contains column data. As another, a system table that contains duplicates in a column that should to be unique.

• Inconsistencies between same system table across segments. For example, a system table is missing row on one segment, but other segments have this row. As another example, the values of specific row column data are different across segments, such as table owner or table access privileges.

• Persistent Table inconsistencies are inconsistencies in persistence object state and file system objects on a segment. For example, there are no running transactions, all transactions are complete, but there is object that is marked as creation incomplete in persistent tables. As another example, a file exists in database directory, but there is no corresponding object existing in the database system tables.

Options

-A

Run gpcheckcat on all databases in the Greenplum Database installation.

-B parallel_processes

The number of processes to run in parallel.

The gpcheckcat utility attempts to determine the number of simultaneous processes (the batch size) to use. The utility assumes it can use a buffer with a minimum of 20MB for each process. The maximum number of parallel processes is the number of Greenplum Database segment instances. The utility displays the number of parallel processes that it uses when it starts checking the catalog.

Note: The utility might run out of memory if the number of errors returned exceeds the buffer size. If an out of memory error occurs, you can lower the batch size with the -B option. For example, if the utility displays a batch size of 936 and runs out of memory, you can specify -B 468 to run 468 processes in parallel.

-C catalog_table

Run cross consistency, foreign key, and ACL tests for the specified catalog table.

-g data_directory

Generate SQL scripts to fix catalog inconsistencies. The scripts are placed in data_directory.

-l

List the gpcheckcat tests.

-O

Run only the gpcheckcat tests that can be run in online (not restricted) mode.

-p port

This option specifies the port that is used by the Greenplum Database.

-P password

The password of the user connecting to Greenplum Database.

-R test_name

Specify a test to run. Some tests can be run only when Greenplum Database is in restricted mode.

These are the tests that can be performed:

acl - Cross consistency check for access control privileges

duplicate - Check for duplicate entries

duplicate_persistent - Check for duplicate gp_persistent_relation_node entries

foreign_key - Check foreign keys

inconsistent - Cross consistency check for master segment inconsistency

mirroring_matching - Checks if mirroring is consistent (either activated or deactivated) for the cluster and segments.

missing_extraneous - Cross consistency check for missing or extraneous entries

owner - Check table ownership that is inconsistent with the master database

part_integrity - Check pg_partition branch integrity, partition with OIDs, partition distribution policy

part_constraint - Check constraints on partitioned tables

unique_index_violation - Check tables that have columns with the unique index constraint for duplicate entries

dependency - Check for dependency on non-existent objects (restricted mode only)

distribution_policy - Check constraints on randomly distributed tables (restricted mode only)

namespace - Check for schemas with a missing schema definition (restricted mode only)

persistent - Check persistent tables (restricted mode only)

pgclass - Check pg_class entry that does not have any corresponding pg_attribute entry (restricted mode only)

-S {none | only}

Specify this option to control the testing of catalog tables that are shared across all databases in the Greenplum Database installation, such as pg_database.

The value none deactivates testing of shared catalog tables. The value only tests only the shared catalog tables.

-U user_name

The user connecting to Greenplum Database.

-? (help)

Displays the online help.

-v (verbose)

Displays detailed information about the tests that are performed.

Notes

The utility identifies tables with missing attributes and displays them in various locations in the output and in a non-standardized format. The utility also displays a summary list of tables with missing attributes in the format database.schema.table.segment\_id after the output information is displayed.

If gpcheckcat detects inconsistent OID (Object ID) information, it generates one or more verification files that contain an SQL query. You can run the SQL query to see details about the OID inconsistencies and investigate the inconsistencies. The files are generated in the directory where gpcheckcat is invoked.

This is the format of the file:

gpcheckcat.verify.dbname.catalog\_table\_name.test\_name.TIMESTAMP.sql

This is an example verification filename created by gpcheckcat when it detects inconsistent OID (Object ID) information in the catalog table pg_type in the database mydb:

gpcheckcat.verify.mydb.pg_type.missing_extraneous.20150420102715.sql

This is an example query from a verification file:

SELECT *
  FROM (
       SELECT relname, oid FROM pg_class WHERE reltype 
         IN (1305822,1301043,1301069,1301095)
       UNION ALL
       SELECT relname, oid FROM gp_dist_random('pg_class') WHERE reltype 
         IN (1305822,1301043,1301069,1301095)
       ) alltyprelids
  GROUP BY relname, oid ORDER BY count(*) desc ;

See Also

gpcheck, gpcheckperf