From e207d532252d8dff96692dc8faf60a166fa2cbc3 Mon Sep 17 00:00:00 2001 From: Paul Jacobs Date: Wed, 22 Apr 2020 19:39:41 +0300 Subject: [PATCH 1/7] Release notes for 3.2.0 --- docs/release_notes.rst | 23 +++++++++++++++++++++++ 1 file changed, 23 insertions(+) diff --git a/docs/release_notes.rst b/docs/release_notes.rst index ceea1a56..c2da6e8e 100644 --- a/docs/release_notes.rst +++ b/docs/release_notes.rst @@ -1,6 +1,29 @@ Percona Toolkit *************** +v3.2.0 released 2019-04-20 +========================== + +Improvements: + + * :jirabug:`PT-1765`: Added documentation for ``DIFF_ROWS`` in ``pt-table-checksum``. + * :jirabug:`PT-1757`: ``pt-table-checksum``: Improved handling of Small Tables. + * :jirabug:`PT-1707`: Added support for IPv6 addresses. + +Bug fixes: + + * :jirabug:`PT-1824`: Added 64-character constraint name limit. (Thank you Iwo Panowicz). + * :jirabug:`PT-1793`: Protocol parser now handles the year 2020. (Thank you Kei Tsuchiya). + * :jirabug:`PT-1782`: ``pt-online-schema-change``: No longer FK warning if no foreign keys. + * :jirabug:`PT-1773`: ``pt-online-schema-change``: FK check restricted if needed. + * :jirabug:`PT-1766`: ``pt-table-checksum``: ``DIFF_ROWS`` now computed correctly. + * :jirabug:`PT-1760`: ``pt-online-schema-change`` no longer stalls for stopped replica when slave is active. + * :jirabug:`PT-1759`: ``pt-stalk`` now collecting ``processlist`` and variables. + * :jirabug:`PT-1576`: ``pt-stalk mysql-only`` now working as expected. + * :jirabug:`PT-1502`: ``pt-online-schema-change`` now working with multi-source replication. + * :jirabug:`PT-297` : ``pt-online-schema-change`` doesn't break replication. + + v3.0.13 released 2019-01-03 =========================== From c1e6096336730c20ed26ba0aebaf1e404bb83570 Mon Sep 17 00:00:00 2001 From: Paul Jacobs Date: Wed, 22 Apr 2020 20:29:08 +0300 Subject: [PATCH 2/7] Release Notes for 3.2.0 --- docs/rn.3-2-0.txt | 36 ++++++++++++++++++++++++++++++++++++ 1 file changed, 36 insertions(+) create mode 100644 docs/rn.3-2-0.txt diff --git a/docs/rn.3-2-0.txt b/docs/rn.3-2-0.txt new file mode 100644 index 00000000..bc355843 --- /dev/null +++ b/docs/rn.3-2-0.txt @@ -0,0 +1,36 @@ +.. _PT-3.2.0: + +================================================================================ +*Percona Toolkit* 3.2.0 +================================================================================ + +:Date: April 23, 2020 +:Installation: `Installing Percona Toolkit `_ + +Improvements +================================================================================ + +* :jirabug:`PT-1773`: Don't make the foreign key check in ``pt-online-schema-change`` if not needed. +* :jirabug:`PT-1757`: ``pt-table-checksum`` can now handle small tables as a single chunk. +* :jirabug:`PT-1813`: MariaDB 10.4 is now supported. + + + +Bugs Fixed +================================================================================ + +* :jirabug:`PT-1782`: ``pt-online-schema-change`` declined to handle tables because of foreign keys even when there were no foreign keys with some MariaDB 10.2 and MySQL 8 versions. +* :jirabug:`PT-1759`: ``pt-stalk`` with ``--mysql-only`` option didn't collect MySQL Status variables. +* :jirabug:`PT-1802`: ``pt-online-schema-change`` didn't handle self-referencing foreign keys properly which caused an unnecessarily high resource consumption. +* :jirabug:`PT-1766`: ``pt-table-checksum`` ``DIFF_ROWS`` was not computed correctly. +* :jirabug:`PT-1760`: ``pt-online-schema-change`` regression caused it to hang for a stopped replica when using replication channels on the slave. +* :jirabug:`PT-1707`: A number of the Percona Toolkit tools failed to operate in the IPv6 environment if the host address specified as a parameter was not enclosed in square brackets. +* :jirabug:`PT-1502`: ``pt-online-schema-change`` was not recognizing the slave with multi-source replication active. +* :jirabug:`PT-1824`: ``pt-online-schema-change`` allowed the name of a constraint to exceed 64 characters when ``--alter-foreign-keys-method=rebuild_constraints`` was used. +* SKIP :jirabug:`PT-1765`: Documentation for ``DIFF_ROWS`` doesn't exist. +* :jirabug:`PT-297`: ``pt-online-schema-change`` could break replication. +* :jirabug:`PT-1768`: Source code for ``src/go/pt-mongodb-query-digest/pt-mongodb-query-digest`` was missing in the official source tar ball. +* :jirabug:`PT-1576`: ``pt-stalk` with ``--mysql-only`` option was not adding MySQL ``processlist`` information to the output file. +* :jirabug:`PT-1793`: ``pt-query-digest`` was unable to handle the year 2020 because of wrong ``tcpdump`` parsing. + + From 9dc874a57d0dc3ece1e2b7b955dd21c298744cc5 Mon Sep 17 00:00:00 2001 From: Paul Jacobs Date: Fri, 24 Apr 2020 15:07:03 +0300 Subject: [PATCH 3/7] RM-505 Updated release notes to match jirabot output and make them ready for release. --- config/sphinx-build/conf.py | 6 +++--- docs/rn.3-2-0.txt | 7 ++++--- 2 files changed, 7 insertions(+), 6 deletions(-) diff --git a/config/sphinx-build/conf.py b/config/sphinx-build/conf.py index e562d2e9..32c7c88a 100644 --- a/config/sphinx-build/conf.py +++ b/config/sphinx-build/conf.py @@ -41,7 +41,7 @@ master_doc = 'index' # General information about the project. project = u'Percona Toolkit' -copyright = u'2017, Percona LLC and/or its affiliates' +copyright = u'2020, Percona LLC and/or its affiliates' # The version info for the project you're documenting, acts as replacement for # |version| and |release|, also used in various other places throughout the @@ -180,7 +180,7 @@ htmlhelp_basename = 'PerconaToolkitdoc' # (source start file, target name, title, author, documentclass [howto/manual]). latex_documents = [ ('index', 'PerconaToolkit.tex', u'Percona Toolkit Documentation', - u'2017, Percona LLC and/or its affiliates', 'manual'), + u'2020, Percona LLC and/or its affiliates', 'manual'), ] # The name of an image file (relative to this directory) to place at the top of @@ -214,5 +214,5 @@ latex_toplevel_sectioning = 'part' # (source start file, name, description, authors, manual section). man_pages = [ ('index', 'perconatoolkit', u'Percona Toolkit Documentation', - [u'2017, Percona LLC and/or its affiliates'], 1) + [u'2020, Percona LLC and/or its affiliates'], 1) ] diff --git a/docs/rn.3-2-0.txt b/docs/rn.3-2-0.txt index bc355843..91ee493e 100644 --- a/docs/rn.3-2-0.txt +++ b/docs/rn.3-2-0.txt @@ -5,6 +5,7 @@ ================================================================================ :Date: April 23, 2020 + :Installation: `Installing Percona Toolkit `_ Improvements @@ -26,11 +27,11 @@ Bugs Fixed * :jirabug:`PT-1760`: ``pt-online-schema-change`` regression caused it to hang for a stopped replica when using replication channels on the slave. * :jirabug:`PT-1707`: A number of the Percona Toolkit tools failed to operate in the IPv6 environment if the host address specified as a parameter was not enclosed in square brackets. * :jirabug:`PT-1502`: ``pt-online-schema-change`` was not recognizing the slave with multi-source replication active. -* :jirabug:`PT-1824`: ``pt-online-schema-change`` allowed the name of a constraint to exceed 64 characters when ``--alter-foreign-keys-method=rebuild_constraints`` was used. -* SKIP :jirabug:`PT-1765`: Documentation for ``DIFF_ROWS`` doesn't exist. +* :jirabug:`PT-1824`: ``pt-online-schema-change`` allowed the name of a constraint to exceed 64 characters when ``--alter-foreign-keys-method=rebuild_constraints`` was used. (Thank you, Iwo Panowicz.) +* :jirabug:`PT-1765`: Documentation for ``DIFF_ROWS`` doesn't exist. * :jirabug:`PT-297`: ``pt-online-schema-change`` could break replication. * :jirabug:`PT-1768`: Source code for ``src/go/pt-mongodb-query-digest/pt-mongodb-query-digest`` was missing in the official source tar ball. * :jirabug:`PT-1576`: ``pt-stalk` with ``--mysql-only`` option was not adding MySQL ``processlist`` information to the output file. -* :jirabug:`PT-1793`: ``pt-query-digest`` was unable to handle the year 2020 because of wrong ``tcpdump`` parsing. +* :jirabug:`PT-1793`: ``pt-query-digest`` was unable to handle the year 2020 because of wrong ``tcpdump`` parsing. (Thank you, Kei Tsuchiya.) From cebb1a68db46ca67db8890b9c025174e21921f32 Mon Sep 17 00:00:00 2001 From: Paul Jacobs Date: Fri, 24 Apr 2020 16:33:52 +0300 Subject: [PATCH 4/7] RM-505 Fixed missing docs for pt-pg-summary and a few historical sphinx warnings. --- docs/installation.rst | 2 +- docs/pt-pg-summary.rst | 473 +++++++++++++++++++++++++++++++++++++++++ docs/release_notes.rst | 31 +-- docs/version-check.rst | 2 +- 4 files changed, 492 insertions(+), 16 deletions(-) create mode 100644 docs/pt-pg-summary.rst diff --git a/docs/installation.rst b/docs/installation.rst index 30cb8cc9..ba126fb8 100644 --- a/docs/installation.rst +++ b/docs/installation.rst @@ -39,7 +39,7 @@ It is recommended to install Percona software from official repositories: During the installating process, the percona-toolkit installer records a unique identifier specific to the given percona-toolkit instance. This ID is a the -product UUID stored in |product-uud|. The installer copies the product_uuid to +product UUID stored in |product-uuid|. The installer copies the product_uuid to |toolkit-uuid|. This unique identifier is used when collecting statistics about the usage of diff --git a/docs/pt-pg-summary.rst b/docs/pt-pg-summary.rst new file mode 100644 index 00000000..754b03e7 --- /dev/null +++ b/docs/pt-pg-summary.rst @@ -0,0 +1,473 @@ +pt-pg-summary +============= +**pt-pg-summary** collects information about a PostgreSQL cluster. + +Usage +----- + +``pt-pg-summary [options] [host:[port]]`` + +Binaries +-------- +Please check the `releases `_ tab to download the binaries. + +Parameters +^^^^^^^^^^ + ++--------+---------------------------------+---------+----------------------------------------------------------------------------+ +| Short | Long | Default | Description | ++========+=================================+=========+============================================================================+ +| | ``--help`` | | Show context-sensitive help (also try ``--help-long`` and ``--help-man``). | ++--------+---------------------------------+---------+----------------------------------------------------------------------------+ +| | ``--version`` | | Show application version. | ++--------+---------------------------------+---------+----------------------------------------------------------------------------+ +| | ``--databases=DATABASES`` | | Summarize this comma-separated list of databases. All if not specified. | ++--------+---------------------------------+---------+----------------------------------------------------------------------------+ +| ``-h`` | ``--host=HOST`` | | Host to connect to. | ++--------+---------------------------------+---------+----------------------------------------------------------------------------+ +| ``-W`` | ``--password=PASSWORD`` | | Password to use when connecting. | ++--------+---------------------------------+---------+----------------------------------------------------------------------------+ +| ``-p`` | ``--port=PORT`` | | Port number to use for connection. | ++--------+---------------------------------+---------+----------------------------------------------------------------------------+ +| | ``--sleep=SLEEP`` | 10 | Seconds to sleep when gathering status counters. | ++--------+---------------------------------+---------+----------------------------------------------------------------------------+ +| ``-U`` | ``--username=USERNAME`` | | User for login if not current user. | ++--------+---------------------------------+---------+----------------------------------------------------------------------------+ +| | ``--disable-ssl`` | true | Disable SSL for the connection. | ++--------+---------------------------------+---------+----------------------------------------------------------------------------+ +| | ``--verbose`` | false | Show verbose log. | ++--------+---------------------------------+---------+----------------------------------------------------------------------------+ +| | ``--debug`` | false | Show debug information in the logs. | ++--------+---------------------------------+---------+----------------------------------------------------------------------------+ + + +.. Currently hidden +.. --list-encrypted-tables Include a list of the encrypted tables in all databases +.. --ask-pass Prompt for a password when connecting to PostgreSQL +.. --config Config file +.. --defaults-file Only read PostgreSQL options from the given file +.. --read-samples Create a report from the files found in this directory +.. --save-samples Save the data files used to generate the summary in this directory + + +Output +^^^^^^ + +The output is grouped into these categories: + +AllDatabases + Selects ``datname`` from ``pg_database`` where ``datistemplate`` is false. + +ClusterInfo + Selects cluster information from ``pg_stat_activity``. + +ConnectedClients + Counts the connected clients by selecting from ``pg_stat_activity``. + +Connections + Selects ``state`` from ``pg_stat_activity`` and counts them. + +Counters + Selects various counter values from ``pg_stat_database``. + +DatabaseWaitEvents + Shows database wait events from ``pg_locks``, ``pg_stat_database``, ``pg_class``, and ``pg_stat_activity``. + +Databases + Shows the name and size of databases from ``pg_stat_database``. + +GlobalWaitEvents + Shows global wait evens from ``pg_stat_activity``. + +IndexCacheHitRatio + Shows index hit ratios from ``pg_statio_user_indexes``. + +PortAndDatadir + Shows port and data directory name from ``pg_settings``. + +ServerVersion + Shows the value of ``server_version_num``. + +Setting + Selects ``name`` and ``setting`` from ``pg_settings``. + +SlaveHosts10 + Selects information for PostgreSQL version 10. + +SlaveHosts96 + Selects information for PostgreSQL version 9.6. + +TableAccess + Shows table access information by selecting from ``pg_locks``, ``pg_stat_database`` and ``pg_class``. + +TableCacheHitRatio + Shows table cache hit ratio information from ``pg_statio_user_tables``. + +Tablespaces + Show owner and location from ``pg_catalog.pg_tablespace``. + + +Output example +"""""""""""""" + +.. code-block:: html + + ##### --- Database Port and Data_Directory --- #### + +----------------------+----------------------------------------------------+ + | Name | Setting | + +----------------------+----------------------------------------------------+ + | data_directory | /var/lib/postgresql/data | + +----------------------+----------------------------------------------------+ + + ##### --- List of Tablespaces ---- ###### + +----------------------+----------------------+----------------------------------------------------+ + | Name | Owner | Location | + +----------------------+----------------------+----------------------------------------------------+ + | pg_default | postgres | | + | pg_global | postgres | | + +----------------------+----------------------+----------------------------------------------------+ + + + ##### --- Cluster Information --- #### + +------------------------------------------------------------------------------------------------------+ + Usename : postgres + Time : 2020-04-21 13:38:22.770077 +0000 UTC + Client Address : 172.19.0.1 + Client Hostname: + Version : PostgreSQL 9.6.17 on x86_64-pc-linux-gnu (Debian 9.6.17-2.pgdg90+1), compiled by + Started : 2020-04-21 13:36:59.909175 +0000 UTC + Is Slave : false + +------------------------------------------------------------------------------------------------------+ + + ##### --- Databases --- #### + +----------------------+------------+ + | Dat Name | Size | + +----------------------+------------+ + | postgres | 7071 kB | + | template1 | 6961 kB | + | template0 | 6961 kB | + +----------------------+------------+ + + ##### --- Index Cache Hit Ratios --- #### + + Database: postgres + +----------------------+------------+ + | Index Name | Ratio | + +----------------------+------------+ + | index hit rate | 0.00 | + +----------------------+------------+ + + ##### --- Table Cache Hit Ratios --- #### + Database: postgres + +----------------------+------------+ + | Index Name | Ratio | + +----------------------+------------+ + | cache hit rate | 0.00 | + +----------------------+------------+ + + ##### --- List of Wait_events for the entire Cluster - all-databases --- #### + No stats available + + ##### --- List of users and client_addr or client_hostname connected to --all-databases --- #### + +----------------------+------------+---------+----------------------+---------+ + | Wait Event Type | Client | State | Count | + +----------------------+------------+---------+----------------------+---------+ + | postgres | 172.19.0.1/32 | active | 1 | + +----------------------+------------+---------+----------------------+---------+ + + ##### --- Counters diff after 10 seconds --- #### + + +----------------------+-------------+------------+--------------+-------------+------------+-------------+------------+-------------+------------+------------+-----------+-----------+-----------+------------+ + | Database | Numbackends | XactCommit | XactRollback | BlksRead | BlksHit | TupReturned | TupFetched | TupInserted | TupUpdated | TupDeleted | Conflicts | TempFiles | TempBytes | Deadlocks | + +----------------------+-------------+------------+--------------+-------------+------------+-------------+------------+-------------+------------+------------+-----------+-----------+-----------+------------+ + | postgres | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | + | template0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | + | template1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | + +----------------------+-------------+------------+--------------+-------------+------------+-------------+------------+-------------+------------+------------+-----------+-----------+-----------+------------+ + + ##### --- Table access per database --- #### + Database: postgres + +----------------------------------------------------+------+--------------------------------+---------+ + | Relname | Kind | Datname | Count | + +----------------------------------------------------+------+--------------------------------+---------+ + | pg_class | r | postgres | 1 | + | pg_stat_database | v | postgres | 1 | + | pg_locks | v | postgres | 1 | + | pg_class_tblspc_relfilenode_index | i | postgres | 1 | + | pg_class_relname_nsp_index | i | postgres | 1 | + | pg_class_oid_index | i | postgres | 1 | + +----------------------------------------------------+------+--------------------------------+---------+ + + ##### --- Instance settings --- #### + Setting Value + allow_system_table_mods : off + application_name : + archive_command : (disabled) + archive_mode : off + archive_timeout : 0 + array_nulls : on + authentication_timeout : 60 + autovacuum : on + autovacuum_analyze_scale_factor : 0.1 + autovacuum_analyze_threshold : 50 + autovacuum_freeze_max_age : 200000000 + autovacuum_max_workers : 3 + autovacuum_multixact_freeze_max_age : 400000000 + autovacuum_naptime : 60 + autovacuum_vacuum_cost_delay : 20 + autovacuum_vacuum_cost_limit : -1 + autovacuum_vacuum_scale_factor : 0.2 + autovacuum_vacuum_threshold : 50 + autovacuum_work_mem : -1 + backend_flush_after : 0 + backslash_quote : safe_encoding + bgwriter_delay : 200 + bgwriter_flush_after : 64 + bgwriter_lru_maxpages : 100 + bgwriter_lru_multiplier : 2 + block_size : 8192 + bonjour : off + bonjour_name : + bytea_output : hex + check_function_bodies : on + checkpoint_completion_target : 0.5 + checkpoint_flush_after : 32 + checkpoint_timeout : 300 + checkpoint_warning : 30 + client_encoding : UTF8 + client_min_messages : notice + cluster_name : + commit_delay : 0 + commit_siblings : 5 + config_file : /var/lib/postgresql/data/postgresql.conf + constraint_exclusion : partition + cpu_index_tuple_cost : 0.005 + cpu_operator_cost : 0.0025 + cpu_tuple_cost : 0.01 + cursor_tuple_fraction : 0.1 + data_checksums : off + data_directory : /var/lib/postgresql/data + data_sync_retry : off + DateStyle : ISO, MDY + db_user_namespace : off + deadlock_timeout : 1000 + debug_assertions : off + debug_pretty_print : on + debug_print_parse : off + debug_print_plan : off + debug_print_rewritten : off + default_statistics_target : 100 + default_tablespace : + default_text_search_config : pg_catalog.english + default_transaction_deferrable : off + default_transaction_isolation : read committed + default_transaction_read_only : off + default_with_oids : off + dynamic_library_path : $libdir + dynamic_shared_memory_type : posix + effective_cache_size : 524288 + effective_io_concurrency : 1 + enable_bitmapscan : on + enable_hashagg : on + enable_hashjoin : on + enable_indexonlyscan : on + enable_indexscan : on + enable_material : on + enable_mergejoin : on + enable_nestloop : on + enable_seqscan : on + enable_sort : on + enable_tidscan : on + escape_string_warning : on + event_source : PostgreSQL + exit_on_error : off + external_pid_file : + extra_float_digits : 2 + force_parallel_mode : off + from_collapse_limit : 8 + fsync : on + full_page_writes : on + geqo : on + geqo_effort : 5 + geqo_generations : 0 + geqo_pool_size : 0 + geqo_seed : 0 + geqo_selection_bias : 2 + geqo_threshold : 12 + gin_fuzzy_search_limit : 0 + gin_pending_list_limit : 4096 + hba_file : /var/lib/postgresql/data/pg_hba.conf + hot_standby : off + hot_standby_feedback : off + huge_pages : try + ident_file : /var/lib/postgresql/data/pg_ident.conf + idle_in_transaction_session_timeout : 0 + ignore_checksum_failure : off + ignore_system_indexes : off + integer_datetimes : on + IntervalStyle : postgres + join_collapse_limit : 8 + krb_caseins_users : off + krb_server_keyfile : FILE:/etc/postgresql-common/krb5.keytab + lc_collate : en_US.utf8 + lc_ctype : en_US.utf8 + lc_messages : en_US.utf8 + lc_monetary : en_US.utf8 + lc_numeric : en_US.utf8 + lc_time : en_US.utf8 + listen_addresses : * + lo_compat_privileges : off + local_preload_libraries : + lock_timeout : 0 + log_autovacuum_min_duration : -1 + log_checkpoints : off + log_connections : off + log_destination : stderr + log_directory : pg_log + log_disconnections : off + log_duration : off + log_error_verbosity : default + log_executor_stats : off + log_file_mode : 0600 + log_filename : postgresql-%Y-%m-%d_%H%M%S.log + log_hostname : off + log_line_prefix : + log_lock_waits : off + log_min_duration_statement : -1 + log_min_error_statement : error + log_min_messages : warning + log_parser_stats : off + log_planner_stats : off + log_replication_commands : off + log_rotation_age : 1440 + log_rotation_size : 10240 + log_statement : none + log_statement_stats : off + log_temp_files : -1 + log_timezone : Etc/UTC + log_truncate_on_rotation : off + logging_collector : off + maintenance_work_mem : 65536 + max_connections : 100 + max_files_per_process : 1000 + max_function_args : 100 + max_identifier_length : 63 + max_index_keys : 32 + max_locks_per_transaction : 64 + max_parallel_workers_per_gather : 0 + max_pred_locks_per_transaction : 64 + max_prepared_transactions : 0 + max_replication_slots : 0 + max_stack_depth : 2048 + max_standby_archive_delay : 30000 + max_standby_streaming_delay : 30000 + max_wal_senders : 0 + max_wal_size : 64 + max_worker_processes : 8 + min_parallel_relation_size : 1024 + min_wal_size : 5 + old_snapshot_threshold : -1 + operator_precedence_warning : off + parallel_setup_cost : 1000 + parallel_tuple_cost : 0.1 + password_encryption : on + port : 5432 + post_auth_delay : 0 + pre_auth_delay : 0 + quote_all_identifiers : off + random_page_cost : 4 + replacement_sort_tuples : 150000 + restart_after_crash : on + row_security : on + search_path : "$user", public + segment_size : 131072 + seq_page_cost : 1 + server_encoding : UTF8 + server_version : 9.6.17 + server_version_num : 90617 + session_preload_libraries : + session_replication_role : origin + shared_buffers : 16384 + shared_preload_libraries : + sql_inheritance : on + ssl : off + ssl_ca_file : + ssl_cert_file : server.crt + ssl_ciphers : HIGH:MEDIUM:+3DES:!aNULL + ssl_crl_file : + ssl_ecdh_curve : prime256v1 + ssl_key_file : server.key + ssl_prefer_server_ciphers : on + standard_conforming_strings : on + statement_timeout : 0 + stats_temp_directory : pg_stat_tmp + superuser_reserved_connections : 3 + synchronize_seqscans : on + synchronous_commit : on + synchronous_standby_names : + syslog_facility : local0 + syslog_ident : postgres + syslog_sequence_numbers : on + syslog_split_messages : on + tcp_keepalives_count : 9 + tcp_keepalives_idle : 7200 + tcp_keepalives_interval : 75 + temp_buffers : 1024 + temp_file_limit : -1 + temp_tablespaces : + TimeZone : Etc/UTC + timezone_abbreviations : Default + trace_notify : off + trace_recovery_messages : log + trace_sort : off + track_activities : on + track_activity_query_size : 1024 + track_commit_timestamp : off + track_counts : on + track_functions : none + track_io_timing : off + transaction_deferrable : off + transaction_isolation : read committed + transaction_read_only : off + transform_null_equals : off + unix_socket_directories : /var/run/postgresql + unix_socket_group : + unix_socket_permissions : 0777 + update_process_title : on + vacuum_cost_delay : 0 + vacuum_cost_limit : 200 + vacuum_cost_page_dirty : 20 + vacuum_cost_page_hit : 1 + vacuum_cost_page_miss : 10 + vacuum_defer_cleanup_age : 0 + vacuum_freeze_min_age : 50000000 + vacuum_freeze_table_age : 150000000 + vacuum_multixact_freeze_min_age : 5000000 + vacuum_multixact_freeze_table_age : 150000000 + wal_block_size : 8192 + wal_buffers : 512 + wal_compression : off + wal_keep_segments : 0 + wal_level : minimal + wal_log_hints : off + wal_receiver_status_interval : 10 + wal_receiver_timeout : 60000 + wal_retrieve_retry_interval : 5000 + wal_segment_size : 2048 + wal_sender_timeout : 60000 + wal_sync_method : fdatasync + wal_writer_delay : 200 + wal_writer_flush_after : 128 + work_mem : 4096 + xmlbinary : base64 + xmloption : content + zero_damaged_pages : off + + ##### --- Processes start up command --- #### + No postgres process found + +Minimum auth role +^^^^^^^^^^^^^^^^^ + +This program needs to run some commands like ``getShardMap`` and to be able to run those commands +it needs to run under a user with the ``clusterAdmin`` or ``root`` built-in roles. diff --git a/docs/release_notes.rst b/docs/release_notes.rst index c2da6e8e..38c065f5 100644 --- a/docs/release_notes.rst +++ b/docs/release_notes.rst @@ -6,22 +6,25 @@ v3.2.0 released 2019-04-20 Improvements: - * :jirabug:`PT-1765`: Added documentation for ``DIFF_ROWS`` in ``pt-table-checksum``. - * :jirabug:`PT-1757`: ``pt-table-checksum``: Improved handling of Small Tables. - * :jirabug:`PT-1707`: Added support for IPv6 addresses. +* :jirabug:`PT-1773`: Don't make the foreign key check in ``pt-online-schema-change`` if not needed. +* :jirabug:`PT-1757`: ``pt-table-checksum`` can now handle small tables as a single chunk. +* :jirabug:`PT-1813`: MariaDB 10.4 is now supported. Bug fixes: - * :jirabug:`PT-1824`: Added 64-character constraint name limit. (Thank you Iwo Panowicz). - * :jirabug:`PT-1793`: Protocol parser now handles the year 2020. (Thank you Kei Tsuchiya). - * :jirabug:`PT-1782`: ``pt-online-schema-change``: No longer FK warning if no foreign keys. - * :jirabug:`PT-1773`: ``pt-online-schema-change``: FK check restricted if needed. - * :jirabug:`PT-1766`: ``pt-table-checksum``: ``DIFF_ROWS`` now computed correctly. - * :jirabug:`PT-1760`: ``pt-online-schema-change`` no longer stalls for stopped replica when slave is active. - * :jirabug:`PT-1759`: ``pt-stalk`` now collecting ``processlist`` and variables. - * :jirabug:`PT-1576`: ``pt-stalk mysql-only`` now working as expected. - * :jirabug:`PT-1502`: ``pt-online-schema-change`` now working with multi-source replication. - * :jirabug:`PT-297` : ``pt-online-schema-change`` doesn't break replication. +* :jirabug:`PT-1782`: ``pt-online-schema-change`` declined to handle tables because of foreign keys even when there were no foreign keys with some MariaDB 10.2 and MySQL 8 versions. +* :jirabug:`PT-1759`: ``pt-stalk`` with ``--mysql-only`` option didn't collect MySQL Status variables. +* :jirabug:`PT-1802`: ``pt-online-schema-change`` didn't handle self-referencing foreign keys properly which caused an unnecessarily high resource consumption. +* :jirabug:`PT-1766`: ``pt-table-checksum`` ``DIFF_ROWS`` was not computed correctly. +* :jirabug:`PT-1760`: ``pt-online-schema-change`` regression caused it to hang for a stopped replica when using replication channels on the slave. +* :jirabug:`PT-1707`: A number of the Percona Toolkit tools failed to operate in the IPv6 environment if the host address specified as a parameter was not enclosed in square brackets. +* :jirabug:`PT-1502`: ``pt-online-schema-change`` was not recognizing the slave with multi-source replication active. +* :jirabug:`PT-1824`: ``pt-online-schema-change`` allowed the name of a constraint to exceed 64 characters when ``--alter-foreign-keys-method=rebuild_constraints`` was used. (Thank you, Iwo Panowicz.) +* :jirabug:`PT-1765`: Documentation for ``DIFF_ROWS`` doesn't exist. +* :jirabug:`PT-297`: ``pt-online-schema-change`` could break replication. +* :jirabug:`PT-1768`: Source code for ``src/go/pt-mongodb-query-digest/pt-mongodb-query-digest`` was missing in the official source tar ball. +* :jirabug:`PT-1576`: ``pt-stalk` with ``--mysql-only`` option was not adding MySQL ``processlist`` information to the output file. +* :jirabug:`PT-1793`: ``pt-query-digest`` was unable to handle the year 2020 because of wrong ``tcpdump`` parsing. (Thank you, Kei Tsuchiya.) v3.0.13 released 2019-01-03 @@ -564,7 +567,7 @@ Bug Fixes: * Bug 1336734: ``pt-online-schema-change`` has implemented new ``--null-to-non-null`` flag which can be used to convert ``NULL`` columns to ``NOT NULL``. -* Bug 1362942: ``pt-slave-restart`` would fail to run on |MariaDB| 10.0.13 due to a different implementation of ``GTID``. +* Bug 1362942: ``pt-slave-restart`` would fail to run on MariaDB 10.0.13 due to a different implementation of ``GTID``. * Bug 1389041: ``pt-table-checksum`` had a high likelihood to skip a table when row count was around ``chunk-size`` * ``chunk-size-limit``. To address this issue a new ``--slave-skip-tolerance`` option has been implemented. diff --git a/docs/version-check.rst b/docs/version-check.rst index 4dcebf61..0ba8e5dc 100644 --- a/docs/version-check.rst +++ b/docs/version-check.rst @@ -99,7 +99,7 @@ of environments running Percona Software and it is good choice for majority of the users. Why not rely on Operating System's built in functionality for software updates? ------------------------------------------------------------------------------ +------------------------------------------------------------------------------- In many environments the Operating Systems repositories may not carry the latest version of software and newer versions of software often installed From 3943cc5767daa00a3d69f4b246888f517cc1db44 Mon Sep 17 00:00:00 2001 From: Paul Jacobs Date: Fri, 24 Apr 2020 16:51:41 +0300 Subject: [PATCH 5/7] RM-505 Updated year for 'COPYRIGHT, LICENSE, AND WARRANTY' section. --- docs/percona-toolkit.pod | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/percona-toolkit.pod b/docs/percona-toolkit.pod index e319377f..6aed847b 100644 --- a/docs/percona-toolkit.pod +++ b/docs/percona-toolkit.pod @@ -548,7 +548,7 @@ Many people have contributed code over the years. See each tool's =head1 COPYRIGHT, LICENSE, AND WARRANTY -Percona Toolkit is copyright 2011-2018 Percona LLC and/or its affiliates, et al. +Percona Toolkit is copyright 2011-2020 Percona LLC and/or its affiliates, et al. See each program's documentation for complete copyright notices. THIS PROGRAM IS PROVIDED "AS IS" AND WITHOUT ANY EXPRESS OR IMPLIED From 9d3485e79f2b5dc216ebfb748740b074d928a3cf Mon Sep 17 00:00:00 2001 From: PaulJacobs-percona <63049452+PaulJacobs-percona@users.noreply.github.com> Date: Fri, 24 Apr 2020 18:02:37 +0300 Subject: [PATCH 6/7] Update release_notes.rst --- docs/release_notes.rst | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/release_notes.rst b/docs/release_notes.rst index 38c065f5..46c8a67f 100644 --- a/docs/release_notes.rst +++ b/docs/release_notes.rst @@ -1,7 +1,7 @@ Percona Toolkit *************** -v3.2.0 released 2019-04-20 +v3.2.0 released 2019-04-23 ========================== Improvements: From feb79c37c81df070dde7e2b6cdfb67ef309b9f43 Mon Sep 17 00:00:00 2001 From: Paul Jacobs Date: Tue, 26 May 2020 17:04:56 +0300 Subject: [PATCH 7/7] PT-1833 3.1.0 release notes missing from documentation --- docs/release_notes.rst | 33 +++++++++++++++++++++++++++++++ docs/rn.3-1-0.txt | 44 ++++++++++++++++++++++++++++++++++++++++++ 2 files changed, 77 insertions(+) create mode 100644 docs/rn.3-1-0.txt diff --git a/docs/release_notes.rst b/docs/release_notes.rst index 46c8a67f..f2df0ac2 100644 --- a/docs/release_notes.rst +++ b/docs/release_notes.rst @@ -27,6 +27,39 @@ Bug fixes: * :jirabug:`PT-1793`: ``pt-query-digest`` was unable to handle the year 2020 because of wrong ``tcpdump`` parsing. (Thank you, Kei Tsuchiya.) +v3.1.0 released 2019-09-12 +========================== + +New Features: + +* :jirabug:`PT-1663`: Implement retention by bytes for pt-stalk + +Improvements: + +* :jirabug:`PT-1705`: Make pt-online-schema-change exit with different codes depending on the status +* :jirabug:`PT-1761`: Prevent pt-osc to run under MySQL 8.0.14+ & 8.0.17 +* :jirabug:`PT-1746`: diskstats not working for kernel 4.18+ + +Bugs Fixed: + +* :jirabug:`PT-1736`: pt-kill ignores --busy-time and --kill-busy-commands=Query when there is a process with Command=Execute +* :jirabug:`PT-1575`: pt-mysql-summary does not print PXC section for PXC 5.6 and 5.7 +* :jirabug:`PT-1728`: Pt-table-checksum failing to scan small tables that get wiped out often +* :jirabug:`PT-1720`: pt-pmp parses configuration files that lead to errors +* :jirabug:`PT-1114`: LP #1182180: pt-table-checksum fails when table is empty +* :jirabug:`PT-1715`: pt-upgrade documentation doesn't have the type tcpdump +* :jirabug:`PT-1344`: LP #1580428: pt-online-schema-change: Use of uninitialized value $host in string +* :jirabug:`PT-1492`: pt-kill in version 3.0.7 seems not to respect busy-time any longer +* :jirabug:`PT-1798`: CLONE - yum repos do not contain 3.1.1 of percona toolkit +* :jirabug:`PT-1797`: yum repos do not contain 3.1.1 of percona toolkit +* :jirabug:`PT-1633`: pt-config-diff doesn't handle innodb_temp_data_file_path correctly +* :jirabug:`PT-1630`: pt-table-checksum not working with galera cluster anymore since 3.0.11 +* :jirabug:`PT-1734`: Tailing log_error in pt-stalk doesn't work +* :jirabug:`PT-1732`: Typo in link on percona.com + + + + v3.0.13 released 2019-01-03 =========================== diff --git a/docs/rn.3-1-0.txt b/docs/rn.3-1-0.txt new file mode 100644 index 00000000..33fddff0 --- /dev/null +++ b/docs/rn.3-1-0.txt @@ -0,0 +1,44 @@ +.. _PT-3.1.0: + +================================================================================ +*Percona Toolkit* 3.1.0 +================================================================================ + +:Date: September 12, 2019 +:Installation: `Installing Percona Toolkit `_ + +New Features +================================================================================ + +* :jirabug:`PT-1663`: Implement retention by bytes for pt-stalk + + + +Improvements +================================================================================ + +* :jirabug:`PT-1705`: Make pt-online-schema-change exit with different codes depending on the status +* :jirabug:`PT-1761`: Prevent pt-osc to run under MySQL 8.0.14+ & 8.0.17 +* :jirabug:`PT-1746`: diskstats not working for kernel 4.18+ + + + +Bugs Fixed +================================================================================ + +* :jirabug:`PT-1736`: pt-kill ignores --busy-time and --kill-busy-commands=Query when there is a process with Command=Execute +* :jirabug:`PT-1575`: pt-mysql-summary does not print PXC section for PXC 5.6 and 5.7 +* :jirabug:`PT-1728`: Pt-table-checksum failing to scan small tables that get wiped out often +* :jirabug:`PT-1720`: pt-pmp parses configuration files that lead to errors +* :jirabug:`PT-1114`: LP #1182180: pt-table-checksum fails when table is empty +* :jirabug:`PT-1715`: pt-upgrade documentation doesn't have the type tcpdump +* :jirabug:`PT-1344`: LP #1580428: pt-online-schema-change: Use of uninitialized value $host in string +* :jirabug:`PT-1492`: pt-kill in version 3.0.7 seems not to respect busy-time any longer +* :jirabug:`PT-1798`: CLONE - yum repos do not contain 3.1.1 of percona toolkit +* :jirabug:`PT-1797`: yum repos do not contain 3.1.1 of percona toolkit +* :jirabug:`PT-1633`: pt-config-diff doesn't handle innodb_temp_data_file_path correctly +* :jirabug:`PT-1630`: pt-table-checksum not working with galera cluster anymore since 3.0.11 +* :jirabug:`PT-1734`: Tailing log_error in pt-stalk doesn't work +* :jirabug:`PT-1732`: Typo in link on percona.com + +