Commit Graph

4805 Commits

Author SHA1 Message Date
Carlos Salguero
3b52114e93 Fixed release date in changelog 2022-12-02 09:38:56 -03:00
Dario Minnucci
7e5c51d0fb Fix some spelling errors (#462)
Co-authored-by: Sveta Smirnova <svetasmirnova@users.noreply.github.com>
2022-12-01 15:54:24 +03:00
Anastasia Alexandrova
e8977042d4 Updated docs templates (#565) 2022-12-01 13:20:19 +01:00
Carlos Salguero
ed030fa3fb PT-2128 Updated version to 3.5.0 (#562) 2022-12-01 14:32:08 +03:00
Carlos Salguero
882d8787c7 Release 3.5.0 (#563)
* Changelog and version for Release 3.5.0

* PT-2076 add rhel9 dependency

* PT-2128 Updated version to 3.5.0

Co-authored-by: svetasmirnova <sveta.smirnova@percona.com>
Co-authored-by: EvgeniyPatlan <evgeniy.patlan@percona.com>
2022-12-01 14:31:46 +03:00
Kazuya Yokogawa
bc3056f29d PT-2110 - Fixed PTDEBUG output with --ignore-engines option (#555) 2022-11-30 14:51:49 +03:00
Anastasia Alexandrova
c9bf980ef5 PT-2117 Updated the version in docs (#564)
modified:   config/sphinx-build/conf.py
	modified:   docs/percona-toolkit.pod
2022-11-29 15:32:00 +01:00
Anastasia Alexandrova
b737f2cf9e PT-2117 Release notes 3.5.0 (#560)
Added release notes
Updated index
2022-11-28 14:58:06 +01:00
Sveta Smirnova
2f5a17b173 PT-2125 Documentation outdated or missed for tools, written in Go (#559)
Added docs/pt-mongodb-index-check.rst, updated docs/pt-k8s-debug-collector.rst
2022-11-18 15:34:11 +03:00
Sveta Smirnova
03ab27228f PT 2105 collect individual logs (#558)
* PT-2105 - Collect individual log files for PXC

Combined log files are hard to read by humans. Since pt-k8-debug-collector is the tool that
accesses data from the running pods, it can copy raw log files, necessary for troubleshooting PXC issues.
So, in addition to collecting logs.txt, this adds method getIndividualFiles for the Dumper that
reads individual files from PXC pods and stores them in the resulting archive.

Additionally, this commit fixes invalid timestamps in the resulting archive.

* PT-2105 - added support for non-default namespaces

* PT-2105 Let pt-k8-debug-collector to collect individual logs in PXC pods

Added test case for this new collection.

* Update go.mod

Co-authored-by: Viacheslav Sarzhan <slava.sarzhan@percona.com>

Co-authored-by: Viacheslav Sarzhan <slava.sarzhan@percona.com>
2022-11-17 19:32:19 +03:00
Sveta Smirnova
cf8f824d5e PT-2107 merge community prs 466 298 58 53 (#554)
* Correcting specified package type in error message (#58)

* Docs table regex (#53)

* Add more specific info about regex

* noop change to trigger checks

* Fix typo (#298)

* Updated readme

* Fix typo in comment

Co-authored-by: Carlos Salguero <carlos.salguero@percona.com>

* Fix for PT-1799 (#466)

Co-authored-by: Daniel Hoherd <daniel.hoherd@gmail.com>
Co-authored-by: Daniël van Eeden <git@myname.nl>
Co-authored-by: Moritz Lenz <moritz.lenz@noris.de>
Co-authored-by: Carlos Salguero <carlos.salguero@percona.com>
2022-11-16 20:48:17 +03:00
Chetan Shivashankar
1828526319 Fixing Readme (#527) 2022-09-28 20:59:11 +03:00
Thomas Deutschmann
a569c929eb Fix package name (#84)
The previous package name "percona-toolkit" is not a valid package name for
ExtUtils::MakeMaker:

  $ perl Makefile.PL
  Checking if your kit is complete...
  Looks good
  Warning: NAME must be a package name
  [...]

Let us use the same package name (Percona::Toolkit) various scripts in bin/
are already using.
2022-09-28 20:58:18 +03:00
E. Souhrada
9bd0fef2c2 PT-1739 - fix unexpected QRT disabling on slaves (#416) 2022-09-28 20:55:20 +03:00
kokopellis
60b3750d96 PT-1631 fix ioprofile ubuntu18.04, ubuntu16.04 support (#431) 2022-09-28 02:58:05 +03:00
yoku0825
cceb48619f Use full_output to avoid to die (PT-1967) (#494) 2022-09-28 02:55:30 +03:00
dm-2
26522d20fd PT-2080 Add JSON logging to pt-kill (#543)
* Add JSON output support to pt-kill

Introduces new flags `--log-json` and `--log-json-fields` to control JSON output:
- `--log-json`: when combined with `--print`, outputs kill information in JSON format instead of plain text, with the same fields as the `kill_log` table when using `--log-dsn`
- `--log-json-fields`: when combined with `--log-json`, adds user-defined key-value pairs to the JSON document that is output (such as cluster name or hostname); parameter value is in the format of `key1:value1,key2:value2`

* Convert --log-json to write to file, remove dependency on --print, update docs

The `--log-json` parameter now takes a file path value, and writes JSON output to this file.

The `--print` parameter is now independent and does not need to be specified to use `--log-json`.

Docs updated for clarity.

* Add chksm to JSON output, make JSON key names consistent

- Adds chksm outout to JSON output to make it easier to group similar queries
- Moves chksm code so that it is always executed, is accessible within the `log-json` scope, and isn't duplicated
- Change JSON key names to consistently use uppercase letters at start of words, change `ts` to `Timestamp`

* Update docs to match changed field names

* Rename JSON parameter, output to STDOUT, fix tests, add test for --json, bug fix for --query-id

- `--json` parameter must now be used in conjunction with `--print`; JSON output replaces normal `--print` output when `--json` is also specified
- `--json` output is now sent to STDOUT instead of a specified file, as its new behaviour is to change the output format of `--print` instead of logging to a file
- Renamed `--log-json` and `--log-json-fields` parameters to `--json` and `--json-fields` to better represent their new behaviour
- Refactored checksum code to prevent test failures when `$query->{'Info'}` is empty
- Added test for `--json` and `--json-fields` parameters
- Fixed bug where specifying `--query-id` would cause errors when `$query->{'Info'}` is empty

* Fix typo: Unkown -> Unknown
2022-09-27 23:41:17 +03:00
Christian Bartolomäus
db32ba584b Fix some typos in documentation of pt-query-digest (#553) 2022-09-12 17:46:35 +03:00
Sveta Smirnova
ec9cc2c910 Pt 1897 lock information in8.0 in pt stalk (#549)
* PT-1897 pt-stalk on MySQL 8 not collecting lock information

For version prior 8.0 pt-stalk continue using Information Schema INNODB_LOCKS and INNODB_LOCK_WAITS tables for collecting lock information.
For version 8.0 and higher pt-stalk uses tables data_locks and data_lock_waits in Performance Schema

* PT-1897 - Better MariaDB support

We cannot simply compare version number with 8.0 to identify if lock tables are in Performance Schema,
because MariaDB 10.x still have them in the Information Schema.
Therefore added additional flag, indicating which syntax we should use

* Tests for PT-1897

* PT-1897: added missed samples for tests

* PT-1897 Fixed retention test

Co-authored-by: Carlos Salguero <carlos.salguero@percona.com>
2022-08-30 18:14:26 +03:00
Sveta Smirnova
bc054ecaf7 PT-1897: removed affected version of protobuf from go.sum (#550) 2022-08-30 18:11:30 +03:00
Anastasia Alexandrova
cc5bfbe39f Pt 2091 doc migration render (#552)
PT-2091 Docs configuration for Render builds

* Added Sphinx-material theme and customizations
* Changed Makefile to use Material theme
* Customized the theme
* Added a separate config for render builds
2022-08-25 16:13:35 +02:00
Denys Kondratenko
210aafa85a Merge pull request #551 from percona/add_doc_options
Add options to specify doc build target
2022-08-24 14:28:22 +02:00
Denys Kondratenko
a9e321b6a2 fix debug 2022-08-24 11:08:30 +02:00
Denys Kondratenko
e4ded8fc75 Fix getopt to work on Mac, which has olf unix version. Add new option 2022-08-24 11:06:41 +02:00
Denys Kondratenko
e4fc31c047 Add options to specify doc build target 2022-08-23 18:04:59 +02:00
Anastasia Alexandrova
0e656391fa Merge pull request #548 from sleto-it/patch-1
v3.4.0 release notes
2022-08-18 12:33:27 +02:00
Rasika Chivate
af0ada1167 Update docs/release_notes.rst 2022-08-18 15:56:48 +05:30
Rasika Chivate
9cb28ef20a Update docs/release_notes.rst 2022-08-18 15:56:35 +05:30
Rasika Chivate
3458809530 Update docs/release_notes.rst 2022-08-18 15:56:29 +05:30
Santo
ed024d7bfa v3.4.0 release notes 2022-08-17 12:15:46 +02:00
Sveta Smirnova
19aa46d1a5 PT-1052 include numa information in pt tool output (#547)
* PT-1052: fix for pt-summary

* Re-added fix from commit 71fae6d117 into proper place: library directory
Added tests for PT-1052 (pt-summary only)

* Fixed tests for pt-summary,
set locale for pt-summary tests, so they are not affected by user environment.
Finished tests for PT-1052

* Added fix for PT-1983 into the proper place: library file

* PT-1052: fix for pt-stalk which now includes numastat data
2022-08-15 15:45:24 +03:00
I
a950b223ff Typo: Intsance -> Instance (#546) 2022-08-01 09:35:44 -03:00
Sveta Smirnova
ac3843bcb7 Pt 1897 lock information in8.0 in pt stalk (#544)
* PT-1897 pt-stalk on MySQL 8 not collecting lock information

For version prior 8.0 pt-stalk continue using Information Schema INNODB_LOCKS and INNODB_LOCK_WAITS tables for collecting lock information.
For version 8.0 and higher pt-stalk uses tables data_locks and data_lock_waits in Performance Schema

* PT-1897 - Better MariaDB support

We cannot simply compare version number with 8.0 to identify if lock tables are in Performance Schema,
because MariaDB 10.x still have them in the Information Schema.
Therefore added additional flag, indicating which syntax we should use

* Tests for PT-1897
2022-07-25 10:01:14 -03:00
Carlos Salguero
896fdcede8 Release 3.4.0 (#539)
* PT-1979 Improved mdb summary information

Added the MongoDB instance command line options to the output.
Also fixed the spacing in the replicaset section.

* Added new template file

* PT-1978 Implemented duplicated indexes detection

* WIP

* PT-1978 WIP

* PT-1978 New tool pt-mongodb-check-index

* Upgraded version and dependencies

* Updated Go sources

* Removed unused file

* Added version command

* Added changelog

* Updated required params

* Added system.profile to the ingored dbs

* Updated Changelog

* Updated version in all programs

* Updated changelog

* Update Changelog

Co-authored-by: rasika-chivate <95711051+rasika-chivate@users.noreply.github.com>

* Update Changelog

Co-authored-by: rasika-chivate <95711051+rasika-chivate@users.noreply.github.com>

* Update Changelog

Co-authored-by: rasika-chivate <95711051+rasika-chivate@users.noreply.github.com>

* Update Changelog

Co-authored-by: rasika-chivate <95711051+rasika-chivate@users.noreply.github.com>

* Update Changelog

Co-authored-by: rasika-chivate <95711051+rasika-chivate@users.noreply.github.com>

* PT-7 fix 3.4.0 build

* Updated Makefile

* Updated changelog

* Updated Changelog

Co-authored-by: rasika-chivate <95711051+rasika-chivate@users.noreply.github.com>
Co-authored-by: Evgeniy Patlan <evgeniy.patlan@percona.com>
2022-07-11 10:29:37 -03:00
Sveta Smirnova
8ebc9534c6 Pt 2075 fix tests for pt stalk (#541)
* Added mysql.proxies_priv to list of exceptions from checks in Sandbox.pm

* Fixed test for slave_status for 5.7+
2022-07-11 15:55:16 +03:00
Sveta Smirnova
07ee5eb1bf PS-2033, proof of concept (#540) 2022-07-11 15:51:29 +03:00
Carlos Salguero
d881738e2f PT-1978 Implemented duplicated indexes detection (#537)
* PT-1978 Implemented duplicated indexes detection

* WIP

* PT-1978 WIP

* PT-1978 New tool pt-mongodb-check-index

* Removed unused file

* Added version command

* Updated required params

* Added system.profile to the ingored dbs

* Fixed for CR
2022-04-20 09:15:45 -03:00
Carlos Salguero
8519e103ad PT-1979 Improved mdb summary information (#536)
* PT-1979 Improved mdb summary information

Added the MongoDB instance command line options to the output.
Also fixed the spacing in the replicaset section.

* Added new template file

* Upgraded deps due to security issues
2022-04-07 18:12:45 -03:00
Sveta Smirnova
2760e8c927 PT-2029 update contributing.md (#534)
* Work on PT-2029 started

* PT-2029: Polished Perl and Bash related instructions in CONTRIBUTE.md

* PT-2029: restructure for CONTRIBUTE.md

* PT-2029: more structure changes for CONTRIBUTE.md

* PT-2029 - added Go content to CONTRIBUTE.md and removed from README.md,
reorganized CONTRIBUTE.md: removed duplicate content, added Go and documentation related stuff
2022-03-22 16:24:37 +03:00
Sveta Smirnova
22ed941238 PT-1218: pt-stalk ominous open_tables function (#535)
After discussion change only affects error message that is more user-friendly now.
I also added two tests that check how open_tables function works in both cases:
with number of open tables less tha 1000 and greater than 1000
2022-03-22 09:33:05 -03:00
Denys Kondratenko
40f179cf26 Merge pull request #533 from percona/PT-2037-option_system_only_for_pt-stalk
PT-2037: option --system-only for pt-stalk
2022-02-07 13:48:03 +01:00
svetasmirnova
3767e57e15 PT-2037 - added test for the situation when both --system-only and --mysql-only are specified 2022-01-27 19:21:04 +03:00
svetasmirnova
9427c16314 PT-2037 - regression fixes
Re-added fix for PT-1340 that was reverted by fix for PT-1398
2022-01-23 03:55:35 +03:00
svetasmirnova
623fdaec91 PT-2037 - option --system-only for pt-stalk
This commit:
1. Moves all changes to the proper place: lib/bash/collect.sh
2. Refactors pt-stalk so it is more modular
3. Places fix for PT-1734 into the right place: lib/bash/collect.sh
4. Fixes tests for PT-1336
2022-01-22 21:21:05 +03:00
svetasmirnova
1f6c95f524 PT-2037 - reviewer suggestions
Refactoring pt-stalk to make it easier to call system and MySQL data collections separately
2022-01-21 04:12:43 +03:00
svetasmirnova
d6e899404e PT-2037 Option --system-only for pt-stalk
Option --system-only triggers only operating system related captures, ignoring all others.
2022-01-19 18:41:05 +03:00
svetasmirnova
5a46d3df77 PT-2037 Added option --system-only to pt-stalk 2022-01-11 01:20:10 +03:00
Nurlan Moldomurov
1c725e94e6 PMM-9337 Update go 1.17 (#529) 2022-01-03 15:02:23 +03:00
Maxim Kondratenko
037b6ed502 SAAS-800 Integrate WhiteSource 2021-12-27 11:41:37 +02:00
Sveta Smirnova
b2860eee31 PT-1336 pt-stalk removes user files from destination (#524)
* PT-1336 Added file name checks and -maxdepth 1 parameter

* PT-1336 pt-stalk removes user files from the destination directory

* Added check that files to be removed were created by pt-stalk

* Added option -maxdepth 1 to find command, so the tool does not search for files in the nested directories

* Added unit tests

* This should fix PT-1812 also
2021-12-10 09:18:18 -03:00