pgBackRest

Bug Fixes:

• Fix hang when the chunk buffer is smaller than the input buffer. (Reviewed by Andrew Pogrebnoi, Douglas J Hunley. Reported by crajac66.)
• Compare a new backup label only against its own full backup set. (Reviewed by Douglas J Hunley. Reported by Anton Glushakov.)
• Fix source archives generated by GitHub missing files required to build. (Reported by aardvarkzed.)

Features:

• PostgreSQL 19beta3 support. (Contributed by Lardière Sébastien. Reviewed by David Steele.)

Documentation Improvements:

• Document exception for dots in S3 bucket names when repo-s3-uri-style=path.
• Remove explicit hot_standby configuration from user guide.

NOTE TO PACKAGERS: A new distribution tarball is available which simplifies the build process by providing pregenerated HTML documentation, man page, and code. The tarball is attached to each release as an asset and is named pgbackrest-{version}.tar.gz. See the README.md in the tarball for details. Please use the new distribution tarball to avoid the additional build tooling required to generate code in future releases.

NOTE TO PACKAGERS: There is a new optional dependency on libsystemd.

IMPORTANT NOTE: Starting with this release, only the restore command may be run as root by default. Use allow-root to run other commands as root (though this is not recommended).

Bug Fixes:

• Fix expire removing a backup in progress on another host. (Reviewed by Douglas J Hunley. Reported by Dmitrii.)
• Fix archive-push-queue-max not enforced when a WAL file errors. (Reviewed by Stefan Fercot. Reported by vut12.)
• Fix async archive-get failure during recovery across a timeline switch. (Reviewed by Douglas J Hunley. Reported by Jimmy Yih.)
• Fix potential buffer overrun in error module. (Fixed by Christophe Pettus. Reviewed by David Steele.)
• Fix use-after-free of parallel protocol client. (Reviewed by Douglas J Hunley. Reported by Georgy Shelkovy.)
• Fix heap overflow when a pg option is set without pg1. (Reviewed by Douglas J Hunley. Reported by Naveen.)

Features:

• PostgreSQL 19beta2 support. (Reviewed by Stefan Fercot.)
• Add archive-expire-before option to clean up WAL archive. (Contributed by Stefan Fercot. Reviewed by David Steele.)
• Add batch delete for Azure storage. (Reviewed by Douglas J Hunley, Crispy.)
• Add support for S3 Outposts. (Contributed by Shiva Kumar Ambigi. Reviewed by David Steele, Roberto Mello.)
• Add S3 process authentication. (Reviewed by Andrew Charlton. Suggested by Andrew Charlton.)

Improvements:

• Reconnect SFTP storage after the server drops an idle connection. (Reviewed by Stefan Fercot. Suggested by mustafa0x, tisserat.)
• Add user/group caching for faster manifest build. (Contributed by Gunnar Lindholm. Reviewed by David Steele.)
• Add per-repo backup progress to info command output. (Contributed by Will Morland. Reviewed by David Steele, Stefan Fercot.)
• Add backup.info checks to verify command. (Contributed by Denis Garsh. Reviewed by David Steele, Douglas J Hunley.)
• Allow the S3 STS endpoint to be configured. (Contributed by Simon Gratton. Reviewed by David Steele.)
• Add archive-push-batch-size to limit WAL pushed per asynchronous run. (Reviewed by Stefan Fercot.)
• Exit async archive-push on first error. (Reviewed by Stefan Fercot. Suggested by Lardière Sébastien.)
• Harden HTTP chunked response parsing. (Contributed by Shubham. Reviewed by David Steele.)
• Error when running as root unless allow-root is enabled. (Reviewed by Douglas J Hunley.)
• Fewer binary searches when building manifest. (Contributed by Gunnar Lindholm. Reviewed by David Steele.)
• Improve seek performance during block incremental delta restore. (Reviewed by David Christensen, Douglas J Hunley.)
• Bundle backup files in order rather than scanning for a better fit. (Reviewed by Stefan Fercot.)
• Report the underlying error when a query fails to complete. (Reviewed by Andrew Pogrebnoi. Suggested by Marco Fontana.)
• Report the actual error when an S3 credential request fails. (Reviewed by Douglas J Hunley. Suggested by Mitchell Grice.)
• Report archive-push spool path errors to the PostgreSQL log. (Reviewed by Douglas J Hunley. Suggested by Don Seiler.)
• Hint that pgBackRest may be out of date when a version is unsupported.
• Add systemd notify integration. (Contributed by Andrew Jackson. Reviewed by David Steele.)
• Suppress unused parameter errors in meson compiler probes. (Contributed by Jörg Plate. Reviewed by David Steele.)
• C11 is now the minimum C standard. (Reviewed by Mohammad Ali Nazir Kosar.)

Documentation Improvements:

• Make stanza option internal for the repo-* commands. (Reviewed by Stefan Fercot.)
• Document that info reads encryption settings from global section. (Reviewed by Stefan Fercot. Suggested by Ron Johnson.)
• Document that expire-auto uses the backup command configuration. (Reviewed by Stefan Fercot. Suggested by Lardière Sébastien.)
• Document adjusting the logrotate su directive for a dedicated user. (Reviewed by Douglas J Hunley. Suggested by lkanbus.)
• Document that end-of-line comments are not supported in config files. (Reviewed by Douglas J Hunley. Suggested by Alex Richman.)

Test Suite Improvements:

• Fix Alpine group conflicts in CI containers. (Contributed by Artur Zakirov. Reviewed by David Steele.)

IMPORTANT NOTE: The minimum values for the repo-storage-upload-chunk-size option have increased. They now represent the minimum allowed by the vendors.

Bug Fixes:

• Fix deadlock due to logging in signal handler. (Fixed by Maxim Michkov. Reviewed by David Steele.)

Features:

• HTTP support for S3, GCS, and Azure. (Contributed by Will Morland. Reviewed by David Steele.)
• Allow expiration of oldest full backup regardless of current retention. (Contributed by Stefan Fercot. Reviewed by David Steele. Suggested by Ron Johnson.)
• Support for Azure managed identities. (Contributed by Moiz Ibrar, Matthew Mols. Reviewed by David Steele.)
• Experimental support for S3 EKS pod identity. (Contributed by Pierre BOUTELOUP. Reviewed by David Steele.)
• Allow configuration of TLS cipher suites. (Contributed by Gunnar "Nick" Bluth. Reviewed by David Steele.)
• Allow process priority to be set. (Reviewed by Douglas J Hunley.)

Improvements:

• Allow dots in S3 bucket names when using path-style URIs. (Contributed by Joakim Hindersson. Reviewed by David Steele.)
• Require TLS >= 1.2 unless verification is disabled. (Reviewed by Douglas J Hunley, Gunnar "Nick" Bluth.)
• Dynamically size S3/GCS/Azure chunks for large uploads. (Reviewed by Douglas J Hunley. Suggested by Timothée Peignier.)
• Optimize S3/GCS/Azure chunk size for small files. (Reviewed by Douglas J Hunley.)
• Remove support for PostgreSQL 9.5. (Reviewed by Douglas J Hunley.)
• Improve logging of default for options with an unresolved dependency. (Reviewed by Stefan Fercot.)

Documentation Improvements:

• Remove explicit max_wal_senders/wal_level configuration from user guide. (Suggested by Jamie Nguyen.)
• Clarify that bundling is useful for filesystems with large block sizes. (Suggested by Ron Johnson.)

Bug Fixes:

• Unnest HTTP/TLS/socket timeouts. (Reviewed by David Christensen.)
• Fix possible segfault in page checksum error message. (Fixed by Zsolt Parragi. Reviewed by David Steele.)

Features:

• Add repo-symlink option to suppress creation of repository symlinks. (Reviewed by Douglas J Hunley. Suggested by Ron Johnson.)

Improvements:

• Add HTTP retries for 408 and 429 errors. (Reviewed by David Christensen.)

Bug Fixes:

• Fix issue with adhoc expiration when no backups in a repository. (Reviewed by Stefan Fercot. Reported by Anup Gupta.)

Features:

• Add restore progress to info command output. (Contributed by Denis Garsh, Maxim Michkov. Reviewed by David Steele.)
• Add progress-only detail level for info command output. (Contributed by Denis Garsh. Reviewed by David Steele, Stefan Fercot.)

Improvements:

• Retry failed reads on object stores. (Reviewed by David Christensen.)
• Fix defaults in command-line help. (Reviewed by David Christensen, Chris Bandy.)

Documentation Improvements:

• Describe discrete option values in a list where appropriate. (Contributed by Anton Kurochkin. Reviewed by David Steele.)
• Fix "less than" in help output for archive-mode option. (Contributed by Anton Kurochkin. Reviewed by David Steele.)

Bug Fixes:

• Revert "calculate content-md5 on S3 only when required". (Reviewed by David Christensen. Reported by Frank Brendel.)
• Fix lower bounds checking for option keys. (Reviewed by David Christensen, Wolfgang Walther. Reported by Wolfgang Walther.)

Bug Fixes:

• Fix block incremental restore issue on non-default repository. (Reviewed by David Christensen, Aleksander Łukasz. Reported by Aleksander Łukasz.)
• Do not set recovery_target_timeline=current for PostgreSQL < 12. (Reviewed by Stefan Fercot.)
• Fix expire archive range logging. (Reviewed by Stefan Fercot. Reported by Aleš Zelený.)
• Fix error reporting for queries with no results. (Reviewed by Stefan Fercot. Reported by Susantha Bathige.)

Features:

• Verify recovery target timeline. (Reviewed by Stefan Fercot.)
• Allow verification of a specified backup. (Contributed by Maxim Michkov. Reviewed by David Steele.)
• Add support for S3/GCS requester pays. (Contributed by Timothée Peignier. Reviewed by David Steele.)
• PostgreSQL 18 experimental support. (Reviewed by Stefan Fercot.)
• Allow connections to PostgreSQL on abstract domain sockets. (Reviewed by Chris Bandy. Suggested by Chris Bandy.)
• Add numeric output to version command. (Contributed by Stefan Fercot. Reviewed by David Steele.)

Improvements:

• Allow backup command to operate on remote repositories. (Reviewed by Stefan Fercot.)
• Use lz4 for protocol compression. (Reviewed by Stefan Fercot.)
• Calculate content-md5 on S3 only when required. (Reviewed by David Christensen.)
• Warn when a value for a multi-key option is overwritten. (Reviewed by David Christensen, Stefan Fercot.)
• Add detail logging for expired archive path. (Contributed by Stefan Fercot. Reviewed by David Steele.)
• Remove support for PostgreSQL 9.4. (Reviewed by Stefan Fercot.)
• Remove autoconf/make build. (Reviewed by David Christensen.)

Documentation Improvements:

• Fix documentation for specifying multiple stanzas with tls-server-auth. (Reviewed by David Christensen, Stefan Fercot. Suggested by Terry MacAndrew.)
• Clarify incremental backup expiration. (Reviewed by Stefan Fercot.)
• Clarify requirement for local/remote pgBackRest versions to match. (Contributed by Greg Clough. Reviewed by David Steele.)
• Add FAQ about exporting self-contained cluster. (Contributed by Stefan Fercot. Reviewed by David Steele.)
• Caveat --tablespace-map-all regarding tablespace creation. (Reviewed by Stefan Fercot, Christophe Courtois. Suggested by Christophe Courtois.)
• Clarify behavior of --repo-retention-full-type. (Reviewed by Antoine Beaupré. Suggested by Antoine Beaupré.)
• Change --process-max recommendation for object stores to --repo-bundle. (Reviewed by Stefan Fercot.)
• Update unix_socket_directory to unix_socket_directories. (Contributed by hyunkyu han. Reviewed by David Steele.)
• Recommend not placing spool-path within pg_xlog/pg_wal. (Reviewed by Martín Marqués, Don Seiler. Suggested by Martín Marqués.)

Bug Fixes:

• Fix issue after disabling bundling with block incremental enabled. (Reviewed by David Christensen.)

Documentation Improvements:

• Clarify behavior of multiple configuration files. (Reviewed by Paul Bierly. Suggested by Paul Bierly.)

Bug Fixes:

• Fix issue with version/help commands attempting to load pgbackrest.conf. (Reviewed by Stefan Fercot. Reported by Bradford Boyle, Julian.)

Test Suite Improvements:

• Stabilize async archiving in integration tests. (Contributed by Viktor Kurilko. Reviewed by David Steele.)

NOTE TO PACKAGERS: This is last feature release to support the autoconf/make build. Please migrate to meson if you have not already done so. 2.54.X patch releases (if any) will continue to support autoconf/make.

Bug Fixes:

• Fix PostgreSQL query performance for large datasets. (Fixed by Thibault Vincent, David Steele. Reviewed by David Christensen, Antoine Millet. Reported by Antoine Millet.)

Features:

• Allow repositories on versioned storage to be read at a target time. (Reviewed by Stefan Fercot, David Christensen.)
• Allow requested standby backup to proceed with no standby. (Reviewed by Stefan Fercot.)

Improvements:

• Summarize backup reference list for info command text output. (Contributed by Stefan Fercot. Reviewed by David Steele.)
• Refresh web-id token for each S3 authentication. (Contributed by Brent Graveland. Reviewed by David Steele.)
• Correctly display current values for indexed options in help. (Reviewed by David Christensen.)
• Save backup.info only when contents have changed. (Reviewed by Stefan Fercot.)
• Remove limitation on reading files in parallel during restore. (Reviewed by David Christensen.)
• Improve SFTP error messages. (Contributed by Reid Thompson. Reviewed by David Steele.)

Documentation Features:

• Add performance tuning section to user guide. (Reviewed by Stefan Fercot.)

Documentation Improvements:

• Clarify source for data_directory. (Contributed by Stefan Fercot. Reviewed by David Steele. Suggested by Matthias.)
• Better logic for deciding when a summary should be lower-cased. (Suggested by Daniel Westermann.)

Bug Fixes:

• Fix permissions when restore run as root user. (Reviewed by Stefan Fercot. Reported by Will M.)
• Fix segfault on delayed connection errors. (Reviewed by David Christensen. Reported by Anton Glushakov.)
• Skip local repository duplicate check for SFTP. (Fixed by Reid Thompson. Reviewed by David Steele. Reported by Anton Kurochkin.)

Improvements:

• PostgreSQL 17beta3 support.