v3.0.2 Mini Install & PolarDB 15

Features

• Minimal Installation support with pgsql-min.yml (NODE, PGSQL, ETCD only)
• Official support for the latest PolarDB for PostgreSQL Kernel v15
• Optimize monitor.pg_table_bloat and monitor.pg_index_bloat with security definer wrap functions to avoid PolarDB statistics view permission issue.
• Honor prometheus_enabled, grafana_enabled option in target register, not register when disabled.
• Add PGDATABASE and PGPORT environment variable to /etc/profile.d/pgsql.sh, set to pg_primary_db (default postgres)

Changes

• Remove PolarDB 11, CloudberryDB 1.5.4 packages from pgsql repo.
• New dedicate repo for PolarDB 15, CloudberryDB 1.6.0, MSSQL, IvorySQL.

Bug Fix

• Fix redis /etc/tmp.files.d entry name
• Set PGHOST and PGPORT when managing pgbouncer users.
• Remove support for pg_snakeoil due to clamv deps break on EL8
• Remove role pgsql notify handler for ansible 2.9 compatibility

Checksums

MD5 (pigsty-v3.0.2.tgz) = e366b754ec9b57f5e22c5feadd8f0901

v3.0.1: Oracle / Patroni4 / BugFix

v3.0.1 Released @ 2024-08-31

Features & Enhancement

• Oracle Compatibility through PolarDB-O (3rd commercial kernel)
• Rewrite monitoring views and SQL statements using Oracle-compatible SQL syntax
• Patroni 4 support and adaptation
• New extension pg_analytics enhances PostgreSQL with analytics capabilities via DuckDB
• Added new extensions: odbc_fdw and jdbc_fdw, providing universal external data source connectivity
• Added new kernel cloudberrydb (open-source fork by the original Greenplum developers)
• Add a restart after PGSQL primary initialization to apply pg_param & pg_files, no need to reboot after provisioning a Supabase PG / PolarDB cluster.
• Add new grafana plugin: volkovlabs-rss-datasource
• Add new dashboard panel: Extensions in PGCAT databases
• Bump Pev2 version to 1.12.1

Bug Fix

• Fix Grafana 11.1.4 panel plugin failed to load by default
• Fix BlackBox Exporter Ping probe failed on certain OS Distro (run as root rather than prometheus)
• Make sure /var/run/postgresql and /var/run/redis temporary directory always auto-create after reboot
• Fix cache.yml playbook not correctly remove outdated Patroni 3.0.4 RPM package
• Correct description errors in some alerting rules
• Remove outdated Bootstrap User/HBA parameters from Patroni configuration file

MD5 (pigsty-v3.0.1.tgz) = 277a05f8dc944b9b5ef99b682b300b8d
MD5 (pigsty-pkg-v3.0.1.d12.x86_64.tgz) = 6ca11ea3d3531f2d208fd7dd3b251234
MD5 (pigsty-pkg-v3.0.1.el8.x86_64.tgz) = 12aa6f2eaac46c907e544677ade1d81f
MD5 (pigsty-pkg-v3.0.1.el9.x86_64.tgz) = f1cc152e688ff94f984fb45b1ae28968
MD5 (pigsty-pkg-v3.0.1.u22.x86_64.tgz) = bad1ab8a54df467c46e7d750d92a56c1

Full Changelog: v3.0.0...v3.0.1

v3.0.0: Kernel, Extension, Service

Pigsty v3.0.0 Released (@2024-08-28)! Get started with:

curl -fsSL https://repo.pigsty.io/get | bash; cd ~/pigsty;
./bootstrap; ./configure; ./install.yml

Check the full Releasenote, and 中文版发行注记 for details

---

Highlight Features

Extension Exploding:

Pigsty now has unprecedented 333 available extensions for PostgreSQL. This includes 121 extension RPM packages and 133 DEB packages, surpassing the total number of extensions provided by the PGDG official repository (135 RPM/109 DEB).
Pigsty has ported unique PG extensions from the EL/DEB system to each other, achieving a great alignment of extension ecosystems between the two major distributions.

A crude list of the extension ecosystem is as follows:

- timescaledb periods temporal_tables emaj table_version pg_cron pg_later pg_background pg_timetable
- postgis pgrouting pointcloud pg_h3 q3c ogr_fdw geoip #pg_geohash #mobilitydb
- pgvector pgvectorscale pg_vectorize pg_similarity pg_tiktoken pgml #smlar
- pg_search pg_bigm zhparser hunspell
- hydra pg_lakehouse pg_duckdb duckdb_fdw pg_fkpart pg_partman plproxy #pg_strom citus
- pg_hint_plan age hll rum pg_graphql pg_jsonschema jsquery index_advisor hypopg imgsmlr pg_ivm pgmq pgq #rdkit
- pg_tle plv8 pllua plprql pldebugger plpgsql_check plprofiler plsh #pljava plr pgtap faker dbt2
- prefix semver pgunit md5hash asn1oid roaringbitmap pgfaceting pgsphere pg_country pg_currency pgmp numeral pg_rational pguint ip4r timestamp9 chkpass #pg_uri #pgemailaddr #acl #debversion #pg_rrule
- topn pg_gzip pg_http pg_net pg_html5_email_address pgsql_tweaks pg_extra_time pg_timeit count_distinct extra_window_functions first_last_agg tdigest aggs_for_arrays pg_arraymath pg_idkit pg_uuidv7 permuteseq pg_hashids
- sequential_uuids pg_math pg_random pg_base36 pg_base62 floatvec pg_financial pgjwt pg_hashlib shacrypt cryptint pg_ecdsa pgpcre icu_ext envvar url_encode #pg_zstd #aggs_for_vecs #quantile #lower_quantile #pgqr #pg_protobuf
- pg_repack pg_squeeze pg_dirtyread pgfincore pgdd ddlx pg_prioritize pg_checksums pg_readonly safeupdate pg_permissions pgautofailover pg_catcheck preprepare pgcozy pg_orphaned pg_crash pg_cheat_funcs pg_savior table_log pg_fio #pgpool pgagent
- pg_profile pg_show_plans pg_stat_kcache pg_stat_monitor pg_qualstats pg_store_plans pg_track_settings pg_wait_sampling system_stats pg_meta pgnodemx pg_sqlog bgw_replstatus pgmeminfo toastinfo pagevis powa pg_top #pg_statviz #pgexporter_ext #pg_mon
- passwordcheck supautils pgsodium pg_vault anonymizer pg_tde pgsmcrypto pgaudit pgauditlogtofile pg_auth_mon credcheck pgcryptokey pg_jobmon logerrors login_hook set_user pg_snakeoil pgextwlist pg_auditor noset #sslutils
- wrappers multicorn mysql_fdw tds_fdw sqlite_fdw pgbouncer_fdw mongo_fdw redis_fdw pg_redis_pubsub kafka_fdw hdfs_fdw firebird_fdw aws_s3 log_fdw #oracle_fdw #db2_fdw
- orafce pgtt session_variable pg_statement_rollback pg_dbms_metadata pg_dbms_lock pgmemcache #pg_dbms_job #wiltondb
- pglogical pgl_ddl_deploy pg_failover_slots wal2json wal2mongo decoderbufs decoder_raw mimeo pgcopydb pgloader pg_fact_loader pg_bulkload pg_comparator pgimportdoc pgexportdoc #repmgr #slony
- gis-stack rag-stack fdw-stack fts-stack etl-stack feat-stack olap-stack supa-stack stat-stack json-stack

Plugable Kernels:

Pigsty v3 allows you to replace the PostgreSQL kernel, currently supporting Babelfish (SQL Server compatible, with wire protocol emulation), IvorySQL (Oracle compatible), and RAC PolarDB for PostgreSQL.
Additionally, self-hosted Supabase is now available on Debian systems. You can emulate MSSQL (via WiltonDB), Oracle (via IvorySQL), Oracle RAC (via PolarDB), MongoDB (via FerretDB), and Firebase (via Supabase) in Pigsty
with production-grade PostgreSQL clusters featuring HA, IaC, PITR, and monitoring.

Pro Edition:

We now offer PGSTY Pro, a professional edition that provides value-added services on top of the open-source features.
The professional edition includes additional modules: MSSQL, Oracle, Mongo, K8S, Victoria, Kafka, etc., and offers broader support for PG major versions, operating systems, and chip architectures.
It provides offline installation packages customized for precise minor versions of all operating systems and support for legacy systems like EL7, Debian 11, and Ubuntu 20.04.

---

Major Changes

This Pigsty release updates the major version number from 2.x to 3.0, with several significant changes:

• Primary supported operating systems updated to: EL 8 / EL 9 / Debian 12 / Ubuntu 22.04
  • EL7 / Debian 11 / Ubuntu 20.04 systems are now deprecated and no longer supported.
  • Users needing to run on these systems should consider our subscription service.
• Default to online installation. Offline packages are no longer provided to resolve minor OS version compatibility issues.
  • The bootstrap process will no longer prompt for downloading offline packages, but if /tmp/pkg.tgz exists, it will still use the offline package automatically.
  • For offline installation, please create offline packages yourself or consider our subscription service.
• Unified adjustment of upstream software repositories used by Pigsty, address changes, and GPG signing and verification for all packages.
  • Standard repository: https://repo.pigsty.io/{apt/yum}
  • Domestic mirror: https://repo.pigsty.cc/{apt/yum}
• API parameter changes and configuration template changes
  • Configuration templates for EL and Debian systems are now consolidated, with differing parameters managed in the roles/node_id/vars/ directory.
  • Configuration directory changes, all configuration file templates are now placed in the conf directory and categorized into default, dbms, demo, build.
• Docker is now completely treated as a separate module and will not be downloaded by default
• New beta module: KAFKA
• New beta module: KUBE

---

Other New Features

• Epic enhancement of PG OLAP analysis capabilities: DuckDB 1.0.0, DuckDB FDW, and PG Lakehouse, Hydra have been ported to the Debian system.
• Strengthened PG vector search and full-text search capabilities: Vectorscale provides DiskANN vector indexing, Hunspell dictionary support, pg_search 0.8.6.
• Resolved package build issues for ParadeDB, now available on Debian/Ubuntu.
• All required extensions for Supabase are now available on Debian/Ubuntu, making Supabase self-hostable across all OSes.
• Provided capability for scenario-based pre-configured extension stacks. If you're unsure which extensions to install, we offer extension recommendation packages (Stacks) tailored for specific application scenarios.
• Created metadata tables, documentation, indexes, and name mappings for all PostgreSQL ecosystem extensions, ensuring alignment and usability for both EL and Debian systems.
• Enhanced proxy_env parameter functionality to mitigate DockerHub ban issues, simplifying configuration.
• Established a new dedicated software repository offering all extension plugins for versions 12-17, with the PG16 extension repository implemented by default in Pigsty.
• Upgraded existing software repositories, employing standard signing and verification mechanisms to ensure package integrity and security. The APT repository adopts a new standard layout built through reprepro.
• Provided sandbox environments for 1, 2, 3, 4, 43 nodes: meta, dual, trio, full, prod, and quick configuration templates for 7 major OS Distros.
• Add PostgreSQL 17 and pgBouncer 1.23 metrics support in pg_exporter config, adding related dashboard panels.
• Add logs panel for PGSQL Pgbouncer / PGSQL Patroni Dashboard
• Add new playbook cache.yml to make offline packages, instead of bash bin/cache and bin/release-pkg

---

API Changes

• New parameter option: pg_mode now has several new options:
  • pgsql: Standard PostgreSQL high availability cluster.
  • citus: Citus horizontally distributed PostgreSQL native high availability cluster.
  • gpsql: Monitoring for Greenplum and GP compatible databases (Pro edition).
  • mssql: Install WiltonDB / Babelfish to provide Microsoft SQL Server compatibility mode for standard PostgreSQL high availability clusters, with wire protocol level support, extensions unavailable.
  • ivory: Install IvorySQL to provide Oracle compatibility for PostgreSQL high availability clusters, supporting Oracle syntax/data types/functions/stored procedures, extensions unavailable (Pro edition).
  • polar: Install PolarDB for PostgreSQL (PG RAC) open-source version to support localization database capabilities, extensions unavailable (Pro edition).
• New parameter: pg_parameters, used to specify parameters in postgresql.auto.conf at the instance level, overriding cluster configurations for personalized settings on different instance members.
• New parameter: pg_files, used to specify additional files to be written to the PostgreSQL data directory, to support license feature required by some kernel forks.
• New parameter: repo_extra_packages, used to specify additional packages to download, to be used in conjunction with repo_packages, facilitating the specification of extension lists unique to OS versions.
• Parameter renaming: `patr...

v2.7.0: Extension Overwhelming

Get started with: bash -c "$(curl -fsSL https://get.pigsty.cc/install)"

Highlight

There are overall 255 extensions available in Pigsty now! check the extension list for details.

Adding numerous new extensions written in rust & pgrx:

• pg_search v0.7.0 : Full text search over SQL tables using the BM25 algorithm
• pg_lakehouse v0.7.0 : Query engine over object stores like S3 and table formats like Delta Lake
• pg_analytics v0.6.1 : Accelerates analytical query processing inside Postgres
• pg_graphql v1.5.4 : GraphQL support to your PostgreSQL database.
• pg_jsonschema v0.3.1 : PostgreSQL extension providing JSON Schema validation
• wrappers v0.3.1 : Postgres Foreign Data Wrappers Collections by Supabase
• pgmq v1.5.2 : A lightweight message queue. Like AWS SQS and RSMQ but on Postgres.
• pg_tier v0.0.3 : Postgres Extension written in Rust, to enable data tiering to AWS S3
• pg_vectorize v0.15.0 : The simplest way to orchestrate vector search on Postgres
• pg_later v0.1.0 : Execute SQL now and get the results later.
• pg_idkit v0.2.3 : Generating many popular types of identifiers
• plprql v0.1.0 : Use PRQL in PostgreSQL
• pgsmcrypto v0.1.0 : PostgreSQL SM Algorithm Extension
• pg_tiktoken v0.0.1 : OpenAI tiktoken tokenizer for postgres
• pgdd v0.5.2 : Access Data Dictionary metadata with pure SQL

And some new extensions in plain C & C++

• parquet_s3_fdw 1.1.0 : ParquetS3 Foreign Data Wrapper for PostgresSQL
• plv8 3.2.2 : V8 Engine Javascript Procedural Language add-on for PostgreSQL
• md5hash 1.0.1 : Custom data type for storing MD5 hashes rather than text
• pg_tde 1.0 alpha: Experimental encrypted access method for PostgreSQL
• pg_dirtyread 2.6 : Read dead but unvacuumed tuples from a PostgreSQL relation
• New deb PGDG extensions: pg_roaringbitmap, pgfaceting, mobilitydb, pgsql-http, pg_hint_plan, pg_statviz, pg_rrule
• New rpm PGDG extensions: pg_profile, pg_show_plans
• Switch to PGDG's pgsql_http, pgsql_gzip, pg_net, pg_bigm instead of Pigsty RPM on EL distros.

New Features

• running on certain docker containers.
• prepare arm64 packages for infra & pgsql packages for el & deb distros.
• new installation script to download from cloudflare, and more hint.
• new monitoring dashboard for PGSQL PITR to assist the PITR procedure.
• make preparation for running pigsty inside docker VM containers
• add a fool-proof design for running pgsql.yml on node that is not managed by pigsty
• add config template for each major version: el7, el8, el9, debian11, debian12, ubuntu20, ubuntu22

Software Upgrade

• PostgreSQL 16.3
• Patroni 3.3.0
• pgBackRest 2.51
• vip-manager v2.5.0
• Haproxy 2.9.7
• Grafana 10.4.2
• Prometheus 2.51
• Loki & Promtail: 3.0.0 (breaking changes!)
• Alertmanager 0.27.0
• BlackBox Exporter 0.25.0
• Node Exporter 1.8.0
• pgBackrest Exporter 0.17.0
• duckdb 0.10.2
• etcd 3.5.13
• minio-20240510014138 / mcli-20240509170424
• pev2 v1.8.0 -> v1.11.0
• pgvector 0.6.1 -> 0.7.0
• pg_tle: v1.3.4 -> v1.4.0
• hydra: v1.1.1 -> v1.1.2
• duckdb_fdw: v1.1.0 recompile with libduckdb 0.10.2
• pg_bm25 0.5.6 -> pg_search 0.7.0
• pg_analytics: 0.5.6 -> 0.6.1
• pg_graphql: 1.5.0 -> 1.5.4
• pg_net 0.8.0 -> 0.9.1
• pg_sparse (deprecated)

Docker Application

• Odoo: launch open source ERP and plugins
• Jupyter: run jupyter notebook container
• PolarDB: run the demo PG RAC playground.
• supabase: bump to the latest GA version.
• bytebase: use the latest tag instead of ad hoc version.
• pg_exporter: update docker image example

Bug Fix

• Fix role pg_exporters white space in variable templates
• Fix minio_cluster not commented in global variables
• Fix the non-exist postgis34 in el7 config template
• Fix EL8 python3.11-cryptography deps to python3-cryptography according to upstream
• Fix /pg/bin/pg-role can not get OS user name from environ in non-interact mode
• Fix /pg/bin/pg-pitr can not hint -X -P flag properly

API Change

• New parameter node_write_etc_hosts to control whether to write /etc/hosts file on target nodes.
• Relocatable prometheus target directory with new parameter prometheus_sd_dir.
• Add -x|--proxy flag to enable and use value of global proxy env by @waitingsong in #405
• No longer parse infra nginx log details since it brings too much labels to the log.
• Use alertmanager API Version v2 instead of v1 in prometheus config.
• Use /pg/cert/ca.crt instead of /etc/pki/ca.crt in pgsql roles.

New Contributors

• @NeroSong made their first contribution in #373
• @waitingsong made their first contribution in #405

Package Checksums

Pigsty will provide offline packages for EL8, Debian 12 and Ubuntu 22.04.

0fe70a5306e8beaa1cf020084b48d0fb  pigsty-v2.7.0.tgz
ec271a1d34b2b1360f78bfa635986c3a  pigsty-pkg-v2.7.0.el8.x86_64.tgz
f3304bfd896b7e3234d81d8ff4b83577  pigsty-pkg-v2.7.0.debian12.x86_64.tgz
5b071c2a651e8d1e68fc02e7e922f2b3  pigsty-pkg-v2.7.0.ubuntu22.x86_64.tgz

You can still perform online installation on el7, el9, debian 11 and ubuntu 20.04

v2.6.0: PG 16, ParadeDB & DuckDB

Highlight

• Use PostgreSQL 16 as the default major version (16.2)
• Introduce ParadeDB extensions: pg_analytics, pg_bm25, and pg_sparse
• Introduce DuckDB and corresponding foreign data wrapper: duckdb_fdw
• Cloudflare CDN https://repo.pigsty.io and QCloud CDN https://repo.pigsty.cc

Configuration

• Disable Grafana Unified Alert to work around the "Database Locked" error。
• add node_repo_modules to add upstream repos (including local one) to node
• remove node_local_repo_urls, replaced by node_repo_modules & repo_upstream.
• remove node_repo_method, replaced by node_repo_modules.
• add the new local repo into repo_upstream instead of node_local_repo_urls
• add chrony into node_default_packages
• remove redis,minio,postgresql client from infra packages
• replace repo_upstream.baseurl $releasever on el8/el9 with major.minor version if applicable

Software Upgrade

• Grafana 10.3.3
• Prometheus 2.47
• node_exporter 1.7.0
• HAProxy 2.9.5
• Loki / Promtail 2.9.4
• minio-20240216110548 / mcli-20240217011557
• etcd 3.5.11
• Redis 7.2.4
• Bytebase 2.13.2
• HAProxy 2.9.5
• DuckDB 0.10.0
• FerretDB 1.19
• Metabase: new docker compose app template added

PostgreSQL x Pigsty Extensions

• PostgreSQL Minor Version Upgrade 16.2, 15.6, 14.11, 13.14, 12.18
• PostgreSQL 16 is now used as the default major version
• pg_exporter 0.6.1, security fix
• Patroni 3.2.2
• pgBadger 12.4
• pgBouncer 1.22
• pgBackRest 2.50
• vip-manager 2.3.0
• PostGIS 3.4.1
• PGVector 0.6.0
• TimescaleDB 2.14.1
• New Extension duckdb_fdw v1.1
• New Extension pgsql-gzip v1.0.0
• New Extension pg_sparse from ParadeDB: v0.5.6
• New Extension pg_bm25 from ParadeDB: v0.5.6
• New Extension pg_analytics from ParadeDB: v0.5.6
• Bump AI/ML Extension pgml to v2.8.1 with pg16 support
• Bump Columnar Extension hydra to v1.1.1 with pg16 support
• Bump Graph Extension age to v1.5.0 with pg16 support
• Bump Packaging Extension pg_tle to v1.3.4 with pg16 support
• Bump GraphQL Extension pg_graphql to v1.5.0 to support supabase

Checksums

6629431c07fd5df993ed8c68d7086b05  pigsty-v2.6.0.tgz
81abcd0ced798e1198740ab13317c29a  pigsty-pkg-v2.6.0.debian11.x86_64.tgz
7304f4458c9abd3a14245eaf72f4eeb4  pigsty-pkg-v2.6.0.debian12.x86_64.tgz
f914fbb12f90dffc4e29f183753736bb  pigsty-pkg-v2.6.0.el7.x86_64.tgz
fc23d122d0743d1c1cb871ca686449c0  pigsty-pkg-v2.6.0.el8.x86_64.tgz
9d258dbcecefd232f3a18bcce512b75e  pigsty-pkg-v2.6.0.el9.x86_64.tgz
901ee668621682f99799de8932fb716c  pigsty-pkg-v2.6.0.ubuntu20.x86_64.tgz
39872cf774c1fe22697c428be2fc2c22  pigsty-pkg-v2.6.0.ubuntu22.x86_64.tgz

What's Changed

• fix debian package url for bootstrap by @PMExtra in #354
• Changed local path to pg private key during pg_key_exists registration. by @Woblidog in #372

New Contributors

• @PMExtra made their first contribution in #354
• @Woblidog made their first contribution in #372

Full Changelog: v2.5.1...v2.6.0

v2.5.1 Minor Update / PG16 Extensions

Routine update with v16.1, v15.5, 14.10, 13.13, 12.17, 11.22

Now PostgreSQL 16 has all the core extensions available (pg_repack & timescaledb added)

• Software Version Upgrade：
  • PostgreSQL to v16.1, v15.5, 14.10, 13.13, 12.17, 11.22
  • Patroni v3.2.0
  • PgBackrest v2.49
  • Citus 12.1
  • TimescaleDB 2.13.0 (with PG 16 support)
  • Grafana v10.2.2
  • FerretDB 1.15
  • SealOS 4.3.7
  • Redis 7.2.3
  • Bytebase 2.11.1

• Remove monitor schema prefix from PGCAT dashboard queries
• New template wool.yml for Aliyun free ECS singleton
• Add python3-jmespath in addition to python3.11-jmespath for el9

74688c0b0515172ba23d897e17fc8e91  pigsty-v2.5.1.tgz
31ee48df1007151009c060e0edbd74de  pigsty-pkg-v2.5.1.el7.x86_64.tgz
a40f1b864ae8a19d9431bcd8e74fa116  pigsty-pkg-v2.5.1.el8.x86_64.tgz
c976cd4431fc70367124fda4e2eac0a7  pigsty-pkg-v2.5.1.el9.x86_64.tgz
7fc1b5bdd3afa267a5fc1d7cb1f3c9a7  pigsty-pkg-v2.5.1.debian11.x86_64.tgz
add0731dc7ed37f134d3cb5b6646624e  pigsty-pkg-v2.5.1.debian12.x86_64.tgz
99048d09fa75ccb8db8e22e2a3b41f28  pigsty-pkg-v2.5.1.ubuntu20.x86_64.tgz
431668425f8ce19388d38e5bfa3a948c  pigsty-pkg-v2.5.1.ubuntu22.x86_64.tgz

v2.5.0 Ubuntu/Debian Support

Get Started with the latest Pigsty v2.5.0:

curl https://get.pigsty.cc/latest | bash

Highlights

• Ubuntu / Debian Support: bullseye, bookworm, jammy, focal, in addition to existing EL 7/8/9 support.

• Dedicate yum/apt repo on https://repo.pigsty.cc and mirror on packagecloud.io/pigsty

• Use PostgreSQL 16 instead of PostgreSQL 14 as the major candidate version.

• New Dashboard: PGSQL Exporter, PGSQL Patroni, Reworked PGSQL Query with new panels & metrics.

• Support for self-hosting Supabase with Pigsty managed PostgreSQL cluster on EL 8/9

• Support for running PostgresML on Ubuntu 22.04 with CUDA support.

• PostgreSQL Extensions Update:

  • New extension on EL: pointcloud with LIDAR data type support.
  • New extension on EL: imgsmlr, pg_similarity, and pg_bigm.
  • Including the columnar extension hydra and do not install citus by default to avoid conflict.
  • Recompile pg_filedump as PG major version independent package.
  • Bump postgis version to v3.4 on el8, el9, ubuntu22, keep existing 3.3 on EL7
  • Remove pg_embedding because it is no longer maintained, use pgvector instead.

• Software Version Upgrade：

  • Grafana to v10.1.5
  • Prometheus to v2.47
  • Promtail/Loki to v2.9.1
  • Node Exporter to v1.6.1
  • Bytebase to v2.10.0
  • patroni to v3.1.2
  • pgbouncer to v1.21.0
  • pg_exporter to v0.6.0
  • pgbackrest to v2.48.0
  • pgbadger to v12.2
  • pg_graphql to v1.4.0
  • pg_net to v0.7.3
  • ferretdb to v0.12.1
  • sealos to 4.3.5
  • Supabase support to 20231013070755

Ubuntu/Debian Support

Pigsty has official support for two Ubuntu LTS version: 22.04 (jammy) and 20.04 (focal). Debian 12 (bookworm) and 11 (bullseye) is also supported. Pigsty will ship offline pacakges for these four version since v2.5.0.

There are 8 parameters need to be specified explicitly when deploying on Debian/Ubuntu, please refer to ubuntu.yml & debian.yml

• repo_upstream: Adjust according to ubuntu / debian repo.
• repo_packages: Adjust according to ubuntu / debian naming convention
• node_repo_local_urls: use the default value: ['deb [trusted=yes] http://${admin_ip}/pigsty ./']
• node_default_packages ：
  • zlib -> zlib1g, readline -> libreadline-dev
  • vim-minimal -> vim-tiny, bind-utils -> dnsutils, perf -> linux-tools-generic,
  • new packages acl to ensure ansible tmp file privileges are set correctly
• infra_packages: replace all _ with - in names, and replace postgresql16 with postgresql-client-16
• pg_packages: replace all _ with - in names, patroni-etcd not needed on ubuntu
• pg_extensions: different naming convention, no passwordcheck_cracklib on ubuntu.
• pg_dbsu_uid: You have to manually specify pg_dbsu_uid on ubuntu, because PGDG deb package does not specify pg dbsu uid.

API Changes

default values of following parameters have changed:

• repo_modules: infra,node,pgsql,redis,minio

• repo_upstream: Now add Pigsty Infra/MinIO/Redis/PGSQL modular upstream repo.

• repo_packages: remove unused karma,mtail,dellhw_exporter and pg 14 extra extensions, adding pg 16 extra extensions.

• pg_extensions: citus is nolonger installed by default, and passwordcheck_cracklib is installed by default

  - pg_repack_${pg_version}* wal2json_${pg_version}* passwordcheck_cracklib_${pg_version}*
  - postgis34_${pg_version}* timescaledb-2-postgresql-${pg_version}* pgvector_${pg_version}*

Checksums

29ecffc798b7e1c5180ad42493c4774c  pigsty-v2.5.0.tgz
87e0be2edc35b18709d7722976e305b0  pigsty-pkg-v2.5.0.el7.x86_64.tgz
e71304d6f53ea6c0f8e2231f238e8204  pigsty-pkg-v2.5.0.el8.x86_64.tgz
39728496c134e4352436d69b02226ee8  pigsty-pkg-v2.5.0.el9.x86_64.tgz
e3f548a6c7961af6107ffeee3eabc9a7  pigsty-pkg-v2.5.0.debian11.x86_64.tgz
1e469cc86a19702e48d7c1a37e2f14f9  pigsty-pkg-v2.5.0.debian12.x86_64.tgz
cc3af3b7c12f98969d3c6962f7c4bd8f  pigsty-pkg-v2.5.0.ubuntu20.x86_64.tgz
c5b2b1a4867eee624e57aed58ac65a80  pigsty-pkg-v2.5.0.ubuntu22.x86_64.tgz

v2.4.1 Supabase/PostgresML support, and other extensions!

Supabase & PostgresML support, and other new extensions!

Highlights

• Supabase support: run open-source Firebase alternative with external postgres managed by Pigsty: example config
• PostgresML support: Run LLMs, vector operations, classical Machine Learning in Postgres.
• GraphQL support: pg_graphql reflects a GraphQL schema from the existing SQL schema.
• Async HTTP Client support pg_net enables asynchronous (non-blocking) HTTP/HTTPS requests with SQL
• JWT support: pgjwt is the PostgreSQL implementation of JWT (JSON Web Tokens)
• Vault support: vault can store encrypted secrets in the Vault
• New component pg_filedump for pg 14 & 15, low-level data recovery tool for PostgreSQL
• New extension hydra the columnar available for PG 13 - 15. (not packaged due to conflict with citus columnar)
• Reduce offline packages size for el9 400MB by removing proj-data*
• Bump FerretDB version to v1.10
• Fix patroni v3.1.1 broken issue

7e3989a98b7b0cd213e7efa09a8e8ebc  pigsty-v2.4.1.tgz
efabe7632d8994f3fb58f9838b8f9d7d  pigsty-pkg-v2.4.1.el7.x86_64.tgz
ea78957e8c8434b120d1c8c43d769b56  pigsty-pkg-v2.4.1.el8.x86_64.tgz
4ef280a7d28872814e34521978b851bb  pigsty-pkg-v2.4.1.el9.x86_64.tgz

v2.4.0 PG16 & RDS Monitor & New Extensions

Get started with bash -c "$(curl -fsSL https://get.pigsty.cc/latest)".

Highlights

• PostgreSQL 16 support
• The first LTS version with business support and consulting service
• Monitoring existing PostgreSQL, RDS for PostgreSQL / PolarDB with PGRDS Dashboards
• New extension: Apache AGE, openCypher graph query engine on PostgreSQL
• New extension: zhparser, full text search for Chinese language
• New extension: pg_roaringbitmap, roaring bitmap for PostgreSQL
• New extension: pg_embedding, hnsw alternative to pgvector
• New extension: pg_tle, admin / manage stored procedure extensions
• New extension: pgsql-http, issue http request with SQL interface
• Add extensions: pg_auth_mon pg_checksums pg_failover_slots pg_readonly postgresql-unit pg_store_plans pg_uuidv7 set_user
• Redis enhancement: add monitoring panels for redis sentinel, and auto HA configuration for redis ms cluster.

API Change

• New Parameter: REDIS.redis_sentinel_monitor: specify masters monitor by redis sentinel cluster

MD5 (pigsty-v2.4.0.tgz) = d6d9e6cc3e79f208098f1c7be503d131
MD5 (pigsty-pkg-v2.4.0.el7.x86_64.tgz) = 257443e3c171439914cbfad8e9f72b17
MD5 (pigsty-pkg-v2.4.0.el8.x86_64.tgz) = 41ad8007ffbfe7d5e8ba5c4b51ff2adc
MD5 (pigsty-pkg-v2.4.0.el9.x86_64.tgz) = 9a950aed77a6df90b0265a6fa6029250

v2.3.1 HNSW Pgvector & PG16 RC1

HNSW Pgvector, PG16 RC1, CN Docs & Bug Fix

Get started with bash -c "$(curl -fsSL https://get.pigsty.cc/latest)".

Highlights

• PGVector 0.5 with HNSW index support
• PostgreSQL 16 RC1 for el8/el9
  ** Adding SealOS for kubernetes support

Bug Fix

• Fix infra.repo.repo_pkg task when downloading rpm with * in their names in repo_packages.
  • if /www/pigsty already have package name match that pattern, some rpm will be skipped.
• Change default value of vip_dns_suffix to '' empty string rather than .vip
• Grant sudo privilege for postgres dbsu when pg_dbsu_sudo = limit and patroni_watchdog_mode = required
  • /usr/bin/sudo /sbin/modprobe softdog: enable watchdog module before launching patroni
  • /usr/bin/sudo /bin/chown {{ pg_dbsu }} /dev/watchdog: chown watchdog before launching patroni

Documentation Update

• Add details to English documentation
• Add Chinese/zh-cn documentation

Software Upgrade

• PostgreSQL 16 RC1 on el8/el9
• PGVector 0.5.0 with hnsw index
• TimescaleDB 2.11.2
• grafana 10.1.0
• loki & promtail 2.8.4
• mcli-20230829225506 / minio-20230829230735
• ferretdb 1.9
• sealos 4.3.3
• pgbadger 1.12.2

MD5 (pigsty-v2.3.1.tgz) = 024f006ba0df0d2dae047cb2c6aec0fe
MD5 (pigsty-pkg-v2.3.1.el7.x86_64.tgz) = ce69791eb622fa87c543096cdf11f970
MD5 (pigsty-pkg-v2.3.1.el8.x86_64.tgz) = 495aba9d6d18ce1ebed6271e6c96b63a
MD5 (pigsty-pkg-v2.3.1.el9.x86_64.tgz) = 38b45582cbc337ff363144980d0d7b64