pgsql: Implement partition-wise grouping/aggregation. - Mailing list pgsql-committers

From Robert Haas
Subject pgsql: Implement partition-wise grouping/aggregation.
Date
Msg-id E1ez3XN-0005Zc-12@gemulon.postgresql.org
Whole thread Raw
Responses Re: pgsql: Implement partition-wise grouping/aggregation.
List pgsql-committers
Implement partition-wise grouping/aggregation.

If the partition keys of input relation are part of the GROUP BY
clause, all the rows belonging to a given group come from a single
partition.  This allows aggregation/grouping over a partitioned
relation to be broken down * into aggregation/grouping on each
partition.  This should be no worse, and often better, than the normal
approach.

If the GROUP BY clause does not contain all the partition keys, we can
still perform partial aggregation for each partition and then finalize
aggregation after appending the partial results.  This is less certain
to be a win, but it's still useful.

Jeevan Chalke, Ashutosh Bapat, Robert Haas.  The larger patch series
of which this patch is a part was also reviewed and tested by Antonin
Houska, Rajkumar Raghuwanshi, David Rowley, Dilip Kumar, Konstantin
Knizhnik, Pascal Legrand, and Rafia Sabih.

Discussion: http://postgr.es/m/CAM2+6=V64_xhstVHie0Rz=KPEQnLJMZt_e314P0jaT_oJ9MR8A@mail.gmail.com

Branch
------
master

Details
-------
https://git.postgresql.org/pg/commitdiff/e2f1eb0ee30d144628ab523432320f174a2c8966

Modified Files
--------------
doc/src/sgml/config.sgml                          |   20 +
src/backend/optimizer/README                      |   14 +
src/backend/optimizer/path/allpaths.c             |   17 +-
src/backend/optimizer/path/costsize.c             |    1 +
src/backend/optimizer/plan/createplan.c           |   10 +-
src/backend/optimizer/plan/planner.c              |  873 ++++++++++---
src/backend/utils/misc/guc.c                      |    9 +
src/backend/utils/misc/postgresql.conf.sample     |    1 +
src/include/nodes/relation.h                      |   75 +-
src/include/optimizer/cost.h                      |    1 +
src/include/optimizer/paths.h                     |    2 +
src/test/regress/expected/partition_aggregate.out | 1393 +++++++++++++++++++++
src/test/regress/expected/sysviews.out            |   37 +-
src/test/regress/parallel_schedule                |    2 +-
src/test/regress/serial_schedule                  |    1 +
src/test/regress/sql/partition_aggregate.sql      |  292 +++++
src/tools/pgindent/typedefs.list                  |    2 +
17 files changed, 2544 insertions(+), 206 deletions(-)


pgsql-committers by date:

Previous
From: Teodor Sigaev
Date:
Subject: pgsql: Add conditional.c to libpgfeutils for MSVC build
Next
From: Tom Lane
Date:
Subject: pgsql: Fix errors in contrib/bloom index build.