Request a Demo
Home   >   mailing lists

Re: PoC: pg_dump --filter-data (like Oracle Where Clause on RMAN for specific tables) - Mailing list pgsql-hackers

From Kirk Wolak
Subject Re: PoC: pg_dump --filter-data (like Oracle Where Clause on RMAN for specific tables)
Date
Msg-id CACLU5mThoC1AH4ZDYQ1+8PiAmGkaNriA2jLQCXX8ZziHEuRqtQ@mail.gmail.com
Whole thread Raw
In response to Re: PoC: pg_dump --filter-data (like Oracle Where Clause on RMAN for specific tables)  (Tom Lane <tgl@sss.pgh.pa.us>)
List pgsql-hackers
Tree view
On Fri, Aug 15, 2025 at 12:37 PM Tom Lane <tgl@sss.pgh.pa.us> wrote:
Kirk Wolak <wolakk@gmail.com> writes:
>   We have a handful of tables that have 90% of the data going back 30 years.
> We NEVER restore this data to Dev or Staging.  We used a special RMAN
> backup where these tables had a "WHERE clause" applied to them during the
> backup/dump process.

Have you considered partitioning these tables by date and then not
dumping the older partitions?  That would fit into existing
functionality a lot better.

                        regards, tom lane

I had not considered it until now.  But because we are talking about only keeping 7 - 28 days of decades of data.
I would assume that window would require a bit of work in production to maintain, making it a tough sell to the client.

pgsql-hackers by date:

Previous
From: Tatsuo Ishii
Date:
Subject: Re: Add RESPECT/IGNORE NULLS and FROM FIRST/LAST options
Next
From: Kirk Wolak
Date:
Subject: Re: PoC: pg_dump --filter-data (like Oracle Where Clause on RMAN for specific tables)