Re: [GENERAL] Inserting millions of record in a partitioned Table - Mailing list pgsql-general

From Vick Khera
Subject Re: [GENERAL] Inserting millions of record in a partitioned Table
Date
Msg-id CALd+dcf6QTOduB21kd=6JGBTd2aJu=KPGtNew0ViEr6KuzbRwA@mail.gmail.com
Whole thread Raw
In response to [GENERAL] Inserting millions of record in a partitioned Table  (Job <Job@colliniconsulting.it>)
Responses Re: [GENERAL] Inserting millions of record in a partitioned Table
List pgsql-general
On Wed, Sep 20, 2017 at 10:10 AM, Job <Job@colliniconsulting.it> wrote:
We noticed that if we import directly into the global table it is really, really slow.
Importing directly in the single partition is faster.


Do you have a rule or trigger on the main table to redirect to the partitions? You should expect that to take some extra time *per row*. Your best bet is to just import into the proper partition and make sure your application produces batch files that align with your partitions.

Either that or write a program that reads the data, determines the partition, and then inserts directly to it. It might be faster.

pgsql-general by date:

Previous
From: Tom Lane
Date:
Subject: Re: [GENERAL] Puzzled by UNION with iso-8859-1 types
Next
From: Rob Sargent
Date:
Subject: Re: [GENERAL] Inserting millions of record in a partitioned Table