Re: Pointers towards identifying bulk import bottleneck (walwriter tuning?) - Mailing list pgsql-general

From Luca Ferrari
Subject Re: Pointers towards identifying bulk import bottleneck (walwriter tuning?)
Date
Msg-id CAKoxK+6t5JgLwOUq+kCkp9i9g6c4CyTm8mkuigS9GBqtaTUMAg@mail.gmail.com
Whole thread Raw
In response to Pointers towards identifying bulk import bottleneck (walwritertuning?)  ("Holtgrewe, Manuel" <manuel.holtgrewe@bihealth.de>)
Responses RE: [ext] Re: Pointers towards identifying bulk import bottleneck(walwriter tuning?)
List pgsql-general
On Tue, Aug 27, 2019 at 12:06 PM Holtgrewe, Manuel
<manuel.holtgrewe@bihealth.de> wrote:
> iotop tells me that walwriter does not go beyond ~35MB/s so maybe this is the culprit? Is there a way to tune
walwriterI/O performance?
 

As far as I know, walwriter is there to help background processes, so
in the case it cannot keep up with WALs the backends will write on
their own. If my understanding is correct, I don't think that could be
the bootleneck.
I've seen you have checkpoints at 4h, that's quite huge to me. Do you
have any hint that checkpoints are happening too frequently?
Any chance you can turn fsync off (only if this is a testbed)?

Also this <https://www.postgresql.org/list/pgsql-performance/> could
be a better place to ask for help.

Luca



pgsql-general by date:

Previous
From: "Arnaud L."
Date:
Subject: Re: psql \copy hanging
Next
From: Shaozhong SHI
Date:
Subject: Re: psql \copy hanging