Re: Out of memory on SELECT in 8.3.5 - Mailing list pgsql-general

From John R Pierce
Subject Re: Out of memory on SELECT in 8.3.5
Date
Msg-id 498FF4B4.2020203@hogranch.com
Whole thread Raw
In response to Re: Out of memory on SELECT in 8.3.5  ("Matt Magoffin" <postgresql.org@msqr.us>)
Responses Re: Out of memory on SELECT in 8.3.5
Re: Out of memory on SELECT in 8.3.5
List pgsql-general
Matt Magoffin wrote:
> We have 100+ postgres processes running, so for an individual process,
> could the 1024 file limit be doing anything to this query? Or would I see
> an explicit error message regarding this condition?
>
>

with 100 concurrent postgres connections,  if they all did something
requiring large amounts of work_mem, you could allocate 100 * 125MB (I
believe thats what you said it was set to?) which is like 12GB :-O

in fact a single query thats doing multiple sorts of large datasets  for
a messy join (or other similar activity) can involve several instances
of workmem.  multiply that by 100 queries, and ouch.

have you considered using a connection pool to reduce the postgres
process count?



pgsql-general by date:

Previous
From: Scara Maccai
Date:
Subject: Re: complex custom aggregate function
Next
From: Scott Marlowe
Date:
Subject: Re: Out of memory on SELECT in 8.3.5