Postgres Pro
Downloads
Home   >   mailing lists

Thread: Postgres size greater than 1TB

Postgres size greater than 1TB

From
"Rossi, Maria"
Date:

Hi,

 

In the past, our postgres cluster data_directory is a file system that is < 1TB

 

Our postgresconf.cfg has this:

 

data_directory = '/dba/psg/gp08/pg_data'

 

Now,  we need a new cluster that needs more than 1TB (Unix has a limit of 1TB for file systems)

Any suggestion on how to handle this?

Can I specify more than 1 path in  my data_directory?

Can I create a tablespace in a new file system/directory?

 

Any help would  be appreciated.

Thanks

 

Maria

 

Re: Postgres size greater than 1TB

From
Jesper Krogh
Date:

On 13 Dec 2018, at 17.33, Rossi, Maria <maria.rossi@jackson.com> wrote:

Hi,

 

In the past, our postgres cluster data_directory is a file system that is < 1TB

 

Our postgresconf.cfg has this:

 

data_directory = '/dba/psg/gp08/pg_data'

 

Now,  we need a new cluster that needs more than 1TB (Unix has a limit of 1TB for file systems)

Any suggestion on how to handle this?


we have filesystems above 100TB. where do you see this limit?

Jesper 

Re: Postgres size greater than 1TB

From
Jesper Krogh
Date:

On 13 Dec 2018, at 17.33, Rossi, Maria <maria.rossi@jackson.com> wrote:

Hi,

 

In the past, our postgres cluster data_directory is a file system that is < 1TB

 

Our postgresconf.cfg has this:

 

data_directory = '/dba/psg/gp08/pg_data'

 

Now,  we need a new cluster that needs more than 1TB (Unix has a limit of 1TB for file systems)

Any suggestion on how to handle this?


we have filesystems above 100TB. where do you see this limit?

Jesper 

Re: Postgres size greater than 1TB

From
Steve Midgley
Date:
On Thu, Dec 13, 2018 at 8:33 AM Rossi, Maria <maria.rossi@jackson.com> wrote:

Hi,

 

In the past, our postgres cluster data_directory is a file system that is < 1TB

 

Our postgresconf.cfg has this:

 

data_directory = '/dba/psg/gp08/pg_data'

 

Now,  we need a new cluster that needs more than 1TB (Unix has a limit of 1TB for file systems)

Any suggestion on how to handle this?

Can I specify more than 1 path in  my data_directory?

Can I create a tablespace in a new file system/directory?


1TB seems incredibly small these days as a file system limit - as Jesper says. If you're on a disk partition system with 1TB file limits (let alone for the whole file system!), you should consider upgrading your disk array and file system to a modern partition scheme, of which there are many choices on Linux/Unix type systems.

Re: Postgres size greater than 1TB

From
Steve Midgley
Date:
On Thu, Dec 13, 2018 at 8:33 AM Rossi, Maria <maria.rossi@jackson.com> wrote:

Hi,

 

In the past, our postgres cluster data_directory is a file system that is < 1TB

 

Our postgresconf.cfg has this:

 

data_directory = '/dba/psg/gp08/pg_data'

 

Now,  we need a new cluster that needs more than 1TB (Unix has a limit of 1TB for file systems)

Any suggestion on how to handle this?

Can I specify more than 1 path in  my data_directory?

Can I create a tablespace in a new file system/directory?


1TB seems incredibly small these days as a file system limit - as Jesper says. If you're on a disk partition system with 1TB file limits (let alone for the whole file system!), you should consider upgrading your disk array and file system to a modern partition scheme, of which there are many choices on Linux/Unix type systems.

RE: Postgres size greater than 1TB

From
"Rossi, Maria"
Date:

Sorry, my mistake.    Should have asked our Unix support first, before I posted.

Was told 1TB limit is old, we don’t have that issue now.

 

Sorry.

 

 

Maria

 

 

From: Steve Midgley <science@misuse.org>
Sent: Thursday, December 13, 2018 11:38 AM
To: Rossi, Maria <maria.rossi@jackson.com>
Cc: pgsql-sql@lists.postgresql.org; pgsql-novice@lists.postgresql.org
Subject: Re: Postgres size greater than 1TB

 

EXTERNAL EMAIL

On Thu, Dec 13, 2018 at 8:33 AM Rossi, Maria <maria.rossi@jackson.com> wrote:

Hi,

 

In the past, our postgres cluster data_directory is a file system that is < 1TB

 

Our postgresconf.cfg has this:

 

data_directory = '/dba/psg/gp08/pg_data'

 

Now,  we need a new cluster that needs more than 1TB (Unix has a limit of 1TB for file systems)

Any suggestion on how to handle this?

Can I specify more than 1 path in  my data_directory?

Can I create a tablespace in a new file system/directory?

 

1TB seems incredibly small these days as a file system limit - as Jesper says. If you're on a disk partition system with 1TB file limits (let alone for the whole file system!), you should consider upgrading your disk array and file system to a modern partition scheme, of which there are many choices on Linux/Unix type systems.

RE: Postgres size greater than 1TB

From
"Rossi, Maria"
Date:

Sorry, my mistake.    Should have asked our Unix support first, before I posted.

Was told 1TB limit is old, we don’t have that issue now.

 

Sorry.

 

 

Maria

 

 

From: Steve Midgley <science@misuse.org>
Sent: Thursday, December 13, 2018 11:38 AM
To: Rossi, Maria <maria.rossi@jackson.com>
Cc: pgsql-sql@lists.postgresql.org; pgsql-novice@lists.postgresql.org
Subject: Re: Postgres size greater than 1TB

 

EXTERNAL EMAIL

On Thu, Dec 13, 2018 at 8:33 AM Rossi, Maria <maria.rossi@jackson.com> wrote:

Hi,

 

In the past, our postgres cluster data_directory is a file system that is < 1TB

 

Our postgresconf.cfg has this:

 

data_directory = '/dba/psg/gp08/pg_data'

 

Now,  we need a new cluster that needs more than 1TB (Unix has a limit of 1TB for file systems)

Any suggestion on how to handle this?

Can I specify more than 1 path in  my data_directory?

Can I create a tablespace in a new file system/directory?

 

1TB seems incredibly small these days as a file system limit - as Jesper says. If you're on a disk partition system with 1TB file limits (let alone for the whole file system!), you should consider upgrading your disk array and file system to a modern partition scheme, of which there are many choices on Linux/Unix type systems.