Re: Data transfer very slow when connected via DSL - Mailing list pgsql-performance

From Harald Armin Massa
Subject Re: Data transfer very slow when connected via DSL
Date
Msg-id 7be3f35d0706220545uaaa957ey3b1ca083ba895c39@mail.gmail.com
Whole thread Raw
In response to Re: Data transfer very slow when connected via DSL  (PFC <lists@peufeu.com>)
List pgsql-performance
PFC,

> Correct. I use a pyro-remote server. On request this remote server copies
> the relevant rows into a temporary table, uses a copy_to Call to push
> them
> into a StringIO-Objekt (that's Pythons version of "In Memory File"),
> serializes that StringIO-Objekt, does a bz2-compression and transfers the
> whole block via VPN.

>       What about a SSH tunnel using data compression ?
Setup on multiple Windows Workstations in multiple Installations is not possible.

> If you fetch all rows from a query in one go, would it be fast ?
I tried the same copy_to via VPN. It took 10-50x the time it took locally.

>Also, PG can now COPY from a query, so you don't really need the temp table...
I know, but was stuck to 8.1 on some servers.

Best wishes,

Harald

--
GHUM Harald Massa
persuadere et programmare
Harald Armin Massa
Spielberger Straße 49
70435 Stuttgart
0173/9409607
fx 01212-5-13695179
-
EuroPython 2007 will take place in Vilnius, Lithuania from Monday 9th July to Wednesday 11th July. See you there!

pgsql-performance by date:

Previous
From: Dimitri
Date:
Subject: Re: Data transfer very slow when connected via DSL
Next
From: "Sabin Coanda"
Date:
Subject: Re: PostgreSQL Configuration Tool for Dummies - feedback adjustable control