Re: Function scan push-down using SQL/MED syntax - Mailing list pgsql-cluster-hackers

From Takahiro Itagaki
Subject Re: Function scan push-down using SQL/MED syntax
Date
Msg-id 20100308100126.9C43.52131E4D@oss.ntt.co.jp
Whole thread Raw
In response to Re: Function scan push-down using SQL/MED syntax  (Takahiro Itagaki <itagaki.takahiro@oss.ntt.co.jp>)
Responses Re: Function scan push-down using SQL/MED syntax
List pgsql-cluster-hackers
Takahiro Itagaki <itagaki.takahiro@oss.ntt.co.jp> wrote:

> > * I'm not very happy with "Getting tuples from the foreign server"
> > section. Present tuplestore isn't quite efficient and putting all
> > tuples into TSS adds devastating overhead. In principle, storing
> > tuples doesn't match SQL exectuor model. So something like cursor is
> > needed here.
>
> Sure, but your optimization requires some extensions in libpq protocol.
> We could send HeapTuple in a binary form if the remote and the local
> server uses the same format, but the present libpq can return tuples
> only as text or libpq-specific binary forms (that is not a HeapTuple).

In addition, I beleive the tuplestore is requried *for performance*
because per-tuple cursor fetching is very slow if we retrieve tuples from
remote servers. We should fetch tuples in some resonable-size of batches.

If we will optimize the part, we could remove PGresult-to-tuplestore
convertson here. But we also need to some codes to avoid memory leak
of PGresult on error because PGresult is allocaed with malloc, not palloc.
(That is the same bug in contrib/dblink fixed recently.)

Regards,
---
Takahiro Itagaki
NTT Open Source Software Center



pgsql-cluster-hackers by date:

Previous
From: Takahiro Itagaki
Date:
Subject: Re: Function scan push-down using SQL/MED syntax
Next
From: Fujii Masao
Date:
Subject: Re: pgCluster page up ...