Re: Hadoop backend? - Mailing list pgsql-hackers

From Tom Lane
Subject Re: Hadoop backend?
Date
Msg-id 28913.1235435083@sss.pgh.pa.us
Whole thread Raw
In response to Re: Hadoop backend?  ("Jonah H. Harris" <jonah.harris@gmail.com>)
Responses Re: Hadoop backend?
Re: Hadoop backend?
Re: Hadoop backend?
List pgsql-hackers
"Jonah H. Harris" <jonah.harris@gmail.com> writes:
> I believe there is more than that which would need to be done nowadays.  I
> seem to recall that the storage manager abstraction has slowly been
> dedicated/optimized for md over the past 6 years or so.

As far as I can tell, the PG storage manager API is at the wrong level
of abstraction for pretty much everything.  These days, everything we do
is atop the Unix filesystem API, and anything that smgr might have been
able to do for us is getting handled in kernel filesystem code or device
drivers.  (Back in the eighties, when it was more plausible for PG to do
direct device access, maybe smgr was good for something; but no more.)

It's interesting to speculate about where we could draw an abstraction
boundary that would be more useful.  I don't think the MySQL guys got it
right either...
        regards, tom lane


pgsql-hackers by date:

Previous
From: "Jonah H. Harris"
Date:
Subject: Re: Hadoop backend?
Next
From: Tom Lane
Date:
Subject: Re: Okay to change TypeCreate() signature in back branches?