Re: COPY enhancements - Mailing list pgsql-hackers

From Emmanuel Cecchet
Subject Re: COPY enhancements
Date
Msg-id 4ACCB8AD.2010803@asterdata.com
Whole thread Raw
In response to Re: COPY enhancements  (Greg Smith <gsmith@gregsmith.com>)
List pgsql-hackers
Greg Smith wrote:
> Absolutely, that's the whole point of logging to a file in the first 
> place.  What needs to happen here is that when one is aborted, you 
> need to make sure that fact is logged, and with enough information 
> (the pid?) to tie it to the COPY that failed.  Then someone can crawl 
> the logs to figure out what happened and what data did and didn't get 
> loaded.  Ideally you'd want to have that as database table information 
> instead, to allow automated recovery and re-commit in the cases where 
> the error wasn't inherent in the data but instead some other type of 
> database failure.
If one is aborted, nothing gets loaded anyway. Now if you want a 
separate log of the successful commands, I don't think that should apply 
just to COPY but to any operation (insert, update, DDL, ...) if you want 
to build some automatic retry mechanism. But this seems independent from 
COPY to me.

manu

-- 
Emmanuel Cecchet
Aster Data Systems
Web: http://www.asterdata.com



pgsql-hackers by date:

Previous
From: Emmanuel Cecchet
Date:
Subject: Re: COPY enhancements
Next
From: David Fetter
Date:
Subject: Concurrency testing