Re: Data loading from a flat file... - Mailing list pgsql-general
From | Angshu Kar |
---|---|
Subject | Re: Data loading from a flat file... |
Date | |
Msg-id | df8328740601052244l240044f0g1318c1c9f7f99bdc@mail.gmail.com Whole thread Raw |
In response to | Re: Data loading from a flat file... (Pandurangan R S <pandurangan.r.s@gmail.com>) |
Responses |
Re: Data loading from a flat file...
|
List | pgsql-general |
Thanks for the chmod command Pandu but the cat command is not doing anything!
And as Michael suggested that file has indeed carriage returns embedded in fields. I opened it in my windows m/c using textpad and got:
B1
C1
E1
B2
C2
E2
.
.
.
Any more suggestions on how to solve this? :(
--
Ignore the impossible but honor it ...
The only enviable second position is success, since failure always comes first...
And as Michael suggested that file has indeed carriage returns embedded in fields. I opened it in my windows m/c using textpad and got:
B1
C1
E1
B2
C2
E2
.
.
.
Any more suggestions on how to solve this? :(
On 1/6/06, Pandurangan R S <pandurangan.r.s@gmail.com> wrote:
To get rid of ^M characters you could use
cat file | tr -d ^M
you need to type ^V before you type ^M in the preceeding command. But
^V will not be displayed on the screen.
You might need to change directory permission too.
use chmod +rx <username>.
For this command to succeed you need to execute this command as root
or the owner of the directory
On 1/6/06, Angshu Kar <angshu96@gmail.com > wrote:
> Thanks Michael.
>
> I'm using PgAdmin III 1.4.0 from my WinXP m/c to access the DB in my linux
> m/c! The file has about 2GB data.It returns back to the prompt very soon.
> I'm using less or vi command to view the file and getting those ^M as
> mentioned (i.e. between fields). Any clue how I can massage the data? If you
> suggest I can try and write the script.
>
> Also, now I'm facing another permission related problem!It's throwing the
> error:
> ERROR: could not open file "/home/akar/final.out" for reading: Permission
> denied
> I've changed the file owner to postgres but without any avail!Also do I
> need to change the permission to akar directory? How(I'm a linux freshie)?
>
> Thanks,
> Angshu
>
>
>
> On 1/5/06, Michael Fuhr <mike@fuhr.org> wrote:
> > On Thu, Jan 05, 2006 at 11:04:16PM -0600, Angshu Kar wrote:
> > > Thanks Jim. the statement is running without any error but nothing is
> > > getting copied into the table!
> >
> > What client are you using and what's the exact command you ran?
> > Does the command finish or does it never return? How much data
> > is there? What version of PostgreSQL are you using and on what
> > platform?
> >
> > > Also, my data file is showing some ^M chars like
> > >
> > > B1^M C1^M E1
> > > B2^M C2^M E2
> >
> > The ^M sequence might represent a carriage return -- how are you
> > viewing the file to see these characters? Are they between fields
> > as shown or only at the ends of lines?
> >
> > > Is it creating any trouble for the COPY command?
> >
> > Possibly; you might need to massage the data if you can't get COPY
> > to read it. That should be an easy job for a script (somebody here
> > can probably help).
> >
> > > And can we use INSERT with COPY?
> >
> > To use INSERT you'd need to read the data and generate the appropriate
> > INSERT commands; that's another scripting job.
> >
> > --
> > Michael Fuhr
> >
>
>
>
> --
> Ignore the impossible but honor it ...
> The only enviable second position is success, since failure always comes
> first...
--
Ignore the impossible but honor it ...
The only enviable second position is success, since failure always comes first...
pgsql-general by date: