Thread: What encoding to use for this error?

We're testing moving our data to UNICODE from LATIN1, but when I try to
import my data, I get the following error:

DBD::Pg::st execute failed: ERROR:  Unicode characters greater than or
equal to
0x10000 are not supported
CONTEXT:  COPY bcp_mdc_products, line 120, column description: "Lladró
"Ducks in
 a Basket""

What encoding should I be using for characters like this?  I thought
unicode was supposed to handle these types of characters?

TIA

Patrick Hatcher

Patrick Hatcher <pathat@comcast.net> writes:
> We're testing moving our data to UNICODE from LATIN1, but when I try to
> import my data, I get the following error:

> DBD::Pg::st execute failed: ERROR:  Unicode characters greater than or
> equal to
> 0x10000 are not supported
> CONTEXT:  COPY bcp_mdc_products, line 120, column description: "Lladr�
> "Ducks in
>  a Basket""

Do you have client_encoding set properly while doing the import?
If the incoming data is LATIN1, you need to say so, so that the backend
knows how to convert it to UNICODE.

            regards, tom lane

Thank you.  I'll take a look at our data export function.

Tom Lane wrote:

>Patrick Hatcher <pathat@comcast.net> writes:
>
>
>>We're testing moving our data to UNICODE from LATIN1, but when I try to
>>import my data, I get the following error:
>>
>>
>
>
>
>>DBD::Pg::st execute failed: ERROR:  Unicode characters greater than or
>>equal to
>>0x10000 are not supported
>>CONTEXT:  COPY bcp_mdc_products, line 120, column description: "Lladró
>>"Ducks in
>> a Basket""
>>
>>
>
>Do you have client_encoding set properly while doing the import?
>If the incoming data is LATIN1, you need to say so, so that the backend
>knows how to convert it to UNICODE.
>
>            regards, tom lane
>
>
>