10:03 p.m.
In response to both Henrique and Periklis in:
http://lists.wfu.edu/pipermail/gretl-users/2018-February/012912.html
http://lists.wfu.edu/pipermail/gretl-users/2018-February/012909.html
It would probably be helpful if you could run gretl.exe with the
--debug flag and report what you see in the console box that
accompanies gretl in that case, when you're trying these operations
with non-ASCII filenames.
To do this you can either create a desktop shortcut to gretl and
append the --debug option flag in the Properties box (that's two
dashes at the start, before "debug") or you could invoke gretl with
that option from a cmd.exe window. This may give us more information
about the precise step in the processing of Windows filenames at
which the encoding problem arises.
Allin
10:06 p.m.
This is what I get:
rcfile: 'C:\Users\P\AppData\Roaming\gretl\.gretl2rc' (found)
langpref='Automatic', langid=0, lcnumeric=1
read_win32_config: returning 0
set_up_windows_look: themepref = 'MS-Windows'
gtkrc = 'C:\Program Files (x86)\gretl\share\themes\MS-Windows\gtk-2.0\gtkrc'
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
GLib : g_date_set_time: assertion `ptm != NULL' failed
Couldn't handle 'C:\Users\P\Desktop\I`I½I±IƒI,I±IƒI_I± spss\excel
I'IµI'I¿I¼I-I½I±.xlsx': Invalid byte sequence in conversion input
PG
*Periklis Gogas
<http://www.econ.duth.gr/personel/dep/gkogkas/index.en.shtml>*
Associate Professor
of Economic Analysis and International Economics
Department of Economics, Democritus University of Thrace
Associate Editor - Journal of Economic Asymmetries
<https://www.journals.elsevier.com/the-journal-of-economic-asymmetries/>
Euro Area Business Cycle Network - Fellow
<http://www.eabcn.org/person/periklis-gogas>
The Rimini Centre for Economic Analysis - Fellow
<http://www.rcfea.org/component/option,com_frontpage/Itemid,1/>
The Society for Economic Measurement - Member
<http://sem.society.cmu.edu/home.html>
Institute for Nonlinear Dynamical Inference (INDI) - Charter Fellow
<http://icemr.ru/institute-for-nonlinear-dynamical-inference/>
On Thu, Feb 8, 2018 at 12:03 AM, Allin Cottrell <cottrell(a)wfu.edu> wrote:
In response to both Henrique and Periklis in:
http://lists.wfu.edu/pipermail/gretl-users/2018-February/012912.html
http://lists.wfu.edu/pipermail/gretl-users/2018-February/012909.html
It would probably be helpful if you could run gretl.exe with the --debug
flag and report what you see in the console box that accompanies gretl in
that case, when you're trying these operations with non-ASCII filenames.
To do this you can either create a desktop shortcut to gretl and append
the --debug option flag in the Properties box (that's two dashes at the
start, before "debug") or you could invoke gretl with that option from a
cmd.exe window. This may give us more information about the precise step in
the processing of Windows filenames at which the encoding problem arises.
Allin
_______________________________________________
Gretl-users mailing list
Gretl-users(a)lists.wfu.edu
http://lists.wfu.edu/mailman/listinfo/gretl-users
10:27 p.m.
On Thu, 8 Feb 2018, Periklis Gogas wrote:
This is what I get:
rcfile: 'C:\Users\P\AppData\Roaming\gretl\.gretl2rc' (found)
langpref='Automatic', langid=0, lcnumeric=1
read_win32_config: returning 0
set_up_windows_look: themepref = 'MS-Windows'
gtkrc = 'C:\Program Files (x86)\gretl\share\themes\MS-Windows\gtk-2.0\gtkrc'
GLib : g_date_set_time: assertion `ptm != NULL' failed
[plus many more of this
message]
...
Couldn't handle 'C:\Users\P\Desktop\I`I½I±IƒI,I±IƒI_I±
spss\excel
I'IµI'I¿I¼I-I½I±.xlsx': Invalid byte sequence in conversion input
Thanks, Periklis! That "Couldn't handle" line gives me a good clue,
if I can just figure exactly what it means.
Allin
11:05 p.m.
That's great!
Thanks Allin!
PG
*Periklis Gogas
<http://www.econ.duth.gr/personel/dep/gkogkas/index.en.shtml>*
Associate Professor
of Economic Analysis and International Economics
Department of Economics, Democritus University of Thrace
Associate Editor - Journal of Economic Asymmetries
<https://www.journals.elsevier.com/the-journal-of-economic-asymmetries/>
Euro Area Business Cycle Network - Fellow
<http://www.eabcn.org/person/periklis-gogas>
The Rimini Centre for Economic Analysis - Fellow
<http://www.rcfea.org/component/option,com_frontpage/Itemid,1/>
The Society for Economic Measurement - Member
<http://sem.society.cmu.edu/home.html>
Institute for Nonlinear Dynamical Inference (INDI) - Charter Fellow
<http://icemr.ru/institute-for-nonlinear-dynamical-inference/>
On Thu, Feb 8, 2018 at 12:27 AM, Allin Cottrell <cottrell(a)wfu.edu> wrote:
On Thu, 8 Feb 2018, Periklis Gogas wrote:
This is what I get:
> rcfile: 'C:\Users\P\AppData\Roaming\gretl\.gretl2rc' (found)
> langpref='Automatic', langid=0, lcnumeric=1
> read_win32_config: returning 0
> set_up_windows_look: themepref = 'MS-Windows'
> gtkrc = 'C:\Program Files (x86)\gretl\share\themes\MS-Wi
> ndows\gtk-2.0\gtkrc'
> GLib : g_date_set_time: assertion `ptm != NULL' failed
>
[plus many more of this message]
...
> Couldn't handle 'C:\Users\P\Desktop\I`I½I±IƒI,I±IƒI_I± spss\excel
> I'IµI'I¿I¼I-I½I±.xlsx': Invalid byte sequence in conversion input
>
Thanks, Periklis! That "Couldn't handle" line gives me a good clue, if I
can just figure exactly what it means.
Allin
_______________________________________________
Gretl-users mailing list
Gretl-users(a)lists.wfu.edu
http://lists.wfu.edu/mailman/listinfo/gretl-users
11:09 p.m.
I saw that too not, the Greek characters are transformed to other symbols.
The correct is:
C:\Users\P\Desktop\Αναστασία spss\excel δεδομένα.xlsx
But it is transformed to:
C:\Users\P\Desktop\I`I½I±IƒI,I±IƒI_I± spss\excelI'IµI'I¿I¼I-I½I±.xlsx
PG
*Periklis Gogas
<http://www.econ.duth.gr/personel/dep/gkogkas/index.en.shtml>*
Associate Professor
of Economic Analysis and International Economics
Department of Economics, Democritus University of Thrace
Associate Editor - Journal of Economic Asymmetries
<https://www.journals.elsevier.com/the-journal-of-economic-asymmetries/>
Euro Area Business Cycle Network - Fellow
<http://www.eabcn.org/person/periklis-gogas>
The Rimini Centre for Economic Analysis - Fellow
<http://www.rcfea.org/component/option,com_frontpage/Itemid,1/>
The Society for Economic Measurement - Member
<http://sem.society.cmu.edu/home.html>
Institute for Nonlinear Dynamical Inference (INDI) - Charter Fellow
<http://icemr.ru/institute-for-nonlinear-dynamical-inference/>
On Thu, Feb 8, 2018 at 1:05 AM, Periklis Gogas <perrygogas(a)gmail.com> wrote:
That's great!
Thanks Allin!
PG
*Periklis Gogas
<http://www.econ.duth.gr/personel/dep/gkogkas/index.en.shtml>*
Associate Professor
of Economic Analysis and International Economics
Department of Economics, Democritus University of Thrace
Associate Editor - Journal of Economic Asymmetries
<https://www.journals.elsevier.com/the-journal-of-economic-asymmetries/>
Euro Area Business Cycle Network - Fellow
<http://www.eabcn.org/person/periklis-gogas>
The Rimini Centre for Economic Analysis - Fellow
<http://www.rcfea.org/component/option,com_frontpage/Itemid,1/>
The Society for Economic Measurement - Member
<http://sem.society.cmu.edu/home.html>
Institute for Nonlinear Dynamical Inference (INDI) - Charter Fellow
<http://icemr.ru/institute-for-nonlinear-dynamical-inference/>
On Thu, Feb 8, 2018 at 12:27 AM, Allin Cottrell <cottrell(a)wfu.edu> wrote:
> On Thu, 8 Feb 2018, Periklis Gogas wrote:
>
> This is what I get:
>> rcfile: 'C:\Users\P\AppData\Roaming\gretl\.gretl2rc' (found)
>> langpref='Automatic', langid=0, lcnumeric=1
>> read_win32_config: returning 0
>> set_up_windows_look: themepref = 'MS-Windows'
>> gtkrc = 'C:\Program Files (x86)\gretl\share\themes\MS-Wi
>> ndows\gtk-2.0\gtkrc'
>> GLib : g_date_set_time: assertion `ptm != NULL' failed
>>
> [plus many more of this message]
> ...
>
>> Couldn't handle 'C:\Users\P\Desktop\I`I½I±IƒI,I±IƒI_I± spss\excel
>> I'IµI'I¿I¼I-I½I±.xlsx': Invalid byte sequence in conversion input
>>
>
> Thanks, Periklis! That "Couldn't handle" line gives me a good clue, if
I
> can just figure exactly what it means.
>
> Allin
>
>
> _______________________________________________
> Gretl-users mailing list
> Gretl-users(a)lists.wfu.edu
> http://lists.wfu.edu/mailman/listinfo/gretl-users
>
1:49 p.m.
Am 07.02.2018 um 23:27 schrieb Allin Cottrell:
> Couldn't handle 'C:\Users\P\Desktop\I`I½I±IƒI,I±IƒI_I±
spss\excel
> I'IµI'I¿I¼I-I½I±.xlsx': Invalid byte sequence in conversion input
Thanks, Periklis! That "Couldn't handle" line gives me a good clue, if I
can just figure exactly what it means.
What are the Windows APIs that readfile() etc. uses?
(BTW, I also see errors in an analogous script to the above --with the
latest snapshot-- when I put German-specific letters in there. So as
Henrique already showed, this is not a non-Latin issue, but more
generally a non-ASCII thing.)
cheers,
sven
7:39 p.m.
On Thu, 8 Feb 2018, Sven Schreiber wrote:
Am 07.02.2018 um 23:27 schrieb Allin Cottrell:
>> Couldn't handle 'C:\Users\P\Desktop\I`I½I±IƒI,I±IƒI_I± spss\excel
>> I'IµI'I¿I¼I-I½I±.xlsx': Invalid byte sequence in conversion input
>
> Thanks, Periklis! That "Couldn't handle" line gives me a good clue, if
I
> can just figure exactly what it means.
What are the Windows APIs that readfile() etc. uses?
We don't use Windows APIs directly; we use standard C-library
functions plus GLib wrappers (both cross-platform). However, I see
what the problem was with readfile(): the GLib function we're calling
requires that the filename is given as UTF-8 on Windows, and we
weren't ensuring that filenames in locale-specific encoding were being
converted when necessary. That fix is in git and snapshots.
(BTW, I also see errors in an analogous script to the above --with
the
latest snapshot-- when I put German-specific letters in there. So as
Henrique already showed, this is not a non-Latin issue, but more
generally a non-ASCII thing.)
The issue with Periklis's filenames is more difficult -- although
there's at least a partial fix in place now. Here's the thing: we've
been assuming that we can get the native Windows counterpart of a
UTF-8 filename by calling GLib's g_locale_from_utf8(). But that only
works if the filename in question can be represented in the locale
codepage, and apparently that's not the case with those mixed Greek
and English filenames; they seem to require representation in UTF-16.
(This is not the case with the examples Henrique gave.)
In order to handle mixed-language UTF-16 Windows filenames reliably,
with full generality, we'll have to revamp a lot of path-related
functionality in libgretl. That may be worth doing, but not for the
imminent release.
Allin
8:32 p.m.
Dear Allin,
The readfile() function is working like a charm now (Windows PC
running PT-Br language). Thanks a lot for your persistence and for
your usually kind help.
Best regards,
Henrique Andrade
12:19 p.m.
Em 7 de fevereiro de 2018, Allin escreveu:
In response to both Henrique and Periklis in:
http://lists.wfu.edu/pipermail/gretl-users/2018-February/012912.html
http://lists.wfu.edu/pipermail/gretl-users/2018-February/012909.html
It would probably be helpful if you could run gretl.exe with the --debug
flag and report what you see in the console box that accompanies gretl in
that case, when you're trying these operations with non-ASCII filenames.
To do this you can either create a desktop shortcut to gretl and append the
--debug option flag in the Properties box (that's two dashes at the start,
before "debug") or you could invoke gretl with that option from a cmd.exe
window. This may give us more information about the precise step in the
processing of Windows filenames at which the encoding problem arises.
This is the Windows Command Prompt output:
<Windows output>
rcfile: 'C:\Users\Henrique\AppData\Roaming\gretl\.gretl2rc' (found)
langpref='Portuguese (Brazil)', langid=16, lcnumeric=1
lcode='portuguese-brazilian.1252' -> locale='Portuguese_Brazil.1252'
set_cp_from_locale: CP = 1252
read_win32_config: returning 0
set_up_windows_look: themepref = 'Clearlooks'
gtkrc = 'C:\Program Files\gretl\share\themes\Clearlooks\gtk-2.0\gtkrc'
</Windows output>
This is the Gretl output:
<Gretl output>
Gretl versão 2017e-git
Sessão atual: 2018-02-08 10:12
Lido o arquivo de dados C:\Program Files\gretl\data\misc\australia.gdt
Table 1. Test for readfile()
Falha ao abrir arquivo "C:/Users/Henrique/Documents/gretl/��a de
Queiroz/Table_1.txt": Invalid argument
Erro ao executar script: parando
string Table_1 = readfile("Table_1.txt")
</Gretl
output>
Best regards,
Henrique Andrade
2514
days inactive
2515
days old
8 comments
4 participants
participants (4)
-
Allin Cottrell -
Henrique Andrade -
Periklis Gogas -
Sven Schreiber