9:13 p.m.
Dear developers of gretl!
Thanks again for the wonderful software! It helps a lot both in scientific
research and in educational process!
Unfortunately, I've discovered a problem with importing data from a CSV file
to a gretl data file.
Specifically, when I try to import daily data from a CSV file (I attach the
CSV-file to this letter), I receive the following:
+++++++++++++++++++++++++++++++++++++++++
parsing D:\aapl.csv...
using delimiter ','
longest line: 56 characters
first field: 'date'
seems to be observation label
number of columns = 7
number of variables: 6
number of non-blank lines: 250
scanning for variable names...
line: date,Open,High,Low,Close,Volume,AClose
scanning for row labels and data...
first row label "014-03-25", last label "2013-04-01"
treating these as undated data
+++++++++++++++++++++++++++++++++++++++++
For some reasons gretl cuts off the first digit of the date in the "first
row label" line (I stressed in red).
And thus it interprets the data as cross-sectional, not as time-series.
I'm using gretl of version 1.9.14. I tried on version 1.9.13 - the same
problem.
But, on version 1.9.12 there was no such problem with importing data from
the attached CSV file - I double-checked it.
Could you please give any comments on how to override the problem on version
1.9.14?
Downgrade to version 1.9.12 is not an option for me now.
Thanks,
Evgenii Gilenko
12:24 p.m.
Am 26.03.2014 22:13, schrieb Evgenii Gilenko:
Unfortunately, I’ve discovered a problem with importing data from a
CSV file to a gretl data file.
Specifically, when I try to import daily data from a CSV file (I
attach the CSV-file to this letter), I receive the following:
...
For some reasons gretl cuts off the first digit of the date in the
“first row label” line (I stressed in red).
I’m using gretl of version 1.9.14. I tried on version 1.9.13 – the
same problem.
But, on version 1.9.12 there was no such problem with importing data
from the attached CSV file – I double-checked it.
Problem confirmed on Windows.
Perhaps it's related to this thing that was changed in 1.9.13 (from the
changelog):
"- CSV importer: ignore leading byte order mark"
Right now I don't remember why that was done, but probably for a good
reason :-)
I noticed that your file from the list seems to have "unixy" line
endings (LF, or \n), provided the mailing list transmission hasn't
changed this. When I changed them to windowsy endings (\r\n, with the
SciTE editor), the import into gretl works nicely, so that's your
workaround. (File with transformed line endings attached.)
hth,
sven
1:57 p.m.
On Thu, Mar 27, 2014 at 12:24 PM, Sven Schreiber <svetosch(a)gmx.net> wrote:
Am 26.03.2014 22:13, schrieb Evgenii Gilenko:
> Unfortunately, I've discovered a problem with importing data from a
> CSV file to a gretl data file.
>
> Specifically, when I try to import daily data from a CSV file (I
> attach the CSV-file to this letter), I receive the following:
>
...
>
> For some reasons gretl cuts off the first digit of the date in the
> "first row label" line (I stressed in red).
>
> I'm using gretl of version 1.9.14. I tried on version 1.9.13 - the
> same problem.
>
> But, on version 1.9.12 there was no such problem with importing data
> from the attached CSV file - I double-checked it.
>
Problem confirmed on Windows.
Perhaps it's related to this thing that was changed in 1.9.13 (from the
changelog):
"- CSV importer: ignore leading byte order mark"
I don't think so -- or at least, this file doesn't have a leading byte
order mark so far as I can tell.
I noticed that your file from the list seems to have
"unixy" line
endings (LF, or \n), provided the mailing list transmission hasn't
changed this. When I changed them to windowsy endings (\r\n, with the
SciTE editor), the import into gretl works nicely, so that's your
workaround. (File with transformed line endings attached.)
Thanks for trouble-shooting this. It seems the problem has to do with text
versus binary file-reading mode ("r" versus "rb" when calling fopen).
I'll
try some testing on Windows and see what I can find.
Allin
12:49 p.m.
The file opens OK in gretl 1.9.15CVS in Linux (Fedora 19).
parsing /home/helio/tmp/aapl.csv...
using delimiter ','
longest line: 55 characters
first field: 'date'
seems to be observation label
number of columns = 7
number of variables: 6
number of non-blank lines: 250
scanning for variable names...
line: date,Open,High,Low,Close,Volume,AClose
scanning for row labels and data...
first row label "2014-03-25", last label "2013-04-01"
trying to parse row labels as dates...
Trying date order YYYYMMDD
Could be 2014-03-25 - 2013-04-01
Observations: 249; days in sample: 257
Missing daily observations: 8
reversing the data!
taking date information from row labels
----
The same with Sven's file:
parsing /home/helio/tmp/aapl_sven.csv...
using delimiter ','
longest line: 56 characters
first field: 'date'
seems to be observation label
number of columns = 7
number of variables: 6
number of non-blank lines: 250
scanning for variable names...
line: date,Open,High,Low,Close,Volume,AClose
scanning for row labels and data...
first row label "2014-03-25", last label "2013-04-01"
trying to parse row labels as dates...
Trying date order YYYYMMDD
Could be 2014-03-25 - 2013-04-01
Observations: 249; days in sample: 257
Missing daily observations: 8
reversing the data!
taking date information from row labels
----
I think that the fix was to deal with an invisible code BOM indicator.
Maybe you should test with latest Windows snapshot.
Hélio
On Wed, Mar 26, 2014 at 9:13 PM, Evgenii Gilenko <e.gilenko(a)spbu.ru> wrote:
Dear developers of gretl!
Thanks again for the wonderful software! It helps a lot both in scientific
research and in educational process!
Unfortunately, I’ve discovered a problem with importing data from a CSV
file to a gretl data file.
Specifically, when I try to import daily data from a CSV file (I attach
the CSV-file to this letter), I receive the following:
+++++++++++++++++++++++++++++++++++++++++
parsing D:\aapl.csv...
using delimiter ','
longest line: 56 characters
first field: 'date'
seems to be observation label
number of columns = 7
number of variables: 6
number of non-blank lines: 250
scanning for variable names...
line: date,Open,High,Low,Close,Volume,AClose
scanning for row labels and data...
first row label *"014-03-25",* last label "2013-04-01"
treating these as undated data
+++++++++++++++++++++++++++++++++++++++++
For some reasons gretl cuts off the first digit of the date in the “first
row label” line (I stressed in red).
And thus it interprets the data as cross-sectional, not as time-series.
I’m using gretl of version 1.9.14. I tried on version 1.9.13 – the same
problem.
But, on version 1.9.12 there was no such problem with importing data from
the attached CSV file – I double-checked it.
Could you please give any comments on how to override the problem on
version 1.9.14?
Downgrade to version 1.9.12 is not an option for me now.
Thanks,
Evgenii Gilenko
_______________________________________________
Gretl-devel mailing list
Gretl-devel(a)lists.wfu.edu
http://lists.wfu.edu/mailman/listinfo/gretl-devel
4:47 p.m.
On Thu, 27 Mar 2014, Hélio Guilherme wrote:
The file opens OK in gretl 1.9.15CVS in Linux (Fedora 19).
Confirmed here. By the way, these data look very much like stuff from
finance.yahoo.com. If this is the case, you may find the "yahoo_get"
function package quite helpful (look under File>Function files>On server).
-------------------------------------------------------
Riccardo (Jack) Lucchetti
Dipartimento di Scienze Economiche e Sociali (DiSES)
Università Politecnica delle Marche
(formerly known as Università di Ancona)
r.lucchetti(a)univpm.it
http://www2.econ.univpm.it/servizi/hpp/lucchetti
-------------------------------------------------------
8:59 p.m.
On Thu, 27 Mar 2014, Hélio Guilherme wrote:
The file opens OK in gretl 1.9.15CVS in Linux (Fedora 19).
Can anyone else test with the current snapshot for Windows? I just tried
the 64-bit Windows snapshot on Windows 8 and the original CSV file, as
attached to
http://lists.wfu.edu/pipermail/gretl-devel/2014-March/004957.html
opened correctly.
Allin
9:24 p.m.
OK with snapshot (26-mar-2014) Windows 7 Professional 64-bit.
parsing C:\temp\aapl.csv...
using delimiter ','
longest line: 55 characters
first field: 'date'
seems to be observation label
number of columns = 7
number of variables: 6
number of non-blank lines: 250
scanning for variable names...
line: date,Open,High,Low,Close,Volume,AClose
scanning for row labels and data...
first row label "2014-03-25", last label "2013-04-01"
trying to parse row labels as dates...
Trying date order YYYYMMDD
Could be 2014-03-25 - 2013-04-01
Observations: 249; days in sample: 257
Missing daily observations: 8
reversing the data!
taking date information from row labels
On Thu, Mar 27, 2014 at 9:59 PM, Allin Cottrell <cottrell(a)wfu.edu> wrote:
On Thu, 27 Mar 2014, Hélio Guilherme wrote:
The file opens OK in gretl 1.9.15CVS in Linux (Fedora 19).
>
Can anyone else test with the current snapshot for Windows? I just tried
the 64-bit Windows snapshot on Windows 8 and the original CSV file, as
attached to
http://lists.wfu.edu/pipermail/gretl-devel/2014-March/004957.html
opened correctly.
Allin
_______________________________________________
Gretl-devel mailing list
Gretl-devel(a)lists.wfu.edu
http://lists.wfu.edu/mailman/listinfo/gretl-devel
2:50 p.m.
No problem on Windows XP with 32-bit version Gretl snapshot in Spanish
and English.
File opened correctly.
On 27/03/14 21:59, Allin Cottrell wrote:
On Thu, 27 Mar 2014, Hélio Guilherme wrote:
> The file opens OK in gretl 1.9.15CVS in Linux (Fedora 19).
Can anyone else test with the current snapshot for Windows? I just
tried the 64-bit Windows snapshot on Windows 8 and the original CSV
file, as attached to
http://lists.wfu.edu/pipermail/gretl-devel/2014-March/004957.html
opened correctly.
Allin
_______________________________________________
Gretl-devel mailing list
Gretl-devel(a)lists.wfu.edu
http://lists.wfu.edu/mailman/listinfo/gretl-devel
--
Firma Arista
*Ignacio Díaz-Emparanza*
Zuzendaria/Director
ignacio.diaz-emparanza(a)ehu.es <mailto:ignacio.diaz.emparanza@ehu.es>
94 6013732
*EKONOMIA APLIKATUA III SAILA (EKONOMETRIA ETA ESTATISTIKA)/
DEPARTAMENTO DE ECONOMÍA APLICADA III (ECONOMETRÍA Y ESTADÍSTICA)
UPV/EHU*
Avda. Lehendakari Aguirre, 83 | 48015 BILBAO
*T.: +34 946013740* | *F.: +34 946013754*
*www.ea3.ehu.es* <http://www.ea3.ehu.es>
ERNE! Baliteke mezu honen zatiren bat edo mezu osoa legez babestuta
egotea. Mezuak badu bere hartzailea. Okerreko helbidera heldu bada
(helbidea gaizki idatzi, transmisioak huts egin) eman abisu igorleari,
korreo honi erantzunda. Kontuz! Mezua ez bada zuretzat, ez erabili, ez
zabaldu beste inori, ez kopiatu eta ez baliatu.
¡ATENCIÓN! Este mensaje contiene información privilegiada o confidencial
a la que sólo tiene derecho a acceder el destinatario. Si usted lo
recibe por error le agradeceríamos que no hiciera uso de la información
y que se pusiese en contacto con el remitente.
E-mail hau inprimatu baino lehen egiaztatu inprimatzeko beharra.
Antes de imprimir este e-mail piense bien si es necesario hacerlo.
3:43 p.m.
On Fri, 28 Mar 2014, Ignacio Diaz-Emparanza wrote:
No problem on Windows XP with 32-bit version Gretl snapshot in
Spanish and
English.
File opened correctly.
Thanks, Ignacio (and also Hélio). I think we can take it this is now
fixed. In fact, I think I fixed it in a commit to csvdata.c on December 26
last year. Another reason to make a release pretty soon.
Allin
On 27/03/14 21:59, Allin Cottrell wrote:
> On Thu, 27 Mar 2014, Hélio Guilherme wrote:
>
>> The file opens OK in gretl 1.9.15CVS in Linux (Fedora 19).
>
> Can anyone else test with the current snapshot for Windows? I just tried
> the 64-bit Windows snapshot on Windows 8 and the original CSV file, as
> attached to
>
> http://lists.wfu.edu/pipermail/gretl-devel/2014-March/004957.html
>
> opened correctly.
3962
days inactive
3964
days old
8 comments
7 participants
participants (7)
-
Allin Cottrell -
Cottrell, Allin
-
Evgenii Gilenko -
Hélio Guilherme -
Ignacio Diaz-Emparanza -
Riccardo (Jack) Lucchetti -
Sven Schreiber