Am 18.02.2018 um 10:37 schrieb Sven Schreiber:
[taking this to devel instead of users]
> On Tue, 13 Feb 2018, Sven Schreiber wrote:
>> Yes. Again, I suggest to tackle the SB.gfn package as a benchmark.
bottleneck is the disk-based transfer of the big random matrix back
to
So Allin had the great idea to enable binary-mode transfer between
Python and Gretl, and I tried it.
(Attention, the binary transfer won't work on Windows yet even with the
latest snapshot due to the issue mentioned in the other thread. You
would have to edit the gretl_io.py file on your machine first.)
the gretl environment. Here are my results for 39999 replications:
And here are new results. (Don't compare the absolute speeds with my
previous post, they are from different machines.)
SB 1.3, 2017-11-14 (F. Di Iorio, S. Fachin, A. Tarassow, Riccardo "Jack"
Lucchetti)
Gretl native (SB package)
This took = 7.587454 sec.
Python / Numba pure calculation
This took = 1.887286 sec.
Python / Numba with text transfer
This took = 6.591593 sec.
Python / Numba with gzipped text transfer
This took = 26.816650 sec.
Python / Numba with binary transfer
This took = 2.087111 sec.
Now we're talking! However, it just occurs to me that "Gretl native" is
misleading, because the SB package is obviously hansl-native, but it's
not a native libgretl C function. Anyway.
thanks,
sven