11:30 a.m.
Hi everyone,
I am working on my master thesis and I have a data set in three different
excel files each on different lengths that need to me merged together. I
saved them as csv since I have some text variables but when trying the JOIN
function I always get error. I tried joining them with matching keys 2 by
2.
Is there somewhere a more detailed explanation of the join function?
Thank you for your help.
/Andreea
12:48 p.m.
On Fri, 2 Aug 2013, Andreea Bolos wrote:
Hi everyone,
I am working on my master thesis and I have a data set in three different
excel files each on different lengths that need to me merged together. I
saved them as csv since I have some text variables but when trying the JOIN
function I always get error. I tried joining them with matching keys 2 by
2.
Is there somewhere a more detailed explanation of the join function?
Thank you for your help.
There's a whole chapter in the user's guide.
-------------------------------------------------------
Riccardo (Jack) Lucchetti
Dipartimento di Scienze Economiche e Sociali (DiSES)
Università Politecnica delle Marche
(formerly known as Università di Ancona)
r.lucchetti(a)univpm.it
http://www2.econ.univpm.it/servizi/hpp/lucchetti
-------------------------------------------------------
4:24 p.m.
I followed the instructions from the manual but I always get "First char of
varname is bad (first must be alphabetical)". The names of my variables are
constructed according to gretl.Do you have any suggestion of what can be
the problem?
thank you for your help.
/Andreea
On Fri, Aug 2, 2013 at 2:48 PM, Riccardo (Jack) Lucchetti <
r.lucchetti(a)univpm.it> wrote:
On Fri, 2 Aug 2013, Andreea Bolos wrote:
Hi everyone,
>
> I am working on my master thesis and I have a data set in three different
> excel files each on different lengths that need to me merged together. I
> saved them as csv since I have some text variables but when trying the
> JOIN
> function I always get error. I tried joining them with matching keys 2
> by
> 2.
>
> Is there somewhere a more detailed explanation of the join function?
>
> Thank you for your help.
>
There's a whole chapter in the user's guide.
------------------------------**-------------------------
Riccardo (Jack) Lucchetti
Dipartimento di Scienze Economiche e Sociali (DiSES)
Università Politecnica delle Marche
(formerly known as Università di Ancona)
r.lucchetti(a)univpm.it
http://www2.econ.univpm.it/**servizi/hpp/lucchetti<http://www2.econ.un...
------------------------------**-------------------------
_______________________________________________
Gretl-users mailing list
Gretl-users(a)lists.wfu.edu
http://lists.wfu.edu/mailman/listinfo/gretl-users
4:26 p.m.
On Fri, 2 Aug 2013, Andreea Bolos wrote:
I followed the instructions from the manual but I always get
"First char of
varname is bad (first must be alphabetical)". The names of my variables are
constructed according to gretl.Do you have any suggestion of what can be
the problem?
Sometimes the error messages to the join command can be misleading. Can
you send me a reduced version of your data files and instructions so that
I can replicate your problem?
-------------------------------------------------------
Riccardo (Jack) Lucchetti
Dipartimento di Scienze Economiche e Sociali (DiSES)
Università Politecnica delle Marche
(formerly known as Università di Ancona)
r.lucchetti(a)univpm.it
http://www2.econ.univpm.it/servizi/hpp/lucchetti
-------------------------------------------------------
4:34 p.m.
On Fri, 2 Aug 2013, Andreea Bolos wrote:
I followed the instructions from the manual but I always get
"First char of
varname is bad (first must be alphabetical)". The names of my variables are
constructed according to gretl.Do you have any suggestion of what can be
the problem?
That particular error message is probably spurious (and has
been fixed in CVS), but it likely does indicate a syntax error
in the invocation of "join". I would recommend trying the
current snapshot (for Windows or Mac) or a build from CVS. Or
if you send your join command to the list maybe we can see
what's wrong.
Allin Cottrell
2:08 p.m.
Thank you for your answers. I need to join 2 files and the Key-matching is
NUMBER variable that is included in both files. Not all observations from
left-hand/inner will match with the ones from right-hand/outer. My
commands were:
"open /Users/andreea/Desktop/Test1Gretl.csv __quiet
join /Users/andreea/Desktop/Test2Gretl.csv CONTRTYPE __ikey=NUMBER
print __byobs"
Thank you again for your help.
On Fri, Aug 2, 2013 at 6:34 PM, Allin Cottrell <cottrell(a)wfu.edu> wrote:
On Fri, 2 Aug 2013, Andreea Bolos wrote:
> I followed the instructions from the manual but I always get "First char
of
> varname is bad (first must be alphabetical)". The names of my variables
are
> constructed according to gretl.Do you have any suggestion of what can be
> the problem?
That particular error message is probably spurious (and has
been fixed in CVS), but it likely does indicate a syntax error
in the invocation of "join". I would recommend trying the
current snapshot (for Windows or Mac) or a build from CVS. Or
if you send your join command to the list maybe we can see
what's wrong.
Allin Cottrell
_______________________________________________
Gretl-users mailing list
Gretl-users(a)lists.wfu.edu
http://lists.wfu.edu/mailman/listinfo/gretl-users
2:30 p.m.
On Sat, 3 Aug 2013, Andreea Bolos wrote:
Thank you for your answers. I need to join 2 files and the
Key-matching is
NUMBER variable that is included in both files. Not all observations from
left-hand/inner will match with the ones from right-hand/outer. My
commands were:
"open /Users/andreea/Desktop/Test1Gretl.csv __quiet
join /Users/andreea/Desktop/Test2Gretl.csv CONTRTYPE __ikey=NUMBER
print __byobs"
Thank you again for your help.
Apart from the usage of __ instead of -- for options, I can see nothing
obviously wrong here, so there must be some problem with your csv files.
Would it be possible to send them to me, please, so I can see what's going
on? Of course, if they're really really large you don't have to send the
whole thing, the first 2-300 lines should be enough.
-------------------------------------------------------
Riccardo (Jack) Lucchetti
Dipartimento di Scienze Economiche e Sociali (DiSES)
Università Politecnica delle Marche
(formerly known as Università di Ancona)
r.lucchetti(a)univpm.it
http://www2.econ.univpm.it/servizi/hpp/lucchetti
-------------------------------------------------------
2:56 p.m.
On Sat, 3 Aug 2013, Andreea Bolos wrote:
Thank you for your answers. I need to join 2 files and the
Key-matching is
NUMBER variable that is included in both files. Not all observations from
left-hand/inner will match with the ones from right-hand/outer. My
commands were:
"open /Users/andreea/Desktop/Test1Gretl.csv __quiet
join /Users/andreea/Desktop/Test2Gretl.csv CONTRTYPE __ikey=NUMBER
print __byobs"
The option-leader in gretl is two dashes (--), not two
underscores. In the first command the string "__quiet" is
simply ignored (which probably should count as a bug), but in
the join command, for which parsing is stricter, the
underscores will generate a syntax error.
Just in case you actually used dashes in your script, another
point to bear in mind is that in gretl variable names are case
sensitive, so the join cammand will fail unless the key
variable is really called NUMBER (all caps).
Allin Cottrell
4:53 p.m.
Thank you for your replies. It is very helpful for me. The data I am
working with contains sensitive information and I do not have the
permission to share it, otherwise I would have sent a sample. The command
worked but now I encountered another problem. The message is "data types
not conformable for operation". Gretl asked for the aggregation option.
But I do not want to aggregate. The right-hand variables have more than
one match with the left-hand variables. The files contain both numerical
and string variables that need to be matched (the count of matches is not
helping). For example one column on the right-hand that needs to be matched
to the left-hand through variable NUMBER (numerical variable) looks
similar to this:
TYPEOFCONTROL (name)
type2
type2
type2
type3
type4
...
Is it possible through the JOIN function to get it in numerical form after
matching, or they need to be numerical before matching? I need the exact
variable to be "joined" to the left-hand. I know that Gretl transforms the
categorical variables into numerical ones (that can later be transformed
into dummies) when importing the data.
Example:
TYPEOFCONTROL (is it possible to get it sth like this after matching?)
1
1
1
2
3
/Andreea
On Sat, Aug 3, 2013 at 4:56 PM, Allin Cottrell <cottrell(a)wfu.edu> wrote:
On Sat, 3 Aug 2013, Andreea Bolos wrote:
> Thank you for your answers. I need to join 2 files and the Key-matching
is
> NUMBER variable that is included in both files. Not all observations from
> left-hand/inner will match with the ones from right-hand/outer. My
> commands were:
> "open /Users/andreea/Desktop/Test1Gretl.csv __quiet
> join /Users/andreea/Desktop/Test2Gretl.csv CONTRTYPE __ikey=NUMBER
> print __byobs"
The option-leader in gretl is two dashes (--), not two
underscores. In the first command the string "__quiet" is
simply ignored (which probably should count as a bug), but in
the join command, for which parsing is stricter, the
underscores will generate a syntax error.
Just in case you actually used dashes in your script, another
point to bear in mind is that in gretl variable names are case
sensitive, so the join cammand will fail unless the key
variable is really called NUMBER (all caps).
Allin Cottrell
_______________________________________________
Gretl-users mailing list
Gretl-users(a)lists.wfu.edu
http://lists.wfu.edu/mailman/listinfo/gretl-users
1:29 p.m.
On Sat, 3 Aug 2013, Andreea Bolos wrote:
Thank you for your replies. It is very helpful for me. The data I am
working with contains sensitive information and I do not have the
permission to share it, otherwise I would have sent a sample. The command
worked but now I encountered another problem. The message is "data types
not conformable for operation". Gretl asked for the aggregation option.
But I do not want to aggregate. The right-hand variables have more than
one match with the left-hand variables.
That sounds like a blocker: if there's more than one match on
the right for a given row on the left, this _must_ be handled
somehow, either by one "aggregation" method or other
(including sequence number as an option), or by application of
a filter on the right-hand data to reduce the matches to
uniqueness. (Or possibly by sub-sampling on the left to skip
rows that have multiple matches on the right.) You just can't
stick more than one value from the right into a given
row/column slot on the left.
The files contain both numerical and string variables that
need to be matched (the count of matches is not helping).
For example one column on the right-hand that needs to be
matched to the left-hand through variable NUMBER (numerical
variable) looks similar to this:
TYPEOFCONTROL (name)
type2
type2
type2
type3
type4
...
Is it possible through the JOIN function to get it in numerical form after
matching, or they need to be numerical before matching?
You can match first. Here's a trivial example:
content of bolos1.csv:
x,key
1,a
2,b
3,c
4,d
5,e
content of bolos2.csv:
TYPEOFCONTROL,key
type2,e
type2,d
type2,c
type3,b
type4,a
hansl script:
open bolos1.csv
join bolos2.csv TYPEOFCONTROL --ikey=key
print -o
output from script:
? open bolos1.csv --quiet
Read datafile
/home/cottrell/stats/esl/gretl/build/cli/bolos1.csv
? join bolos2.csv TYPEOFCONTROL --ikey=key
? print --byobs
x key TYPEOFCONTROL
1 1 1 3
2 2 2 2
3 3 3 1
4 4 4 1
5 5 5 1
Allin Cottrell
4169
days inactive
4171
days old
9 comments
3 participants
participants (3)
-
Allin Cottrell -
Andreea Bolos -
Riccardo (Jack) Lucchetti