Pandas merging two dataframes with different number of multiindices
up vote
0
down vote
favorite
Welcome, I have a simple question, to which I haven't found a solution.
I have two dataframes df1 and df2:
df1contains several columns and a multiindex asyear-month-week
df2contains the multiindexyear-weekwith only one column in the df.
I would like to create an inner join of df1 and df2, joining on 'year' and 'week'.
I have tried to do the following:
df1['newcol'] = df1.index.get_level_values(2).map(lambda x: df2.newcol[x])
Which only joins on month (or year?), is there any way to expand it so that the merge is actually right?
Thanks in advance!
df1
df2
python pandas dataframe
asked Nov 22 at 15:09
acronis011
33
|
show 1 more comment
up vote
0
down vote
favorite
Welcome, I have a simple question, to which I haven't found a solution.
I have two dataframes df1 and df2:
df1contains several columns and a multiindex asyear-month-week
df2contains the multiindexyear-weekwith only one column in the df.
I would like to create an inner join of df1 and df2, joining on 'year' and 'week'.
I have tried to do the following:
df1['newcol'] = df1.index.get_level_values(2).map(lambda x: df2.newcol[x])
Which only joins on month (or year?), is there any way to expand it so that the merge is actually right?
Thanks in advance!
df1
df2
python pandas dataframe
asked Nov 22 at 15:09
acronis011
33
2
Can you provide a sample dataframe via a Minimal, Complete, and Verifiable example.
– jpp
Nov 22 at 15:10
2
Show us some sample of the datasets. Refer to the guide on how to add code snippets.
– Shiv_90
Nov 22 at 15:11
I added some pictures to represent the dataset, i hope it helps!
– acronis011
Nov 22 at 15:22
We can't copy/paste pictures into python :D
– user3471881
Nov 22 at 15:32
1
Did you trypd.merge([df1, df2], how = 'inner', on = ['year', 'week']?
– maow
Nov 22 at 15:38
|
show 1 more comment
up vote
0
down vote
favorite
up vote
0
down vote
favorite
Welcome, I have a simple question, to which I haven't found a solution.
I have two dataframes df1 and df2:
df1contains several columns and a multiindex asyear-month-week
df2contains the multiindexyear-weekwith only one column in the df.
I would like to create an inner join of df1 and df2, joining on 'year' and 'week'.
I have tried to do the following:
df1['newcol'] = df1.index.get_level_values(2).map(lambda x: df2.newcol[x])
Which only joins on month (or year?), is there any way to expand it so that the merge is actually right?
Thanks in advance!
df1
df2
python pandas dataframe
asked Nov 22 at 15:09
acronis011
33
Welcome, I have a simple question, to which I haven't found a solution.
I have two dataframes df1 and df2:
df1contains several columns and a multiindex asyear-month-week
df2contains the multiindexyear-weekwith only one column in the df.
I would like to create an inner join of df1 and df2, joining on 'year' and 'week'.
I have tried to do the following:
df1['newcol'] = df1.index.get_level_values(2).map(lambda x: df2.newcol[x])
Which only joins on month (or year?), is there any way to expand it so that the merge is actually right?
Thanks in advance!
df1
df2
python pandas dataframe
python pandas dataframe
asked Nov 22 at 15:09
acronis011
33
asked Nov 22 at 15:09
acronis011
33
edited Nov 22 at 15:20
asked Nov 22 at 15:09
acronis011
33
asked Nov 22 at 15:09
acronis011
33
asked Nov 22 at 15:09
acronis011
33
33
2
Can you provide a sample dataframe via a Minimal, Complete, and Verifiable example.
– jpp
Nov 22 at 15:10
2
Show us some sample of the datasets. Refer to the guide on how to add code snippets.
– Shiv_90
Nov 22 at 15:11
I added some pictures to represent the dataset, i hope it helps!
– acronis011
Nov 22 at 15:22
We can't copy/paste pictures into python :D
– user3471881
Nov 22 at 15:32
1
Did you trypd.merge([df1, df2], how = 'inner', on = ['year', 'week']?
– maow
Nov 22 at 15:38
|
show 1 more comment
2
Can you provide a sample dataframe via a Minimal, Complete, and Verifiable example.
– jpp
Nov 22 at 15:10
2
Show us some sample of the datasets. Refer to the guide on how to add code snippets.
– Shiv_90
Nov 22 at 15:11
I added some pictures to represent the dataset, i hope it helps!
– acronis011
Nov 22 at 15:22
We can't copy/paste pictures into python :D
– user3471881
Nov 22 at 15:32
1
Did you trypd.merge([df1, df2], how = 'inner', on = ['year', 'week']?
– maow
Nov 22 at 15:38
2
2
Can you provide a sample dataframe via a Minimal, Complete, and Verifiable example.
– jpp
Nov 22 at 15:10
Can you provide a sample dataframe via a Minimal, Complete, and Verifiable example.
– jpp
Nov 22 at 15:10
2
2
Show us some sample of the datasets. Refer to the guide on how to add code snippets.
– Shiv_90
Nov 22 at 15:11
Show us some sample of the datasets. Refer to the guide on how to add code snippets.
– Shiv_90
Nov 22 at 15:11
I added some pictures to represent the dataset, i hope it helps!
– acronis011
Nov 22 at 15:22
I added some pictures to represent the dataset, i hope it helps!
– acronis011
Nov 22 at 15:22
We can't copy/paste pictures into python :D
– user3471881
Nov 22 at 15:32
We can't copy/paste pictures into python :D
– user3471881
Nov 22 at 15:32
1
1
Did you try
pd.merge([df1, df2], how = 'inner', on = ['year', 'week']?– maow
Nov 22 at 15:38
Did you try
pd.merge([df1, df2], how = 'inner', on = ['year', 'week']?– maow
Nov 22 at 15:38
|
show 1 more comment
1 Answer
1
active
oldest
votes
up vote
0
down vote
Eventually i solved with with removing the multiindex and doing a good old inner join on the two columns and then recreating the multiindex at the end.
Here are the sniplets:
df=df.reset_index()
df2=df2.reset_index()
df['year']=df['year'].apply(int)
df2['year']=df2['year'].apply(int)
df['week']=df['week'].apply(int)
df2['week']=df2['week'].apply(int)
result = pd.merge(df, df2, how='left', left_on= ['year','week'],right_on= ['year','week'])
result=result.set_index(['year', 'month','week','day'])
answered Nov 22 at 15:51
acronis011
33
Since flattening index is not that intuitive for many, I'd suggest that you could add the actual code that you used, so that others could benefit from your experience ;) stackoverflow.blog/2011/07/01/…
– leoburgy
Nov 22 at 16:08
add a comment |
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
up vote
0
down vote
Eventually i solved with with removing the multiindex and doing a good old inner join on the two columns and then recreating the multiindex at the end.
Here are the sniplets:
df=df.reset_index()
df2=df2.reset_index()
df['year']=df['year'].apply(int)
df2['year']=df2['year'].apply(int)
df['week']=df['week'].apply(int)
df2['week']=df2['week'].apply(int)
result = pd.merge(df, df2, how='left', left_on= ['year','week'],right_on= ['year','week'])
result=result.set_index(['year', 'month','week','day'])
answered Nov 22 at 15:51
acronis011
33
Since flattening index is not that intuitive for many, I'd suggest that you could add the actual code that you used, so that others could benefit from your experience ;) stackoverflow.blog/2011/07/01/…
– leoburgy
Nov 22 at 16:08
add a comment |
up vote
0
down vote
Eventually i solved with with removing the multiindex and doing a good old inner join on the two columns and then recreating the multiindex at the end.
Here are the sniplets:
df=df.reset_index()
df2=df2.reset_index()
df['year']=df['year'].apply(int)
df2['year']=df2['year'].apply(int)
df['week']=df['week'].apply(int)
df2['week']=df2['week'].apply(int)
result = pd.merge(df, df2, how='left', left_on= ['year','week'],right_on= ['year','week'])
result=result.set_index(['year', 'month','week','day'])
answered Nov 22 at 15:51
acronis011
33
Since flattening index is not that intuitive for many, I'd suggest that you could add the actual code that you used, so that others could benefit from your experience ;) stackoverflow.blog/2011/07/01/…
– leoburgy
Nov 22 at 16:08
add a comment |
up vote
0
down vote
up vote
0
down vote
Eventually i solved with with removing the multiindex and doing a good old inner join on the two columns and then recreating the multiindex at the end.
Here are the sniplets:
df=df.reset_index()
df2=df2.reset_index()
df['year']=df['year'].apply(int)
df2['year']=df2['year'].apply(int)
df['week']=df['week'].apply(int)
df2['week']=df2['week'].apply(int)
result = pd.merge(df, df2, how='left', left_on= ['year','week'],right_on= ['year','week'])
result=result.set_index(['year', 'month','week','day'])
answered Nov 22 at 15:51
acronis011
33
Eventually i solved with with removing the multiindex and doing a good old inner join on the two columns and then recreating the multiindex at the end.
Here are the sniplets:
df=df.reset_index()
df2=df2.reset_index()
df['year']=df['year'].apply(int)
df2['year']=df2['year'].apply(int)
df['week']=df['week'].apply(int)
df2['week']=df2['week'].apply(int)
result = pd.merge(df, df2, how='left', left_on= ['year','week'],right_on= ['year','week'])
result=result.set_index(['year', 'month','week','day'])
answered Nov 22 at 15:51
acronis011
33
edited Nov 22 at 16:20
answered Nov 22 at 15:51
acronis011
33
answered Nov 22 at 15:51
acronis011
33
answered Nov 22 at 15:51
acronis011
33
33
Since flattening index is not that intuitive for many, I'd suggest that you could add the actual code that you used, so that others could benefit from your experience ;) stackoverflow.blog/2011/07/01/…
– leoburgy
Nov 22 at 16:08
add a comment |
Since flattening index is not that intuitive for many, I'd suggest that you could add the actual code that you used, so that others could benefit from your experience ;) stackoverflow.blog/2011/07/01/…
– leoburgy
Nov 22 at 16:08
Since flattening index is not that intuitive for many, I'd suggest that you could add the actual code that you used, so that others could benefit from your experience ;) stackoverflow.blog/2011/07/01/…
– leoburgy
Nov 22 at 16:08
Since flattening index is not that intuitive for many, I'd suggest that you could add the actual code that you used, so that others could benefit from your experience ;) stackoverflow.blog/2011/07/01/…
– leoburgy
Nov 22 at 16:08
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Some of your past answers have not been well-received, and you're in danger of being blocked from answering.
Please pay close attention to the following guidance:
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53433795%2fpandas-merging-two-dataframes-with-different-number-of-multiindices%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
2
Can you provide a sample dataframe via a Minimal, Complete, and Verifiable example.
– jpp
Nov 22 at 15:10
2
Show us some sample of the datasets. Refer to the guide on how to add code snippets.
– Shiv_90
Nov 22 at 15:11
I added some pictures to represent the dataset, i hope it helps!
– acronis011
Nov 22 at 15:22
We can't copy/paste pictures into python :D
– user3471881
Nov 22 at 15:32
1
Did you try
pd.merge([df1, df2], how = 'inner', on = ['year', 'week']?– maow
Nov 22 at 15:38