dump of lists into csv export












-2














I need to add column headers and then export the following to csv.
But when I export the list, I get the last line with each of the characters in columns.



This is the output:



Current output of list



If I implement df=pd.DataFrame([d])
I get the following :



enter image description here



Code that creates this list is as follows



soup=BeautifulSoup(s,'lxml')

soup.prettify()

for anchor in soup.findAll('a', href=True):

s=anchor['href']

if 'bus' in s:

    urlparse(s)

    path = urlparse(s).path[1:]

    parts = path.split('/')

    d= parts[2:4]

    df=pd.DataFrame(d)

    print(df)





python pandas







share|improve this question




















  • 2




    Please replace the screenshots with the actual data. Screenshots of data, code, and errors do not belong on SO.
    – DYZ
    Nov 11 at 23:35










  • @DYZ but I am unable to get the data to csv hence why I am asking the question. I cannot copy paste the results for some reason from the command prompt. Its a lot of data by the way and its just a small fraction of it.
    – tabarneck
    Nov 11 at 23:47










  • What type of object is d? Why are you passing it to pd.DataFrame as a list (e.g. in ). Have you tried pd.DataFrame(d)?
    – dmitriys
    Nov 11 at 23:50










  • I get something like this if I do without the alon-De-Coiffure-Pour-Hommes-Laurier 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 Kings-Barbershop 0 0 Longueuil 1 Kings-Barbershop
    – tabarneck
    Nov 11 at 23:52








  • 1




    I will add the code to the post
    – tabarneck
    Nov 11 at 23:54
















-2














I need to add column headers and then export the following to csv.
But when I export the list, I get the last line with each of the characters in columns.



This is the output:



Current output of list



If I implement df=pd.DataFrame([d])
I get the following :



enter image description here



Code that creates this list is as follows



soup=BeautifulSoup(s,'lxml')

soup.prettify()

for anchor in soup.findAll('a', href=True):

s=anchor['href']

if 'bus' in s:

    urlparse(s)

    path = urlparse(s).path[1:]

    parts = path.split('/')

    d= parts[2:4]

    df=pd.DataFrame(d)

    print(df)





python pandas







share|improve this question




















  • 2




    Please replace the screenshots with the actual data. Screenshots of data, code, and errors do not belong on SO.
    – DYZ
    Nov 11 at 23:35










  • @DYZ but I am unable to get the data to csv hence why I am asking the question. I cannot copy paste the results for some reason from the command prompt. Its a lot of data by the way and its just a small fraction of it.
    – tabarneck
    Nov 11 at 23:47










  • What type of object is d? Why are you passing it to pd.DataFrame as a list (e.g. in ). Have you tried pd.DataFrame(d)?
    – dmitriys
    Nov 11 at 23:50










  • I get something like this if I do without the alon-De-Coiffure-Pour-Hommes-Laurier 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 Kings-Barbershop 0 0 Longueuil 1 Kings-Barbershop
    – tabarneck
    Nov 11 at 23:52








  • 1




    I will add the code to the post
    – tabarneck
    Nov 11 at 23:54














-2












-2








-2







I need to add column headers and then export the following to csv.
But when I export the list, I get the last line with each of the characters in columns.



This is the output:



Current output of list



If I implement df=pd.DataFrame([d])
I get the following :



enter image description here



Code that creates this list is as follows



soup=BeautifulSoup(s,'lxml')

soup.prettify()

for anchor in soup.findAll('a', href=True):

s=anchor['href']

if 'bus' in s:

    urlparse(s)

    path = urlparse(s).path[1:]

    parts = path.split('/')

    d= parts[2:4]

    df=pd.DataFrame(d)

    print(df)





python pandas







share|improve this question















I need to add column headers and then export the following to csv.
But when I export the list, I get the last line with each of the characters in columns.



This is the output:



Current output of list



If I implement df=pd.DataFrame([d])
I get the following :



enter image description here



Code that creates this list is as follows



soup=BeautifulSoup(s,'lxml')

soup.prettify()

for anchor in soup.findAll('a', href=True):

s=anchor['href']

if 'bus' in s:

    urlparse(s)

    path = urlparse(s).path[1:]

    parts = path.split('/')

    d= parts[2:4]

    df=pd.DataFrame(d)

    print(df)





python pandas




python pandas






share|improve this question















share|improve this question













share|improve this question




share|improve this question








edited Nov 12 at 0:23









eyllanesc

73.4k103056




73.4k103056










asked Nov 11 at 23:29









tabarneck

226




226








  • 2




    Please replace the screenshots with the actual data. Screenshots of data, code, and errors do not belong on SO.
    – DYZ
    Nov 11 at 23:35










  • @DYZ but I am unable to get the data to csv hence why I am asking the question. I cannot copy paste the results for some reason from the command prompt. Its a lot of data by the way and its just a small fraction of it.
    – tabarneck
    Nov 11 at 23:47










  • What type of object is d? Why are you passing it to pd.DataFrame as a list (e.g. in ). Have you tried pd.DataFrame(d)?
    – dmitriys
    Nov 11 at 23:50










  • I get something like this if I do without the alon-De-Coiffure-Pour-Hommes-Laurier 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 Kings-Barbershop 0 0 Longueuil 1 Kings-Barbershop
    – tabarneck
    Nov 11 at 23:52








  • 1




    I will add the code to the post
    – tabarneck
    Nov 11 at 23:54














  • 2




    Please replace the screenshots with the actual data. Screenshots of data, code, and errors do not belong on SO.
    – DYZ
    Nov 11 at 23:35










  • @DYZ but I am unable to get the data to csv hence why I am asking the question. I cannot copy paste the results for some reason from the command prompt. Its a lot of data by the way and its just a small fraction of it.
    – tabarneck
    Nov 11 at 23:47










  • What type of object is d? Why are you passing it to pd.DataFrame as a list (e.g. in ). Have you tried pd.DataFrame(d)?
    – dmitriys
    Nov 11 at 23:50










  • I get something like this if I do without the alon-De-Coiffure-Pour-Hommes-Laurier 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 Kings-Barbershop 0 0 Longueuil 1 Kings-Barbershop
    – tabarneck
    Nov 11 at 23:52








  • 1




    I will add the code to the post
    – tabarneck
    Nov 11 at 23:54








2




2




Please replace the screenshots with the actual data. Screenshots of data, code, and errors do not belong on SO.
– DYZ
Nov 11 at 23:35




Please replace the screenshots with the actual data. Screenshots of data, code, and errors do not belong on SO.
– DYZ
Nov 11 at 23:35












@DYZ but I am unable to get the data to csv hence why I am asking the question. I cannot copy paste the results for some reason from the command prompt. Its a lot of data by the way and its just a small fraction of it.
– tabarneck
Nov 11 at 23:47




@DYZ but I am unable to get the data to csv hence why I am asking the question. I cannot copy paste the results for some reason from the command prompt. Its a lot of data by the way and its just a small fraction of it.
– tabarneck
Nov 11 at 23:47












What type of object is d? Why are you passing it to pd.DataFrame as a list (e.g. in ). Have you tried pd.DataFrame(d)?
– dmitriys
Nov 11 at 23:50




What type of object is d? Why are you passing it to pd.DataFrame as a list (e.g. in ). Have you tried pd.DataFrame(d)?
– dmitriys
Nov 11 at 23:50












I get something like this if I do without the alon-De-Coiffure-Pour-Hommes-Laurier 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 Kings-Barbershop 0 0 Longueuil 1 Kings-Barbershop
– tabarneck
Nov 11 at 23:52






I get something like this if I do without the alon-De-Coiffure-Pour-Hommes-Laurier 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 King-s-Barbershop 0 0 Longueuil 1 Kings-Barbershop 0 0 Longueuil 1 Kings-Barbershop
– tabarneck
Nov 11 at 23:52






1




1




I will add the code to the post
– tabarneck
Nov 11 at 23:54




I will add the code to the post
– tabarneck
Nov 11 at 23:54












1 Answer
1






active

oldest

votes


















1














I think the issue is that for each iteration of the loop you're creating a new DataFrame; whereas what I imagine you probably want is a single DataFrame with all of the values for d. Try the below:



# Instantiate an empty list to collect values of `d` for each iteration

d_values = 



soup=BeautifulSoup(s,'lxml')

soup.prettify()

for anchor in soup.findAll('a', href=True):

    s=anchor['href']



    if 'bus' in s:

        urlparse(s)

        path = urlparse(s).path[1:]

        parts = path.split('/')

        d = parts[2:4]



        # Append `d` to your list, creating a list of lists

        d_values.append(d)



# Once your loop is done, create a DataFrame from your list of lists

df = pd.DataFrame(d_values, columns=['col1name','col2name'])





share|improve this answer





















  • Thank you so much! really appreciate your help!
    – tabarneck
    Nov 12 at 4:08











Your Answer






StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");

StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});

function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});


}
});














draft saved

draft discarded


















StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53254297%2fdump-of-lists-into-csv-export%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown

























1 Answer
1






active

oldest

votes








1 Answer
1






active

oldest

votes









active

oldest

votes






active

oldest

votes









1














I think the issue is that for each iteration of the loop you're creating a new DataFrame; whereas what I imagine you probably want is a single DataFrame with all of the values for d. Try the below:



# Instantiate an empty list to collect values of `d` for each iteration

d_values = 



soup=BeautifulSoup(s,'lxml')

soup.prettify()

for anchor in soup.findAll('a', href=True):

    s=anchor['href']



    if 'bus' in s:

        urlparse(s)

        path = urlparse(s).path[1:]

        parts = path.split('/')

        d = parts[2:4]



        # Append `d` to your list, creating a list of lists

        d_values.append(d)



# Once your loop is done, create a DataFrame from your list of lists

df = pd.DataFrame(d_values, columns=['col1name','col2name'])





share|improve this answer





















  • Thank you so much! really appreciate your help!
    – tabarneck
    Nov 12 at 4:08
















1














I think the issue is that for each iteration of the loop you're creating a new DataFrame; whereas what I imagine you probably want is a single DataFrame with all of the values for d. Try the below:



# Instantiate an empty list to collect values of `d` for each iteration

d_values = 



soup=BeautifulSoup(s,'lxml')

soup.prettify()

for anchor in soup.findAll('a', href=True):

    s=anchor['href']



    if 'bus' in s:

        urlparse(s)

        path = urlparse(s).path[1:]

        parts = path.split('/')

        d = parts[2:4]



        # Append `d` to your list, creating a list of lists

        d_values.append(d)



# Once your loop is done, create a DataFrame from your list of lists

df = pd.DataFrame(d_values, columns=['col1name','col2name'])





share|improve this answer





















  • Thank you so much! really appreciate your help!
    – tabarneck
    Nov 12 at 4:08














1












1








1






I think the issue is that for each iteration of the loop you're creating a new DataFrame; whereas what I imagine you probably want is a single DataFrame with all of the values for d. Try the below:



# Instantiate an empty list to collect values of `d` for each iteration

d_values = 



soup=BeautifulSoup(s,'lxml')

soup.prettify()

for anchor in soup.findAll('a', href=True):

    s=anchor['href']



    if 'bus' in s:

        urlparse(s)

        path = urlparse(s).path[1:]

        parts = path.split('/')

        d = parts[2:4]



        # Append `d` to your list, creating a list of lists

        d_values.append(d)



# Once your loop is done, create a DataFrame from your list of lists

df = pd.DataFrame(d_values, columns=['col1name','col2name'])





share|improve this answer












I think the issue is that for each iteration of the loop you're creating a new DataFrame; whereas what I imagine you probably want is a single DataFrame with all of the values for d. Try the below:



# Instantiate an empty list to collect values of `d` for each iteration

d_values = 



soup=BeautifulSoup(s,'lxml')

soup.prettify()

for anchor in soup.findAll('a', href=True):

    s=anchor['href']



    if 'bus' in s:

        urlparse(s)

        path = urlparse(s).path[1:]

        parts = path.split('/')

        d = parts[2:4]



        # Append `d` to your list, creating a list of lists

        d_values.append(d)



# Once your loop is done, create a DataFrame from your list of lists

df = pd.DataFrame(d_values, columns=['col1name','col2name'])






share|improve this answer












share|improve this answer



share|improve this answer










answered Nov 12 at 1:30









dmitriys

15119




15119












  • Thank you so much! really appreciate your help!
    – tabarneck
    Nov 12 at 4:08


















  • Thank you so much! really appreciate your help!
    – tabarneck
    Nov 12 at 4:08
















Thank you so much! really appreciate your help!
– tabarneck
Nov 12 at 4:08




Thank you so much! really appreciate your help!
– tabarneck
Nov 12 at 4:08


















draft saved

draft discarded




















































Thanks for contributing an answer to Stack Overflow!


  • Please be sure to answer the question. Provide details and share your research!

But avoid …



  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.


To learn more, see our tips on writing great answers.





Some of your past answers have not been well-received, and you're in danger of being blocked from answering.


Please pay close attention to the following guidance:


  • Please be sure to answer the question. Provide details and share your research!

But avoid …



  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.


To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53254297%2fdump-of-lists-into-csv-export%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







-

這個網誌中的熱門文章

Xamarin.form Move up view when keyboard appear

圖片
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty{ height:90px;width:728px;box-sizing:border-box; } 0 I'm trying to build a Chat app UI, the idea of the Layout was pretty simple: When the input bar is focused, keyboard show up and "push" up the chat bar, as it's a grid, the ListView will resize to fit the screen: I update the input bar's margin to "push" it up: NSValue result = (NSValue)args.Notification.UserInfo.ObjectForKey(new NSString(UIKeyboard.FrameEndUserInfoKey)); CGSize keyboardSize = result.RectangleFValue.Size; if (Element != null){ Element.Margin = new Thickness(0, 0, 0,keyboardSize.Height); //push the entry up to keyboard height when keyboard is activated } And this is ...
閱讀完整內容

Post-Redirect-Get with Spring WebFlux and Thymeleaf

圖片
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty{ height:90px;width:728px;box-sizing:border-box; } 2 Can someone explain to me how to implement the post-redirect-get pattern in Spring WebFlux and Thymeleaf? What subscribes on the database save method? @GetMapping("/register") public String showRegisterForm(Model model) { model.addAttribute("user", new User()); return "register"; } @PostMapping public String processRegisterForm(@Valid User user, BindingResult bindingResult) { if (bindingResult.hasErrors()) { return "register"; } else { userRepository.save(user); //what subscribes on this? //how to redirect on e.g. "/login"? ...
閱讀完整內容

Anylogic : not able to use stopDelay()

圖片
-2 I am building a railway station model. I want a train to depart when I click a button. I want to call stopDelay() for that but I am not sure how to do that and from which place. anylogic share | improve this question asked Nov 23 '18 at 10:12 Anupam Singh Anupam Singh 1 Hi Anupam, welcome to SOF. Please check how to ask good questions, see link below. Your question is...
閱讀完整內容