how to extract a column in a for loop out of a dataframe from multiple list glob created by glob











up vote
-1
down vote

favorite












I am a beginner in Python and just started with machine learning. I can not figure out how to extract a column out of df_test.



I would like to extract column 280 (this is the target y for a linearregression, y_test)



I used glob, to combine multiple cvs files, which are the test set for the regression. I have to extract x_test which is columns 0-279 and all rows. and y_test column 280



from glob import glob
filenames= glob('webStats_test*.csv')
df_test= [pd.read_csv(f)for f in filenames]
new_df = pd.DataFrame()


really hope you could help, already spend ours looking and trying but with no results.



Kind regards irmgard










share|improve this question
























  • Question has nothing to do with machine-learning - kindly do not spam the tag (removed).
    – desertnaut
    Nov 10 at 19:11















up vote
-1
down vote

favorite












I am a beginner in Python and just started with machine learning. I can not figure out how to extract a column out of df_test.



I would like to extract column 280 (this is the target y for a linearregression, y_test)



I used glob, to combine multiple cvs files, which are the test set for the regression. I have to extract x_test which is columns 0-279 and all rows. and y_test column 280



from glob import glob
filenames= glob('webStats_test*.csv')
df_test= [pd.read_csv(f)for f in filenames]
new_df = pd.DataFrame()


really hope you could help, already spend ours looking and trying but with no results.



Kind regards irmgard










share|improve this question
























  • Question has nothing to do with machine-learning - kindly do not spam the tag (removed).
    – desertnaut
    Nov 10 at 19:11













up vote
-1
down vote

favorite









up vote
-1
down vote

favorite











I am a beginner in Python and just started with machine learning. I can not figure out how to extract a column out of df_test.



I would like to extract column 280 (this is the target y for a linearregression, y_test)



I used glob, to combine multiple cvs files, which are the test set for the regression. I have to extract x_test which is columns 0-279 and all rows. and y_test column 280



from glob import glob
filenames= glob('webStats_test*.csv')
df_test= [pd.read_csv(f)for f in filenames]
new_df = pd.DataFrame()


really hope you could help, already spend ours looking and trying but with no results.



Kind regards irmgard










share|improve this question















I am a beginner in Python and just started with machine learning. I can not figure out how to extract a column out of df_test.



I would like to extract column 280 (this is the target y for a linearregression, y_test)



I used glob, to combine multiple cvs files, which are the test set for the regression. I have to extract x_test which is columns 0-279 and all rows. and y_test column 280



from glob import glob
filenames= glob('webStats_test*.csv')
df_test= [pd.read_csv(f)for f in filenames]
new_df = pd.DataFrame()


really hope you could help, already spend ours looking and trying but with no results.



Kind regards irmgard







python-3.x pandas glob






share|improve this question















share|improve this question













share|improve this question




share|improve this question








edited Nov 10 at 19:11









desertnaut

15.2k53161




15.2k53161










asked Nov 10 at 17:09









Irm

91




91












  • Question has nothing to do with machine-learning - kindly do not spam the tag (removed).
    – desertnaut
    Nov 10 at 19:11


















  • Question has nothing to do with machine-learning - kindly do not spam the tag (removed).
    – desertnaut
    Nov 10 at 19:11
















Question has nothing to do with machine-learning - kindly do not spam the tag (removed).
– desertnaut
Nov 10 at 19:11




Question has nothing to do with machine-learning - kindly do not spam the tag (removed).
– desertnaut
Nov 10 at 19:11












1 Answer
1






active

oldest

votes

















up vote
0
down vote













You can use pandas .iloc for this.



x_test = new_df.iloc[:, :280]
y_test = new_df.iloc[:, 280]


But in your code, you still first have to fill new_df with actual data... I would append all your different files to a list of DataFrames and then use concat to combine the list of DataFrames to 1 DataFrame.






share|improve this answer





















    Your Answer






    StackExchange.ifUsing("editor", function () {
    StackExchange.using("externalEditor", function () {
    StackExchange.using("snippets", function () {
    StackExchange.snippets.init();
    });
    });
    }, "code-snippets");

    StackExchange.ready(function() {
    var channelOptions = {
    tags: "".split(" "),
    id: "1"
    };
    initTagRenderer("".split(" "), "".split(" "), channelOptions);

    StackExchange.using("externalEditor", function() {
    // Have to fire editor after snippets, if snippets enabled
    if (StackExchange.settings.snippets.snippetsEnabled) {
    StackExchange.using("snippets", function() {
    createEditor();
    });
    }
    else {
    createEditor();
    }
    });

    function createEditor() {
    StackExchange.prepareEditor({
    heartbeatType: 'answer',
    convertImagesToLinks: true,
    noModals: true,
    showLowRepImageUploadWarning: true,
    reputationToPostImages: 10,
    bindNavPrevention: true,
    postfix: "",
    imageUploader: {
    brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
    contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
    allowUrls: true
    },
    onDemand: true,
    discardSelector: ".discard-answer"
    ,immediatelyShowMarkdownHelp:true
    });


    }
    });














     

    draft saved


    draft discarded


















    StackExchange.ready(
    function () {
    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53241375%2fhow-to-extract-a-column-in-a-for-loop-out-of-a-dataframe-from-multiple-list-glob%23new-answer', 'question_page');
    }
    );

    Post as a guest















    Required, but never shown

























    1 Answer
    1






    active

    oldest

    votes








    1 Answer
    1






    active

    oldest

    votes









    active

    oldest

    votes






    active

    oldest

    votes








    up vote
    0
    down vote













    You can use pandas .iloc for this.



    x_test = new_df.iloc[:, :280]
    y_test = new_df.iloc[:, 280]


    But in your code, you still first have to fill new_df with actual data... I would append all your different files to a list of DataFrames and then use concat to combine the list of DataFrames to 1 DataFrame.






    share|improve this answer

























      up vote
      0
      down vote













      You can use pandas .iloc for this.



      x_test = new_df.iloc[:, :280]
      y_test = new_df.iloc[:, 280]


      But in your code, you still first have to fill new_df with actual data... I would append all your different files to a list of DataFrames and then use concat to combine the list of DataFrames to 1 DataFrame.






      share|improve this answer























        up vote
        0
        down vote










        up vote
        0
        down vote









        You can use pandas .iloc for this.



        x_test = new_df.iloc[:, :280]
        y_test = new_df.iloc[:, 280]


        But in your code, you still first have to fill new_df with actual data... I would append all your different files to a list of DataFrames and then use concat to combine the list of DataFrames to 1 DataFrame.






        share|improve this answer












        You can use pandas .iloc for this.



        x_test = new_df.iloc[:, :280]
        y_test = new_df.iloc[:, 280]


        But in your code, you still first have to fill new_df with actual data... I would append all your different files to a list of DataFrames and then use concat to combine the list of DataFrames to 1 DataFrame.







        share|improve this answer












        share|improve this answer



        share|improve this answer










        answered Nov 10 at 20:18









        Niels Henkens

        202111




        202111






























             

            draft saved


            draft discarded



















































             


            draft saved


            draft discarded














            StackExchange.ready(
            function () {
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53241375%2fhow-to-extract-a-column-in-a-for-loop-out-of-a-dataframe-from-multiple-list-glob%23new-answer', 'question_page');
            }
            );

            Post as a guest















            Required, but never shown





















































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown

































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown







            Popular posts from this blog

            Florida Star v. B. J. F.

            Danny Elfman

            Lugert, Oklahoma