Removing outlier from time series analysis using pandas





.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty{ height:90px;width:728px;box-sizing:border-box;
}







0















I have a time series analysis to model NDVI.
I used the following code:



import numpy as np
from pandas import Series
from matplotlib import pyplot
series = Series.from_csv('WSC-10-50.csv', header=0)
pyplot.subplots(figsize=(20, 10))
pyplot.plot(series)
pyplot.show()

print(series.describe())


How do I remove any outliers from the data set and replot?
I would also like to run the best fit line across new plot with the outliers removed



Any help?










share|improve this question

























  • The question is too broad. Consider asking it on Cross Validated; you may have a better response rate.

    – DYZ
    Nov 25 '18 at 1:42













  • ... or narrowing down to an actual question.

    – Ted Lyngmo
    Nov 25 '18 at 1:43











  • Take a look at this.

    – Ken Dekalb
    Nov 25 '18 at 3:29


















0















I have a time series analysis to model NDVI.
I used the following code:



import numpy as np
from pandas import Series
from matplotlib import pyplot
series = Series.from_csv('WSC-10-50.csv', header=0)
pyplot.subplots(figsize=(20, 10))
pyplot.plot(series)
pyplot.show()

print(series.describe())


How do I remove any outliers from the data set and replot?
I would also like to run the best fit line across new plot with the outliers removed



Any help?










share|improve this question

























  • The question is too broad. Consider asking it on Cross Validated; you may have a better response rate.

    – DYZ
    Nov 25 '18 at 1:42













  • ... or narrowing down to an actual question.

    – Ted Lyngmo
    Nov 25 '18 at 1:43











  • Take a look at this.

    – Ken Dekalb
    Nov 25 '18 at 3:29














0












0








0








I have a time series analysis to model NDVI.
I used the following code:



import numpy as np
from pandas import Series
from matplotlib import pyplot
series = Series.from_csv('WSC-10-50.csv', header=0)
pyplot.subplots(figsize=(20, 10))
pyplot.plot(series)
pyplot.show()

print(series.describe())


How do I remove any outliers from the data set and replot?
I would also like to run the best fit line across new plot with the outliers removed



Any help?










share|improve this question
















I have a time series analysis to model NDVI.
I used the following code:



import numpy as np
from pandas import Series
from matplotlib import pyplot
series = Series.from_csv('WSC-10-50.csv', header=0)
pyplot.subplots(figsize=(20, 10))
pyplot.plot(series)
pyplot.show()

print(series.describe())


How do I remove any outliers from the data set and replot?
I would also like to run the best fit line across new plot with the outliers removed



Any help?







python pandas scipy cross-validation






share|improve this question















share|improve this question













share|improve this question




share|improve this question








edited Nov 25 '18 at 8:16









Ken Dekalb

317112




317112










asked Nov 25 '18 at 1:34









Selena ChavezSelena Chavez

275




275













  • The question is too broad. Consider asking it on Cross Validated; you may have a better response rate.

    – DYZ
    Nov 25 '18 at 1:42













  • ... or narrowing down to an actual question.

    – Ted Lyngmo
    Nov 25 '18 at 1:43











  • Take a look at this.

    – Ken Dekalb
    Nov 25 '18 at 3:29



















  • The question is too broad. Consider asking it on Cross Validated; you may have a better response rate.

    – DYZ
    Nov 25 '18 at 1:42













  • ... or narrowing down to an actual question.

    – Ted Lyngmo
    Nov 25 '18 at 1:43











  • Take a look at this.

    – Ken Dekalb
    Nov 25 '18 at 3:29

















The question is too broad. Consider asking it on Cross Validated; you may have a better response rate.

– DYZ
Nov 25 '18 at 1:42







The question is too broad. Consider asking it on Cross Validated; you may have a better response rate.

– DYZ
Nov 25 '18 at 1:42















... or narrowing down to an actual question.

– Ted Lyngmo
Nov 25 '18 at 1:43





... or narrowing down to an actual question.

– Ted Lyngmo
Nov 25 '18 at 1:43













Take a look at this.

– Ken Dekalb
Nov 25 '18 at 3:29





Take a look at this.

– Ken Dekalb
Nov 25 '18 at 3:29












0






active

oldest

votes












Your Answer






StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");

StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});

function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});


}
});














draft saved

draft discarded


















StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53463947%2fremoving-outlier-from-time-series-analysis-using-pandas%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown

























0






active

oldest

votes








0






active

oldest

votes









active

oldest

votes






active

oldest

votes
















draft saved

draft discarded




















































Thanks for contributing an answer to Stack Overflow!


  • Please be sure to answer the question. Provide details and share your research!

But avoid



  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.


To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53463947%2fremoving-outlier-from-time-series-analysis-using-pandas%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







這個網誌中的熱門文章

Xamarin.form Move up view when keyboard appear

Post-Redirect-Get with Spring WebFlux and Thymeleaf

Anylogic : not able to use stopDelay()