Delete old/partial data in emoncms.org feed

Hello. I´m testing a solar system to heat water.

I have several feeds to Emoncms.org.

They all have garbage data in them because I´m testing out the hardware.

Feeds are temperature sensors that seems to send non-expected data values some times (transient values).

Data expected is between 0 and 100 ºC, (most of them betwen 15 and 70 ºC) but sometimes send values of 400. So, when I want to see data in multigraph (http://emoncms.org/aicanduit/graftemp) , high values doesn´t let me see low values with precission.

Now I would like to delete the garbage data (specifics intervals of a feed) in the feeds but I don't seem to see a way to delete old data. Can someone point me in the right direction?

Thanks in advance.

aicanduit's picture

Re: Delete old/partial data in emoncms.org feed

Well, now I know deleting data in graph is disabled by Tristan due to error last summer,

I'm trying to delete point of October 23th 2014, 17h 55m 10s (value of 448.60) in feed Colector1 (id =24966)  through "json.deletedatapoint":

With miliseconds:

http://emoncms.org/feed/deletedatapoint.json?id=24966&feedtime=1414086910000&apikey=...(my apikey)

Return False.

Without miliseconds:

http://emoncms.org/feed/deletedatapoint.json?id=24966&feedtime=1414086910&apikey=...(my apikey)

Return false also.

 

Any idea ?

Edit:

I've downloaded feed data (export). This are the values:

1414079710,448.60
1414079740,411.20
1414079770,31.57
1414079800,31.43
1414079830,31.37
1414079860,31.32
1414079890,31.19
1414079920,31.18
1414079950,31.19

I´ve changed th UNIX time to 1414079710 and 1414079710000 with same negative results.

I've tryied with "update" also:

http://emoncms.org/feed/update.json?id=24966&time=1414079710&value=100.0......
http://emoncms.org/feed/update.json?id=24966&time=1414079710000&value=10......

Both results are null.

What I'm doing wrong ?

¿?

 

 

 

bdog's picture

Re: Delete old/partial data in emoncms.org feed

Maybe give this a try:

http://emoncms.org/feed/update.json?id=[feedID]&time=[time as in your csv export]&value=[new value]

Without the '[ ]' of course. It will return 'null' even if it works.

Let me know how it goes.

 

B

 

dod's picture

Re: Delete old/partial data in emoncms.org feed

Same here, trying to delete some data, infact all data prior to a specific point.

The emontx3 temp output needed scaling and due to being switched off it has a start point of 200c for two weeks dropping to the correct temp of 20c so now the graph is wrong.

 

tried 

http://emoncms.org/feed/update.json?id=49874&time=1407706830&value=20

 

also tried adding &apikey= on the end but I get back null and no change in the exported data.

bdog's picture

Re: Delete old/partial data in emoncms.org feed

This is the area I looked at to arrive at my conclusion:

https://github.com/emoncms/emoncms/blob/master/Modules/feed/feed_control...

And I just realized that my post above is the exact same method that aicanduit was using. I had initially posted the URL without the .json because I was getting the 'null' response and I assumed that it was failing, when in fact it wasn't. After realizing this, I edited my post, changing it to the URL that worked. So now it looks like I'm suggesting that you do the same thing and expect a different result. <oops>

Since you're getting different results using the same method I'd check the following:

- make sure you're logged in with the browser you're using for the update

- change datapoints that would be really obvious and look for the changes not only in export, but in the graphs as well.

B
 

 

 

Paul Reed's picture

Re: Delete old/partial data in emoncms.org feed

If it's a PHPFIWA feed, then why not try this script https://github.com/emoncms/usefulscripts/blob/master/readme.md The remove spike script will remove datapoints that fall outside of your criteria.

Paul

aicanduit's picture

Re: Delete old/partial data in emoncms.org feed

Logged seems to work, thanks !

 

Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.