View Issue Details

IDProjectCategoryView StatusLast Update
0000115Adam4EVEFeature Requestpublic2016-08-06 07:40
ReporterSuccessor Assigned ToSuccessor  
PrioritynormalSeverityfeatureReproducibilityalways
Status acknowledgedResolutionopen 
Product Version0.0.1 
Summary0000115: Use EveProsper OHLC data
Descriptionhttp://api.eveprosper.com/CREST/OHLC.[csv|json]?typeID=[typeid]&regionID=[regionid]

http://api.eveprosper.com/CREST/OHLC.csv?typeID=34&regionID=10000002
TagsNo tags attached.

Activities

Successor

2016-08-06 07:40

administrator   ~0000068

Importer created however the API is very slow, thus import of one region takes 7 hours:

egion 10000002: data request after: 2,7s; Memory: 16.721.032; Type: 42232 (Gold Ouroboros Accelerator)
Region 10000002: data request after: 2,2s; Memory: 16.768.952; Type: 42233 (Silver Ouroboros Accelerator)
Region 10000002: data request after: 1,7s; Memory: 16.820.184; Type: 42234 (Copper Ouroboros Accelerator)
Final DB insert of 2655 rows in 0,1s
--------------------------------------------
Import finished
--------------------------------------------
Regions: 1; Items: 11012; Successful requests: 10265; Inserts: 176; Rows: 2627830; Error 500: 747; Runtime: 28424.9s (API: 25247.8, DB: 52.9); API Bytes: 323808829

Chat log from Slack with lockefox:

Ethan02
6:28 AM @lockefox: For the OHLC data from api.eveprosper.com are you planning to add a "bulk request"? Like the last 7 days of data for all items in a region?
HLIBindustry Lockefox
6:35 AM Not for a while
6:35 Model is quandl
6:36 And the back end right now is not super stable yet
6:36 Also... It just transmutes the crest feed without any db
Ethan02
6:39 AM if its pure crest without DB, where do you get the open and close from? doesn't crest only provide high, low and avg?
HLIBindustry Lockefox
6:52 AM It's a cheat. Yesterday is open, today is close
Ethan02
6:55 AM ok, assumed u pulled crest every hour or more a day and created the data from that
HLIBindustry Lockefox
7:00 AM No, the feed is daily (same as history feed in game)
7:00 I have hourly data, but it's not ready to API yet
Ethan02
7:04 AM good to know, thx. Then I'll push the integration of that graph onto the bench for now

Issue History

Date Modified Username Field Change
2016-07-13 09:49 Successor New Issue
2016-07-13 09:49 Successor Status new => assigned
2016-07-13 09:49 Successor Assigned To => Successor
2016-08-06 07:40 Successor Note Added: 0000068
2016-08-06 07:40 Successor Status assigned => acknowledged