ESI Transition Test Release

Testing before new release
User avatar
Salvoxia
Developer
Posts: 1525
Joined: Wed Feb 22, 2012 12:11

ESI Transition Test Release

Post by Salvoxia » Sun Nov 27, 2016 18:12

Hi guys,

I'm sure most of you are familiar with the new ESI API CCP released a couple of weeks ago, and with their intention to shut down the XML and CREST API, as soon as ESI supports everything the older APIs have to offer.
So I've been busy over the last couple of days with transitioning the first killboard functions over to ESI, using a Swagger-generated ESI library.
A first experimental release is now ready, based on the current 4.2.28.0 release for Ascention 1.0

Change Log:
  • introduced Swagger-generated ESI library
  • manually posted kills via CREST links will now be posted using ESI
  • zKB Fetch now uses ESI for posting kills
  • fetching Pilots, Corporations and Alliances is now done using ESI
  • item values will now be fetched using ESI
  • Alliance Tournament ship prices are now hardcoded to more realistic values
  • increased minimum PHP version required for installation to 5.4 for compatibility with generated ESI library
  • cURL is now a hard prerequisite for installing EDK (for compatibility with generated ESI library)
All of these changes are "under the hood", so if I did not screw up, you should not recognize any difference.

As can be seen in the change log, the minimum system requirements for installing EDK will be increased to at least PHP 5.4 with cURL for all releases dealing with ESI.
The kill posting implementation with ESI is actually not the first, but the second shot, since the first approach proved to be too slow. Now, posting a single kill requires just two calls to ESI, one for fetching the actual kill, another for translating all IDs to names.
There still are many functions relying on the XML API as well as CREST. These will be phased out over time, some functions do not yet have an equivalent in ESI.

Download: https://github.com/evekb/evedev-kb/archive/salvoxia.zip
Github Branch: https://github.com/evekb/evedev-kb/tree/salvoxia
Warning: Do NOT use this release with your production database!!

If you test this release, I'd highly appreciate any feedback! I'm especially interested in the following:
  • any errors you encounter with killmail posting, either manually or using zKBFetch
  • the overall performance of killmail posting (timeouts you perhaps encounter)
  • any wrong information in the posted kills, with regard to the basic information (timestamp, victims, attackers, ...)
Your help is much appreciated!


Anytime there's a new test release, i'll post an update in this thread, the download link will stay the same.

Best Regards,
Salvoxia

User avatar
SnakeTheBest
Apprentice
Posts: 43
Joined: Tue Feb 02, 2010 00:30

Re: ESI Transition Test Release

Post by SnakeTheBest » Sun Dec 11, 2016 21:12

thanks!!! :D :D

Bas
Apprentice
Posts: 65
Joined: Sun Apr 20, 2014 12:11
Location: Russia, Moscow
Contact:

Re: ESI Transition Test Release

Post by Bas » Sun Dec 11, 2016 22:37

does esi work with zkb fetcher or only for eve api?

User avatar
Salvoxia
Developer
Posts: 1525
Joined: Wed Feb 22, 2012 12:11

Re: ESI Transition Test Release

Post by Salvoxia » Mon Dec 12, 2016 16:13

The current test build in the linked branch uses ESI for kill posting via CREST links and for zKBFetch. Importing from the EVE API still uses the XML API and CREST parser.

User avatar
Salvoxia
Developer
Posts: 1525
Joined: Wed Feb 22, 2012 12:11

Re: ESI Transition Test Release

Post by Salvoxia » Wed Apr 12, 2017 13:29

Hi all,

just a quick update:
The branch linked in the OP now contains a version with all XML API usage eliminated exception for:
  • Char/Corp KillMails (Corp not yet possible via ESI, will look into that as soon as there's an enpoint)
  • Standings (in a very particular use case only)
CREST is still used for fetching Unknown Items. This cannot be switched over to ESI yet, since there's still information missing in ESI.

All of the rest now uses ESI. It's still a bit slow for some use cases. On the one hand, multiple ESI calls are now required to get the same amount of information you used to get with a single CREST or XML API call (nothing we can change), and ESI calls do not yet get cached on the other hand. This will be added though, the usual caching mechanisms will be supported for ESI caching (File, Memcached, Redis).

If any of you feel like giving this version a try, feedback is appreciated!

Best Regards,
Salvoxia

User avatar
Salvoxia
Developer
Posts: 1525
Joined: Wed Feb 22, 2012 12:11

Re: ESI Transition Test Release

Post by Salvoxia » Tue May 02, 2017 10:41

Caching for ESI is now implemented and available for testing in this branch.

User avatar
edp
Someday Author
Posts: 95
Joined: Fri Sep 25, 2009 19:10

Re: ESI Transition Test Release

Post by edp » Tue Jun 06, 2017 10:27

Downloaded and will run it concurrent to the latest stable 4.x version to compare.

User avatar
edp
Someday Author
Posts: 95
Joined: Fri Sep 25, 2009 19:10

Re: ESI Transition Test Release

Post by edp » Tue Jun 06, 2017 11:13

First error off of a fresh install:

Cache for fetch not made initially.

Error in fetch: Path "/cache/esi/kbtest.tiod.wtf/Files" is not writable, please set a chmod 0777 or any writable permission and make sure to make use of an absolute path !

After making this directory, the error remains. Manual fetching works, with the exception of the first item.

kbfetch also does not work, reporting on the page the following:

Error reading feed: https://zkillboard.com/api/corporationID/98512537/
Path "/cache/esi/kbtest.tiod.wtf/Files" is not writable, please set a chmod 0777 or any writable permission and make sure to make use of an absolute path !, Start time = 2017-04-29 18:38:52

test site is http://kbtest.tiod.wtf

User avatar
Salvoxia
Developer
Posts: 1525
Joined: Wed Feb 22, 2012 12:11

Re: ESI Transition Test Release

Post by Salvoxia » Tue Jun 06, 2017 16:15

Hi,

thank you very much for giving it a try!

Could you please try the following: Recursively set chmod 0777 for the entire cache folder and all folders inside?

Best Regards,
Salvoxia

User avatar
edp
Someday Author
Posts: 95
Joined: Fri Sep 25, 2009 19:10

Re: ESI Transition Test Release

Post by edp » Tue Jun 06, 2017 16:18

Done; unfortunately no luck. It's the oddest thing I've seen in some time.

Post Reply

Return to “Testing”

Who is online

Users browsing this forum: No registered users and 2 guests