zkillboard fetch

Help and support in getting the EVE-Dev Killboard to run on your site.
sonicj
Noob
Posts: 7
Joined: Fri Mar 30, 2018 13:44

zkillboard fetch

Post by sonicj » Fri Mar 30, 2018 13:53

Fresh install and trying to import from zkillboard. I get the following error on the fetch administration page:
Error getting data: (7), Start time = 2018-03-30 11:00:00


On the administration troubleshooting page I see this error:
Connection to CREST API NOT successul, Error: Error getting data: (7) (Code: 0)

I saw in another post an updated class.zkbfetch.php file from an older version. I tried it as well without success. Is this fetch supposed to be functional?

User avatar
Salvoxia
Developer
Posts: 1465
Joined: Wed Feb 22, 2012 12:11

Re: zkillboard fetch

Post by Salvoxia » Fri Mar 30, 2018 14:58

Hi,

yes, zKBFetch ist supposed to be working. I just tested it on my development killboard, works normal.
Is it possible you tried to run it during downtime? The EVE API is down as well during downtime. If so, could you just try again now?

Best Regards,
Salvoxia

sonicj
Noob
Posts: 7
Joined: Fri Mar 30, 2018 13:44

Re: zkillboard fetch

Post by sonicj » Fri Mar 30, 2018 15:14

Yes I just tried it again. I have tried using it these ways below, where xxxxxxxxx is the corp id or the player id and when i go to the link in my browser i see info.

https://zkillboard.com/api/corporation/xxxxxxxxx/
https://zkillboard.com/api/kills/corpor ... xxxxxxxxx/
https://zkillboard.com/api/character/xxxxxxxx/
https://zkillboard.com/api/kills/character/xxxxxxxx/

I have tried adjusting the start time as well. This is supposed to pull all killmails for that character or corporation from zKillboard, correct?

User avatar
Salvoxia
Developer
Posts: 1465
Joined: Wed Feb 22, 2012 12:11

Re: zkillboard fetch

Post by Salvoxia » Fri Mar 30, 2018 15:53

Ah, I see.
You seem to have overlooked a small but important detail regarding the zKB URL: the entity type, for which you want to fetch kills, is always followed by "ID": corporationID, characterID, allianceID.
So for corporations, it would be https://zkillboard.com/api/corporationID/xxxxxxxxx/

I hope that helps.

Best Regards,
Salvoxia

sonicj
Noob
Posts: 7
Joined: Fri Mar 30, 2018 13:44

Re: zkillboard fetch

Post by sonicj » Sat Mar 31, 2018 01:17

The second link I posted actually has the corporation that way and i still get the error.

This is the exact one I used:
https://zkillboard.com/api/corporationID/618890022/

Here is the error using different timestamps:
Error reading feed: https://zkillboard.com/api/corporationID/618890022/
Error getting data: (7), Start time = 2007-03-30 11:00:00

Error reading feed: https://zkillboard.com/api/corporationID/618890022/
Error getting data: (7), Start time = 2018-03-30 23:00:00

User avatar
Salvoxia
Developer
Posts: 1465
Joined: Wed Feb 22, 2012 12:11

Re: zkillboard fetch

Post by Salvoxia » Sat Mar 31, 2018 10:38

Hi,

that works for me as well.
Let's take a closer look at the error you get. 7 is the cURL error number, which means "Failed to connect() to host or proxy. ".
That sounds like cURL couldn't establish a connection from your web server to zkillboard.com.
Can you check if it's at all possible to connect to zkillboard.com from your server (e.g. SSH into your server and wget zkillboard.com).

The Troubleshooting page in EDK's Admin Control Panel might also help. It checks if cURL connection to the EVE API is possible. If that's not possible as well, that's a bigger problem.

You could also try changing the API connection method in ACP -> Configuration to "file". But I advise to use this only as a diagnostic function, since this option will go away soon.

Best Regards,
Salvoxia

sonicj
Noob
Posts: 7
Joined: Fri Mar 30, 2018 13:44

Re: zkillboard fetch

Post by sonicj » Sat Mar 31, 2018 14:40

I found where outgoing connections were being blocked. I added them to allowed and it worked.

When i run the fetch with a timestamp of the current time and i have 2 in the box for Negative last kill timestamp offset [h]:, does that mean it will pull in the past 2 hours? If so, and if I want to pull in all the killmails for my corp can I set an unlimited time or is there a limit?

User avatar
Salvoxia
Developer
Posts: 1465
Joined: Wed Feb 22, 2012 12:11

Re: zkillboard fetch

Post by Salvoxia » Sat Mar 31, 2018 15:21

Hi,

glad it's working now :)

The negative time offset will go x hours in the past of the timestamp set for the feed, that's correct. However, the intended is use to get killmails that are posted late to zKB.
If you want to fetch all kills zKB has for your corp, I suggest getting the timestamp of the first kill zKB has and setting the zKBFetch timestamp to that time. It will then work through all kills zKB knows until it arrives at the present.

Best Regards,
Salvoxia

sonicj
Noob
Posts: 7
Joined: Fri Mar 30, 2018 13:44

Re: zkillboard fetch

Post by sonicj » Sat Mar 31, 2018 16:19

Thank you so much for your help.

Hopefully my last 2 questions :)

1. When i run it to the oldest kill date and time that zkillboard has, it does not post all the killmails. It says the following:
30 kills were posted and 1 were skipped (200 kills fetched). Timestamp of last kill: 2007-12-16 17:14:00
Why did it skip so many?

2. zkillboard does not have all my corp killmails from years ago. I think battleclinic had alot more. Does that database of killmails exist anywhere, that I can import them?

User avatar
Salvoxia
Developer
Posts: 1465
Joined: Wed Feb 22, 2012 12:11

Re: zkillboard fetch

Post by Salvoxia » Sat Mar 31, 2018 17:08

Hi,

about skipping: Nothing to worry about, if not accompanied by error messages. zKB's API always returns 200 kills, but EDK does not process all mails in one chunk, but only a portion of it, to avoid running into PHP's maximum execution time limit.
You can find the setting for this in ACP -> Configuration "Max number of kills to process per run [10-200]:".
That value was initialized based on the execution time limit PHP detected.

So nothing to worry about, it will fetch all mails eventually, especially when using the cron jobs.

Regarding battleclinic: I guess you are talking about kills from 2007 and earlier? I'm afraid I don't know of any database with kills that old. You also need to keep in mind that back then, killmails really were textual mails, and there was no way to identify fake mails in an automated way. Also, the old killmails lacked much of the information we are used to nowadays, an example being what module was fitted to what slot.

Best Regards,
Salvoxia

Post Reply

Return to “Support”

Who is online

Users browsing this forum: No registered users and 4 guests