[EDK4] allicorpstats_page update

[anchorhead]

ok i found php.ini, there are 3 php.ini on Debian in 3 different folder /etc/php5/... i have increase memory_limit at 768Mo and maximun timeout at 120 but for alliance shadow of xXdeathXx there is always a fatal error with timeout ...

[prometh]

Without having looked at the actual code, 2 minutes might still be not enough, i would try to increase it further and check if the page always loads that long or if it's just the initial call.

[Salvoxia]

Hi,

Shadow of xxDeathxx currently has 85 member corporations, which is a lot.
What is your default time filter set to in the mod's settings? If it's set to "All time" as default I easily can imagine two minutes might not be enough, if your killboard has a very large number of killmails for Shadow of xxDeathxx as well.

You used your own modified version of the mod before trying my updated version, did it work for Shadow of xxDeathxx with that version?

Regards,
Salvoxia

[anchorhead]

I use your version Salvoxia, for goonswarm for example i have no problem.

My default timer is all time but there is 4 killmail for shadow of death whereas goons more 500 ...

[Salvoxia]

Hi,

sorry for the late reply. I'm not at home for this week, will take another look on weekend.

Regards,
Salvoxia

[anchorhead]

No problem, i have tested in another KB and i have no problem ... -_-'

[anchorhead]

I don"t understand why just for shadow of death i have this error :
Fatal error: Maximum execution time of 30 seconds exceeded in /var/www/kb/common/includes/class.dbnormalquery.php on line 36

I have tested on KB test, with fresh install without modification of files, no problem but when i import my Database from true Kb, problem appears ...

What do you think and what i can do in database for fix it ?

Maybe i should empty my database and import kills at new, but i don't want reinstall all DB, what table i can empty without problem for remove all kills ?

Edit : i have empty this table for test, reimport kill and problem disappear ... :
Can you says me if the following table can be empty without problem ? and if i have forget one plz:

kb3_alliances
kb3_corps
kb3_inv_all
kb3_inv_crp
kb3_inv_detail
kb3_items_destroyed
kb3_items_dropped
kb3_kills
kb3_log
kb3_mails
kb3_pilots
kb3_sum_alliance
kb3_sum_corp
kb3_sum_pilot
kb3_sum_pilot_solo

[Salvoxia]

Hi,

I don't really understand it either. I tested it with Shadow of xXDeathXx on my popuplated test killboard (250k kills in the database) and the thing that took the longest was adding all the corps in the alliance and getting each corp's corporation sheet from the API. It took way longer than 30 seconds, but displayed correctly in the end (with around 2200 kills for Shadow of xXDeathXx on record).

I did another test for Goonswarm Federation with its 322 corps and with around 22k kills on file. Displayng Corp stats for the current week was not possible with the 32bit web server hitting the 2 GB memory limit every time (after 5-8 minutes).

At the end of the day, what we're trying to do here is applying analysis methods usually found in data warehouses to a productive database. That usually won't work very well, because the productive database is optimized for transactions, not for aggregating data. Data Warehouses are separated databases with pre-aggregated data, copied and transformed from the productive database. That way, the data is prepared for such analysis methods. So it's not very surprising the performance of a productive database is not very good (to put it mildly).

So with this mod, depending on the number of corps of an alliance and the number of kills in your database, it might be very possible that you can't get it to work at all because of memory limitations (if you're using a 32bit version of PHP) and 30 seconds time limit won't be enough in many cases.

If you want to remove all kills from your database the tables you listed look about right. If you have any campaigns with pilots/corps/alliances as target you also need to clear kb3_contracts and kb3_contract_details, because these tables contain references to pilot/corp/alliance IDs which will be not valid any more after clearing and re-adding the corps and alliances.

Regards,
Salvoxia

[anchorhead]

ok, i think my database is corrupt with time but i don't know what exactly ... when i reimport all kills with zkb, there is no problem. But lot of killmaills are missed, maybe problem are killmails malformed with manual post

ok thanks for kb_contracts

[Eingang]

Could someone with some more free time than I have please take a stab at updating this for 4.4.x+? I suspect there are probably others who would greatly appreciate it. Thanks!