Request for feedback on Inventory Consolidation to tackle lags

[kamesennin]

Hi Modern Warriors,

We are finally ready to begin the first phase of the inventory consolidation. As mentioned before, we had determined, with much help from the community, that one of the major causes of lag during events was the player data files size due to all the items in ones inventory.

One of the measures we are working on to tackle this issue is consolidating all the redundant inventory items into a smaller number of new items with the same equivalent power and bonus stats. This will entail deleting items from your inventory and replacing them with newer items with higher Att/Def. The end result should be of no loss of Att/Def to you, but an overall reduction in the amount of items in your inventory. This should drastically reduce the size of your data file and improve performance.

This initiative will involve the below 2 phases:

For the first iteration of this feature, we plan on first consolidating items that do not have bonuses.
After this is successful, we will then proceed to consolidating all the items with bonuses.

Since this would be a big modification to player accounts, we would like to get the community involved early on in the process so we can eventually roll this out to all players.

Currently the rule-set that we are planning on implementing is the below:


Target players for inventory consolidation:

Players who have more than 9000 items and Sum (Attack)> 30,000,000 or Sum (defense) > 30,000,000

Excluded Items:

Exclude items with bonuses
Exclude items with NULL or ZERO Attack OR Defense
This should exclude all consumables, H&V units, currencies etc.
Exclude the top 1500 equipment items in each of the following categories namely Head, Foot, Armor, Accessory and top 3000 items in the Weapon category.
Top items are to be calculated in terms of total power (attack+defense)- for each player.
Exclude items in the exception list, which includes, Goal Triggers, Memorial Items, Consumables, rare special items, currencies and other key items

Create Replacement Attack and Defense Items:

Calculate the total attack and defense for each player
Quantity of Attack Item= Total Attack/Attack Item Stat
Quantity of Defense Item= Total Defense/Defense Item Stat
For the minimum Attack and Defense Item Stat, we are currently considering to set it at 30,000,000 and round up stats of players to the nearest 30M increment. This is to limit the size of the item Quantity integer of the new replacement items.

Consolidate Items:

Downtime while Attack and Defense items in player inventory are consolidated


What we would like to request from you is to provide your feedback regarding the above inventory consolidation rule-set with your concerns and suggestions. We would especially like your cooperation regarding generating the Excluded Items list.

Thank you for your cooperation!

Kamesennin

[Twist of Cain]

Sounds like a good plan; however, I'm definitely not going to be the guinea pig to first try it.

[Spooneron]

Hello Warriors,

If there are any concerns or any points of failures that come to your mind with the above process, please post them here so that we can address them and make the initiative better.

Thank you for your co-operation.

Spooneron

[OlapDev]

From what I hear from friends still playing, Seeing as IOS and Android don't even show the same stats and therefore people don't know what their stats are. I don't see how they will be able to confirm that they are correct post process.

Get this wrong and people will be going to Google and Apple to resolve their issues.

(Shame I'd already quit a year ago.. sounds like a good way that I could have got my money back ��)

[Mrs Cash]

As long as my stats remain the same, I could care less how they are converted.
My main concern is that, well, I don't trust that things will go smoothly, and I don't want to get screwed.
Plus, it doesn't seem to matter, the lag is the same on all of my accounts, whether I have 186k # of units or 2k.

[Jg48]

Pull the plug you incompetent fools.

Keep getting error

Error


And guess what more errors

Pull the ****ing plug

[solper]

I expect that my accounts gonna loose on this as I am not a big hitter.

Pleas do it really bad, then I may delete my google account

[whitepath23]

Hi Modern Warriors,

We are finally ready to begin the first phase of the inventory consolidation. As mentioned before, we had determined, with much help from the community, that one of the major causes of lag during events was the player data files size due to all the items in ones inventory.

One of the measures we are working on to tackle this issue is consolidating all the redundant inventory items into a smaller number of new items with the same equivalent power and bonus stats. This will entail deleting items from your inventory and replacing them with newer items with higher Att/Def. The end result should be of no loss of Att/Def to you, but an overall reduction in the amount of items in your inventory. This should drastically reduce the size of your data file and improve performance.

This initiative will involve the below 2 phases:

For the first iteration of this feature, we plan on first consolidating items that do not have bonuses.
After this is successful, we will then proceed to consolidating all the items with bonuses.

Since this would be a big modification to player accounts, we would like to get the community involved early on in the process so we can eventually roll this out to all players.

Currently the rule-set that we are planning on implementing is the below:


Target players for inventory consolidation:

Players who have more than 9000 items and Sum (Attack)> 30,000,000 or Sum (defense) > 30,000,000

Excluded Items:

Exclude items with bonuses
Exclude items with NULL or ZERO Attack OR Defense
This should exclude all consumables, H&V units, currencies etc.
Exclude the top 1500 equipment items in each of the following categories namely Head, Foot, Armor, Accessory and top 3000 items in the Weapon category.
Top items are to be calculated in terms of total power (attack+defense)- for each player.
Exclude items in the exception list, which includes, Goal Triggers, Memorial Items, Consumables, rare special items, currencies and other key items

Create Replacement Attack and Defense Items:

Calculate the total attack and defense for each player
Quantity of Attack Item= Total Attack/Attack Item Stat
Quantity of Defense Item= Total Defense/Defense Item Stat
For the minimum Attack and Defense Item Stat, we are currently considering to set it at 30,000,000 and round up stats of players to the nearest 30M increment. This is to limit the size of the item Quantity integer of the new replacement items.

Consolidate Items:

Downtime while Attack and Defense items in player inventory are consolidated


What we would like to request from you is to provide your feedback regarding the above inventory consolidation rule-set with your concerns and suggestions. We would especially like your cooperation regarding generating the Excluded Items list.

Thank you for your cooperation!

Kamesennin

I am willing to test it out. I still want faction resources that are locked back as well. The response we got that was gree was s jj opposed to or we thought gree handled that doesn't sit well. Tickets are still unanswered


I am willing consolidate,

[DEWIN NUTTIN]

I am willing to test it out. I still want faction resources that are locked back as well. The response we got that was gree was s jj opposed to or we thought gree handled that doesn't sit well. Tickets are still unanswered


I am willing consolidate,

A true hero, one whose name will live forever.

The collective awaits as I cower over my keyboard slobbering and crying at such selfless bravery.

[Pyrowoman]

Im not sure how consolidation of units with boosts will work that the unit doesnt make the army but the boost does. Could you explain more on this please. Thank you.
Plus im still waiting on locked resources that have not been issued back to my faction as well.

[Annihilator2]

1. Item #3 seems as problematic. And negative effect is expected: players will lost their current stats.
I suggest to simply remove not excluded items that are not in any army (attack army, defense, FL).
2. All players worry about side effects.
I suggest to build separate servers with full copy of current servers in environment same as game environment and data and run test change there at first.
Then all events shall be tested there by your test team and volunteers.
3. Preventive actions shall be taken as well: the same stackable units shall be rewarded in all events and in stock (no new units). In such case, max limit will be increased from sale to sale to prevent buying unlimited number of stackable units.

[Jg48]

I can see how it will work the best. Gree/deca delete ALL UNITS FROM ALL INVENTORY. Then the game will work as it was intended

[labowski]

Question....will you please stop spamming our inventories with the low level event awards? As an example the Prestige level of the current LTQ SLAGELSE Prestige 1/15 the reward is Slagelse Desert Assailant 1.8M attack 1.2M defense. These units will not make most players armies and will only add to the lag. Thank you for your consideration and waiting for your response please....@ Kamesennin

[Batchief]

Consolidation of inventory not going so well. Members of my faction losing gold units, including upgrade specialist. Not good during the ltb that is in progress. You should post on the member’s board when you start on their profile! Faction member: Hooper ID 155 863 379.

[a hug for you]

please read the forum (general) if what your doing now has caused many players to lose boost buildings
boost buildings reset back to level 1, current divine fortress removed from base and having to start upgrading
all over again, and players soldier equipment gone i suggest you stop what your doing.If this isn`t a result of
what your doing then something else is and needs looking into asap.

[Batchief]

Consolidation of inventory not going so well. Members of my faction losing gold units, including upgrade specialist. Not good during the ltb that is in progress. You should post on the member’s board when you start on their profile! Faction member: Hooper ID 155 863 379.

My mistake! I thought consolidation of inventory was the cause of Hooper’s reduction down to 33 units. It is in fact a corrupt memory in a server as announced in another thread. It still has the same effect; Hooper is not a happy player.

[whitepath23]

When is this happening and when for Pete's sake are we getting the locker faction resources? There is a post below from aurelius that said it would happen, it didn't, he said he would post an update on status, he didnt

[OlapDev]

When is this happening and when for Pete's sake are we getting the locker faction resources? There is a post below from aurelius that said it would happen, it didn't, he said he would post an update on status, he didnt

Aurelius left GREE when Deca came onboard.. He was managing the locked faction resources himself. I doubt Deca would be able to assist

[daniel pena]

My mistake! I thought consolidation of inventory was the cause of Hooper’s reduction down to 33 units. It is in fact a corrupt memory in a server as announced in another thread. It still has the same effect; Hooper is not a happy player.

Do you really believe that this bug is due to cached memory??

To me is obvious that is related to this item consolidation. I had +5 building upgrade, now, I have +1!! I lost 4 of my upgrade infantry. My stats that were near a trillion now is about 10 billion (well, a trillion is not that big, but 10 billion is nothing)

[Mrs Cash]

Logically, would it make more sense to test things out in waves?

Buildings should not be touched or messed with.
Gold anything should not be touched or messed with.
Units with % att or def should not be touched. Maybe later.
If it's a crap item, low att/def, say under 1m. Consolidate.
See how things go, then carry on.

[Sierra Hotel]

Any progress on the actual 'reinstatement gold' for the victims of the memory cache mess up?

Frontline is starting (and no the 500 gold is different than what you just stole from us) and my accounts are still over 1000% less stats and no fix, no 'reinstatment gold, all my recent gold building purchases are gone, (most were at level 20).

What is happening?


ticket#
3324119
3324117
3324106
3324211
3324236
3324112

[Dumas]

Gree/Deca,

In your Phase 2 consolidation of the Units with Bonuses, I would suggest that you don't modify any items that have a bonus with a reduction effect (aka Health regen/ building upgrade time)... Only modify/combine bonuses that are additive in nature aka Attack/defense enhancement.

Just my .02cents

Dumas

[daniel pena]

Does this looks right to you all?????

[Mrs Cash]

Android. Number of units went from 218k to 193k. Stats haven't decreased, to my knowledge, too many mods were applied during Raid Boss BUT, lag is worse, took over 2 minutes to use a health pack and get in 4 hits. Haven't noticed any other issues, but it's still early...

[daniel pena]

To improve lag caused by large inventories the 1st version of inventory wipe is being implemented across all players. Find more info on "Forum Modern War-Announcements-Inventory Wipe release"

The only thing whipped out was my bonuses and my stats...

[Cuombajj]

Why not make recycling much easier, so we can decide for ourselves what to get rid of

[OlapDev]

Why not make recycling much easier, so we can decide for ourselves what to get rid of

Bit techy here... But recycling a unit doesn't hard delete the unit.. it soft deletes it so the performance issue still exists as it has to ignore it when calculating

[Hobbs]

I’ll let you know my view when I get the first wipe !! Still waiting for that.
Lag on iOS hits is a joke and getting worse with each WD event.

[solper]

Bit techy here... But recycling a unit doesn't hard delete the unit.. it soft deletes it so the performance issue still exists as it has to ignore it when calculating

The units who are soft deleted have a unique identyfyer in database and should be eady to delete by a agent running a simple script

[HellRaizer]

The units who are soft deleted have a unique identyfyer in database and should be eady to delete by a agent running a simple script

That is such a rookie thing to stay. The implications of a “simple delete” are rather large.

Let’s take SQL Server, which I believe they use on AWS.

This may one of the largest tables
Is it partitioned ? Probably not
Is it over indexed / under indexed?
How long does it take to delete, let’s say 1000 rows?
Will the table lock, will that cause blocking/deadlocks and therefore gamer impact
Deleting on its own will cause fragmentation and leave the table the same size. Therefore how long will an index rebuild take?

I could keep going on. Bugs me when I’m sent to review a clients DB model and process and the “developers” think that databases are “simple”

[solper]

If time to rebuild index and deleting are one week I would like to wait, if game run good after that.

I do not think enything are easy, but I think everything can be solved.

[whitepath23]

Here is why this is still a problem....

1. We continue to get units that make no ones army.....what can you buy in store to help your army
2. Add function to inventory that allows you to mass delete...don't need to touch every one to get it to delete
4. How about taking all the different types of units inftant air and such...add up a players attakck and defense on the ones that don't make an give a big unit.