PDA

View Full Version : Server Stability Issue



kamesennin
01-04-2018, 12:39 PM
Hello Mobsters,

Many of you have been experiencing login and leaderboard issues over the last 42 hours. We are sorry for the inconvenience.
This is due to our web hosting company conducting server maintenance to address security issues, which has impacted the stability of the game in unforeseen ways. We were informed that server maintenance will be impacted until at least January 5, 2018 18:00 PM PST so we expect the game to be unstable until then.

We will try to remove the Street Assault event this weekend, but due to server access instability, it is uncertain if we can remove the event in time. This means we might have to let the scheduled Street Assault to continue. We will update you if this is the case and give everyone advanced warning to participate in this event at your own risk. We cannot guarantee how the event will perform or if even any prizes will get paid out.

We expect the issue to get resolved over the weekend and we will work on getting everything straightened out for any events that were negatively impacted as soon we get our access back. Sorry again for the inconvenience. We will keep you updated.

Kamesennin

kamesennin
01-05-2018, 07:43 AM
Hello Mobsters,

Our development team is still working hard to resolve the server issue but the Street Assault this weekend will still be unstable. We are very sorry for the inconvenience.

It is still most likely that the prizes won’t payout (even if you see the leaderboard) and the upcoming Street Assault event may end abruptly because we are still trying to stop this event.
We do not want you to waste spending any gold and consumables on this event so please DO NOT PARTICIPATE in the Street Assault unless you just want to participate for the sake of enjoying it.

We will continue to do our best to resolve this issue as quickly as possible and will keep you updated.

Kamesennin

kamesennin
01-08-2018, 03:04 AM
Hi all,

Just a quick update, unfortunately the server issue is ongoing but we are close to resolving it.
We are very sorry for the inconvenience and appreciate your continued patience.

We have confirmed that the Street Assault event Charoliar Bust will not payout prizes.
Some players will also not receive their prizes for the Raid Boss Rafael Quintaro and Lockbox Encajuelados Research events.
We will prepare compensation packages for the Raid Boss and Lockbox events.

kamesennin
01-10-2018, 06:08 AM
Hi all,

I am sorry to inform you that the server stability issue is ongoing and our development team is still working on the fix.

Currently we believe the Hate & Revenge Cremita Powder event might be affected.

We are very sorry for the inconvenience and we will keep you updated about any developments.

Kamesennin

kamesennin
01-12-2018, 05:29 AM
Hello all,

Here is an update to the progress we have made so far. We made progress on our data deployment tool, but we are now having issues with our QA servers.

Normally an event gets deployed to QA server where we test it to make sure everything is correct before pushing it out to the game server.
Due to QA server issues we have no way to confirm that the data is being deployed correctly and don’t want to risk corrupt data getting out.

We are hoping to get this resolved today so we can get some new events in time for the weekend. Any events that we deploy will be ones that do not have a Leaderboard component to them.
We will give you another progress update later today

We are also having intermittent issues with the servers that handle event Leaderboards. Once we get the QA environment working normally again we will move onto getting those Leaderboard servers working correctly.
Our current goal is to get out some events that don’t have leaderboard so you can continue playing and progressing while we work on resolving the issue.

We apologize for the inconvenience and please know that the engineers have been working non-stop including the weekend to fix this.

Kamesennin

kamesennin
01-12-2018, 12:47 PM
Hi all,

We unfortunately have to inform you that our engineers are still working on getting Leaderboard servers working.

Meanwhile you will have the below events to participate in this weekend:

[Epic Boss] Teodoro Vargas
[LTQ] Fusilados Attack
[LTQ] Mota Contraband
[LTQ] Plantacion Sowing


We will also have a small daily surprise waiting for you to help you with the weekend boss event.

We appreciate your continued patience and we hope to bring back all the events to you soon.

Kamesennin

kamesennin
01-17-2018, 09:19 AM
Hi all,

We are making progress with fixing the issues and will be rolling out some test events to make sure everything is working before we return to the normal event schedule.

The first test will be the following 16 hour Street Assault:


Churro Smoking: Jan 17, 8:00 AM - Jan 18, 0:00 PST

Since this is a test guild event, there will be a guild-lock for the next 16 hours so you will not be able to switch guilds during the event duration.
We are sorry for the inconvenience but please participate at your own risk and avoid wasting any gold.

Thank you for your continued patience.

Kamesennin

kamesennin
01-18-2018, 07:08 AM
Hello all,

We have noticed that there are still issues with the test Street Assault event that we ran yesterday so we will be running another 24 hour Street Assault test event.


Banda Cooperation: Jan 18, 8:00 AM - Jan 19, 8:00 AM PST

We're aware that there are still a lot of issues in the game and we apologize for the frustration this is causing everyone.
Unfortunately the game is still very unstable and we strongly advise that you avoid wasting your gold while we are still testing these events.
We will continue to work hard to get the game fully functional as soon as possible.

Please reach out to us with your account details if you encounter any issues.

Kamesennin

kamesennin
01-19-2018, 06:25 AM
Hello all,

We apologize for the inconvenience but there will not be an official guild event this weekend.
We have made fixes to some of the reported issues in Street Assault so we will be running another 24 hour test Street assault.
As this will be another test, please participate at your own risk and avoid wasting any gold.


24H Test Street Assault Charoliar Bust: Jan 21, 1:00 AM - Jan 22, 1:00 AM PST

However, there will still be events in the game this weekend for you to participate in, which are the following:


Epic Boss Diego Alvares
24H LTQ Rag Flagging
24H LTQ Crimen Initiation

As always, please reach out to us with your account details if you encounter any issues.

Kamesennin

kamesennin
01-22-2018, 08:25 AM
Hello all,

We have made additional fixes for Street Assault, which will be tested with another 24 hour Street Assault.
Sorry for the inconvenience but there will be a guild lock for the duration of the below event.


24H Test Street Assault Pildora Spread: Jan 22, 7:00 AM - Jan 23, 7:00 AM PST

As before, please participate at your own risk and avoid wasting any gold.

Thank you for your continued patience.

Kamesennin

kamesennin
01-25-2018, 09:20 AM
Hi all,

We are happy to announce that there will be a full-length Street Assault this weekend so you can rally your troops and prepare for war! Just as a small gesture for your continued patience, we will have a gift with Street Assault points bonus waiting for you when you login to boost you during the event.


Street Assault Charoliar Bust: Jan 26, 3:00 PM - Jan 29, 2:00 PM PST

We have fixed most of the major bugs that were found during the test runs but if you encounter any issues during the war please don’t hesitate to contact our customer support with your account details.
Please bear with us but due to technical constraints we cannot make fixes in real-time during the event so any improvements will be implemented for the next war.

We hope to bring back Battle for Empire City the following weekend so we can get back to our regular weekend cycle but we will keep you updated on this.

We really appreciate your continued patience and we hope you have a wonderful weekend!

Kamesennin

kamesennin
01-30-2018, 03:02 AM
Hi all,

We’ve noticed that some people are having problems with getting leaderboard prizes for the last Street Assault Charoliar Bust.

We know this is really annoying so we are working hard to investigate this issue to make sure you receive your prizes as soon as possible.

We deeply apologize and we thank all of you for your patience.

Kamesennin

kamesennin
01-31-2018, 08:53 AM
Hi all,

We’re really sorry for the delay of the leaderboard prizes for the last Street Assault Charoliar Bust. We fixed the technical issues and have sent out the prizes again so you should receive your reward items when you login into the game.

Please let us know if you still have trouble receiving your rewards and we will make sure you receive your prizes as soon as possible.

The good news is that we were able to make some progress with fixing the Battle for Empire City event so we will be running the below test event.


TEST Battle for Empire City, Vatos Chicanos: Jan 31 9:00am - Feb 1 1:00 am PST

As before, since this is a test event and we cannot make fixes on the fly, we may be running a couple more tests over the coming days.

Thank you so much for your continued patience and we hope to bring back the full normal event schedule soon.

Kamesennin

kamesennin
02-01-2018, 08:10 AM
Hi all,

We are happy to announce the below full-length Battle for Empire City event this weekend so you can start preparing for war!


Battle for Empire City, Firecracker Delight: Feb 2 3:00 PM - Feb 5 2:00 PM PST

We fixed the major bugs found during the test run but if you encounter any issues during the war please contact customer support along with your account details.

As before, due to technical constraints we cannot make fixes in real-time during the event so any improvements will be implemented for the next war.

We really appreciate your continued patience and we hope you enjoy the guild war!

Kamesennin

kamesennin
02-06-2018, 09:06 AM
Hi all,

We have made some progress with Hate & Revenge and this is a heads up that we will run the first short 4H test for H&R.


Hate & Revenge, Jade Dragons: 7th of Feb 1:00 AM - 7th of Feb 5:00 AM PST

As always, this is a test so please participate at your own risk and avoid wasting any gold.
Bug reports are highly appreciated as it would help us fix things better so please contact customer support along with your account details.

We have heard that you would like to hear more details about the exact issues that we are fixing so we will let you know more about the fixes from the next testing iteration.

Thank you for your continued patience while we work to get the game fully back to the normal event schedule.

Kamesennin

Karrazz
02-08-2018, 08:12 AM
Hi everyone,

The team has made several adjustments to the Hate & Revenge event and we would like to perform another iteration to confirm fixes. Here are the details for the next event:

Hate & Revenge, NuoYan Festival (5 hours): 8th of Feb 1:00 AM - 9th of Feb 5:00 AM PST

As always, this is a test so please participate at your own risk and avoid wasting any gold.

Also, if you encounter any technical difficulties, please reach out to our customer service or Player Representatives with your account ID and details as to what you are experiencing. Please note that screenshots or videos are always of great help as it allows us to easily understand and locate what has cause said issue.

Thank again for your continued patience!


Karrazz

kamesennin
02-09-2018, 09:21 AM
[Updated HCB test times]
Hi all,

This is an update regarding the upcoming weekend event and test events next week.

This weekend will be a normal Street Assault “Panda Symbols” but we will continue testing other events. We are making progress with Hate & Revenge but we will run more tests for H&R and will also start testing Hardcore Boss next week, which will be followed by an Epic Boss.

Currently, the tentative schedule for the test events are the below, which we will update once we confirm the exact times/dates:

TEST Hate & Revenge : Start Time: 2am PST, Feb 13th. End Time 2am PST, Feb 14th.
Issues we will be verifying on this event:
'Event is over' pop-up appears as the 'Hate and Revenge' event is still active.
Delay in updating leaderboard ranks in H&R event


TEST Hardcore Boss: Start Time: 2am PST, Feb 14th. End Time 2am PST, Feb 16th.

As always, test events will not have rewards with bonuses so please participate at your own risk and avoid wasting your gold.

If you find issues, we would really appreciate it if you could contact support with your account details.

Thank you for your continued patience and we hope to get back to the normal event schedule soon.

Kamesennin

kamesennin
02-16-2018, 07:41 AM
Hi all,

We would like to let you know that we will be running the below first test Raid Boss next week.
The test event will run for 24 hours and will not have rewards with bonuses so please participate at your own risk and avoid wasting any gold.


24HR TEST Raid Boss Goh Dan: 19th of Feb 10:00 PM - 20th of Feb 10:00 PM PST

Bug reports are highly appreciated as it would help us fix things better so please contact customer support along with your account details.
As before, we cannot make fixes on the fly so we will implement improvements in the next iteration along with details about the issues that we are focusing on.

Thank you for your continued patience while we work to get the game fully back to the normal event schedule.

Kamesennin

kamesennin
02-21-2018, 09:11 AM
Hi all,

We have noticed issues in Raid Boss so we will be running the below second test Raid Boss.
This test event will run for 32 hours this time but will again not have rewards with bonuses so please participate at your own risk and avoid wasting any gold.


24HR TEST Raid Boss Dan Corleone: 21st of Feb 9:00 PM - 23rd of Feb 5:00 AM PST

Below are the issues that we are focusing on:
Issues we have fixed:

"Cannot Reach Server"error when performing certain actions during the event

Issues we are verifying:

Occasionally disappearing RB icon
Leaderboard "Most Kills" and "Total Damage" points updating issue
Loot popup issues
Disappearing summoning/fight details

For this test RB, we will be focusing on leaderboard issues so we may be performing resets and other actions during the event, which may affect your ranks in the leaderboard. This means you may find some discrepancies in your rank on the leaderboard but please don't worry, this is probably due to our testing activities.

Bug reports are highly appreciated as it would help us fix things better so please contact customer support along with your account details. As before, we cannot make fixes on the fly so we will implement improvements in the next iteration along with details about the issues that we are focusing on.

Thank you for your continued patience while we work to get the game fully back to the normal event schedule.

Kamesennin

kamesennin
02-22-2018, 06:42 AM
Hi Mobsters,

First we want to thank you for playing Crime City despite the recent issues with the game. Now that we have begun to bring the regular schedule back, we would like to start rolling out compensation to make up for the issues.

For the first stage, we will take all the temporary bonuses that were due to expire in January or February and extend their deadlines until the 6th of April. We are still designing a compensation package for you with your community representatives, which will be rolled out in stages soon. The details we will inform you here on the forums.

Thank you for patience and we hope you enjoy the extended temp bonuses in-game.

Kamesennin

kamesennin
02-23-2018, 09:06 AM
Hi all,

This is an update regarding the test event schedule next week, which will be followed by regular Battle for Empire City Badlands Battle the following weekend.
We have still found issues with HCB so we will be running a second test, but due to technical requirements we need to run an Epic Boss prior to the HCB for the first group matchmaking to work.

[UPDATE] Since there was some confusion, we want you to know that there will be no bonuses on the rewards of both the below EB and HCB test events.


24H TEST Epic Boss Kong Mei: 26th of Feb 2:00 PM - 27th of Feb 2:00 PM PST
48H TEST Hardcore Boss Freddy Cruel: 28th of Feb 1:00 AM - 2nd of Mar 1:00 AM PST

Below are the main issues that we are focusing on during this test iteration:
Issues to be further investigated:
Dummy account matching issue

Fixed issues:
Reward give out issues

As usual, bug reports are highly appreciated as it would help us fix things better so please contact customer support along with your account details. We cannot make fixes on the fly so we will implement improvements in the next iteration along with details about the issues that we are focusing on.

Thank you for your continued patience while we work to get the game fully back to the normal event schedule.

Kamesennin

kamesennin
03-02-2018, 09:46 AM
Hi Mobsters,

We are delighted to announce that we have resolved most of the major blocker issues in the events and will be returning to the normal event schedule from March 2nd 3PM PST! This means that the events will run with bonuses on the rewards and we will return to the same event cycle as before the server incident.
We apologize for the inconvenience, but please understand that we are still aware and will continue working on fixing the non-blocker issues and lags that remain in-game.

We really appreciate your patience through this whole testing process and are currently working on the compensation plan with your community representatives for all your trouble.

Now that we are officially ending event testing, I will close this thread.
Please see http://forums.gree.net/showthread.php?124065-March-Cycle-Update for more information regarding the event cycle for March.

We hope you have a blast in-game!

Kamesennin