A Week of Headaches
This week has been all about servers it seems. From Ps3 to Xbox 360 we've been running down leads on issues all week and to be honest, server problems are the most frustrating, simply because they're not handled by us and means it's not a problem with the game we programmed, but with hardware malfunction of servers ran outside of Infinity Ward.
Regardless of the source of the problem and whether or not we run the servers, we work just as hard to resolve the issue. Regretfully though, since we don't run the servers, the most we can do is ensure we're working with our community to get feedback and keep that feedback going to the server teams (at Microsoft or at DemonWare), so that they can stay on top of the issues at hand and resolve as quickly as possible.
The biggest contributing factor to the frustration and headaches though is that my biggest annoyance is life is the use of excuses. The act of chalking up life's problems to something beyond your control and therefore nothing you can do. I don't believe in passing the buck, just as much I don't believe in taking flack for something that is out of your control. What I do believe in, is truthful communication, identifying the source of the issue, but still working to address it in every way possible regardless.
Which is why I want to make it clear, simply because the servers having problems are out of our control, the means to resolving the issues is not and I will not use that as an excuse to do nothing. No bucks will be passed, as I would rather have a problem we can address directly ANY DAY over a problem I have to rely on someone else to address for me.
With that said...
PS3 Server Updates
Earlier this week, via this blog, Steve Pearce made a comment regarding the status of the Ps3 online matchmaking servers for Call of Duty 4: Modern Warfare. The DemonWare team has been working non-stop on troubleshooting and upgrading their servers this past week with the help of the PS3 community providing insightful feedback on their problems. The team rolled out a few major updates this past week, and we were seeing some minor improvements on connectivity.
Late last night / early this morning they rolled out another update to the servers as well as the smaller ones all this week. After this update I'm happy to say we saw a big improvement over the major issue they were having (a lot of users playing at the same time at peak hours). With this latest update we've noticed a 10% increase in users playing at the same time during peak hours with no major incidents or downtimes.
This is great news, because if the major issue has been addressed it will allow the DemonWare team to focus even more on the smaller occurrences and individual unique problems users may be experiencing. This in no way means the task is complete and improvements will stop on the server side, just means its a big step forward in the improvement of online play for the Ps3 version.
We've been getting a lots of reports of improved connectivity and matchmaking which I can vow for myself as I spent awhile last night playing online on the Ps3 version and didn't run into any issues matchmaking or finding games. Ran into a few glitchers on Pipeline sneaking into pipes underground that I'm gonna have to talk with the level designer tomorrow about though. ;)
Xbox Live - Reports of Losing Rank
Over the holiday, Xbox reported record numbers of users online, which apparently resulted in some hiccups in their service (source: Xbox LIVE Holiday Performance) which we're starting to notice some side effects as we've recently been seeing a surge of Customer Service calls, forum posts, and emails regarding lost rank online.
UPDATE: Fantastic news. Just got word from Microsoft's LIVE team that they believe they've fixed the issue. It was apparently an SQL Storage Database issue which has been addressed.
If you experience any future problems with your rank, please let me know immediately so I can make them aware. This won't correct any previously lost rank, however it will prevent it from happening any further.
On the PC Side, MOD TOOLS!
While the console side has been keeping me busy the most recently the PC side of things has a lot of cools stuff happening as well. The biggest is probably the fact that we're closing in on the final version of the Mod Tools which means we'll soon be releasing them to the community as a whole.
We've been having a Mod Tools beta over the last month (delayed by Holidays) with a few members of the PC community which were helping us test and optimize the tools based on their feedback. This past week we sent out the first release candidate to the small group of community testers which we hope will be the final version. If it is then we can expect to release the tools to the Modding / Mapping community as a whole very soon and start seeing some really cool Call of Duty 4: Modern Warfare PC Mods being released.
They Wonder Why People Don't Make PC Games Any More
On another PC related note, we pulled some disturbing numbers this past week about the amount of PC players currently playing Multiplayer (which was fantastic). What wasn't fantastic was the percentage of those numbers who were playing on stolen copies of the game on stolen / cracked CD keys of pirated copies (and that was only people playing online).
Not sure if I can share the exact numbers or percentage of PC players with you, but I'll check and see; if I can I'll update with them. As the amount of people who pirate PC games is astounding. It blows me away at the amount of people willing to steal games (or anything) simply because it's not physical or it's on the safety of the internet to do.
Closing Thoughts and Conclusions
It's been a stressful week but thankfully an extremely productively one. We're moving forward on all fronts and we're still working hard on improving Call of Duty 4: Modern Warfare well after launch. Did some take-home testing of the new feature patch that's coming out and the grenade kill-cam never ceases to be awesome. Especially when you watch it fly through the air, through some tiny window, and land right at your feet. It's still got a bit of testing to go through before it'll finish certification, but it's looking good. Still working on getting the EU Connectivity Patch out, next week should be a big one for that according to Production.
As always, feel free to let me know any questions or feedback you guys might have. I try to respond to every email (via the email contact on this blog) and reply to comments when I can. Thanks everyone for the continued support.
Week in Review: Servers, Servers, Servers