A new MMO in the Jumpgate universe
  #1  
Old 01-11-2008, 10:50 AM
Istvan's Avatar
Istvan Istvan is offline
Jumpgate Developer
 
Join Date: Dec 2007
Location: Louisville, CO
Posts: 95
Post Development Bulletin #3: Sharding the Servers

Since this remains a topic of at least minor confusion, I’d like to make a last-ditch attempt to offer a primer on the subject for members of our community unfamiliar with sharded games.

First, a quick history lesson: The term "shard" originates from Ultima Online, one of the oldest graphical MMOGs. Due to UO’s popularity, it was technically impossible for the server architecture of UO to support the number of simultaneous users attempting to play the game. Multiple servers were thus established, each as an independent copy of the game world, so that more people could play. The game fiction described these multiple worlds as the shards of a shattered world-gem (Mondain’s, for those faithful Avatars who remember that far back). Other games have occasionally chosen different genre-specific terminology, but in much of the game industry, "shards" and "sharding" have become the simple generic handles used to discuss the subject.

While it is true that some shards can be purposed, i.e. for moderation of special Role-playing environments, or for PvP rules, ultimately sharding is almost always performed for technical reasons, not for game design reasons. Purposing shards is perhaps a means to make the best of things, since you’re going to have to shard the game anyway.

Science fiction has called the sudden arrival of too many people in one place a "flash crowd"[1], and the phenomenon has real meaning in the modern Internet where traffic surges occur that can knock down servers. In an unsharded game world, as on the greater Internet, the simple knowledge that a special event will occur at a certain time in a certain place can easily result in a flash crowd at the target location. Sharding is a very easy way to prevent this instability: the server administration process simply limits the number of accounts permitted to use a certain server. Heavily used servers are typically listed as "full", and either new subscribers are directed to other shards, or new logins to that shard are disallowed until the load eases, or both. Overall load is distributed, and no server crosses the threshold of instability. Nearly every mainstream online game that boasts more than a few thousand simultaneous players is sharded. Depending on the direct traffic handling ability of the server hardware, the figures that have been suggested to me to use as an example are 2500-5000 users per shard.

EvE Online is most often given as the best-known example of a successful monolithic, unsharded game. EvE was doubtless designed from the ground up to be that way – it uses many server nodes, but each is only responsible for a region of the game. EvE’s design is exemplary, but just as with a sharded game, the nodes in EvE still have physical limits and still can only handle a certain amount of player traffic before they are overloaded. The larger corporations in the game are known to prearrange major fleet engagements with EvE’s support staff, so that additional machines can be assigned to the affected node to reduce the possibility that node will collapse due to the spike in demand. Though EvE’s structure is resilient, the support team is responsive, and the problems are indeed minimized, EvE still suffers from this basic problem of any unsharded game.

Jumpgate is an interesting case because a naive look at its architecture suggests that it also could function as an unsharded game. Jumpgate includes "spaceservers" that handle regions of the game world, and which in fact are scalable so that theoretically any number of spaceservers can be used, from one supporting the whole game, to one supporting every independent sector of the game space (~170 in JGC). This design predates EvE’s architecture by several years, and was chosen because Jumpgate’s real-time spaceflight simulation relies on very rapid packet transfers between clients and spaceservers to provide smooth location and damage updates for combat, as the PvPers in our community especially are very well aware (and when this system isn’t running smoothly, it’s obvious). The absolutely critical factor here is that whereas the spaceserver design is optimized for rapid combat information flow and scalability, for all noncombat transactions the game relies on a central state server, which is not at all scalable in the same way.

A fundamental redesign of the Jumpgate server architecture has never been practical within the development timeline of Jumpgate Evolution. Jumpgate Classic itself was sharded for two reasons: improved service in terms of network latency for the European customers, and a business agreement with the European publisher that they would operate their own copy of the game. In all stress tests of Jumpgate Classic during beta, we never reached a point where the total number of online users truly taxed the state server, thus an unsharded game would indeed have been possible with our architecture, up to a point. Since we never had large numbers of subscribers, we still do not entirely know how many thousand simultaneous users represent the threshold where we are forced to shard the game.

With Jumpgate Evolution, and all the new expertise, new energy, and new interest coming together on the project, we intend and expect to find out what those limits truly are. At the end of the day, that is the ultimate reason we will shard.



Notes:

1. Niven, Larry – "Flash Crowd" (c) 1973, orig. appeared in Three Trips in Time and Space, by Robert Silverberg, ed. (also in short story compilation The Flight of the Horse, (c) 1973 by Larry Niven).
Reply With Quote
  #2  
Old 01-11-2008, 10:52 AM
Tritian's Avatar
Tritian Tritian is offline
No Title
 
Join Date: Dec 2007
Location: On your six
Posts: 710
Default

first post!

i win at forum!


So from what you say, it looks like sharding is going to be a definite in JGE?

Will there definitely be US and EU servers?
Will there definitely be PvP and PvE servers?
__________________
While one who sings with his tongue on fire gargles in the rat race choir
Bent out of shape from society’s pliers. Cares not to come up any higher
But rather get you down in the hole that he’s in.

Last edited by Tritian : 01-11-2008 at 11:03 AM.
Reply With Quote
  #3  
Old 01-11-2008, 11:06 AM
McFretN's Avatar
McFretN McFretN is offline
Veteran Pilot
 
Join Date: Jan 2008
Posts: 199
Default

If there are distinguished servers for PvP, PvE and possibly more, can you tell anything about the game rules in them? (Are players not attackable in PvE? Is PvP a major fragfest without consecuences? etc.)
__________________
one volley, one podride… NOVA Mk.1
Reply With Quote
  #4  
Old 01-11-2008, 11:09 AM
Istvan's Avatar
Istvan Istvan is offline
Jumpgate Developer
 
Join Date: Dec 2007
Location: Louisville, CO
Posts: 95
Default

All we can say with certainty at this point is that sharding will depend on the number of players. As I tried to make painfully clear in the bulletin – the decision to shard is a technical issue. The topic of "what kinds of servers will there be?" is a design matter quite subsidiary to the actual sharding decision itself.

Last edited by Istvan : 01-11-2008 at 11:14 AM. Reason: even clearer?
Reply With Quote
  #5  
Old 01-11-2008, 11:16 AM
Injustice's Avatar
Injustice Injustice is offline
Ultimate Forum Troll
 
Join Date: Dec 2007
Location: 29 Palms, CA
Posts: 559
Default

In other words, JGE’s success will dictate the existance of shards, and the individual rules of said shards will depend on whether or not the JG cummunity can learn to behave itself. Does that about sum it up?
__________________
WWMD?
G.Rasputin – Will you call me Big Radar Southpaw like you used to?
Chewcaca – I will put on the Rubber Glove of Colon crushing +5. You will cry, and so will baby Jesus.
Liet – Sorry, but when it comes to gay roleplay in online spaceship sim MMOGs, I’m #1!

"First of Foot, and Right of the Line"
Reply With Quote
  #6  
Old 01-11-2008, 11:19 AM
Tritian's Avatar
Tritian Tritian is offline
No Title
 
Join Date: Dec 2007
Location: On your six
Posts: 710
Default

So basically:

1) There will probably be sharding due to performance issues
2) There may be sharding due to locality issues
3) There may be sharding due to PvP issues
__________________
While one who sings with his tongue on fire gargles in the rat race choir
Bent out of shape from society’s pliers. Cares not to come up any higher
But rather get you down in the hole that he’s in.
Reply With Quote
  #7  
Old 01-11-2008, 11:22 AM
sentinels sentinels is offline
Forum Title Coveter
 
Join Date: Dec 2007
Posts: 464
Send a message via AIM to sentinels
Default

i think that’s a great write-up and i agree that really the only reasons you should shard the game is for latency and load issues.
Reply With Quote
  #8  
Old 01-11-2008, 12:25 PM
biteme biteme is offline
Veteran Pilot
 
Join Date: Dec 2007
Posts: 193
Default

Ok then let’s clear this up right away, Open up an alpha test with me and 4000 of my closest friends and let’s see how many people it takes to bring down the server. Seems reasonable eh?


You have my email address, I will be expecting something shortly.
Reply With Quote
  #9  
Old 01-11-2008, 12:35 PM
lordopic's Avatar
lordopic lordopic is offline
Veteran Pilot
 
Join Date: Dec 2007
Location: Sea of Shadows
Posts: 1,044
Default

Can understand why but im off to puke

But if we get a EU server i might just not project it,
__________________
Happiness is not something ready made. It comes from your own actions.


Dalhi Lama

Last edited by lordopic : 01-11-2008 at 12:38 PM.
Reply With Quote
  #10  
Old 01-11-2008, 12:41 PM
Karash's Avatar
Karash Karash is offline
Veteran Pilot
 
Join Date: Dec 2007
Location: Great Pillars DMZ
Posts: 261
Default

Seems to me that ND will only decide to shard the game IF there are too many users…not due to PVP concerns.
Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump


All times are GMT -6. The time now is 07:42 AM.


Powered by vBulletin® Version 3.6.8
Copyright ©2000 – 2008, Jelsoft Enterprises Ltd.