Skip to main content

Good, beta, best: How beta tests help shape games like ‘Gwent’ and ‘The Elder Scrolls: Legends’

talking tests gwent elder scrolls legends gwentcardgame2
CD Projekt RED's Gwent: The Witcher Card Game booth at Gamescom 2016. CD Projekt RED
If you eagerly anticipated any of 2016’s biggest AAA video games, chances are you could have found a way to play it ahead of its formal release.

Street Fighter V, Battlefront 1, Gears of War 4, Overwatch, The Division — No matter the genre, it seems like every big-name multiplayer game has some kind of beta just prior to launch to kick the tires and start converting eager fans into a loyal community.

Beta tests are becoming a bigger part of the development process than ever before — and that’s good news for gamers.

House of Cards

In 2014, Blizzard launched Hearthstone: Heroes of Warcraft. By April, 2016 it had amassed a player base of 50 million players, demonstrating that the digital card game genre had serious potential, and breathing new life into the genre from a wave of developers looking to capitalize on the game’s success.

There are a lot of little knobs and levers that you can turn and pull.

In 2017, we’ll see two of the more prominent projects hit the scene; Bethesda’s The Elder Scrolls: Legends, and CD Projekt Red’s Gwent, a spin-off of The Witcher series’ in-world card game. Though Legends just launched last week and Gwent’s formal debut is a long way off, players have been digging into both of these games for months now. You see, like Hearthstone, both projects launched lengthy beta tests far before their official launch.

Announced at E3 2015, developer Dire Wolf Digital rolled out Legends to a select group of players in April 2016. In August 2016, the studio opened the floodgates with an open beta for anyone interested in trying it. By the time the game formally launched March 9, 2017, the game had been widely available for the better part of a year. According to Bethesda Softworks VP Pete Hines, the extended beta period gives the developer information that they couldn’t get otherwise.

Bethesda announces Elder Scrolls: Legends during its E3 2015 showcase.

Bethesda announces Elder Scrolls: Legends at its E3 2015 showcase.

“We’re trying to find this balance of reward, and challenge, and fun,” said Bethesda’s Pete Hines when he spoke to Digital Trends in late 2016, while The Elder Scrolls’ Legends beta was in full swing. “There are a lot of little knobs and levers that you can turn and pull. I think we have, in a number of cases, done a little more or a little less of various things to see where the sweet spot is — and we’re going to continue doing things.”

Gwent has taken a little bit of a different path. When CD Projekt Red made the decision to spin the card game off into a standalone release, they realized they couldn’t just dump the content from The Witcher 3 into a standalone app and expect people to like it. Gwent had to become a much bigger and more complex, with more cards and more sophisticated mechanics.

“A lot of us on the Gwent team have previously worked on live-service multiplayer games, so we generally knew what to expect,” said Benjamin Lee, the studio’s development director. “When it comes to balancing a live competitive multiplayer game like Gwent, we look at a large amount of data, what the players think, and also our own experiences to determine what changes we need to make. It’s a lot of work and you’re doing that constantly throughout the game’s lifecycle.”

Fresh Eyes

By the time an open beta begins, the game being tested is usually very close to completion. There’s no sense in letting your audience try things out for themselves if the overall experience is undercooked.

Image used with permission by copyright holder
In Gwent‘s “keg” system the player receives a pack of cards and gets to choose the final card they want to keep.

No matter how extensive the game’s internal testing has been, there are sure to be flaws in the beta build. Tiny details that went unnoticed throughout development, suddenly often stick out like a sore thumb to players who have never seen the game before.

This is where beta testing comes in very handy, as evidenced by a problem that CD Projekt Red solved in November 2016.

More often than not, the most involved players in a beta test become the game’s most supportive fans.

In Gwent, the process of opening new packs of cards is slightly different to rivals like Hearthstone. When opening a pack of cards —called a “keg” in the game — you are given a random smattering of cards, but are also asked to pick one of three cards offered up on a separate screen. A popular post on the Gwent subreddit pointed out that the system would be better if players could check what cards they already owned when making this decision. “I hope it will be fixed fast,” another player said.

Before long, a CD Projekt Red representative had taken to the comments section to confirm that the change would be made, and shortly after the game’s first patch, it was implemented in-game.

“With regards to this specific change, I think it was the volume of suggestions surrounding the same idea, both from the community and within the team, and with hindsight it seems very obvious,” Lee said, when asked about this particular fix. “We had no arguments about making the change. It does improve the gameplay experience, especially for newer players, and so we wanted to make sure it was in the game as soon as possible.”

Bethesda's booth featuring Elder Scrolls: Legends at Gamescom 2016 (Photo: Marco Verch / Wikimedia Commons)
Bethesda’s booth featuring Elder Scrolls: Legends at Gamescom 2016 (Photo: Marco Verch / Wikimedia Commons)

This kind of crowdsourced user experience improvement also played into the way The Elder Scrolls: Legends changed as a result of beta testing. To test the mobile version of the game, Bethesda launched an iPad version in Canada. The team found soon after that creating an account was much more of a barrier to entry on the platform than it was on PC. As a result, they tweaked the mobile version by employing a guest mode that can be converted to a full account at a later time.

“It’s nothing to do with whether the game was fun,” explained Hines. “It’s more about how currently works, it’s simply some functionality that we currently didn’t have, that we knew we needed.”

He compared the scenario to a conversation he had with legendary Bethesda designer Todd Howard during the production of Morrowind. “He said, ‘you know, nobody ever spends any time talking about how awesome the installation process for a game is, they just expect it to work — but it doesn’t just work unless you put the time in to make sure that it works.’

“In this case, it doesn’t matter whether Legends is a good game,” he continued. “If we put a roadblock in front of you that you’re not expecting, we have a much bigger problem, that has nothing to do with the game.”

Balancing Act

These tweaks ensured that, when the game officially launches, players’ day one experience will be as smooth as possible. However, launch day isn’t the biggest concern when it comes to a beta test.

Both Gwent and Legends hope to engage an active player base for many years, with regular injections of new content along the way. As players develop new decks and new strategies, the game will evolve organically. That makes it all the more important that the base game is as well-balanced as possible before each game goes live.

“We’ve changed stats, we’ve changed values, we’ve removed abilities, we’ve added abilities,” Hines said. “The team behind Legends is an elite bunch with plenty of experience crafting this kind of game, but they’re not too proud to reassess earlier design decisions if the finished product stands to benefit.

“There’s no substitute for putting it in front of wider and wider numbers of players.”

“These are really good designers and strategy card players who have gone back and changed what they initially designed, because they aren’t beholden to, ‘well, I made it like this so it needs to stay like that.’ We’re going to keep changing it so that the game continues to improve and grow.”

Hines gives the example of an Orc deck that hit the scene around the time the game’s open beta got underway. The deck was easy to use, fairly cheap to build, and proved to be incredibly effective against just about anything that was put in front of it.

“It was just so good, so often, against so many different decks, that it was really kind of out of control,” he remembered. “But, it’s hard to know whether that’s the case until you get a much wider sample size, right? Because if you have all the developers, and the QA and production folks, that’s still — relative to the number of people who are going to play the game — a pretty small sample size.”

Putting the game in the hands of the players allows developers to get an idea of what works and what doesn’t in a scenario that’s much closer to a retail release than internal development. When you’re creating a game that needs to stand up to the rigors of competitive play for years to come, feedback is very important. And opening up your game to the masses gives you feedback that you simply can’t get elsewhere.

“There’s no substitute when you’re trying to figure out how balanced the game is,” added Hines. “There’s no substitute for putting it in front of wider and wider numbers of players.”

Let’s Talk

But even the feedback from players may take a back seat to the community building that occurs when a developer works with the community to polish its game. There’s seemingly transactional relationship that forms between the two: The player gets a sneak preview, at the price of being a guinea pig. The developer gets essential feedback, at the price of letting players see their unfinished product, warts and all. This relationship, however, doesn’t come to an end when the beta is done.

It isn’t always possible to make a game without breaking some hearts.

More often than not, the most involved players in a beta test become the game’s most supportive fans. Whether their interest is in a genre, a franchise, or a particular game, participants sign up for a reason. These players are going to be crucial later on, if the game is going to be a success.

Between the fact that beta players are supplying crucial feedback, and the fact that the population of a beta test will hopefully stick around to become the game’s initial player base, developers need to maintain a good relationship with their testers.

“We are not doing any resets at all anymore, ever,” Hines said when asked about the prospect of a progress wipe for Legends players while the game’s open beta was still in full swing. “We did a reset several months ago, and when we did it, we said we’re not doing any more resets. The game is just, live, at this point. We’re not going to have anybody — myself included — lose all this stuff that they’ve been working on.”

Image used with permission by copyright holder

In games like Gwent and Legends, where players can track their progress by the library of cards they’ve amassed, that can be tricky. It isn’t always possible to make a game without breaking some hearts. When you have wipe players’ progress, it’s in the interest of the studio to keep them in the loop as much as is possible.

“You know us [Bethesda] well enough to know we can hold things fairly close to the chest,” Hines said. “We can go to the E3 before Fallout 4 launched before you even know that that game exists. But at the same time, with a game like this, we do want to be more transparent and let folks know. I think that kind of interaction is critically important.”

That’s why the team behind Legends has gone beyond their official channels to source feedback. They’re scouring social media, Reddit, and forums like NeoGAF for any mention of their game, good or bad. Any information is good information, and no feedback should go to waste.


Modern game development is expensive. Any AAA multiplayer title that suffers from lopsided online play, technical issues, or a lack of players at launch could spell doom for its developer. Beta tests help make sure these scenarios don’t play out. They’re a dress rehearsal, a safety net — and done right, they can make the finished product much, much better.

Beta tests are only going to become more prominent in the gaming industry, and the techniques that companies are using to get your attention before launch are becoming more and more sophisticated. In February, Ubisoft launched closed and open betas for its medieval fighter For Honor in rapid succession, effectively extending the launch coverage of the game for a full week prior to launch, while building a community and circumventing the need for pre-release reviews.

Image used with permission by copyright holder

A beta test can serve several different purposes at once, from perfecting a game’s balance, to making sure technical infrastructure is in place, to out-and-out promotion. But all of these purposes really boil down to one goal: making sure the game doesn’t flop when it’s released.

When Gwent and The Elder Scrolls: Legends drop their beta status, they will not only represent the design choices of their creators, but countless hours of test play and lots of feedback. With any luck, all that effort will result in games that can stand the test of time for months and years to come.

Editors' Recommendations

Brad Jones
Brad is an English-born writer currently splitting his time between Edinburgh and Pennsylvania. You can find him on Twitter…
Best Buy deals: Save on laptops, TVs, appliances, and more
best buy shuts down insignia line smart home products store 2 768x768

One of the best places to shop for almost anything involving electronics says so right in its name: Best Buy. The retail giant has a ton of departments with some of today’s most popular devices, components, and appliances for sale. It also offers a lot of these at a discount, which is certainly what we’re seeing right now. Some of the best TV deals, best tablet deals, best laptop deals, and best phone deals can currently be found at Best Buy, and those are just the tip of the iceberg. We’ve tracked down all of the best deals you can shop at Best Buy right now, so read onward for some gift ideas for yourself or a loved one and for some great ways to save.
Best Buy TV deals

There may be no better place to purchase one of the best TVs than Best Buy. There is almost always some huge savings to find on TVs at Best Buy, and that’s certainly the case right now. You’ll find deals top TV brands like Sony, Samsung, and LG, and more budget-friendly brands like TCL and Hisense are in play, too.

Read more
Best PS5 SSD deals: Add more storage to your PS5 from $80
A 2TB WD Black

If you've snapped up one of the better PS5 deals around at the moment, it's a smart move to also buy one of the best SSDs for PS5 so you can easily expand your PlayStation 5's storage. While the internal storage will get you started, as you install more games and download more titles from the PSN store, the more you'll find yourself limited for space. That's why we've sought out all the best PS5 SSD deals around right now. Below, we've listed the best PS5 SSDs so you won't have to worry about any compatibility issues or installing a heatsink for yourself. Different sizes and price ranges are available here so you'll easily find the right one for your situation.
Our favorite PS5 SSD deal

It wasn't that long ago that you'd have to pay well over $100 to get a SSD for your PS5 and often, it'd be slower than the pricier alternatives. These days, you can buy a Samsung 980 Pro 1TB SSD with heatsink for just $80 from Best Buy, thereby saving $40 off the regular price of $120. The SSD offers speedy performance while also having its own nickel coated high end controller to help deliver effective thermal control. It means it won't overheat and performance won't be compromised. Being a PCIe Gen 4 SSD, you get twice the data transfer speed of PCIe Gen 3 which is useful. Offering maximum read speeds of 7,000 megabytes per second, it's a good upgrade to go alongside your existing hard drive with 1TB offering plenty of extra space at a shrewd price.

Read more
Best Xbox Series X deals: consoles, games, and accessories
Xbox Series X on a table.

The Xbox Series X, Microsoft's flagship video game console that's competing against Sony's PlayStation 5 and the Nintendo Switch, offers phenomenal performance with an extremely efficient cooling structure that allows it to remain surprisingly quiet while pushing out 12 teraflops of processing power. The Xbox Series X works amazing with an Xbox Game Pass subscription, which grants access to a massive library of titles that you can play as long as your membership remains active. If you're interested in Xbox Series X deals for the console, as well as its games and accessories, we've rounded up the top offers below, but since we're not sure how long they'll remain online, it's highly recommended that you make your purchases quickly.
Best Xbox Series X deals

If you don't own the Xbox Series X yet, you're missing out on a powerful console. Discounts don't happen often, so the offers that we've rounded up here aren't expected to last long. Whether you just want the console, or you prefer getting it with a bundled game or an Xbox Game Pass subscription, you're going to get great value, especially if you're able to pocket the savings from below.

Read more