Good, beta, best: How beta tests help shape games like ‘Gwent’ and ‘The Elder Scrolls: Legends’

talking tests gwent elder scrolls legends gwentcardgame2
CD Projekt RED's Gwent: The Witcher Card Game booth at Gamescom 2016. CD Projekt RED
If you eagerly anticipated any of 2016’s biggest AAA video games, chances are you could have found a way to play it ahead of its formal release.

Street Fighter V, Battlefront 1, Gears of War 4, Overwatch, The Division — No matter the genre, it seems like every big-name multiplayer game has some kind of beta just prior to launch to kick the tires and start converting eager fans into a loyal community.

Beta tests are becoming a bigger part of the development process than ever before — and that’s good news for gamers.

House of Cards

In 2014, Blizzard launched Hearthstone: Heroes of Warcraft. By April, 2016 it had amassed a player base of 50 million players, demonstrating that the digital card game genre had serious potential, and breathing new life into the genre from a wave of developers looking to capitalize on the game’s success.

There are a lot of little knobs and levers that you can turn and pull.

In 2017, we’ll see two of the more prominent projects hit the scene; Bethesda’s The Elder Scrolls: Legends, and CD Projekt Red’s Gwent, a spin-off of The Witcher series’ in-world card game. Though Legends just launched last week and Gwent’s formal debut is a long way off, players have been digging into both of these games for months now. You see, like Hearthstone, both projects launched lengthy beta tests far before their official launch.

Announced at E3 2015, developer Dire Wolf Digital rolled out Legends to a select group of players in April 2016. In August 2016, the studio opened the floodgates with an open beta for anyone interested in trying it. By the time the game formally launched March 9, 2017, the game had been widely available for the better part of a year. According to Bethesda Softworks VP Pete Hines, the extended beta period gives the developer information that they couldn’t get otherwise.

talking tests gwent elder scrolls legends elderscrollslegends3
Bethesda announces Elder Scrolls: Legends during its E3 2015 showcase.

Bethesda announces Elder Scrolls: Legends at its E3 2015 showcase.

“We’re trying to find this balance of reward, and challenge, and fun,” said Bethesda’s Pete Hines when he spoke to Digital Trends in late 2016, while The Elder Scrolls’ Legends beta was in full swing. “There are a lot of little knobs and levers that you can turn and pull. I think we have, in a number of cases, done a little more or a little less of various things to see where the sweet spot is — and we’re going to continue doing things.”

Gwent has taken a little bit of a different path. When CD Projekt Red made the decision to spin the card game off into a standalone release, they realized they couldn’t just dump the content from The Witcher 3 into a standalone app and expect people to like it. Gwent had to become a much bigger and more complex, with more cards and more sophisticated mechanics.

“A lot of us on the Gwent team have previously worked on live-service multiplayer games, so we generally knew what to expect,” said Benjamin Lee, the studio’s development director. “When it comes to balancing a live competitive multiplayer game like Gwent, we look at a large amount of data, what the players think, and also our own experiences to determine what changes we need to make. It’s a lot of work and you’re doing that constantly throughout the game’s lifecycle.”

Fresh Eyes

By the time an open beta begins, the game being tested is usually very close to completion. There’s no sense in letting your audience try things out for themselves if the overall experience is undercooked.

talking tests gwent elder scrolls legends gwentcardgame4
In <em>Gwent<em>'s "keg" system the player receives a pack of cards and gets to choose the final card they want to keep.
In Gwent‘s “keg” system the player receives a pack of cards and gets to choose the final card they want to keep.

No matter how extensive the game’s internal testing has been, there are sure to be flaws in the beta build. Tiny details that went unnoticed throughout development, suddenly often stick out like a sore thumb to players who have never seen the game before.

This is where beta testing comes in very handy, as evidenced by a problem that CD Projekt Red solved in November 2016.

More often than not, the most involved players in a beta test become the game’s most supportive fans.

In Gwent, the process of opening new packs of cards is slightly different to rivals like Hearthstone. When opening a pack of cards —called a “keg” in the game — you are given a random smattering of cards, but are also asked to pick one of three cards offered up on a separate screen. A popular post on the Gwent subreddit pointed out that the system would be better if players could check what cards they already owned when making this decision. “I hope it will be fixed fast,” another player said.

Before long, a CD Projekt Red representative had taken to the comments section to confirm that the change would be made, and shortly after the game’s first patch, it was implemented in-game.

“With regards to this specific change, I think it was the volume of suggestions surrounding the same idea, both from the community and within the team, and with hindsight it seems very obvious,” Lee said, when asked about this particular fix. “We had no arguments about making the change. It does improve the gameplay experience, especially for newer players, and so we wanted to make sure it was in the game as soon as possible.”

talking tests gwent elder scrolls legends the
Bethesda's booth featuring Elder Scrolls: Legends at Gamescom 2016 (Photo: Marco Verch / Wikimedia Commons)
Bethesda’s booth featuring Elder Scrolls: Legends at Gamescom 2016 (Photo: Marco Verch / Wikimedia Commons)

This kind of crowdsourced user experience improvement also played into the way The Elder Scrolls: Legends changed as a result of beta testing. To test the mobile version of the game, Bethesda launched an iPad version in Canada. The team found soon after that creating an account was much more of a barrier to entry on the platform than it was on PC. As a result, they tweaked the mobile version by employing a guest mode that can be converted to a full account at a later time.

“It’s nothing to do with whether the game was fun,” explained Hines. “It’s more about how currently works, it’s simply some functionality that we currently didn’t have, that we knew we needed.”

He compared the scenario to a conversation he had with legendary Bethesda designer Todd Howard during the production of Morrowind. “He said, ‘you know, nobody ever spends any time talking about how awesome the installation process for a game is, they just expect it to work — but it doesn’t just work unless you put the time in to make sure that it works.’

“In this case, it doesn’t matter whether Legends is a good game,” he continued. “If we put a roadblock in front of you that you’re not expecting, we have a much bigger problem, that has nothing to do with the game.”

Balancing Act

These tweaks ensured that, when the game officially launches, players’ day one experience will be as smooth as possible. However, launch day isn’t the biggest concern when it comes to a beta test.

Both Gwent and Legends hope to engage an active player base for many years, with regular injections of new content along the way. As players develop new decks and new strategies, the game will evolve organically. That makes it all the more important that the base game is as well-balanced as possible before each game goes live.

“We’ve changed stats, we’ve changed values, we’ve removed abilities, we’ve added abilities,” Hines said. “The team behind Legends is an elite bunch with plenty of experience crafting this kind of game, but they’re not too proud to reassess earlier design decisions if the finished product stands to benefit.

“There’s no substitute for putting it in front of wider and wider numbers of players.”

“These are really good designers and strategy card players who have gone back and changed what they initially designed, because they aren’t beholden to, ‘well, I made it like this so it needs to stay like that.’ We’re going to keep changing it so that the game continues to improve and grow.”

Hines gives the example of an Orc deck that hit the scene around the time the game’s open beta got underway. The deck was easy to use, fairly cheap to build, and proved to be incredibly effective against just about anything that was put in front of it.

“It was just so good, so often, against so many different decks, that it was really kind of out of control,” he remembered. “But, it’s hard to know whether that’s the case until you get a much wider sample size, right? Because if you have all the developers, and the QA and production folks, that’s still — relative to the number of people who are going to play the game — a pretty small sample size.”

Putting the game in the hands of the players allows developers to get an idea of what works and what doesn’t in a scenario that’s much closer to a retail release than internal development. When you’re creating a game that needs to stand up to the rigors of competitive play for years to come, feedback is very important. And opening up your game to the masses gives you feedback that you simply can’t get elsewhere.

“There’s no substitute when you’re trying to figure out how balanced the game is,” added Hines. “There’s no substitute for putting it in front of wider and wider numbers of players.”

Let’s Talk

But even the feedback from players may take a back seat to the community building that occurs when a developer works with the community to polish its game. There’s seemingly transactional relationship that forms between the two: The player gets a sneak preview, at the price of being a guinea pig. The developer gets essential feedback, at the price of letting players see their unfinished product, warts and all. This relationship, however, doesn’t come to an end when the beta is done.

It isn’t always possible to make a game without breaking some hearts.

More often than not, the most involved players in a beta test become the game’s most supportive fans. Whether their interest is in a genre, a franchise, or a particular game, participants sign up for a reason. These players are going to be crucial later on, if the game is going to be a success.

Between the fact that beta players are supplying crucial feedback, and the fact that the population of a beta test will hopefully stick around to become the game’s initial player base, developers need to maintain a good relationship with their testers.

“We are not doing any resets at all anymore, ever,” Hines said when asked about the prospect of a progress wipe for Legends players while the game’s open beta was still in full swing. “We did a reset several months ago, and when we did it, we said we’re not doing any more resets. The game is just, live, at this point. We’re not going to have anybody — myself included — lose all this stuff that they’ve been working on.”

talking tests gwent elder scrolls legends gwentcardgame7

In games like Gwent and Legends, where players can track their progress by the library of cards they’ve amassed, that can be tricky. It isn’t always possible to make a game without breaking some hearts. When you have wipe players’ progress, it’s in the interest of the studio to keep them in the loop as much as is possible.

“You know us [Bethesda] well enough to know we can hold things fairly close to the chest,” Hines said. “We can go to the E3 before Fallout 4 launched before you even know that that game exists. But at the same time, with a game like this, we do want to be more transparent and let folks know. I think that kind of interaction is critically important.”

That’s why the team behind Legends has gone beyond their official channels to source feedback. They’re scouring social media, Reddit, and forums like NeoGAF for any mention of their game, good or bad. Any information is good information, and no feedback should go to waste.


Modern game development is expensive. Any AAA multiplayer title that suffers from lopsided online play, technical issues, or a lack of players at launch could spell doom for its developer. Beta tests help make sure these scenarios don’t play out. They’re a dress rehearsal, a safety net — and done right, they can make the finished product much, much better.

Beta tests are only going to become more prominent in the gaming industry, and the techniques that companies are using to get your attention before launch are becoming more and more sophisticated. In February, Ubisoft launched closed and open betas for its medieval fighter For Honor in rapid succession, effectively extending the launch coverage of the game for a full week prior to launch, while building a community and circumventing the need for pre-release reviews.

talking tests gwent elder scrolls legends gwentcardgame1

A beta test can serve several different purposes at once, from perfecting a game’s balance, to making sure technical infrastructure is in place, to out-and-out promotion. But all of these purposes really boil down to one goal: making sure the game doesn’t flop when it’s released.

When Gwent and The Elder Scrolls: Legends drop their beta status, they will not only represent the design choices of their creators, but countless hours of test play and lots of feedback. With any luck, all that effort will result in games that can stand the test of time for months and years to come.


Cyberpunk 2077 will feature romance options beyond heterosexual relationships

CD Projekt Red’s upcoming Cyberpunk 2077 will feature a gender-fluid character creator, and the game’s lead quest designer reveals that the romance options will be more diverse than The Witcher 3's.

The MacOS Catalina public beta is live. Here’s how to download it

Apple's latest MacOS update, known as Catalina, is finally available for developer preview, which means if you're willing to pay a little for the privilege, you can be one of the first to try it out.

343 Industries says first beta for Halo: Reach on PC will be next week

After a delay, 343 Industries is following through on its promise to send out beta invites for Halo: Reach on PC. Some PC gamers will be getting a first taste of Halo: The Master Chief Collection on PC next week.

How to play the Monster Hunter World: Iceborne beta

Monster Hunter World: Iceborne doesn't launch until September 6, but PS4 users can check out a chunk of the large new expansion very soon. Here's what you need to know about the Monster Hunter World: Iceborne beta.

Fortnite PC players may have to upgrade graphics cards once Season 10 kicks in

Epic Games said that Fortnite for PC will no longer support DirectX 10 starting in Season 10. Players will need to have DirectX 11-capable graphics cards to continue playing the Battle Royale shooter.

GuardianCon raises $3.7 million: Bungie breaks record, but Dr. Lupo does better

Destiny developer Bungie joined this year's GuardianCon Charity Marathon Stream, breaking the record by raising $400,000 in just four hours. The proceeds of the week-long event will be donated to St. Jude Children's Research Hospital.

Final Fantasy VIII Remastered will come with features for faster progression

Final Fantasy VIII Remastered will come with features that will enable faster progression. Players who do not want to go through the same grind as in their first playthrough will be able to activate battle enhancements, among others.

Flyers in Apex Legends may be hinting at something monstrous for Season 2

Flying beasts have appeared in Apex Legends' King's Canyon map. While the creatures are peaceful for now, they may be hinting that something more monstrous is coming to the team-based Battle Royale shooter once Season 2 launches on July 2.

Blizzard suffers another blow with exit of global esports director Kim Phan

Blizzard suffered another blow with the departure of global esports director Kim Phan. Her exit comes after Overwatch League's founding commissioner Nate Nanzer left last month to join Epic Games.

Here’s how to get early access to FFXIV: Shadowbringers

You can get early access to FFXIV: Shadowbringers by pre-ordering it, but simply purchasing it isn't enough to get you in. Here's how you can get early access to Shadowbringers, regardless of what platform you're on.

Our guide to taking down the monsters in Monster Hunter World: Iceborne

The Monster Hunter World: Iceborne beta features three large monsters to hunt: Great Jagras, Banbaro, and Tigrex. Our hunting guide will help you learn the ins and outs of each of these foes.

From controllers to the cameras, here's what we know about the HTC Vive Cosmos

The HTC Vive Cosmos headset is a premium VR device equipped with a modular design and ease-of-use when setting up. Here is everything we know about the headset, including its cameras and controllers.

Apple has a plan to save Mac gaming, but it’s not the one you want

The Mac isn’t known for being a game-friendly platform, but Apple hopes to change that in the coming months and years. The thing is, its plan may not be quite what you were hoping for if you’re a Mac gamer.

The Dell G5587 Nvidia GTX 1060 gaming laptop just dropped to $799 at Walmart

Gone are the days when you had to spend a grand or more to get a great gaming laptop. PC makers like Dell are cranking out some excellent and affordable machines today like the Dell G5587, which is on sale right now for just $799.