Interested in joining the Silph Research group? Learn More »

Silph Study: #052

Published:
11.15.2021

Exploring Raid Rewards

Greetings travelers! On August 27, 2020, Mega Raids were introduced and with them a major overhaul of the Raid Battle system as a whole. Gone are Tier 2 and Tier 4 raids, and replacing them are new Mega raids and speed bonuses. With all of these changes, we felt it was time to update our previous findings on raid rewards. The Research Group pulled out their raid passes, and explored these changes, collecting data from over 5,000 raids! Let’s see what they have uncovered.

Key Findings

  • The number of Premier Balls corresponds to the number of item bundles for each Tier.
  • The reward types and frequencies have changed for several raid Tiers.
  • Potions dropped in Tier 3 raids are unevenly distributed depending on the raid boss.

Background

This study comprises data collected across two different time periods. Prior to the introduction of Mega Raids, researchers collected item rewards from 3,437 raids (from December 12, 2019 to February 15, 2020).¹ The results of this first collection period are presented in the appendix. Following the addition of Mega Raids, Silph Researchers collected data from an additional 1,761 raids between June 15 and October 10, 2021. This time period will be the focus of this article.

The redistribution of raid Tiers coincided with a rework of how Premier Balls and item bundles were awarded: team contribution bonuses were replaced with speed bonuses. The screenshots below show how Premier Balls were awarded before and after the Mega Raid update.

Screenshots of how Premier Balls were awarded from before (left) and after (middle) the Mega Raid overhaul. In Mega Raids (right), Mega Energy is awarded in place of Speed Premier Balls.

Premier Ball and Item Rewards

Let’s begin with the ball-to-bundle relationship: there is a relationship between the number of Premier Balls received and the number of item bundles awarded. Premier Balls are awarded for Damage, Gym Control, Friendship Level, and Speed. Only three of those factors, however, influence the number of bundles the Trainer will be rewarded. Damage, Gym Control, and Speed contribute equally to the number of reward bundles. The table below shows the number of bundles awarded for each bonus Premier Ball received. Note that the table does not include Friendship balls, as those do not count toward bundles.

Premier Ball
Number of Balls
Tier 1 Raid Egg
Tier 1 Bundles
Tier 3 Raid Egg
Tier 3 Bundles
Tier 5 Raid Egg
Tier 5 Bundles
Mega Raid Egg
Mega Bundles
6 4
7 5
8 3 5 6 6
9 3 5 7 6
10 3 6 7 7
11 3 6 7 8
12 3 6 8 8
13 3 6 8
14 4 7 8
15 4 7 9
16 4 7 9
17 4 8 9
18 4 8 10
19 4 8 Not observed²
20 4 8 Not observed²


The grayed-out cells indicate situations in which it is impossible to receive that specific number of balls.² The implementation of speed rewards has greatly increased the number of Premier Balls awarded, from the previous maximum of 14 balls to the new maximum of 20 bonus Premier Balls.³ The total number of item bundles awarded in each raid Tier remains roughly equivalent to pre-Mega levels. A full list of the legacy rewards can be found in the appendix.

Item Bundle Distribution

Now, let’s take a look at the composition of bundles. Each bundle consists of 1-3 items, and bundle composition for some rewards vary based on the raid difficulty level. Certain items, such as Fast and Charged TMs, are always awarded in bundles of 1. Hyper Potions, on the other hand, are not found in Tier 1 raids, but are awarded in bundles of 2 in Tier 3 raids and bundles of 3 in Tier 5 raids. Silph Researchers recorded at least 1,000 bundles for each of the four available raid Tiers. The table below shows the number of each item per bundle and the frequency of each bundle’s appearance for each raid Tier.

Raid Random Rewards: Each Cell = 1 Bundle
Tier 1
Tier 1 Raid Egg
3-4 bundles
20.15%
Two Revives
19.38%
1 Golden Razz
19.23%
1 Rare Candy
40.15%
0.62%
Fast TM
0.46%
Charged TM
Tier 3
Tier 3 Raid Egg
5-8 bundles
17.14%
3 Revives
18.96%
1 Golden Razz
19.97%
2 Rare Candy
27.34%
2 Super Potion
8.55%
2 Hyper Potion
4.47%
Fast TM
3.58%
Charged TM
Tier 5
Tier 5 Raid Egg
6-10 bundles
18.32%
3 Revives
18.13%
2 Golden Razz
15.74%
3 Rare Candy
37.05%
3 Hyper Potion
5.11%
Fast TM
5.66%
Charged TM
Mega

4-8 bundles
16.82%
3 Revives
17.86%
1 Golden Razz
10.53%
2 Rare Candy
31.20%
2 Hyper Potion
3.29%
Fast TM
2.82%
Charged TM
17.48%
2 Silver Pinap


In addition, the following rewards are always received, independent of the number of Premier balls.

Raid Guaranteed Rewards
Tier 1
Tier 1 Raid Egg
1 Golden Razz 1000 Stardust 3500 XP
Tier 3
Tier 3 Raid Egg
2 Golden Razz Charged TM 1000 Stardust 5000 XP
Tier 5
Tier 5 Raid Egg
3 Golden Razz 1000 Stardust 10,000 XP
Mega
Mega Raid Egg
2 Golden Razz Charged TM 1000 Stardust 10000 XP


Reward bundles can be any combination of the possible items for each Tier. At least, this holds true for almost all Tiers. We discovered, however, that certain Tier 3 raids break this pattern!

Speculation on Raid Tier Merging

When Tier 2 and Tier 4 raids were retired last year, an official blog post stated that the rewards for Tier 1 and Tier 3 raids would be increased to match the previous Tier 2 and Tier 4 rewards.

In our data set, Tier 1 raid rewards matched those from legacy Tier 2 raids, as announced. However, we found that rewards from Tier 3 raids did not match legacy Tier 4 raid rewards. Specifically, Tier 3 raids could award both Super Potions and Hyper Potions, whereas the legacy Tier 4 raids only awarded Hyper Potions.

Interestingly, we found that the proportion of Super and Hyper Potions was dependent on the Pokémon battled. Species that have always been found in Tier 3 raids, such as Alolan Raichu, reward Super Potions significantly more often than raid bosses which moved from Tier 4 to Tier 3, such as Tyranitar (χ² test of independence, p-value < 0.001).⁴ While this discrepancy caused a slight difference in the number of non-Potion rewards, there was not sufficient evidence to reject the null hypothesis that non-Potion rewards are given in equal proportion between the two sets of raid bosses (χ² test of independence, p-value = 0.07).

Item Reward
Legacy Tier 3 Species Legacy Tier 4 Species
Super Potion 535 30.40% 130 23.01%
Hyper Potion 80 4.55% 91 16.11%
Non-Potion Items 1145 65.06% 344 60.88%
χ²(2, N = 2325) = 87.0, p-value < 0.001


For now, we cannot be certain what causes the different rewards observed within Tier 3 raid bosses. It’s possible that Potion rewards were incorrectly updated when raids were reworked. Alternatively, another hidden variable might be at play. It’s interesting to note that a single raid never rewarded both Super and Hyper Potion bundles to a Researcher. This observation suggests that the hidden variable affects the entire reward package, as opposed to each bundle.

Parting Words

Raids are a great way to play with friends locally or around the world! No longer is it important to complete raids with players from the same team. Instead, the larger the group the higher the rewards received! This change encourages players to come together in larger groups and builds community engagement. Whether you participate in raids for the rewards, to collect the sought-after Mega Energy, or to chase the newest (shiny) raid boss with your friends, raids are here to stay. Niantic has hinted that EX Raids may eventually return. Will rewards received from EX Raids differ from our past data?

A big thank you to all the Researchers who helped collect data from 2019 to 2021 — without you this project would not have been possible. Until next time, travelers!


Acknowledgements

Authors: Lead Researcher Belle and Scientist CaroKann
Analysis: Scientists Pancake and CaroKann
Project Leaders: Scientist DeeDillyDawn and Lead Researchers AlertedFancy and Belle
Graphics: Scientists WoodWoseWulf, CaroKann, and DeeDillyDawn
Editing: Scientists Cham1nade and Titleist and Senior Researcher JinianD
Data collection: Between December 2019 and October 2021, 162 Silph Raiders contributed data to this project. These eight scored the most raid completions:

  • alohanico
  • aniwol
  • Kingdaddyxxx
  • marinaj
  • SquidKidLena
  • omahanime
  • RDC-DCIfan68
  • ThatOneZebra

Footnotes

¹ A minor change, effective December 5, 2019, introduced a guaranteed Charge TM in Tier 4 raids, and Rare candy rewards were adjusted.

² In our study we did not observe certain theoretically-possible ball/bundle combinations, such as a Tier 5 raid with 19 or 20 balls received. These would be extremely difficult to achieve, as it would require the Trainer to contribute a minimum of 15% damage in under 30 seconds in order to receive 3-4 damage balls plus 8 speed balls.

³ Winning a Tier 1 to Tier 5 raid will always reward Trainers with a minimum of 2 speed balls, netting them at least 8 Bonus Premier Balls. In Mega Raids, Mega Energy replaces Premier Balls, meaning there is a maximum number of 12 Bonus Premier Balls possible.

The relationship between the time used to complete the raid and the awarded Bonus Premier Balls or Mega Energy is shown in the table below.

Time used Speed Balls Awarded Mega Energy Awarded
0-10% 8 90
10-25% 6 80
25-50% 4 70
50-75% 3 60
75-100% 2 50

⁴ We compared the frequency of each type of reward from before the Mega Raid changes to those afterward using a Pearson’s chi-squared test of independence. There was no significant difference in the reward drops between pre-Mega Tier 2 and the post-Mega Tier 1 raids (χ²(5, N = 4,018) = 5.39, Bonferroni-corrected p-value = 1), or between pre-Mega Tier 5 and the post-Mega Tier 5 raids (χ²(5, N = 14,164) = 12.3, Bonferroni-corrected p-value = 0.09). There was, however, a significant difference in item rewards from pre-Mega Tier 4 and post-Mega Tier 3 raids (χ²(6, N = 4,494) = 1267.6, Bonferroni-corrected p-value < 0.001). Individual comparisons of each item reward type showed that Potion type (Super or Hyper), contributed most to the observed difference in pre-Mega Tier 4 and post-Mega Tier 3 raids. When correcting for multiple hypotheses, no other item type differed significantly in the pre-Mega and post-Mega groups.

Appendix of Pre-Mega Raid Data

The pre-Mega raid appendix covers unpublished data collected from December 12, 2019, to February 15, 2020, and highlights the minor 2019 raid reward updates before the August 2020 Mega Raid update.

Number of
Premier Balls
Tier 1
Bundles
Tier 2
Bundles
Tier 3
Bundles
Tier 4
Bundles
Tier 5
Bundles
6 1 2 3 5 4
7 2 3 4 6 5
8 2 3 4 6 5
9 2 3 5 7 6
10 2 3 5 7 6
11 2 4 5 8 7
12 2 4 6 8 7
13 2 4 6 9 8
14 2 4 6 9 8

Raid Random Rewards: Each Cell = 1 Bundle Guaranteed Rewards
Tier 1
2 bundles
20.50%
Two Revives
19.48%
1 Golden Razz
0.32%
Fast TM
0.19%
Charged TM
19.73%
1 Rare Candy
39.78%
1 Super Potion
Guaranteed
1 Golden Razz
Guaranteed
1000 Stardust
Guaranteed
3000 XP
Tier 2
3-4 bundles
19.29%
Two Revives
21.10%
1 Golden Razz
0.61%
Fast TM
0.54%
Charged TM
20.22%
1 Rare Candy
39.78%
Guaranteed
1 Golden Razz
Guaranteed
1000 Stardust
Guaranteed
3500 XP
Tier 3
5-6 bundles
18.00%
Two Revives
19.05%
1 Golden Razz
3.89%
Fast TM
1.65%
Charged TM
18.39%
2 Rare Candy
39.02%
Guaranteed
2 Golden Razz
Guaranteed
1000 Stardust
Guaranteed
4000 XP
Tier 4
6-9 bundles
18.33%
3 Revives
17.10%
1 Golden Razz
5.63%
Fast TM
3.45%
Charged TM
18.23%
2 Rare Candy
37.26%
2 Hyper Potion
Guaranteed
2 Golden Razz
Guaranteed
1000 Stardust
Guaranteed
5000 XP
Guaranteed
Charged TM
Tier 5
4-8 bundles
17.53%
3 Revives
17.97%
2 Golden Razz
5.36%
Fast TM
5.62%
Charged TM
17.78%
3 Rare Candy
35.73%
3 Hyper Potion
Guaranteed
3 Golden Razz
Guaranteed
1000 Stardust
Guaranteed

Back to Top.