BUG and FEEDBACK for OUR SCORES / WHAT THESE SCORE MEAN page (last updated 2020-09-27)
Here’s what should be the correct definitions:
Rating beers on RateBeer is easy section
Overall: Your overall personal experience of the product, which will dictate your final 5 STAR RATING.
Appearance and Mouthfeel are each scored out of 5. Aroma and Taste are scored out of 10. While Overall is scored out of 20. These all combine to give the product a total score out of 50, which is then divided and displayed as a score out of 5 for each rating.
Product #1: Aroma 7/10 Appearance 3/5 Taste 7/10 Mouthfeel 3/5 Overall 15/20
STAR RATING: 3.5/5
Product #2: Aroma 7/10 Appearance 3/5 Taste 8/10 Mouthfeel 2/5 Overall 16/20
STAR RATING: 3.6/5
Despite the 4 sensory attributes giving the same total, the higher Overall rating on Product #2 (3.6 star rating) reflects that user liked it more than Product #1 (3.5 star rating).
RateBeer Score Calculation Guide section
- STAR SCORE: An real average score out of 5 (not Star Rating)
Add this section before the OVERALL SCORE section
STAR SCORE section
Next to the star score, you will notice the number of ratings and the number of reviews. RATINGS that are accompanied with a written review of 75 or more characters are considered as REVIEWS.
RATING AVERAGE SCORE
Score based on the real average of all Ratings. This is the score displayed as the 5 STAR SCORE on the product page.
REVIEW AVERAGE SCORE
Score based on the real average of Reviews only. This score is displayed in the STATISTICS of the product page.
WEIGHTED AVERAGE SCORE
move the graph pic there
RateBeer uses an algorithm when calculating the weighted average score, considering both the reviews given by each user and the total number of reviews for the product.
Our scores are calculated with the same true Bayesian estimate formula used by the Internet Movie Database for calculating their average ratings (with 2.75 as the midpoint of the scale). On RateBeer, this means that as a product accumulates more ratings, the Weighted Average Score in turn becomes more accurate.
The Weighted average Score is based on REVIEWS only, not all Ratings.
TOP LISTS are made using the WEIGHTED AVERAGE SCORE, not the RATING AVERAGE SCORE.
Overall Score section
Remove everything and change to this only:
A product’s overall score reflects the rating given by RateBeer users and how this beer compares to all other products (no matter the kind) on RateBeer.
The OVERALL SCORE is a score based on 100 (Highest being 100) obtained by comparing the Weighted Rating Score of a product to all the products (no matter the kind) listed on the website
STYLE SCORE section
The style score is helpful in illustrating how a product stacks up against other beers listed within the same style category – it’s like comparing apples to apples and oranges to oranges (or Imperial Stouts to Imperial Stouts and Premium Lagers to Premium Lagers).
The STYLE SCORE is a score based on 100 (Highest being 100) obtained by comparing the Weighted Rating Score of a product to all of the products of the same style.
Quality of our scores
The framed section isn’t true anymore since the star rating includes all Ratings, not just reviews…so delete it
Add this instead there:
For increased accuracy, a beer must also receive a minimum number of ratings before the OVERALL SCORE and STYLE SCORE are visible.
To ensure the validity of all our scores and to combat abuse, ratings from new users on RateBeer do not impact the WEIGHTED AVERAGE SCORE until they have given several ratings.
Also, could you add how PLACE SCORES are calculated too in this page:
There is no definition for each of the 6 points used to calculated the score. (and why 2 out of them don’t count towards the total)
There is no mention about if the 5-STAR PLACE SCORE uses Bayesian formula or not.
There is no mention as well if the GLOBAL PLACE SCORE is based against all places in the world vs country vs city as well as there’s no mention if it’s based against all places in the world vs types of places OR if it’s simply a percentile score of the average 5-star score…