Browser Extensions 

rm-v-fs-full copy 2

FakeSpot vs. ReviewMeta for Analyzing Reviews

August 11th, 2016

We often get asked the question “How is ReviewMeta different than FakeSpot?” The goal of both ReviewMeta and FakeSpot is to empower consumers to cut through the noise and deception of suspicious reviews, but there are still some objective differences worth pointing out.  The ReviewMeta platform embraces transparency and customization to give nuanced insights to a product’s reviews.

Note: This article was written on August 10th, 2016, so things may be different on either site.

Comparing the Basics

For this article, we compared the review analysis of the same product (Beard Grow XL) on both FakeSpot and ReviewMeta.

FakeSpot:

fs-summary

The first thing you’ll notice is the different ways each site summarizes the results.  FakeSpot displays a letter grade (A, B, C, D or F) and the detected percentage of “low quality reviews”.  This helps the consumer get a sense of how trustworthy the reviews are for the product, but doesn’t go much beyond that.

ReviewMeta:

rm-summary

ReviewMeta, on the other hand, shows one of three outcomes (PASS, WARN or FAIL) and a recalculated average rating and number of reviews after filtering out the suspicious ones.  While this is still just an estimate, it’s helps consumers get a sense of what the honest reviewers are saying about the product.

rm-adjustment

Additionally, ReviewMeta shows you exactly how we come up with each adjustment and gives you the power to edit the adjustment yourself.  So, for example, if you think all unverified purchases should be completely removed, you can slide the dial all the way to 0% which recalculates the score after removing all unverified reviews.

It’s important to remember that unnatural reviews do not necessarily mean the product is of inferior quality.  While inauthentic reviews are sometimes created to help push a poor quality products on Amazon, we’re seeing that sellers of high quality products are also being forced to generate inauthentic reviews just to stay competitive.  So if a product gets an F on FakeSpot or a FAIL on ReviewMeta, it still might be worth buying.

Sites Analyzed:

Both ReviewMeta and FakeSpot work with Amazon.com, Amazon.co.uk, and Amazon.ca.  However, only FakeSpot supports Amazon.com.au while only ReviewMeta supports Bodybuilding.com

Methodology

FakeSpot:

fs-details

FakeSpot explains how their analysis works on their How it Works page:

Fakespot utilizes numerous technologies to validate the authenticity of reviews.

The primary criteria is the language utilized by the reviewer, the profile of the reviewer,correlation with other reviewers data and machine learning algorithm that focuses on improving itself by detecting fraudulent reviews.

The technologies include: profile clusters, sentiment analysis, cluster correlation and artificial intelligence intertwined with these functionalities.

The biggest methodological difference between FakeSpot and ReviewMeta, is that FakeSpot primarily analyzes the language of the reviews which isn’t the case with ReviewMeta.  We only look at the text of the review in 3 of our 12 tests: Phrase Repetition, Word Count Comparison, and Incentivized Reviews.  The other 9 tests are looking at data beyond the language.

Also, FakeSpot’s algorithm may be hard at work in the background, but they don’t share too many details with the public besides a few bullet points about what they found in the reviews.

fs-examples

They also show 3 example inauthentic reviews with a broad explanation as to why they are low quality.

Obviously FakeSpot has a lot more data than this, but they’ve decided not to share it with the consumer.  We didn’t create FakeSpot, so we can only theorize as to why, but one possible explanation is that they don’t want to give away their secrets so that sellers can beat their system, or maybe they don’t want to give the consumer information overload.

ReviewMeta:

reviewmeta-details

At ReviewMeta, we chose the approach of showing our work for a few reasons:

  1. Transparency. The savvy consumer isn’t going to blindly trust a “magic formula” that decides if the reviews are authentic.
  2. Education. Part of the purpose is educating consumers about how our formula works and why these reviews are viewed as unnatural.
  3. Subjectivity. If you click the “View/Edit Adjustment” link, you’re able to change our weighting scales as you see fit. Some people believe that unverified reviews are no less trustworthy than verifieds and want those always included in the final rating.
  4. It’s going to be MUCH harder for brands to create unnatural reviews in a manner that doesn’t raise a red flag on our site. Yes, it’s technically possible, but it would require much, much more effort to pull off.

We show the detailed results of all 12 tests that we run and include examples of reviews that are flagged for every single test.  Our goal is to create a tool that enables consumers to have access to as much information as possible, so they can effectively research the reviews and make an informed decision.

Browser Extensions

extensions

Both FakeSpot and ReviewMeta offer free browser extensions:

FakeSpot’s extension seems to just help you get to the analysis on their website.  When looking at a product on Amazon, you can click their extension to open the analysis on FakeSpot.com for that product in a new window.

Not only does ReviewMeta’s extension help you get to their analysis from a single click, it also instantly provides you with the adjusted rating without having to touch a thing or leave the page.  Also, the color indicates whether the product got a PASS, FAIL or WARN.

What’s Next?

We believe that the more tools that are available to the consumer to help them make informed decisions, the better.  Fake reviews are flooding every industry and there aren’t enough resources available to help combat this.  Brands have a massive financial incentive to acquire as many positive reviews as possible, and many aren’t being honest when doing so.  The consumer has a right to know what’s going on behind the reviews they’re reading.

At ReviewMeta, we plan to continue improving our tool, further analyzing the data to identify more issues with the current system (see our in-depth analysis of incentivized reviews here) and expand our service to other review sites.


11 responses to “FakeSpot vs. ReviewMeta for Analyzing Reviews”

  1. Lynn Brooks says:

    I just found this site, and absolutely love it!! I’m an avid reader, and one-click books often. I’ve paid for books that were rated highly and the book didn’t add up to the amazing reviews it had.
    Also, I’m aware there is review exchange groups for authors on Facebook, and noticed they swap reviews. So, this site is helpful and has saved me money. Thank you!!

  2. Patty Fisk says:

    Sometimes ReviewMeta gives a “pass” report while FakeSpot gives an “F” grade. How can this be and what does it mean? It leaves me completely baffled and clueless.

    • Hello Patty-

      Thanks for the comment. The most important thing to keep in mind is that ReviewMeta and Fakespot are both estimates. Neither is going to be able to get it right 100%, and sometimes the algorithms will disagree with each other. Here at ReviewMeta, I tried very hard to create a comprehensive report that would show exactly why reviews are considered to be unnatural. Fakespot doesn’t seem to have taken the same approach, so other than saying “they are both estimates”, it’s hard to fully understand why the two sites seem to disagree with one another.

  3. JimD says:

    Hmmmm…. are those affiliate links being substituted for the actual buy links when using these services?

    • Hi JimD-

      When we launched the site in May, 2016, we were using the Amazon Affiliate links to help offset the enormous costs of developing and running the site. In August, 2016, Amazon terminated our affiliate relationship and since we’ve relied on banner ads and donations to fund the project. Our algorithm is in no way influenced by these monetization methods whatsoever.

  4. Rhett Lewis says:

    Can I ask how to monetise your website?

    How do you make money?

    Does this impact the data your provide?

  5. Lauren says:

    Even verified purchases can be fake. There are websites and fb groups that refund your purchase amount via PayPal in exchange for 5 star reviews.

    • Yes, we’re seeing that a lot lately. Verified Purchase reviews do not get any special boost in our system; the badge only prevents them from being devalued in the Unverified Purchases test.

  6. BaconLovingInfidel says:

    very cool

  7. shane moulton says:

    Nooice! Appreciate what y’all are doing!

Leave a Reply to Patty Fisk