ReviewMeta’s Preliminary Reports
In an ideal world, we’d be able to analyze every last piece of data before telling you how the reviews look. Unfortunately, it takes a massive amount of computing power to process that much data, and we understand that you aren’t always willing to wait a few hours before we give the product a complete look.
We have two levels of reports: “Preliminary” and “Full”.
What’s the difference between Preliminary and Full reports?
The Preliminary report looks at a smaller sample of the data and can be generated in under a minute. We’re relying on a lot of existing data that’s already in our system, so our user sampling might not be exactly “random”. Lastly, you can’t change the weighting and recalculate the adjusted rating for products that only have a preliminary report.
How accurate are the Preliminary Reports?
Our goal is to fine-tune our preliminary reports to the point where they are 95% accurate at predicting what the full report will say. However, that’s currently NOT the case.
As of 9/26/2016, here’s our stats: (we will update as we make progress)
- When the Preliminary Report says “Pass“, the Full Report will be:
- Pass 69%
- Warn 26%
- Fail 4%
- When the Preliminary Reports says “Warn“, the Full Report will be:
- Pass 41%
- Warn 41%
- Fail 18%
- When the Preliminary Report says “Fail“, the Full Report will be:
- Pass 15%
- Warn 23%
- Fail 61%
How can I get a full report?
If a full analysis isn’t ready for the product you’re researching, we can run one in as little as a few hours. However, in order to know which products are the highest in demand, we look to see if anyone has requested an email notification for that product. If you enter your email, you’ll be bumping up the priority for that product, and we’ll try to have it completed in a few hours.