Data & Methodology · Review Intelligence

Your Comp Set's Reviews Are a Dataset, Not a Report Card

Nearly every Airbnb listing rates between 4.5 and 5 stars, so the star average carries almost no signal anymore. The thousands of words underneath it still do. Here's how to mine your own reviews — and your competitors' — for the pricing, amenity, and early-warning intelligence the score can't show you.

~95% Airbnb listings rated 4.5 or 5 stars
0.89% ADR lift per 1% higher reputation score
5–9% Revenue lift per 1-star rating increase (Yelp data)
2K–5K Reviews sitting in a typical 15–20-comp set

Every review ever written about your listing is public. So is every review ever written about every listing you compete with — timestamped, attributed to a stay, sitting in plain view. Across a typical comp set of 15 to 20 established properties, that's usually several thousand documented guest experiences of your exact market, your exact guest, your exact product category.

Almost nobody treats this as data. Hosts read reviews as a report card to be endured. Data platforms compress them into a score and a count. That compression is exactly the opportunity: a 4.83 average is a lossy summary of thousands of words, and the words contain what the number can't — what guests in your market actually praise, what they quietly tolerate, what they wish existed, and what's starting to go wrong two miles down the road.

This piece makes the case that those words are worth money, shows why the Airbnb star scale has stopped carrying much signal on its own, and walks through the actual method — offense mining, defense mining, and wishlist mining — for turning a comp set's reviews into decisions.

A note before you read further: the theme-count table later in this piece is a constructed illustration built to demonstrate the method, not real listing data. Everything else is drawn from peer-reviewed hospitality and marketing research, cited as we go.

Reputation converts directly into rate and occupancy

This is one of the better-documented relationships in hospitality research. Cornell's Center for Hospitality Research matched hotel reputation scores against actual sales data and found that a 1% increase in a hotel's online reputation score corresponded to as much as a 0.89% increase in ADR, a 0.54% increase in occupancy, and a 1.42% increase in RevPAR — with the effect strongest for midscale properties, exactly the tier most short-term rentals compete in.

The economics

What a 1% Reputation Gain Is Worth

Cornell matched online reputation scores against real hotel sales data. The effect was strongest for midscale properties — the tier most short-term rentals compete in.

The pattern holds outside lodging, too: a Harvard Business School study of Yelp found a one-star rating increase associated with a 5 to 9% revenue increase for independent restaurants, and a separate study in The Economic Journal found an extra half-star made a restaurant 19% more likely to sell out its seats at peak times. Reviews aren't a customer-service afterthought — they're a pricing input.

The problem: on Airbnb, the score barely moves

Here's the finding that should change how you read every Airbnb rating. Researchers analyzing ratings for millions of Airbnb properties worldwide found that nearly 95% of them average either 4.5 or 5 stars, with virtually none below 3.5. For comparison, roughly 700,000 hotel and B&B ratings collected from TripAdvisor showed hotels averaging 3.8 stars and B&Bs 4.1, with far more variance.

The compression problem

Where Every Stay Is Above Average

Average guest rating by platform and category. Airbnb's version of the five-star scale has compressed so far that a high-4s rating barely differentiates you from your comp set.

Stranger still: for properties cross-listed on both platforms, the same physical property tends to rate higher on Airbnb, and the two platforms' scores are only weakly correlated. Same building, same beds, different score, depending on where the guest wrote it down. Airbnb's own published figures confirm the compression from the inside: the platform reports its average listing rating exceeds 4.75, with over 80% of recent reviews at five stars.

So the entire competitive universe of your market is crammed into a few tenths of a star. When 95% of listings sit between 4.5 and 5.0, the score has almost no resolution left. What's recoverable is everything the number can't hold: themes and specific amenity mentions, complaint clusters, seasonal shifts in guest type, and the gaps between what a listing promised and what the stay actually delivered. None of it appears on a dashboard. All of it is sitting in public text.

A worked example: one cabin, 25 reviews, 90 minutes

To show the method rather than just describe it, take one illustrative Pigeon Forge cabin and reduce its last 25 reviews to a theme count.

Worked example

One Cabin's Last 25 Reviews, Reduced to Themes

Illustrative, to demonstrate the method — not real listing data.

ThemeMentionsSentimentWhat it means
Hot tub14PositiveThe product — belongs in the cover photo
View from deck11PositiveThe product — lead with it in the description
Driveway steep or hard to find6NegativeExpectation item — free fix via copy and an arrival guide
Mattress comfort4NegativeFix-it item — a few hundred dollars from a ratings problem
“Great for game weekends”3PositiveDemand signal — price football weekends for it
Kitchen well stocked3PositiveTable stakes — maintain, don't over-invest

Twenty-five reviews, ninety minutes of reading, and this host now knows things the star rating never said. That's the method. The rest of this piece scales it.

Early warning: complaint clusters move before the rating does

The field guide's Chapter 2 established that ratings have inertia: an established listing's average moves slowly, and by the time it's visibly dropped, the recovery math is measured in dozens of consecutive perfect reviews. The words move first. A listing headed for its first 3-star review almost always telegraphs it: two or three reviews mentioning the place felt “a bit tired,” a repeated aside about shower pressure, a polite “just know the stairs are steep” that starts appearing in otherwise glowing writeups.

The research explains why the softening happens. Studies of Airbnb's own review system have found that dissatisfied guests often simply decline to write anything rather than leave a negative review, and separate research on review-reporting behavior finds the same shape from the cost side: posting a review takes effort, so the people who bother skew toward the ends of the satisfaction spectrum, and platforms hear disproportionately from the delighted.

2 mentions = coincidence · 3 = cluster Every complaint that actually makes it into text is standing in for several guests who felt the same thing and said nothing. A cluster of three isn't three data points — it's the visible tip of a distribution.

Two Piles for Every Cluster

Fix-it items

Physical problems — the mattress, the water heater, the flaky lock. They cost money and, once addressed, end the cluster permanently.

Expectation items

Informational — the steep driveway, the road noise, the “cozy” second bedroom. Often free to fix: a sentence of honest listing copy turns a post-stay complaint into a pre-booking filter. A guest who books knowing about the driveway doesn't review the driveway.

Competitive review mining: reading your comp set's guests

Everything above applies to your own reviews. The larger prize is everyone else's, because your competitors' reviews are a continuously updated survey of what guests in your market value, written in their own words, at a sample size you could never afford to commission.

There's real structure in this text. A large-scale analysis of Airbnb review comments found guest experience organized around three key attributes — location, amenities, and the host — with price, surprisingly, not surfacing as a key influencer, and with a strong positivity bias in the writing. Subsequent topic-modeling research on Airbnb reviews has repeatedly extracted coherent, rankable aspect structures. If academics can reliably mine these themes from millions of reviews, an operator can mine them from a couple thousand — and commercial STR tooling has followed the same insight, with competitor review analysis now a shipped feature in the category. This isn't an exotic technique. It's an underused one.

Run the Mining in Two Directions

Offense

Read the five to ten top performers in your comp set and tally what their guests rave about unprompted. If the best-earning cabins keep drawing praise for the coffee setup or the hot-tub-with-a-view, that's the market telling you its hierarchy of delight. Audit your own reviews against that list — a gap is a cheap, review-visible upgrade. The phrases guests use when delighted are pre-tested marketing copy, in the customer's own voice.

Defense

A cluster of broken-AC complaints or “host never responded” reviews on a top comp is a temporary transfer of demand. Noticing it the week it forms lets you emphasize your own genuine strengths — a recently serviced HVAC, a five-year cleanliness streak — while it's live. The signal decays as competitors fix things, so cadence matters more than depth. This is never about writing anything negative about a competitor; it's letting their guests' words tell you which of your strengths to turn up this month.

Amenity wishlist mining

There's a special class of review sentence worth its own section: the wish. “Would have loved a fire pit.” “Only thing missing was an EV charger.” “Wish there had been a pack-and-play for the baby.” Guests volunteer, unprompted and for free, the amenities they'd have valued — and aggregated across a comp set, those wishes become a ranked, demand-side amenity investment list for your specific market.

This inverts how most amenity decisions get made. The usual method is supply-side imitation: the cabin next door added a theater room, so theater rooms must work. Wishlist mining is demand-side: guests in this market, having stayed in properties like yours, keep asking for X. Research on feature-level review mining has shown this kind of text contains information that predicts prices and demand beyond what star ratings alone capture. The rating says “good stay.” The text says which features the market actually pays for.

Forum callout: “Is a hot tub worth it in [market]?” is a permanent thread on BiggerPockets and every host group, permanently unresolved because it's argued with anecdotes from different markets. The method above is how you answer it locally: count hot tub mentions, praise, and wishes across your actual comp set's reviews, then compare realized RevPAR of comps with and without one. You'll have a market-specific answer while the forum thread is still arguing about someone's cousin's cabin in a different state.

Two honest caveats before you spend money on this signal. First, mentions measure salience, not proven revenue lift — the pairing step is checking wish frequency against the pricing data, whether comps with the amenity actually realize higher ADR or occupancy than matched comps without it (the field guide's Chapter 9 formalizes this as amenity gap analysis at the market level). Second, beware survivorship in what gets praised: guests praise what already exists, so an amenity nobody in the market offers shows up only as wishes — which is exactly why wish data is more valuable than praise data for finding gaps. Praise tells you the table stakes; wishes point at the open space.

The ceiling of doing this by hand

Honest scoping, because this method shouldn't be oversold in its manual form. Reading your own last 30 reviews is an afternoon, worth doing quarterly regardless of anything else. Reading one competitor's full review history is another hour or two. Doing it for 15 to 20 comps means two to five thousand reviews on the first pass — and, harder, it means re-reading on a cadence, because the entire value of the defensive and wishlist signals is freshness.

The 90-minute quarterly version any operator can actually sustain:

  1. Your own last 30 reviews, tallied for recurring nouns — 30 minutes.
  2. The three top performers in your comp set, last 15 reviews each, tallied for praise themes and wishes — 45 minutes.
  3. Turning the tallies into at most three actions: one fix, one copy change, one amenity to price out — 15 minutes.

That cadence, kept honestly, puts you ahead of nearly every self-managed operator in your market, because nearly none of them do even this.

What the manual version can't do is the full-market, every-review, every-week version: every new review across the whole comp set parsed for themes as it lands, wish counts tracked as time series, complaint clusters flagged the week they form, amenity signals joined to pricing outcomes. That's not a reading habit — that's a data pipeline with text analysis on top. The method doesn't change. The pipeline only changes who does the reading.

The takeaway

Star ratings on Airbnb have compressed to the point of near uselessness as a competitive signal; the text underneath them hasn't. Reviews are a continuously updated, unusually honest survey of what guests in your market value, sitting in public view, refreshed every time someone checks out.

The gap between an operator who reads for it and one who doesn't isn't talent — it's a 90-minute quarterly habit versus a scroll past the star average. Everything in this piece is knowable from your own comp set today, and most operators have never counted a single theme across it.

About this analysis

How to Read the Numbers Above

Reputation figuresPeer-reviewed hospitality and marketing research (Cornell Center for Hospitality Research, Harvard Business School, The Economic Journal), cited inline throughout
Rating compressionA large-scale study of Airbnb ratings published in Marketing Letters (2021) and Airbnb's own Global Quality Report
Worked theme tableIllustrative — a constructed example built to demonstrate the method, not real listing data
Comp-set scope15–20 established comps, a typical range for a defined Southeast STR market
LimitationThis piece demonstrates a method, not a specific market's findings

Every figure above exists to demonstrate the method, not to describe your property. Your comp set's real praise themes, complaint clusters, and amenity wishes are exactly what a review-mining pass produces.

Sources & further reading

Chris K. Anderson, “The Impact of Social Media on Lodging Performance,” Cornell Hospitality Report, Center for Hospitality Research, Cornell University, 2012.

Michael Luca, “Reviews, Reputation, and Revenue: The Case of Yelp.com,” Harvard Business School Working Paper 12-016.

Michael Anderson and Jeremy Magruder, “Learning from the Crowd,” The Economic Journal, 122(563), 2012.

Georgios Zervas, Davide Proserpio, and John W. Byers, “A First Look at Online Reputation on Airbnb, Where Every Stay Is Above Average,” Marketing Letters, 32(1), 2021.

Andrey Fradkin et al., research on Airbnb's review system, Marketing Science, 2021.

Mingming Cheng and Xin Jin, “What do Airbnb users care about?” International Journal of Hospitality Management, 76, 2019.

Yi Luo and Rong Tang, “Understanding hidden dimensions in textual reviews on Airbnb,” International Journal of Hospitality Management, 80, 2019.

Nikolay Archak, Anindya Ghose, and Panagiotis G. Ipeirotis, “Deriving the Pricing Power of Product Features by Mining Consumer Reviews,” Management Science, 57(8), 2011.

Airbnb Newsroom, Global Quality Report.

Frequently asked questions

Why do almost all Airbnb listings have a 4.5 or 5-star rating?

Research analyzing millions of Airbnb properties found that nearly 95% average either 4.5 or 5 stars, with virtually none below 3.5 — Airbnb's own reporting puts the platform average above 4.75, with over 80% of recent reviews at five stars. Comparable TripAdvisor data shows hotels averaging 3.8 and B&Bs 4.1, with far more spread. Likely causes include under-reporting of negative experiences, positivity bias in who bothers to write a review, and the platform's historical dual host-guest review structure.

Does a higher Airbnb rating actually increase revenue?

Yes, based on hotel-industry research using matched reputation and sales data: a 1% increase in online reputation score was associated with up to a 0.89% increase in ADR, a 0.54% increase in occupancy, and a 1.42% increase in RevPAR, with the effect strongest for midscale properties. Separate research found that raising an average rating from 3.8 to 4.8 on a five-point scale supported roughly an 8% rate increase without hurting net bookings.

How many competitor reviews should I actually read?

A typical comp set of 15 to 20 established properties holds a few thousand reviews in total, which is too many to reread constantly. A sustainable routine is roughly 90 minutes per quarter: 30 minutes on your own last 30 reviews, 45 minutes on the last 15 reviews from your top 3 comp-set performers, and 15 minutes turning what you found into at most three actions.

What's the difference between a random complaint and a complaint cluster?

Two mentions of the same issue across recent reviews is usually coincidence. Three is a cluster worth acting on, because review platforms under-collect dissatisfaction — guests who are unhappy often skip writing a review entirely rather than leave a negative one. A complaint that does make it into text is standing in for several guests who felt the same thing and said nothing.

See What Your Guests Are Already Telling You

We'll Mine Your Comp Set's Reviews For You — Free

This piece used one illustrative cabin to show the method. If you operate in the Southeast, we'll run your actual comp set's reviews through it — praise themes, complaint clusters, and the amenity wishlist your next dollar should chase — as part of a free teardown.