Airbnb — A Transformer That Reads Your Whole Travel History
Episode notes
Airbnb's JourneyFormer replaces hundreds of hand-crafted guest statistics with a transformer that reads each guest's raw event history. In a three-week A/B test it added 0.55% more bookers in search and 5.04% more email views.
Key takeaways:
- Aggregates erase the story. Hand-built “what this guest likes” features lose order, recency and co-occurrence. A sequence model keeps them.
- Two timelines. A long-term sequence of milestones like bookings and a short-term sequence of recent activity (capped at 200 events), with location encoded through 14 levels of S2 cells.
- Built for serving cost. 128-dimension embeddings are shrunk to 32 before the guest profile is stored, and sparse computation skips empty sequence slots.
- Results. Offline NDCG rose 1.48%. Online, search saw +0.55% bookers, +0.82% booked nights and +0.90% views, and email ranking saw +5.04% views.
- Our take. The tools aren't new; the work is in taming long, noisy, real travel histories.
Chapters:
00:00 Guessing a friend's favorite movie
00:45 Airbnb's JourneyFormer
02:17 What aggregate features lose
03:49 Years of history at scale
05:20 S2 cells: encoding place
06:50 The transformer encoder
09:54 Shrinking embeddings for serving
11:25 Sparse computation
12:11 Results offline and online
14:30 What's genuinely new
17:33 Related work
18:19 Commentary and closing question
Sources:
- JourneyFormer: Encoding Airbnb Guest Journey with Sequence Modeling (Zha et al., Airbnb; arXiv, Jun 2026 (KDD '26))
Related episode: E1: LinkedIn — A Transformer That Ranks Your Feed
Enjoyed it? Follow Data Science in the Wild (one real production ML/AI system or paper per episode, hosted by Peter Liu) and rate it on Apple Podcasts or Spotify.
Also from Peter: The GenAI Evolution Atlas, Wednesday AI deep dives and Friday news roundups.
Made with AI-generated voices; curated by Peter Liu from the sources above.