Table of Contents
Problem Definition
- We covered three aspects beyond the choice of algorithm:
- Modelling
- Experimentation
- Serving
- In this paper
- challenges and solutions
- display an overview of the business gains of the step changes in the Machine Learning ranking of Booking.com.
- Main conclusion
- Our main conclusion is that there are multiple aspects that need to be
carefully addressed for the creation of a Machine Learned ranker
in a large-scale commercial setting.
Methods
- Our main conclusion is that there are multiple aspects that need to be
carefully addressed for the creation of a Machine Learned ranker
in a large-scale commercial setting.
- Modelling
- Signals definition
- Feature representation
- Bias
- Experimentation
- Leakage: retraining and features
- Speed of experiment: interleaving
- Serving
Impact
- Improvements of each step: refer to plot
TODO & Questions & Further Reading
- understand each model family