What are the pros and cons of online vs offline AI evaluations?

In the realm of AI development, evaluations can be conducted online or offline, each with its own advantages and disadvantages. Online evaluations allow for real-time feedback and can be more scalable, while offline evaluations provide a controlled environment that can lead to more accurate results. What experiences have you had with either method? Which do you prefer and why?