The testing of Microsoft Translator (MT) service can be divided into two broad areas
1) Testing of the machine learning system that returns the translation answer
2) the web service that serves translate requests running on the Microsoft cloud.
The MT service offers translation in 36 different languages for users across the globe through UI and API. Testing the MT cloud service without user data would be like shooting in the dark. From a product standpoint, we need to answer questions like How do we prioritize languages for improvement? How do we divide resources in our data center for effective capacity distribution for the languages? From a test perspective we need to understand how the system is being used so that we can ensure that any new bits deployed will hold-up in production.
[youtube Q2fUFSdUq20]
Video Producer: Google Test Automation Conference