Managing an artificial intelligence service with hundreds of thousands of daily requests is not an easy task. It is necessary to carry out a good design that makes it possible to handle changes without loss of service, have service health status information in real time, automatic alarm management, evaluate new versions of artifacts with real load, manage abuses, autorecovery. In this session, we will deepdive into the kubernetes and istio service mesh ecosystem talking about the decisions made for Itzuli language tools project:
https://www.euskadi.eus/itzuli
