Monitoring your Azure OpenAI usage (part 2)


In this article, the author discusses the importance of monitoring Azure OpenAI usage and provides a tool for monitoring Azure OpenAI. Microsoft has released a template for an Azure Workbook that can be installed in your subscription to monitor Azure OpenAI. The workbook provides an overview of your Azure OpenAI resource, metrics for HTTP requests, token-based usage, PTU utilization, and fine-tuning. It also includes insights from logs and allows you to monitor usage patterns and traffic origins. The author emphasizes the need for monitoring Azure OpenAI services to control resource allocation, track service consumption for accurate billing, and set up usage limits.


Article 15m

Login now to access my digest by 365.Training

Learn how my digest works
Features
  • Articles, blogs, podcasts, training, and videos
  • Quick read TL;DRs for each item
  • Advanced filtering to prioritize what you care about
  • Quick views to isolate what you are looking for right now
  • Save your favorite items
  • Share your favorites
  • Snooze items you want to revisit when you have more time