Get started with Generative AI - Azure API Management with Generative AI

Diving into using APIM with generative AI models. 🔎 Looking for content on a particular topic? Search the channel. If I have something it will be there! 🤔 Due to the channel growth and number of people wanting help I no longer can answer or even read questions and they will just stay in the moderation queue never to be seen so please post questions to other sites like Reddit, Microsoft Community Hub etc. ▬▬▬▬▬▬ C H A P T E R S ⏰ ▬▬▬▬▬▬ 00:00 - Introduction 00:27 - Adding APIM into the mix 03:16 - LLM supported 05:24 - Authentication to the LLM 06:21 - Adding LLM to APIM 06:47 - Azure Portal onboarding experience 08:30 - Some key GenAI capabilities in APIM 08:46 - Token limits 12:37 - Emit token metrics 14:20 - Load balancing and switching between instances 21:25 - Logging prompts 23:17 - Semantic caching 25:31 - Requirements 27:40 - How it works 29:58 - Demo 35:01 - Chaining? 35:38 - Great example scenario repo 36:48 - Summary 38:57 - Close ▬▬▬▬▬▬ K E Y L I N K S 🔗 ▬▬▬▬▬▬ ► Whiteboard: 🔗 https://github.com/johnthebrit/RandomStuff/raw/master/Whiteboards/APIMandGenAI.png ► Git Repo of APIM and GenAI scenarios: 🔗 https://github.com/Azure-Samples/AI-Gateway/tree/main ► Token limit policy: 🔗 https://learn.microsoft.com/azure/api-management/azure-openai-token-limit-policy ► Emit metrics policy: 🔗 https://learn.microsoft.com/azure/api-management/azure-openai-emit-token-metric-policy ▬▬▬▬▬▬ Want to learn more? 🚀 ▬▬▬▬▬▬ 📖 Recommended Learning Path for Azure 🔗 https://learn.onboardtoazure.com 🥇 Certification Content Repository 🔗 https://github.com/johnthebrit/CertificationMaterials 📅 Weekly Azure Update 🔗 https://youtube.com/playlist?list=PLlVtbbG169nEv7jSfOVmQGRp9wAoAM0Ks ☁ Azure Master Class 🔗 https://youtube.com/playlist?list=PLlVtbbG169nGccbp8VSpAozu3w9xSQJoY ⚙ DevOps Master Class 🔗 https://youtube.com/playlist?list=PLlVtbbG169nFr8RzQ4GIxUEznpNR53ERq 💻 PowerShell Master Class 🔗 https://youtube.com/playlist?list=PLlVtbbG169nFq_hR7FcMYg32xsSAObuq8 🎓 Certification Cram Videos 🔗 https://youtube.com/playlist?list=PLlVtbbG169nHz2qfLvPsAz9CnnXofhmcA 🧠 Mentoring Content 🔗 https://youtube.com/playlist?list=PLlVtbbG169nGHxNkSWB0PjzZHwZ0BkXZZ ❔ Questions? Maybe I answered it in my FAQ 🔗 https://savilltech.com/faq 👕 Cure Childhood Cancer Charity T-Shirt Channel Store 🔗 https://johns-t-shirts-store.creator-spring.com/ 👂 Enable the subtitles and from there you can translate to your native language via the auto-translate feature in settings! https://youtu.be/v5b53-PgEmI for a demo of using this feature. SUBSCRIBE ✅ https://www.youtube.com/channel/UCpIn7ox7j7bH_OFj7tYouOQ?sub_confirmation=1 #Azure #Cloud #johnsavillstechnicaltraining