InfoQ Homepage Large language models Content on InfoQ
-
Navigating LLM Deployment: Tips, Tricks, and Techniques
Meryem Arik shares best practices for self-hosting LLMs in corporate environments, highlighting the importance of cost efficiency and performance optimization.
/presentations/model-optimization/en/mediumimage/meryem-arik-medium-1741703788166.jpeg)
-
How GitHub Copilot Serves 400 Million Completion Requests a Day
David Cheney explains the architecture powering GitHub Copilot, detailing how they achieve sub-200ms response times for millions of daily requests.
/presentations/github-copilot/en/mediumimage/davidcheney-medium-1741334769344.jpeg)
-
Leveraging Open-source LLMs for Production
Andrey Cheptsov discusses the practical use of open-source LLMs for real-world applications, weighing their pros and cons, highlighting advantages like privacy and cost-efficiency.
/presentations/open-source-llm/en/mediumimage/Andrey-Cheptsov-medium-1737105576530.jpg)
-
Taking LLMs out of the Black Box: A Practical Guide to Human-in-the-Loop Distillation
Ines Montani discusses practical solutions for using the latest LLMs in real-world applications and explores how to distill knowledge into smaller and faster components.
/presentations/llm-disttilation/en/mediumimage/Ines-Montani-medium-1737104567445.jpg)
-
Navigating LLM Deployment: Tips, Tricks, and Techniques
Meryem Arik discusses some of the best practices in model optimization, serving and monitoring - with practical tips and real case-studies.
/presentations/llm-deployment/en/mediumimage/Meryem-Arik-medium-1728647474023.jpeg)
-
Manipulating the Machine: Prompt Injections and Countermeasures
Georg Dresler discusses various methods to perform prompt injection to extract system prompts and documents used by GPTs, and ways to integrate countermeasures to protect against stealing information.
/presentations/prompt-injection-chatgpt/en/mediumimage/GeorgDresler-medium-1729844770207.jpg)
-
Poetry4Shellz – Avoiding Limerick Based Exploitation and Safely Using AI in Your Apps
Rich Smith provides a case study of a real world LLM based app that is vulnerable to a variety of attack vectors that illustrate the challenges to account for when integrating today's LLM technologies
/presentations/poetry4shellz/en/mediumimage/Rich-Smith-Medium-1725609475115.jpg)
-
Mind Your Language Models: an Approach to Architecting Intelligent Systems
Nischal HP discusses the intricacies of designing and implementing intelligent systems powered by LLMs, drawing upon practical insights gained from real-world deployments.
/presentations/architecture-llm/en/mediumimage/NischalHP-medium-1724394495924.jpg)
-
Generative Search: Practical Advice for Retrieval Augmented Generation (RAG)
Sam Partee discusses Vector embeddings in LLMs, a tool capable of capturing the essence of unstructured data used by LLMs to gain access to a wealth of contextually relevant knowledge.
/presentations/vector-embedding-llm/en/mediumimage/SamPartee-medium-1718796896899.jpg)
-
Defensible Moats: Unlocking Enterprise Value with Large Language Models
Nischal HP discusses risk mitigation, environmental, social, and governance (ESG) framework implementation to achieve sustainability goals, strategic procurement, spend analytics, data compliance.
/presentations/risk-mitigation-llm/en/mediumimage/NischalHP-medium-1718109596117.jpg)
-
When AIOps Meets MLOps: What it Takes to Deploy ML Models at Scale
Ghida Ibrahim introduces the concept of AIOps referring to using AI and data-driven tooling to provision, manage and scale distributed IT infra.
/presentations/aiops-mlops/en/mediumimage/GhidaIbrahim-medium-1718631160878.jpg)
-
Reach Next-Level Autonomy with LLM-Based AI Agents
Tingyi Li discusses the AI Agent, exploring how it extends the frontiers of Generative AI applications and leads to next-level autonomy in combination with enterprise data.
/presentations/ai-agent-llm/en/mediumimage/TingyiLi-medium-1717748092234.jpeg)