InfoQ Homepage Large language models Content on InfoQ
-
How Green is Green: LLMs to Understand Climate Disclosure at Scale
Leo Browning explains the journey of developing a Retrieval Augmented Generation (RAG) system at a climate-focused startup.
/presentations/rag-llm/en/mediumimage/leo-browning-medium-1741333444936.jpeg)
-
LLM and Generative AI for Sensitive Data - Navigating Security, Responsibility, and Pitfalls in Highly Regulated Industries
Stefania Chaplin and Azhir Mahmood discuss responsible, secure, and explainable AI in regulated industries. Learn MLOps, legislation, and future trends.
/presentations/llm-ml-security/en/mediumimage/azhir-stefania-medium-1741181597784.jpg)
-
Unleashing Llama's Potential: CPU-Based Fine-Tuning
Anil Rajput and Rema Hariharan detail CPU-based LLM (Llama) optimization strategies for performance and TCO reduction.
/presentations/llama2/en/mediumimage/anil-rajput-rema-hariharan-medium-1743448668469.jpg)
-
Navigating LLM Deployment: Tips, Tricks, and Techniques
Meryem Arik shares best practices for self-hosting LLMs in corporate environments, highlighting the importance of cost efficiency and performance optimization.
/presentations/model-optimization/en/mediumimage/meryem-arik-medium-1741703788166.jpeg)
-
How GitHub Copilot Serves 400 Million Completion Requests a Day
David Cheney explains the architecture powering GitHub Copilot, detailing how they achieve sub-200ms response times for millions of daily requests.
/presentations/github-copilot/en/mediumimage/davidcheney-medium-1741334769344.jpeg)
-
Leveraging Open-source LLMs for Production
Andrey Cheptsov discusses the practical use of open-source LLMs for real-world applications, weighing their pros and cons, highlighting advantages like privacy and cost-efficiency.
/presentations/open-source-llm/en/mediumimage/Andrey-Cheptsov-medium-1737105576530.jpg)
-
Taking LLMs out of the Black Box: A Practical Guide to Human-in-the-Loop Distillation
Ines Montani discusses practical solutions for using the latest LLMs in real-world applications and explores how to distill knowledge into smaller and faster components.
/presentations/llm-disttilation/en/mediumimage/Ines-Montani-medium-1737104567445.jpg)
-
Navigating LLM Deployment: Tips, Tricks, and Techniques
Meryem Arik discusses some of the best practices in model optimization, serving and monitoring - with practical tips and real case-studies.
/presentations/llm-deployment/en/mediumimage/Meryem-Arik-medium-1728647474023.jpeg)
-
Manipulating the Machine: Prompt Injections and Countermeasures
Georg Dresler discusses various methods to perform prompt injection to extract system prompts and documents used by GPTs, and ways to integrate countermeasures to protect against stealing information.
/presentations/prompt-injection-chatgpt/en/mediumimage/GeorgDresler-medium-1729844770207.jpg)
-
Poetry4Shellz – Avoiding Limerick Based Exploitation and Safely Using AI in Your Apps
Rich Smith provides a case study of a real world LLM based app that is vulnerable to a variety of attack vectors that illustrate the challenges to account for when integrating today's LLM technologies
/presentations/poetry4shellz/en/mediumimage/Rich-Smith-Medium-1725609475115.jpg)
-
Mind Your Language Models: an Approach to Architecting Intelligent Systems
Nischal HP discusses the intricacies of designing and implementing intelligent systems powered by LLMs, drawing upon practical insights gained from real-world deployments.
/presentations/architecture-llm/en/mediumimage/NischalHP-medium-1724394495924.jpg)
-
Generative Search: Practical Advice for Retrieval Augmented Generation (RAG)
Sam Partee discusses Vector embeddings in LLMs, a tool capable of capturing the essence of unstructured data used by LLMs to gain access to a wealth of contextually relevant knowledge.
/presentations/vector-embedding-llm/en/mediumimage/SamPartee-medium-1718796896899.jpg)