InfoQ Homepage InfoQ Dev Summit Munich 2024 Content on InfoQ
Presentations
RSS Feed-
Leveraging Open-source LLMs for Production
Andrey Cheptsov discusses the practical use of open-source LLMs for real-world applications, weighing their pros and cons, highlighting advantages like privacy and cost-efficiency.
-
Taking LLMs out of the Black Box: A Practical Guide to Human-in-the-Loop Distillation
Ines Montani discusses practical solutions for using the latest LLMs in real-world applications and explores how to distill knowledge into smaller and faster components.
-
Launching AI Agents across Europe at Breakneck Speed with an Agent Computing Platform
Arun Joseph, Patrick Whelan discuss patterns for productionizing LLM powered applications, AI agents development lifecycle, toolkits, components and building blocks of an AI Agents computing platform.
-
Manipulating the Machine: Prompt Injections and Countermeasures
Georg Dresler discusses various methods to perform prompt injection to extract system prompts and documents used by GPTs, and ways to integrate countermeasures to protect against stealing information.
-
1BRC–Nerd Sniping the Java Community
Gunnar Morling discusses some of the tricks employed by the fastest solutions for processing a 13 GB input file within less than two seconds through parallelization and efficient memory access.