Retrieval Is Filtering, Not Search: A Mental Model for Enterprise RAG
Enterprise Document Intelligence [Vol.1 #7A] - Stop searching strings. Filter line_df and toc_df. Pick anchors small, expand context large
The post Retrieval Is Filtering, Not Search: A Mental Model for Enterprise RAG appeared first on Towards Data Science.
For years, AI progress has centered on scaling individual foundation models: larger parameters, longer context windows, stronger reasoning, and better tool use. Sakana AI’s Fugu points elsewhere, behaving like one model from the outside while coordinating multiple expert agents internally. A single ...
Clustering Unstructured Text with LLM Embeddings and HDBSCAN
The current era of Generative AI seems to primarily focus on chat interfaces and prompts, but the range of applications of large language models , or LLMs for short, is not limited to just that.
5 Essential Approaches to Robust Outlier Detection
Outliers can easily ruin the performance of any predictive analysis models you build: robustly detecting and handling them is crucial in any data project. This article lists and compares five essential approaches for detecting them.
Build Your Own Local AI Coding Agent with Gemma 4 and OpenCode
From installing Ollama to launching OpenCode with a local model, step by step.
The post Build Your Own Local AI Coding Agent with Gemma 4 and OpenCode appeared first on Towards Data Science.
Agentic AI is not failing because the technology is bad. It is failing because of five specific misconceptions that teams carry into their first deployments and each one is correctable.
3 NLTK Tricks for Advanced Text Preprocessing & Linguistic Analysis
In this article, we will walk through three essential NLTK tricks to elevate your text preprocessing: preserving phrase integrity with the MWETokenizer, context-aware lemmatization with POS mapping, and statistical collocation extraction using association measures.
Neural Networks, Explained for Beginners: Start Here If They’ve Confused You
The intuition behind neural networks and why they need activation functions.
The post Neural Networks, Explained for Beginners: Start Here If They’ve Confused You appeared first on Towards Data Science.
Claude’s Hidden Art Skill: Making Illustrations With Code
Everyone says Claude can’t make pictures. That’s partly true. Here is the kind of art it makes on its own, with no plugins and no connectors: Drawn by Claude in SVG, no image model anywhere near it. Not pixels but code: shapes and coordinates that stay sharp at any size and redraw themselves when yo...
Tool Calling, Explained: How AI Agents Decide What to Do Next
Understanding ow LLMs interact with the world around them, from returning data to taking action
The post Tool Calling, Explained: How AI Agents Decide What to Do Next appeared first on Towards Data Science.
What Are the Possibilities to Build Date Tables in Self-Service Environments?
For years, I created date tables with DAX code whenever I didn’t have a way to create them upstream of the data flow. Now I've realised there's another way to do it. Let’s see what the alternatives are and how they compare.
The post What Are the Possibilities to Build Date Tables in Self-Service Env...
7 Crucial Barriers Between Data Teams and Self-Healing Data Architecture
What data teams need to build with AI to make self-healing data architecture a practical reality
The post 7 Crucial Barriers Between Data Teams and Self-Healing Data Architecture appeared first on Towards Data Science.
Parse Scanned PDFs for RAG with EasyOCR: Free OCR Gives You Words, Not a Document
Enterprise Document Intelligence [Vol.1 #5quinquies] - Same 1974 scanned PDF, two engines. EasyOCR recovers text. Docling recovers text + sections + figures. The structural gap makes one output usable downstream and the other one a flat string.
The post Parse Scanned PDFs for RAG with EasyOCR: Free ...
GPU-Resident Top-K for Agentic RAG: I Built a CUDA Kernel So My Retrieval Step Would Stop Bouncing Off the GPU
The PCIe transfer latency is silently bottlenecking your agentic inference. Here is how building a custom device-resident vector search kernel bypasses the CPU to unlock deterministic microsecond tail latencies.
The post GPU-Resident Top-K for Agentic RAG: I Built a CUDA Kernel So My Retrieval Step ...
Structured Outputs with LLMs: JSON Mode, Function Calling, and When to Use Each
Getting reliable, readable responses out of your LLM, and knowing which tool to reach for
The post Structured Outputs with LLMs: JSON Mode, Function Calling, and When to Use Each appeared first on Towards Data Science.
For decades, the existence of the hydrophobic core, a region in the 3D structure of proteins where hydrophobic amino acids reside together, has been considered a general property in proteins. What we have found now may extend that model. In particular, the rest of amino acids also seem to cluster to...
Most People Use ChatGPT Wrong: 10 Features and Tips That Changed How I Work
Most people used ChatGPT like a smarter search engine. Ask a question, get an answer, and move on. It works but it leaves a surprising amount of value on the table. Over the past few years, ChatGPT has evolved far beyond a simple chatbot. It can browse the web, analyze files, generate images, mainta...
Dispatching the Parsed RAG Question: Chunk Strategy, Model Tier, Activations, Audit
Enterprise Document Intelligence [Vol.1 #6c] - The decisions the parser makes on top of the user string, using the document’s profile: dispatch, activations, full schema, three approaches to deciding what fires, the audit _meta block, and a broker-corpus walkthrough
The post Dispatching the Parsed R...
The Power and Pitfalls of Vector-Based Image Search
A hands-on guide to setting up image similarity search in Milvus, and why visual replication isn't always enough.
The post The Power and Pitfalls of Vector-Based Image Search appeared first on Towards Data Science.
The Secret to Reproducible and Portable Optimization: ORPilot’s Intermediate Representation (IR)
Why production-level AI optimization modeling agent needs reproducibility and portability, and how IR helps achieve them
The post The Secret to Reproducible and Portable Optimization: ORPilot’s Intermediate Representation (IR) appeared first on Towards Data Science.