Data Neighbor Newsletter

Data Neighbor Newsletter

Home
Podcast
Chat
Newsletter
Archive
About

Building AI That Actually Works

What Salesforce's Research Leader Taught Us About Enterprise Agents
READ THE LATEST
AI evals are becoming a product capability, not a model debugging task
As AI features scale, the hard part stops being “can we score outputs” and becomes “can the whole team use evaluation to make better product decisions.”
 • Shane Butler
AI Evaluation's Missing Layer
A lot of what gets called “AI evaluation” right now looks like debugging.
 • Shane Butler
The Fastest Way to Lose Customers With AI
Is Your Team Ready to Scale AI? A Quick Diagnostic for AI Evaluation
 • Shane Butler
Users Lie (But Turkey Sandwiches Don't)
Or the importance of testing feedback informed hypotheses with actual behavioral data
 • Shane Butler
Redesigning Metrics for AI Products
AI demands a new set of metrics. It requires evolving unreliable deterministic metrics to a systematic analytics process that rigorously ties…
 • Shane Butler
Rough Thoughts on What an AI Evaluation Lifecycle Might Look Like
I’ve spent the last 10 years in data science and the past year almost exclusively focused on AI evaluation.
 • Shane Butler
If you don’t know where to begin with AI evaluation, start here.
Five simple steps anyone can use to get initial signal on quality.
 • Shane Butler
Data Neighbor Newsletter
Data Neighbor Newsletter
We reveal the secrets to a thriving data career, providing insights, emerging trends, and an insider's view of how data and AI transform our profession
Recommendations
User's avatar
The Data Hustle
Sai Kumar Bysani
Tech For Product
Tech For Product
Colin Matthews
Exploring Language Models
Exploring Language Models
Maarten Grootendorst

Data Neighbor Newsletter

AboutArchiveRecommendationsSitemap
© 2026 Data Neighbor · Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture