3 Takeaways From Building AI Agents in Freight Tech
I spent 2 years building AI agents at a freight tech startup. Production agents, real workflows, millions of conversations. Here's what stuck.
Not an AI.
👋 there! My name’s Daniel.
I’m a data scientist building AI products. I get excited about technology that transforms how work gets done.
To get in touch, drop me a line at dryanfurman@gmail.com.
scroll
Marin Headlands (Oct 2025)
Palace of Fine Arts (Oct 2025)
Golden Gate (Jan 2025)
Ocean Beach (Feb 2022)
Chestnut Street (Feb 2025)
Marin Headlands (Jul 2025)
Tank Hill (Jun 2020)
Big Sur (Dec 2016)
Outskirts of Seattle (Mar 2025)
Marina District (May 2025)
Mallorca Cap de Formentor (Jul 2025)
Mendocino (Apr 2025)
Marin Headlands (Oct 2025)
Palace of Fine Arts (Oct 2025)
Golden Gate (Jan 2025)
Ocean Beach (Feb 2022)
Chestnut Street (Feb 2025)
Marin Headlands (Jul 2025)
Tank Hill (Jun 2020)
Big Sur (Dec 2016)
Outskirts of Seattle (Mar 2025)
Marina District (May 2025)
Mallorca Cap de Formentor (Jul 2025)
Mendocino (Apr 2025)
Marin Headlands (Oct 2025)
Palace of Fine Arts (Oct 2025)
Golden Gate (Jan 2025)
Ocean Beach (Feb 2022)
Chestnut Street (Feb 2025)
Marin Headlands (Jul 2025)
Tank Hill (Jun 2020)
Big Sur (Dec 2016)
Outskirts of Seattle (Mar 2025)
Marina District (May 2025)
Mallorca Cap de Formentor (Jul 2025)
Mendocino (Apr 2025)
Evaluating LLMs with Chat Templates
LLMs are typically finetuned on chat-templated datasets, which convert conversations into strings ready for text generation. Matching this format is standard at prediction time, as deviations are often noted to hurt performance. Here, we test this theory using an instruction-following benchmark and the best open-source LLMs available at this time.
Work
- Company
- Replit
- Role
- Senior Data Scientist, AI Agent
- Date
- Company
- Parade.ai
- Role
- Lead AI Product Engineer
- Date
- Company
- West Monroe Partners
- Role
- Senior Data Scientist
- Date
- Company
- Understory.ai
- Role
- ML Engineer
- Date
Education
- Institution
- University of California, Berkeley
- Degree
- Master of Science in Applied Data Science
- Institution
- University of Pennsylvania
- Degree
- Bachelor of Arts in Earth Science