AIHacker Noonabout 3 hours ago
On-Device LLM Ignored Search Tool, Fabricated Data
15 min read
An iOS developer shipped an on-device LanguageModelSession with Apple's SpotlightSearchTool for snippet search. The model ignored the tool and invented data instead. The feature compiles and runs on device with no embeddings, vector store, or server.
Level
Hype check
Tap to vote and see what everyone thinks.
Summary by ByteBrief
