Idea: What if Lumo used on-device processing for heavy lifting?
Here's a thought: what if Lumo tapped into Apple's on-device intelligence (Neural Engine on iPhones/MacBooks) to pre-process large files before sending them to the cloud?
Right now, if you upload a big reference book — say, 12 MB — Lumo simply truncates it to 128K tokens. You lose most of the content before analysis even begins. That's frustrating.
A hybrid approach could fix this: the device handles the first pass (chunking, summarizing, extracting key sections), then ships the compressed result to Lumo's servers for the deep work. Less server load, faster responses, and no more throwing away half your document.
Yes, it'd need bigger token limits on the server side and some clever work to keep everything encrypted end-to-end — but the payoff is real. This kind of edge-cloud split is already gaining traction in the industry, and it feels like a natural.
Something to think about.