On-device inference
Running a model on the phone or the edge instead of a server round trip: classify a signal, detect an event, or read a barcode locally, with low latency and no dependence on a live connection.
- What it changes
- A feature that had to wait on the network now responds instantly and keeps working offline, which matters when the device is in a basement, a field, or a moving vehicle.
- How it is built
- A compact model packaged to run on-device, with a server fallback for the heavier cases, so the common path is instant and the rare path is still handled.