Core concepts
Compatibility and limits
Support is discovered at runtime and varies by transport, OS, phone agent, permissions and current state.
Driver matrix
| Capability | Relay | ADB bridge | WDA bridge |
|---|---|---|---|
| Screenshot | JPEG stream required | PNG | PNG |
| Inspect | Native bridge required | XML + pixels | Tree + logical points |
| Apps | Agent-defined; older agents may reject | Package list | Not implemented |
| Clipboard read | Not implemented | Not implemented | Plain text |
| Text | Agent-defined | ASCII; literal %s rejected | WDA text input |
| Native extensions | Private bridge required | Bridge-defined | Bridge-defined |
Check device readiness
- List the device and read its current capabilities. A fresh native bridge registration can add commands for only 15 seconds without renewal.
- Acquire a session and request a screenshot. Confirm the image is fresh, correctly oriented and shows the expected app state.
- If the task depends on accessibility nodes, run inspect through a supported native bridge and check that the required controls are exposed.
- Test the specific command and parameters your workflow needs, then observe the result. App permissions and OS state can change what succeeds.
- Before scheduling, keep the worker running under the same parent key and verify that it can claim a disposable observation task.
See native bridge setup and error recovery when a check fails.
Limits
- Capabilities describe current routes, not universal behavior across apps and permission states.
- Wake does not bypass a lock screen, consent prompt or secure input.
- Black or stale frames do not prove capture works.
- External ADB/WDA clients and people can still change the phone during a session.
- FleetDeck hosts coordination, not the model process. Scheduled work needs an always-on worker.
Media validation
Base64 must be complete and padded with no data URL prefix. Chunk indexes must stay below chunkCount; chunkCount cannot exceed totalBytes; decoded payload bytes cannot exceed totalBytes; a single chunk must decode to exactly totalBytes. These cross-field rules return VALIDATION and may not be fully visible in generated OpenAPI schema.
