Skip to main content
Artificial Intelligence

PalmClaw: A Native On-Device Agent Framework for Mobile Phones

| Source: arXiv

Preprint — not peer-reviewed. Large Language Model (LLM) agents have moved beyond generating responses to executing multi-step tasks by calling tools, observing the results, and iteratively deciding the next action. Most agent systems run on desktops or servers, which support tool use and task automation. Mobile devices are also important agent environments because they are widely accessible and contain users' data, sensors, and daily-use applications. Existing mobile agents mainly operate smartphones through graphical user

Large Language Model (LLM) agents have moved beyond generating responses to executing multi-step tasks by calling tools, observing the results, and iteratively deciding the next action. Most agent systems run on desktops or servers, which support tool use and task automation. Mobile devices are also important agent environments because they are widely accessible and contain users' data, sensors, and daily-use applications. Existing mobile agents mainly operate smartphones through graphical user interface (GUI) actions such as tapping, swiping, and typing, which often form long, interface-dependent sequences, cannot directly access device capabilities, and make execution boundaries difficult to define. We present \textbf{PalmClaw}, an open-source agent framework that runs natively on mobile phones and manages the sessions, memory, skills, tools, and agent loop directly on the device. PalmClaw exposes device capabilities as device tools with explicit arguments, structured results, and clearly defined execution boundaries. This design enables agents to use mobile capabilities directly while keeping each action explicit and controlled. Experiments show an 11.5\% relative improvement in task success and a 94.9\% reduction in completion time over the strongest baseline, with lower setup burden and traces illustrating how execution boundaries are applied. Code is available at https://github.com/ModalityDance/PalmClaw.

Read the original source →

Related Stories

Artificial Intelligence

PLK1-mediated phosphorylation of PHGDH reprograms serine metabolism in advanced prostate cancer.

Metabolic reprogramming is a hallmark of cancer, enabling tumor cells to meet their increased biosynthetic and energetic demands. Although cells possess the capacity for de novo serine biosynthesis, most transformed cancer cells preferentially rely on exogenous serine uptake to sustain their growth, yet the regulatory mechanisms driving this metabolic dependency remain poorly understood. Here, we uncover a mechanism by which Polo-like kinase 1 (PLK1), frequently overexpressed in prostate cancer,

Continue reading
Artificial Intelligence

When coordination is avoidable: A monotonicity analysis of organizational tasks.

Organizations devote substantial resources to coordination, yet which tasks actually require it for correctness remains unclear. The problem is acute in multiagent AI systems, where coordination cost is directly measurable and can exceed the cost of the work itself. Distributed systems theory provides a precise criterion: Coordination is required when a task specification is nonmonotonic, meaning that as histories grow, new information can invalidate prior conclusions. Here we show that Thompson

Continue reading
Artificial Intelligence

Dapagliflozin and Acute Kidney Injury Following Cardiac Surgery: A Randomized Clinical Trial.

Two percent to 50% of patients undergoing elective cardiac surgery experience acute kidney injury (AKI) postoperatively. Medications to prevent AKI after elective cardiac surgery have not been identified. In patients undergoing elective cardiac surgery, to evaluate whether initiating dapagliflozin 1 day prior to surgery reduces the incidence of AKI at 7 days after cardiac surgery, compared with placebo. Multicenter, double-blind, placebo-controlled randomized clinical trial conducted at 2 academ

Continue reading
Artificial Intelligence

Context-aware multimodal AI navigates hidden pathways in five centuries of art evolution.

The rise of multimodal generative AI transforms the intersection of technology and art, offering richer insights into large-scale artworks. While significant research has focused on their creative potential, their ability to represent artworks in latent spaces remains underexamined. We use generative AI, specifically Stable Diffusion, to analyze 500 y of Western paintings by extracting two types of latent information with the model: formal aspects (e.g., colors) and contextual aspects (e.g., sub

Continue reading
Artificial Intelligence

Advancing cancer detection and treatment using longitudinal routine clinical data.

Cancer management remains fragmented across its continuum, from late-stage diagnosis and salvage therapies to non-personalized surveillance. Here, we present Oncoformer, a unified multimodal transformer model trained on the China Oncology Multimodal Prediction and Surveillance Study (COMPASS) cohort (3.67 million individuals, 17.7 million clinical visits) and validated on independent external cohorts, including the UK Biobank. Oncoformer integrates longitudinal electronic health records with che

Continue reading