There is no free benchmark: An institutional view of legal AI benchmarking.

July 28, 2026| Source: Proceedings of the National Academy of Sciences of the United States of America

Despite substantial excitement around the use of AI in law, little information exists on the performance and associated risks of the domain's widely marketed tools. Recent work, for instance, has demonstrated the significant potential for "hallucinations"-wherein models make up facts, law, and precedent-leading Chief Justice Roberts to spotlight this risk in his annual report on the judiciary. We argue that there is a need for public AI benchmarking in law. First, relative to other AI application domains, the legal AI ecosystem lacks legibility-there is little information about the design and performance of many commercial legal AI systems. Legal AI has not benefited from the types of benchmarking that have catalyzed, measured, and informed AI innovation and responsible use in other domains. Second, we articulate the challenges of the institutional design of benchmarking. We illustrate how benchmarks can be captured, watered down, and abused. Careful institutional design around the why, who, what, and how of benchmarking will be critical to navigate difficult tradeoffs of transparency, objectivity, expertise, and resources. Third, addressing legal AI's illegibility requires matching institutional models to available resources and constraints. Rather than advocating for a single "best" approach to benchmarking, we show how benchmarking strategies depend on available resources.

Read the original source →

Extensive glacier loss in the coterminous United States.

Glaciers populate the mountain ranges of the western conterminous United States and despite their importance to alpine hydrology, their area and volume change have never been comprehensively evaluated. Our study shows that since the mid-twentieth century about one-quarter of the glaciers have disappeared and the overall area and volume are reduced by one-third. The pattern of glacier shrinkage suggests most glaciers in the conterminous United States are largely maintained by local topographic in

Physical/TechOctober 20, 2026

Reaction-based cryo-EM resolves the continuous conformational spectrum of CTP synthase catalysis.

Capturing enzymes under native turnover conditions remains a grand challenge in structural biology. Here, we develop a reaction-based cryo-electron microscopy (cryo-EM) strategy that directly samples Drosophila melanogaster cytidine triphosphate synthase (CTPS) from actively catalyzing mixtures containing only natural substrates and allosteric effectors. By integrating reaction-based sampling with three-dimensional variability analysis, we resolve a continuous conformational spectrum of CTPS dur

Physical/TechOctober 20, 2026

GTP orchestrates CTP synthase via an allosteric effector-cycling mechanism.

Cytidine triphosphate (CTP), a fundamental building block of RNA, plays vital roles in diverse biological processes. CTP synthase (CTPS) is the only known enzyme for de novo synthesis of CTP. Efficient CTPS catalysis requires guanosine triphosphate (GTP) in a dose-dependent, nonconsumptive manner; however, the precise mechanism by which GTP drives CTP formation remains unclear. Here, we integrate a series of cryo-EM structures of Drosophila melanogaster CTPS captured from actively catalyzing sam

Physical/TechOctober 20, 2026

Antiferromagnetism and tightly bound Cooper pairs induced by kinetic frustration.

Antiferromagnetism and superconductivity are often viewed as competing orders in correlated electron systems. Here, we demonstrate that kinetic frustration in hole motion facilitates their coexistence within the square-lattice repulsive Hubbard model. Combining exact analytical solutions on tailored geometries with large-scale numerical simulations, we reveal a robust pairing mechanism: Holes on opposite sublattices behave as if they carry opposite effective charges due to spin singlet formation

Physical/TechOctober 20, 2026

Coordinated transformations of the labyrinth and occiput during the dinosaur-bird transition.

Evolutionary shape changes of the vertebrate semicircular canals (SCCs) are often ascribed to evolutionary transitions in locomotion, including the origin of flight during the dinosaur-bird transition. However, the potential for transformations of braincase architecture to influence SCC shape independent of sensory-functional adaptation has generally been overlooked. We evaluate the influence of both factors using a large dataset of 146 living and recently extinct crown birds, including taxa rep