Skip to main content
Artificial Intelligence

Context-aware multimodal AI navigates hidden pathways in five centuries of art evolution.

| Source: Proceedings of the National Academy of Sciences of the United States of America

The rise of multimodal generative AI transforms the intersection of technology and art, offering richer insights into large-scale artworks. While significant research has focused on their creative potential, their ability to represent artworks in latent spaces remains underexamined. We use generative AI, specifically Stable Diffusion, to analyze 500 y of Western paintings by extracting two types of latent information with the model: formal aspects (e.g., colors) and contextual aspects (e.g., sub

The rise of multimodal generative AI transforms the intersection of technology and art, offering richer insights into large-scale artworks. While significant research has focused on their creative potential, their ability to represent artworks in latent spaces remains underexamined. We use generative AI, specifically Stable Diffusion, to analyze 500 y of Western paintings by extracting two types of latent information with the model: formal aspects (e.g., colors) and contextual aspects (e.g., subjects). Our findings reveal that contextual information exhibits stronger vector alignment and orientation with conventional artistic periods, styles, and individual artists than formal elements. Also, we show how artistic expression aligns with historical shifts using contextual keywords extracted from paintings. Our generative experiment, infusing prospective contexts into historical artworks, validates this vector alignment and orientation by synthesizing artworks consistent with the stylistic patterns of target periods. This study demonstrates how multimodal AI expands traditional formal analysis by integrating temporal, cultural, and historical contexts to quantify the latent structure of cultural knowledge.

Read the original source →

Related Stories

Artificial Intelligence

Integrating cooperative breeding with reciprocity and culture extends Hamilton's rule to humans.

We study how kinship and reciprocity shape giving and child care support in societies with limited access to markets. Extending Hamilton's rule to incorporate reciprocity, we test it using behavioral data from dictator games and surveys in remote matrilocal and patrilocal villages of northeast India (N = 406 parents of young children). We replicate with data from urban Manila neighborhoods (N = 301) and the Solomon Islands (N = 624). Consistent with predictions, transfers to recipients increase

Continue reading
Artificial Intelligence

Multi-omics atlas of chronic exercise.

Exercise reduces all-cause mortality, yet its molecular effects across organs, sexes, and circadian phases remain incompletely understood. We subjected mice to 8 weeks of voluntary wheel running and collected 22 tissues and plasma during active and inactive phases for bulk RNA sequencing, metabolomics, proteomics, and single-nucleus RNA and methylation sequencing. Exercise induced canonical fiber-type switching and widespread, tissue-specific remodeling, with the largest transcriptomic changes i

Continue reading
Artificial Intelligence

A microexon regulatory code reveals autism-linked genetic variation.

Neuronal microexons are a highly conserved class of alternative splicing events enriched in genes with critical functions in nervous system biology 1,2 . Microexon splicing is often disrupted in the brains of autistic individuals, and mice with microexon deficiencies display autism-like phenotypes 1,3,4 . However, the full landscape of microexons is not known, and the impact of genetic variation on these exons has not been systematically investigated. Here, through extensive transcriptome profil

Continue reading
Artificial Intelligence

Deep learning of fossil pollen morphology reveals 25,000 y of ecological change in eastern African grasslands.

Grass (Poaceae) pollen is largely overlooked in investigations of grassland evolution because the pollen of most species cannot be differentiated using traditional optical microscopy. However, the combination of superresolution microscopy and deep learning enables the capture and quantification of distinct morphological variation across the pollen of grass species. Using a semisupervised deep-learning strategy, we trained convolutional neural networks (CNNs) on superresolution images of known mo

Continue reading
Artificial Intelligence

Tyrosine phosphorylation unfolds nucleophosmin and disrupts its integration into the nucleolus.

Nucleophosmin (NPM1) is a multifunctional nucleolar protein essential for ribosome biogenesis, genome stability, and stress responses. Its integration into the nucleolus depends on its oligomerization and multivalent interactions that enable liquid-liquid phase separation (LLPS). Here, we investigate how tyrosine phosphorylation at Tyr17, Tyr29, and Tyr67 located within the interface between monomers at the N-terminal oligomerization domain regulates NPM1 structure and function. Replacing tyrosi

Continue reading