HighlightCurated by Aramai Editorial

Show and tell: A neural image caption generator

A neural image caption generator pairing computer vision with a deep recurrent language model, trained to maximize likelihood, setting new BLEU scores.

Automatically describing an image connects computer vision and natural language processing. This paper presents a generative model with a deep recurrent architecture that draws on advances in computer vision and machine translation to produce natural sentences describing an image, trained to maximize the likelihood of the target description. It is accurate and fluent, learning language solely from image descriptions. Its BLEU-1 on Pascal reaches 59 versus a prior 25 (human ~69), with gains on Flickr30k (56 to 66) and SBU (19 to 28) and a BLEU-4 of 27.7 on COCO.

Based on: Show and tell: A neural image caption generator · Computer Vision and Pattern Recognition

HighlightCurated by Aramai Editorial

Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations

Presents Visual Genome, a dataset of 108K+ images with object, attribute, and relationship annotations canonicalized to WordNet for visual reasoning.

Computers do well on perceptual tasks like image classification but poorly on cognitive tasks such as description and question answering, which require reasoning about object relationships, not just recognizing them. The authors present Visual Genome to enable modeling of these interactions. It contains over 108K images, each averaging 35 objects, 26 attributes, and 21 relationships, with objects, attributes, relationships, and noun phrases canonicalized to WordNet synsets, forming a dense, large dataset of descriptions, objects, attributes, relationships, and QA pairs.

Based on: Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations · International Journal of Computer Vision

HighlightCurated by Aramai Editorial

Supervised Contrastive Learning

Proposes a supervised contrastive loss that leverages label information to outperform cross-entropy on image classification and improve robustness.

Cross-entropy is the dominant loss for supervised image classification, but this paper proposes a training method that outperforms it across architectures and augmentations. It adapts the self-supervised batch contrastive loss to supervised training, pulling same-class embeddings together while pushing different classes apart, using large batches and normalized embeddings. On ResNet-50 and ResNet-200 it beats cross-entropy by over 1%, setting a new state of the art of 78.8% with AutoAugment, and also improves robustness and hyperparameter stability.

Based on: Supervised Contrastive Learning · Neural Information Processing Systems

HighlightCurated by Aramai Editorial

Massive MIMO for next generation wireless systems

Overview of massive MIMO, which uses a large excess of base-station antennas over terminals with TDD to boost wireless throughput and energy efficiency.

Multi-user MIMO improves on point-to-point MIMO by using cheap single-antenna terminals, not requiring rich scattering, and simplifying resource allocation, but in its original form it does not scale. Massive MIMO deploys far more service antennas than active terminals with time-division duplex operation. The extra antennas focus energy into smaller regions, greatly improving throughput and energy efficiency while enabling low-power components, lower latency, a simpler MAC layer, and robustness to jamming. The article surveys the concept and open challenges.

Based on: Massive MIMO for next generation wireless systems · IEEE Communications Magazine

HighlightCurated by Aramai Editorial

Categorical Reparameterization with Gumbel-Softmax

Introduces Gumbel-Softmax, a differentiable reparameterization enabling gradient-based training through categorical latent variables in neural networks.

Categorical variables naturally represent discrete structure, but stochastic neural networks rarely use categorical latents because one cannot backpropagate through samples. This work presents an efficient gradient estimator that replaces the non-differentiable categorical sample with a differentiable sample from a novel Gumbel-Softmax distribution, which anneals smoothly toward a categorical distribution. It beats state-of-the-art gradient estimators on structured output prediction and unsupervised generative modeling with categorical latents, and speeds up semi-supervised classification.

Based on: Categorical Reparameterization with Gumbel-Softmax · International Conference on Learning Representations

HighlightCurated by Aramai Editorial

Tabu Search

A book presenting tabu search, a meta-heuristic for optimization problems, illustrated with applications from scheduling and VLSI design to logistics.

This book presents tabu search, a meta-heuristic that broadens the ability to solve difficult problems across resource planning, telecommunications, VLSI design, scheduling, logistics, pattern classification, and manufacturing, among many domains. The major ideas are explained through examples tied to real applications, with numerous illustrations and diagrams clarifying key principles. The aim is to convey hands-on knowledge and insight rather than only computational recipes or abstract themes, while also addressing advanced issues.

Based on: Tabu Search · Semantic Scholar

HighlightCurated by Aramai Editorial

The STRING database in 2021: customizable protein–protein networks, and functional characterization of user-uploaded gene/measurement sets

The 2021 STRING update adds customizable protein–protein networks and functional characterization of user-uploaded gene or measurement sets.

STRING integrates known and predicted associations between proteins, spanning physical interactions and functional associations. It scores evidence from literature text-mining, interaction-experiment and curated pathway databases, predictions from co-expression and conserved genomic context, and cross-organism transfer. Version 11.5 will cover over 14,000 organisms, and adds a reworked text-mining system, a new scoring mode for physical interactions, interface features for customizing and sharing networks, and querying with genome-wide data plus automated enrichment and bias detection.

Based on: The STRING database in 2021: customizable protein–protein networks, and functional characterization of user-uploaded gene/measurement sets · Nucleic Acids Res.

HighlightCurated by Aramai Editorial

Classifier-Free Diffusion Guidance

Trades diffusion sample quality against diversity without a separate classifier by combining joint conditional and unconditional score estimates.

Classifier guidance adjusts the trade-off between mode coverage and sample fidelity in conditional diffusion models after training, mixing a diffusion model's score estimate with the gradient of a separately trained image classifier. This paper shows the same guidance works without any classifier: a single generative model jointly trains conditional and unconditional diffusion models, then combines their score estimates. This classifier-free guidance yields a quality-diversity trade-off comparable to classifier guidance.

Based on: Classifier-Free Diffusion Guidance · arXiv.org

HighlightCurated by Aramai Editorial

Inference and analysis of cell-cell communication using CellChat

CellChat infers and analyzes cell–cell communication networks from single-cell RNA-seq data using a curated ligand–receptor interaction database.

Understanding cell communication requires accurate signaling links and systems-level analysis. The authors build a database of ligand, receptor, and cofactor interactions capturing known heteromeric complexes, then develop CellChat to quantitatively infer intercellular communication networks from single-cell RNA-seq data. Via network analysis, pattern recognition, and manifold learning, it predicts signaling inputs and outputs, classifies pathways, and separates conserved from context-specific signaling. Applied to mouse and human skin, it extracts complex patterns and offers a web Explorer.

Based on: Inference and analysis of cell-cell communication using CellChat · Nature Communications

HighlightCurated by Aramai Editorial

Deformable Convolutional Networks

Introduces deformable convolution and deformable RoI pooling, adding learnable spatial offsets to boost CNNs' geometric transformation modeling.

CNNs are limited in modeling geometric transformations because of the fixed geometric structures in their modules. This work adds two modules, deformable convolution and deformable RoI pooling, that augment spatial sampling locations with additional offsets learned from the target task without extra supervision. They drop into existing CNNs and train end-to-end via back-propagation. Experiments show learning dense spatial transformation helps object detection and semantic segmentation.

Based on: Deformable Convolutional Networks · IEEE International Conference on Computer Vision

HighlightCurated by Aramai Editorial

Scalable Diffusion Models with Transformers

Introduces Diffusion Transformers (DiT): latent diffusion models that swap the U-Net backbone for a transformer, setting state-of-the-art ImageNet FID.

This paper introduces Diffusion Transformers (DiTs), diffusion models built on the transformer architecture. Training latent diffusion models of images, the authors replace the usual U-Net backbone with a transformer operating on latent patches, and study scalability via forward-pass complexity in Gflops. DiTs with higher Gflops—via greater depth, width, or more tokens—consistently achieve lower FID. The largest, DiT-XL/2, beats all prior diffusion models on class-conditional ImageNet 512×512 and 256×256, reaching a state-of-the-art FID of 2.27 on the latter.

Based on: Scalable Diffusion Models with Transformers · IEEE International Conference on Computer Vision

HighlightCurated by Aramai Editorial

The entity-relationship model: toward a unified view of data

Proposes the entity-relationship model, a semantic data model with a diagrammatic technique unifying views of data for database design.

This paper proposes the entity-relationship model, a data model that incorporates the semantic information of the real world by describing data in terms of entities and the relationships among them. A special diagrammatic technique is introduced to depict these entities and relationships, and the paper gives a worked example of database design and description using both the model and the diagrams. The author discusses the model's implications for data integrity, information retrieval, and data manipulation, working toward a unified view of data.

Based on: The entity-relationship model: toward a unified view of data · Very Large Data Bases Conference