Computer Vision

LeviTor: Revolutionizing image-to-video synthesis with intuitive 3D trajectory control, generating realistic videos from static images by abstracting object masks into depth-aware control points.

DI-PCG uses a lightweight diffusion transformer to efficiently and accurately estimate parameters of procedural generators from images, enabling high-fidelity 3D asset creation.

Affordance-Aware Object Insertion uses a novel Mask-Aware Dual Diffusion model & SAM-FB dataset to realistically place objects in scenes, considering contextual relationships.

Prompting unlocks 4K metric depth from low-cost LiDAR.

FashionComposer revolutionizes fashion image creation through flexible composition of garments, faces, and poses.

AniDoc automates cartoon animation line art video colorization, making animation creation easier!

VidTok: an open-source, top performing video tokenizer.

Move-in-2D generates realistic human motion sequences conditioned on a 2D scene image and text prompt, overcoming limitations of existing approaches and improving video synthesis.

Edit many objects at once in videos! MIVE does it accurately without affecting other areas, a big step for AI video editing.

ChatDiT enables zero-shot, multi-turn image generation using pretrained diffusion transformers and a novel multi-agent framework.

Generate wide-scope 3D scenes from single images in a snap!

Create realistic 3D heads with specific hairstyles from text, no 3D hair data needed!

Leveraging video models, researchers achieve state-of-the-art 3D super-resolution by generating ‘video-like’ sequences from unordered images, eliminating artifacts and computational demands.

MOVIS enhances 3D scene generation by improving cross-view consistency in multi-object novel view synthesis.

IDArb: A diffusion model for decomposing images into intrinsic components like albedo, normal, and material properties, handling varying views and lighting.

ColorFlow, a new AI model, accurately colorizes black-and-white image sequences while preserving character identity.

Training-free method adds physical properties to 3D models using vision-language models.

New attack fools breast ultrasound AI using subtle text prompts.

BrushEdit revolutionizes interactive image editing with instructions & inpainting.

Neural LightRig uses multi-light diffusion to accurately estimate object normals and materials from a single image, outperforming existing methods.