CVPR 2024 人体姿态估计总汇（3D人体、手语翻译和人体网格恢复/重建等）

1、Human Pose Estimation(人体姿态估计)

• CLOAF: CoLlisiOn-Aware Human Flow
• Meta-Point Learning and Refining for Category-Agnostic Pose Estimation
• SurMo: Surface-based 4D Motion Modeling for Dynamic Human Rendering
  ⭐code
• GALA: Generating Animatable Layered Assets from a Single Scan
  ⭐code
  🏠project
• ShapeMatcher: Self-Supervised Joint Shape Canonicalization Segmentation Retrieval and Deformation自监督关节形状规范化、分割、检索和变形
• 手部
  • Authentic Hand Avatar from a Phone Scan via Universal Hand Model
  • URHand: Universal Relightable Hands
    🏠project
  • OHTA: One-shot Hand Avatar via Data-driven Implicit Priors
    ⭐code
    🏠project
  • BOTH2Hands: Inferring 3D Hands from Both Text Prompts and Body Dynamics
    ⭐code
    🏠project
  • Reconstructing Hands in 3D with Transformers
  • 3D手部姿态估计
    • HOISDF: Constraining 3D Hand-Object Pose Estimation with Global Signed Distance Fields
      ⭐code
    • Single-to-Dual-View Adaptation for Egocentric 3D Hand Pose Estimation
      ⭐code
    • HandDiff: 3D Hand Pose Estimation with Diffusion on Image-Point Cloud
      ⭐code
  • 手部网格重建
    • Complementing Event Streams and RGB Frames for Hand Mesh Reconstruction
      ⭐code
      🏠project
    • HandBooster: Boosting 3D Hand-Mesh Reconstruction by Conditional Synthesis and Sampling of Hand-Object Interactions
      ⭐code
  • 手部网格恢复
    • A Simple Baseline for Efficient Hand Mesh Reconstruction
      ⭐code
      🏠project
    • HHMR: Holistic Hand Mesh Recovery by Enhancing the Multimodal Controllability of Graph Diffusion Models
      🏠project
  • 手部姿态跟踪
    • MS-MANO: Enabling Hand Pose Tracking with Biomechanical Constraints
  • 手部纹理重建
    • BiTT: Bi-directional Texture Reconstruction of Interacting Two Hands from a Single Image
      ⭐code
      🏠project
  • 手势合成
    • Weakly-Supervised Emotion Transition Learning for Diverse 3D Co-speech Gesture Generation
      🏠project
    • ConvoFusion: Multi-Modal Conversational Diffusion for Co-Speech Gesture Synthesis
      🏠project
    • DiffSHEG: A Diffusion-Based Approach for Real-Time Speech-driven Holistic 3D Expression and Gesture Generation
      🏠project
    • EMAGE: Towards Unified Holistic Co-Speech Gesture Generation via Expressive Masked Audio Gesture Modeling
      🏠project
• 人体
  • LiveHPS: LiDAR-based Scene-level Human Pose and Shape Estimation in Free Environment
  • AiOS: All-in-One-Stage Expressive Human Pose and Shape Estimation
  • LPSNet: End-to-End Human Pose and Shape Estimation with Lensless Imaging
  • Dynamic Inertial Poser (DynaIP): Part-Based Motion Dynamics Learning for Enhanced Human Pose Estimation with Sparse Inertial Sensors
  • Fast Adaptation for Human Pose Estimation via Meta-Optimization
  • RAM-Avatar: Real-time Photo-Realistic Avatar from Monocular Videos with Full-body Control
    ⭐code
  • SDPose: Tokenized Pose Estimation via Circulation-Guide Self-Distillation
    ⭐code
  • 多人姿势估计
    • DiffusionRegPose: Enhancing Multi-Person Pose Estimation using a Diffusion-Based End-to-End Regression Approach
    • RTMO: Towards High-Performance One-Stage Real-Time Multi-Person Pose Estimation
  • 3D 人体
    • Person-in-WiFi 3D: End-to-End Multi-Person 3D Pose Estimation with Wi-Fi
    • Cross-view and Cross-pose Completion for 3D Human Understanding
    • TexVocab: Texture Vocabulary-conditioned Human Avatars
      🏠project
    • MonoDiff: Monocular 3D Object Detection and Pose Estimation with Diffusion Models
    • ChatPose: Chatting about 3D Human Pose
      🏠project
    • SelfPose3d: Self-Supervised Multi-Person Multi-View 3d Pose Estimation
      ⭐code
    • Attention-Propagation Network for Egocentric Heatmap to 3D Pose Lifting
    • FutureHuman3D: Forecasting Complex Long-Term 3D Human Behavior from Video Observations
      🏠project
    • FinePOSE: Fine-Grained Prompt-Driven 3D Human Pose Estimation via Diffusion Models
    • PoseIRM: Enhance 3D Human Pose Estimation on Unseen Camera Settings via Invariant Risk Minimization
    • Score-Guided Diffusion for 3D Human Recovery
      ⭐code
    • A Dual-Augmentor Framework for Domain Generalization in 3D Human Pose Estimation
    • KTPFormer: Kinematics and Trajectory Prior Knowledge-Enhanced Transformer for 3D Human Pose Estimation
      ⭐code
    • Multiple View Geometry Transformers for 3D Human Pose Estimation
      ⭐code
    • Normalizing Flows on the Product Space of SO(3) Manifolds for Probabilistic Human Pose Modeling
    • Multi-agent Long-term 3D Human Pose Forecasting via Interaction-aware Trajectory Conditioning
      ⭐code
    • EventEgo3D: 3D Human Motion Capture from Egocentric Event Streams
      🏠project
    • 3D Human Pose Perception from Egocentric Stereo Videos
      ⭐code
      🏠project
    • Forecasting of 3D Whole-body Human Poses with Grasping Objects3D 全身人体姿势
    • BodyMAP -- Jointly Predicting Body Mesh and 3D Applied Pressure Map for People in Bed
      ⭐code
      🏠project
    • MeshPose: Unifying DensePose and 3D Body Mesh Reconstruction
    • Exploring Vision Transformers for 3D Human Motion-Language Models with Motion Patches
    • Hourglass Tokenizer for Efficient Transformer-Based 3D Human Pose Estimation
      ⭐code
      👍让视频姿态Transformer变得飞速，北大提出高效三维人体姿态估计框架HoT
    • Optimizing Diffusion Noise Can Serve As Universal Motion Priors
      ⭐code
      🏠project
    • En3D: An Enhanced Generative Model for Sculpting 3D Humans from 2D Synthetic Data
      ⭐code
      🏠project
• 人体网格恢复/重建
  • DPMesh: Exploiting Diffusion Prior for Occluded Human Mesh Recovery
  • Instance-aware Contrastive Learning for Occluded Human Mesh Reconstruction
  • PostureHMR: Posture Transformation for 3D Human Mesh Recovery
  • Probabilistic Human Mesh Estimation with Hypothesis Scoring
  • KITRO:Refining Human Mesh by 2D Clues and Kinematic-tree Rotation
    ⭐code
  • Semantic Human Mesh Reconstruction with Textures
    🏠project
  • TokenHMR: Advancing Human Mesh Recovery with a Tokenized Pose Representation
    🏠project
  • SCULPT: Shape-Conditioned Unpaired Learning of Pose-dependent Clothed and Textured Human Meshes人体网格
  • R-Cyclic Diffuser: Reductive and Cyclic Latent Diffusion for 3D Clothed Human Digitalization
  • DiffusionPoser: Real-time Human Motion Reconstruction From Arbitrary Sparse Sensors Using Autoregressive Diffusion
    🏠project
  • Synergistic Global-space Camera and Human Reconstruction from Videos
  • SiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusion
  • SIFU: Side-view Conditioned Implicit Function for Real-world Usable Clothed Human Reconstruction
• 动作捕捉
  • ProxyCap: Real-time Monocular Full-body Capture in World Space via Human-Centric Proxy-to-Motion Learning
    🏠project
  • Egocentric Whole-Body Motion Capture with FisheyeViT and Diffusion-Based Motion Refinement
  • Capturing Closely Interacted Two-Person Motions with Reaction Priors
    🏠project
  • Loose Inertial Poser: Motion Capture with IMU-attached Loose-Wear Jacket
    ⭐code
  • Mocap Everyone Everywhere: Lightweight Motion Capture With Smartwatches and a Head-Mounted Camera
    ⭐code
    🏠project
• 3D人体生成
  • HumanNorm: Learning Normal Diffusion Model for High-quality and Realistic 3D Human Generation
    ⭐code
    🏠project
  • FlowMDM: Seamless Human Motion Composition with Blended Positional Encodings
    ⭐code
    🏠project人体运动合成
  • HumanRef: Single Image to 3D Human Generation via Reference-Guided Diffusion
    🏠project
  • Gaussian Shell Maps for Efficient 3D Human Generation
• 语音驱动的人体动画
  • Emotional Speech-driven 3D Body Animation via Disentangled Latent Diffusion
    ⭐code
    🏠project
• 文本提示的人体动画
  • HOIAnimator: Generating Text-prompt Human-object Animations using Novel Perceptive Diffusion Models
• 手语翻译
  • LLMs are Good Sign Language Translators
  • Neural Sign Actors: A Diffusion Model for 3D Sign Language Production from Text
• 3D姿势迁移
  • Towards Robust 3D Pose Transfer with Adversarial Learning
  • Cinematic Behavior Transfer via NeRF-based Differentiable Filming
• 人体重建
  • MultiPly: Reconstruction of Multiple People from Monocular Video in the Wild
  • Closely Interactive Human Reconstruction with Proxemics and Physics-Guided Adaption
    ⭐code
  • Joint Reconstruction of 3D Human and Object via Contact-Based Refinement Transformer
    ⭐code
  • HiLo: Detailed and Robust 3D Clothed Human Reconstruction with High-and Low-Frequency Information of Parametric Models
  • ANIM: Accurate Neural Implicit Model for Human Reconstruction from a single RGB-D Image
  • Diffusion-FOF: Single-View Clothed Human Reconstruction via Diffusion-Based Fourier Occupancy Field
  • VS: Reconstructing Clothed 3D Human from Single Image via Vertex Shift
    ⭐code
  • WHAM: Reconstructing World-grounded Humans with Accurate 3D Motion
    🏠project3D 运动重建
• 类别无关的姿势估计
  • ESCAPE: Encoding Super-keypoints for Category-Agnostic Pose Estimation
• 视频估计人体动力学
  • PhysPT: Physics-aware Pretrained Transformer for Estimating Human Dynamics from Monocular Videos
• 人体姿势回归
  • Video-Based Human Pose Regression via Decoupled Space-Time Aggregation
    ⭐code
• 3D人体模型
  • GauHuman: Articulated Gaussian Splatting from Monocular Human Videos
    ⭐code
    🏠project
• 人体生成
  • FairRAG: Fair Human Generation via Fair Retrieval Augmentation
  • HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splatting
    🏠project文本驱动 3D 人体生成
  • Joint2Human: High-Quality 3D Human Generation via Compact Spherical Embedding of 3D Joints
    🏠project
  • MoMask: Generative Masked Modeling of 3D Human Motions
    🏠project3D 人体运动
• 人体运动理解
  • HumMUSS: Human Motion Understanding using State Space Models
• 人体形状
  • Distilling CLIP with Dual Guidance for Learning Discriminative Human Body Shape Representation
• 舞蹈生成
  • DisCo: Disentangled Control for Realistic Human Dance Generation
    🏠project
  • POPDG: Popular 3D Dance Generation with PopDanceSet
  • DanceCamera3D: 3D Camera Movement Synthesis with Music and Dance
    ⭐code
  • Lodge: A Coarse to Fine Diffusion Network for Long Dance Generation Guided by the Characteristic Dance Primitives
    🏠project
  • Bidirectional Autoregessive Diffusion Model for Dance Generation