AMFG2023

We have experienced rapid advances in the face, gesture, and cross-modality (e.g., voice and face) technologies with many thanks to deep learning (i.e., dating back to 2012, AlexNet) and large-scale, labeled datasets. The progress in deep learning continues to push renowned public databases to near saturation, thus calling for the compiling of evermore challenging image collections as databases. In practice, and even widely in applied research, using off-the-shelf deep learning models has become the norm, as numerous pre-trained networks are available for download and readily deployed to new, unseen data (e.g., VGG-Face, ResNet). We have almost grown “spoiled” from such luxury, which, in all actuality, has enabled us to stay hidden from many truths. Theoretically, the truth behind what makes neural networks more discriminant than ever before is still, in all fairness, unclear. Instead, they act as a black box to most practitioners and researchers alike. More troublesome is the absence of tools to quantitatively and qualitatively characterize existing deep models, which could yield more significant insights about these all-so-familiar black boxes. With the frontier moving forward at rates incomparable to any spurt of the past, challenges such as high variations in illumination, pose, age, etc., now confront us. However, state-of-the-art deep learning models often fail when faced with such challenges owing to the difficulties in modeling structured data and visual dynamics.Alongside the effort spent on conventional face recognition is the research done across modality learning, such as face and voice, gestures in imagery, and video motion, along with several other tasks. This line of work has attracted attention from industry and academic researchers from all sorts of domains. Additionally, and in some cases with this, there has been a push to advance these technologies for social media-based applications. Regardless of the exact domain and purpose, the following capabilities must be satisfied: face and body tracking (e.g., facial expression analysis, face detection, gesture recognition), lip reading and voice understanding, face and body characterization (e.g., behavioral understanding, emotion recognition), face, body, and gesture characteristic analysis (e.g., gait, age, gender, ethnicity recognition), group understanding via social cues (e.g., kinship, non-blood relationships, personality), and visual sentiment analysis (e.g., temperament, arrangement). Thus, needing to be able to create effective models for visual certainty has significant value in both the scientific communities and the commercial market, with applications that span topics of human-computer interaction, social media analytics, video indexing, visual surveillance, and internet vision. Researchers have made significant progress addressing many of these problems, especially when considering off-the-shelf and cost-efficient vision products available these days, e.g., Intel RealSense, SHORE, and Affdex. Nonetheless, serious challenges remain, which only amplify when considering the unconstrained imaging conditions captured by different sources focused on non-cooperative subjects. These latter challenges especially grabbed our interest, as we sought to bring together cutting-edge techniques and recent advances in deep learning to solve the challenges in the wild.

This one-day serial workshop (AMFG2023) provides a forum for researchers to review the recent progress of recognition, analysis, and modeling of face, body, and gesture while embracing the most advanced deep learning systems available for face and gesture analysis, particularly under an unconstrained environment like social media and across modalities like face-to-voice. The workshop includes up to two keynotes and peer-reviewed papers (oral and poster). We call for original, high-quality contributions on the following topics:

• Novel deep model, deep learning survey, or comparative study for face/gesture recognition;
• Data-driven or physics-based generative models for faces, poses, and gestures; deep learning for internet-scale soft biometrics and profiling: age, gender, ethnicity, personality, kinship, occupation, beauty ranking, and fashion classification by facial or body descriptor;
• Deep learning for detection and recognition of faces and bodies with large 3D rotation, illumination change, partial occlusion, unknown/changing background, and aging (i.e., in the wild); especially large 3D rotation robust face and gesture recognition;
• Motion analysis, tracking, and extraction of face and body models captured from several non-overlapping views;
• Face, gait, and action recognition in low-quality (e.g., blurred), or low-resolution video from fixed or mobile device cameras;
• AutoML for face and gesture analysis;
• Social/psychological-based studies that aid in understanding computational modeling and building better automated face and gesture systems with interactive features;
• Multimedia learning models involving faces and gestures (e.g., voice, wearable IMUs, and face);
• Trustworthy learning for face and gesture analysis, e.g., fairness, explainable and transparency;
• Other applications that involve face and gesture analysis.

The first AMFG was held in conjunction
with the 2003 ICCV in Nice, France. So far, it has been successfully held TEN times. The
homepages of the last three AMFG workshops are as follows: 

1. AMFG2003@CVPR
2. AMFG2005@CVPR
3. AMFG2007@CVPR
4. AMFG2010@CVPR
5. AMFG2013@CVPR
6. AMFG2015@CVPR
7. AMFG2017@CVPR
8. AMFG2018@CVPR
9. AMFG2019@CVPR
10. AMFG2021@CVPR

Face and gesture (hands) modeling have been long-standing problems in the computer vision community,
and have also been widely explored and studied in many other workshops in recent years, yet
with different emphases compared with AMFG as follows:

• Face recognition towards security concerns, such as fairness in
  ChaLearn2020@ECCV, face antispoofing
  in ChaLearn2021@ICCV, and masked face recognition in MFR2021@ICCV
• Hands modeling for action understanding, such as HANDS2022@ECCV and HBHA2022@ECCV
• Face and gesture modeling in VR/AR, such as WCPA2022@ECCV
  and CV4ARVR2022@CVPR

The proposed workshop will focus on the fundamental research centering on face and gesture, and thus
provide theoretical and technical support to the above applications. The topics covered by AMFG will
also benefit the community in a more generalized context, including human-computer interaction,
multimodal learning, egocentric vision, artificial ethics, robotics, etc.