Image-to-Video
PyTorch
ONNX
LivePortrait
talking-head-generation
audio-driven-face-animation
cvpr-2026
Instructions to use doubi-killer/PC-Talk with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LivePortrait
How to use doubi-killer/PC-Talk with LivePortrait:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Add PC-Talk checkpoint download instructions and usage terms
Browse files
README.md
CHANGED
|
@@ -1,24 +1,97 @@
|
|
| 1 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 2 |
|
| 3 |
-
|
| 4 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 5 |
|
| 6 |
```text
|
| 7 |
-
|
| 8 |
-
|
| 9 |
-
|
| 10 |
-
|
| 11 |
-
|
| 12 |
-
βββ
|
| 13 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 14 |
```
|
| 15 |
|
| 16 |
-
`lac.pth`
|
| 17 |
-
|
| 18 |
-
|
| 19 |
|
| 20 |
-
|
| 21 |
-
|
| 22 |
-
|
| 23 |
-
|
| 24 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: other
|
| 3 |
+
license_name: checkpoint-specific-upstream-terms
|
| 4 |
+
license_link: https://github.com/BQ-Wang0511/PC-Talk/blob/main/THIRD_PARTY_NOTICES.md
|
| 5 |
+
library_name: pytorch
|
| 6 |
+
pipeline_tag: image-to-video
|
| 7 |
+
tags:
|
| 8 |
+
- talking-head-generation
|
| 9 |
+
- audio-driven-face-animation
|
| 10 |
+
- liveportrait
|
| 11 |
+
- cvpr-2026
|
| 12 |
+
- arxiv:2503.14295
|
| 13 |
+
---
|
| 14 |
|
| 15 |
+
# PC-Talk β CVPR 2026 Checkpoints
|
| 16 |
+
|
| 17 |
+
Runtime checkpoints for **PC-Talk: Precise Facial Animation Control for
|
| 18 |
+
Audio-Driven Talking Face Generation**.
|
| 19 |
+
|
| 20 |
+
- [Paper](https://arxiv.org/abs/2503.14295)
|
| 21 |
+
- [Project page](https://bq-wang0511.github.io/PC-Talk/)
|
| 22 |
+
- [Source code and full inference instructions](https://github.com/BQ-Wang0511/PC-Talk)
|
| 23 |
+
|
| 24 |
+
## Download
|
| 25 |
+
|
| 26 |
+
Clone the source code and download the checkpoints directly into their runtime
|
| 27 |
+
location:
|
| 28 |
+
|
| 29 |
+
```bash
|
| 30 |
+
git clone https://github.com/BQ-Wang0511/PC-Talk.git
|
| 31 |
+
cd PC-Talk
|
| 32 |
+
pip install -U huggingface_hub
|
| 33 |
+
hf download doubi-killer/PC-Talk --local-dir pctalk/checkpoints
|
| 34 |
+
```
|
| 35 |
+
|
| 36 |
+
The repository contains 12 model files (about 920 MB), preserving the layout
|
| 37 |
+
expected by PC-Talk:
|
| 38 |
|
| 39 |
```text
|
| 40 |
+
audio_encoder.pth
|
| 41 |
+
lac.pth
|
| 42 |
+
emc.pth
|
| 43 |
+
style_encoder.pth
|
| 44 |
+
liveportrait/
|
| 45 |
+
βββ landmark.onnx
|
| 46 |
+
βββ base_models/
|
| 47 |
+
β βββ appearance_feature_extractor.pth
|
| 48 |
+
β βββ motion_extractor.pth
|
| 49 |
+
β βββ spade_generator.pth
|
| 50 |
+
β βββ warping_module.pth
|
| 51 |
+
βββ retargeting_models/
|
| 52 |
+
βββ stitching_retargeting_module.pth
|
| 53 |
+
insightface/models/buffalo_l/
|
| 54 |
+
βββ 2d106det.onnx
|
| 55 |
+
βββ det_10g.onnx
|
| 56 |
```
|
| 57 |
|
| 58 |
+
`lac.pth` includes both the LAC model and its refinement model. EMC is used for
|
| 59 |
+
emotion control; the style encoder is used for reference-style input. The
|
| 60 |
+
LivePortrait and face-analysis weights are included for the inference backend.
|
| 61 |
|
| 62 |
+
The original `SHA256SUMS` manifest uses paths relative to the **source-code
|
| 63 |
+
repository root**. After downloading, verify the files from that root:
|
| 64 |
+
|
| 65 |
+
```bash
|
| 66 |
+
sha256sum -c pctalk/checkpoints/SHA256SUMS
|
| 67 |
+
```
|
| 68 |
+
|
| 69 |
+
These are downloadable inference assets, not a Transformers-format model. Use
|
| 70 |
+
the PC-Talk source code to run inference. See its README for installation,
|
| 71 |
+
image/video examples, emotion controls and articulation settings.
|
| 72 |
+
|
| 73 |
+
## Usage terms and safety
|
| 74 |
+
|
| 75 |
+
The source-code license does **not** automatically license every model weight.
|
| 76 |
+
Third-party components retain their upstream terms:
|
| 77 |
+
|
| 78 |
+
- [LivePortrait](https://github.com/KwaiVGI/LivePortrait)
|
| 79 |
+
- [InsightFace](https://github.com/deepinsight/insightface)
|
| 80 |
+
- [Wav2Lip](https://github.com/Rudrabha/Wav2Lip)
|
| 81 |
+
|
| 82 |
+
In particular, the InsightFace model assets are restricted to non-commercial
|
| 83 |
+
research use and must be replaced for commercial deployment. Consult the
|
| 84 |
+
upstream licenses and the source repository's third-party notices before use.
|
| 85 |
+
Only load PyTorch checkpoints from trusted sources.
|
| 86 |
+
|
| 87 |
+
## Citation
|
| 88 |
+
|
| 89 |
+
```bibtex
|
| 90 |
+
@inproceedings{wang2026pc,
|
| 91 |
+
title={PC-Talk: Precise Facial Animation Control for Audio-Driven Talking Face Generation},
|
| 92 |
+
author={Wang, Baiqin and Zhu, Xiangyu and Shen, Fan and Xu, Hao and Lei, Zhen},
|
| 93 |
+
booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
|
| 94 |
+
pages={25153--25162},
|
| 95 |
+
year={2026}
|
| 96 |
+
}
|
| 97 |
+
```
|