# Nonlinear_Face_3DMM

**Repository Path**: kunjiang/Nonlinear_Face_3DMM

## Basic Information

- **Project Name**: Nonlinear_Face_3DMM
- **Description**: Source code for "Nonlinear 3D Face Morphable Model"
- **Primary Language**: Python
- **License**: Apache-2.0
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2019-08-09
- **Last Updated**: 2020-12-18

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# Nonlinear 3D Face Morphable Model
### [[Project page]](http://cvlab.cse.msu.edu/project-nonlinear-3dmm.html)   [[CVPR'18 Paper]](http://cvlab.cse.msu.edu/pdfs/Tran_Liu_CVPR2018.pdf) [[CVPR'19 Paper]](http://cvlab.cse.msu.edu/pdfs/Tran_Liu_Liu_CVPR2019.pdf)


![Teaser](./images/nonlinear-3dmm.jpg)

## Library requirements

* Tensorflow


## Data

Download following pre-processed training data (10GB) and unzip into ./data/300W_LP/

[Filelist](https://drive.google.com/open?id=1R80j6Y1JiNPzsucsMOGpoogKDiYg2ynP)
[Images](https://drive.google.com/open?id=1QkBiPAOA-a2buta--8atVVcKoAl5sj7O)
[Textures](https://drive.google.com/open?id=1oW8wTKkkw2VDVpCv9q8UjqG3mGQCHLQd)
[Masks](https://drive.google.com/open?id=1xTTtYYWIJlq8wYEl5BSQfjM-Vuw3jmwq)

Download following 3DMM definition and unzip into current folder (./)
[3DMM_definition.zip](https://drive.google.com/open?id=1-UJdQeFw0cf9u9gUHokNoheH0z3L1fEH)

## Compile the rendering layer - CUDA code
```bash
$ # Compile
$ cd TF_newop/
$ ./compile_op_v2_sz224.sh
$ # Run an example
$ python rendering_example.py
```
Currently the code is working but not optimal (i.e see line 139 of TF_newop/cuda_op_kernel_v2_sz224.cu.cc)
also the image size is hard-coded. Any contribution is welcome!


## Run the code

Pretraining

```bash
```


Finetunning

```bash
```


## Citation

If you find this work useful, please cite our papers with the following bibtex:
```latex
@inproceedings{ tran2019towards, 
  author = { Luan Tran and Feng Liu and Xiaoming Liu },
  title = { Towards High-fidelity Nonlinear 3D Face Morphable Model },
  booktitle = { In Proceeding of IEEE Computer Vision and Pattern Recognition },
  address = { Long Beach, CA },
  month = { June },
  year = { 2019 },
}
```

```latex
@article{ tran2018on, 
  author = { Luan Tran and Xiaoming Liu },
  title = { On Learning 3D Face Morphable Model from In-the-wild Images },
  journal = { IEEE Transactions on Pattern Analysis and Machine Intelligence },
  month = { July },
  year = { 2019 },
}
```


```latex
@inproceedings{ tran2018nonlinear, 
  author = { Luan Tran and Xiaoming Liu },
  title = { Nonlinear 3D Face Morphable Model },
  booktitle = { IEEE Computer Vision and Pattern Recognition (CVPR) },
  address = { Salt Lake City, UT },
  month = { June },
  year = { 2018 },
}
```

## Contacts

If you have any questions, feel free to drop an email to _tranluan@msu.edu_.