I am controlling Obama’s facial expression
I am controlling Obama’s facial expression =D
This is so weird but so amusing to play with !
I have been trying Avatarify which is an open source deepfake project on git hub that allows me to see my expression on other people in real time without the need to record a video. It can be used to live stream call on zoom with someone’s else character.
I just needed to add a 2D photo, and the person’s expression in the photo is changing according to my facial expression.
The installation guide is easy and don’t need programing experience, just some simple OS commands.
https://github.com/alievk/avatarify#install
The only challenge was that I don’t have the required CUDA-enabled (NVIDIA) video card on my laptop neither on my work desktop this is why I used it on Google colab (Colaboratory) which is a free cloud service that provides free GPU and allows executing python code in cells ( it looks so much like Jupyter Notebooks which is the open source project on which Colab is based )
Steps to run Avatarify on Google colab can be found here :
https://colab.research.google.com/github/alievk/avatarify/blob/master/avatarify.ipynb
At the beginning when I tried the colab on my laptop it worked but it was very very slow that I was not able to enjoy the experience. I’m not sure what the exact reason was but I think it is due to the processor and to the poor home internet connection.
I have recently tried it at work using my Desktop which has relatively high performance CPU and better and more stable internet connection and it worked way better.
( My desktop does not have a web cam so I have used Droid cam app (https://play.google.com/store/apps/details?id=com.dev47apps.droidcam&hl=en) to use my android phone Camera as a webcam.
There is another option that gives better experience with less latency which is creating a ssh reverse tunnel to an AWS t3.micro free instance . I have tried it but something went wrong with me and the ssh into the instance was not succeed.
Steps on how to connect to AWS are listing here :
https://colab.research.google.com/github/alievk/avatarify/blob/master/avatarify.ipynb
One of the thing that you can do using avatarify is to join a zoom call o someone else characters. I did not try this yet but this video shows how (Not real) Elon Musk joined this video call
https://www.youtube.com/watch?v=lONuXGNqLO0&feature=youtu.be
Avatarify was created by Ali Aliev (https://twitter.com/aialievk) and Karim Iskakov(https://twitter.com/k4rfly) based on First order motion model (https://github.com/AliaksandrSiarohin/first-order-model) .
Check out Avatarify here on GitHub if you want to try it for yourself. (https://github.com/alievk/avatarify)
Documented experience with Avatarify :
https://github.com/DashBarkHuss/100-days-of-code/blob/master/post-log.md#avatarify-1
