TPSM - Thin Plate Spline Motion Modeling. You can right click and download the picture and video on this site to do your testing.
Choose the image you want to animate. I chose a picture I made using Mid Journey Ai Art Generator. I have an entire library of Art you can check out on deviant art deviantart.com/justthetipwithdaniel if you want to grab this model or just check out the art. Make it's cropped like a passport photo, just like you see above.
This will be the Video that animates the picture above and basically drives or puppets the 2D static image.
Go to the TPSM Demo on Hugging Face in the Link Below (This is Free and there is no Sign up)
What is Hugging face? There is a free to use websites for all things AI, you can use image and video upscaler (improve resolution), Do some AI art generation (describe an image and have diffusion tech create it for you), and some other super cool tech to play with or be exposed to.
Step #1 - Upload your image
You will see a box to drop your image into. Just click on that box and upload the image or drag your file into that box. Click on the image Below to go to the TPSM Hugging face site.
Step #2 - Upload your video
Now drag or upload your driving video to this box. Make sure your video looks like the sample I provided. Your video will have to be 256x256 to greatly improve the processing time. It will work with any MP4 sample, but it will just take longer to convert the video to the resolution it prefers. Unfortunately, this means the video will not be very high quality.
Tip 1: I wouldn't go to crazy yet, I would stick to a short video clip under 20 seconds of length.
Tip 2: Also, I wouldn't upload videos of yourself as these tools have that information saved somewhere. Who knows. I do have a local install tutorial if you want to use this tech often, and not upload to someone else's website. Also, there is a similar tech called DaGan that produces similar results, and the site works exactly like this one.
Tip 3: Videos and images for this particular demo (vox demo) should stick to similar proportions to samples I provided. Just think, passport photo size. There is a way to animate the body using a different model (ted model). You can find that demo on the same website.
"Remembering that you are going to die is the best way I know to avoid the trap of thinking you have something to lose. You are already naked. There is no reason not to follow your heart." - Steve Jobs
Step #3 Check your Output
Now let's take a look at what it produced! You Awesome Techie you! The output box will be located at the bottom and your video will be available for download.
Check out my results below.
You're Done!
That's it! You just animated a 2D photo! Pat yourself on the back. No really do it right now because not many people could say they did that today. Also try a similar tool that might produce better results for you, this tool is called DaGan.
Here is a quick YouTube Short on everything we just went over, with some examples of animated photos.
Local Installation
This demo website is great and easy to use. You probably didn't need my help, but you definitely needed me to show you it existed. Hugging face is home to a lot of free AI art and upcoming technology demos.
You probably noticed this render took a while and if you tried to do a video longer than 10 minutes you might have got an error or denial. No worries you can install this locally. I made an entire video on how to do that. Just check out on YouTube.
TPSM Local Installation Tutorial on YouTube!!!!
Here is how to install TPSM on your Local PC for Windows. If you are using Linux, you can check out this tutorial by Nerdy Rodent instead.
Comentarios