We can now do fully automated nine-phoneme lipsinc, using the same Program that Ron Gilbert and his team used on Thimbleweed Park.
Rhubarb Lipsync is created by Daniel S Wolf, and the Blender addon is created by Scaredyfish.
There are a lot of links in this tutorial, so here goes…
First there’s the software:
- Rhubarb Lipsinc Download Page:
- Rhubarb Lipsinc Blender Addon:
And then some bits I created myself:
I was really exited to discover this – even if it makes my previous tutorials obsolete!
As promised – lazy lipsinc with realistic human models – from Makehuman, ManualBastioniLAB or wherever.
Personally, I’m using a model imported from Makehuman using this method ➡️
but other realistic humans are available.
The technique for lazy animation for realistic humans is a little different to lazy animation for more cartoony characters: The movement has to be more subtle.
00:55 – Creating shapekeys
08:45 – Setting up drivers
18:07 – Facial expression
19:15 – Recording body animation
I hope you all find this helpful.
From MakeHuman to Blender with IK and Face Controls
Don’t worry – I’ll get back to the Lipsinc for the Lazy series, but this is a necessary detour… Whether it had to be quite such an elaborate tutorial, and whether I had to make it a Ru Paul’s Drag Race spoof… I really don’t know. While under 10 mins this took around as long to make as the 50 min crowd tutorial!
Anyhow – this is about The MHX2 format (MakeHuman eXchange 2) which allows you to import into Blender with a full IK rig and facial controls.
MakeHuman Blender Addons
Then there’s three I decided to host myself. I didn’t create these addons: they’re made by the Makehuman Team. All I did was zip them up individually ready for you to download and install in Blender by going LINK
- MAKEWALK Enables you to import motion capture data in .bvh format. looks like it also works with
- MAKETARGET Enables you to create custom shapes for the Makehuman body mesh in Makehuman
- MAKECLOTHES Enables you to create clothes, hair, and other accessories in Makehuman.
Also, feel free to download How to Install Blender Addons in 8 Seconds and use it in your own tutorials. This has the credits already added.
I would like to thank these videos for teaching me:
Import MakeHuman Files to Blender for Mac (Tutorial)
MakeHuman to Blender with IK Bones and Motion Capture (Tutorial)
Part 1: Makehuman___________________________00:57
Part 2: The Gimp____________________________05:11
Part 3: Importing into Blender______________09:26
Part 4: Materials___________________________10:14
Part 5: Correcting FBX rotation wierdness___12:52
Part 6: Setting up variations in Edit Mode__13:37
Part 7: Randomising Materials 1_____________17:06
Part 8: Modulo Explained____________________19:53
Part 9: Randomising Materials 2_____________22:14
Part 10: Setting up simple IK_______________24:06
Part 11: Adding black people________________28:35
Part 12: The Particle system________________32:08
Part 13: Animation: Setting up actions______37:23
Part 14: Animation: combining the actions___47:32