Free Automated Lipsync: Blender, Makehuman + Rhubarb

NEWS FLASH!

We can now do fully automated nine-phoneme lipsinc, using the same Program that Ron Gilbert and his team used on Thimbleweed Park.

Rhubarb Lipsync is created by Daniel S Wolf, and the Blender addon is created by Scaredyfish.

There are a lot of links in this tutorial, so here goes…

First there’s the software:

  • Rhubarb Lipsinc Download Page:
    https://github.com/DanielSWolf/rhubarb-lip-sync/releases
  • Rhubarb Lipsinc Blender Addon:
    https://github.com/scaredyfish/blender-rhubarb-lipsync

And then some bits I created myself:


I was really exited to discover this – even if it makes my previous tutorials obsolete!

 

Lipsinc for the Lazy in Blender 2: Realism

As promised – lazy lipsinc with realistic human models – from Makehuman, ManualBastioniLAB or wherever.

From MakeHuman to Blender with IK and Face Controls Tutorial

Personally, I’m using a model imported from Makehuman using this method ➡️
but other realistic humans are available.

The technique for lazy animation for realistic humans is a little different to lazy animation for more cartoony characters: The movement has to be more subtle.

00:55 – Creating shapekeys
08:45 – Setting up drivers
18:07 – Facial expression
19:15 – Recording body animation

I hope you all find this helpful.

From MakeHuman to Blender with IK and Face Controls

From MakeHuman to Blender with IK and Face Controls

Don’t worry – I’ll get back to the Lipsinc for the Lazy series, but this is a necessary detour… Whether it had to be quite such an elaborate tutorial, and whether I had to make it a Ru Paul’s Drag Race spoof… I really don’t know. While under 10 mins this took around as long to make as the 50 min crowd tutorial!

Anyhow – this is about The MHX2 format (MakeHuman eXchange 2) which allows you to import into Blender with a full IK rig and facial controls.

MakeHuman Blender Addons

Then there’s three I decided to host myself. I didn’t create these addons: they’re made by the Makehuman Team.  All I did was zip them up individually ready for you to download and install in Blender by going LINK

  • MAKEWALK Enables you to import motion capture data in .bvh format. looks like it also works with
  • MAKETARGET Enables you to create custom shapes for the Makehuman body mesh in Makehuman
  • MAKECLOTHES Enables you to create clothes, hair, and other accessories in Makehuman.

Also, feel free to download How to Install Blender Addons in 8 Seconds and use it in your own tutorials.  This has the credits already added.

I would like to thank these videos for teaching me:
Import MakeHuman Files to Blender for Mac (Tutorial)
MakeHuman to Blender with IK Bones and Motion Capture (Tutorial)

Creating a Crowd in Blender and Makehuman

Part 1: Makehuman___________________________00:57
Part 2: The Gimp____________________________05:11
Part 3: Importing into Blender______________09:26
Part 4: Materials___________________________10:14
Part 5: Correcting FBX rotation wierdness___12:52
Part 6: Setting up variations in Edit Mode__13:37
Part 7: Randomising Materials 1_____________17:06
Part 8: Modulo Explained____________________19:53
Part 9: Randomising Materials 2_____________22:14
Part 10: Setting up simple IK_______________24:06
Part 11: Adding black people________________28:35
Part 12: The Particle system________________32:08
Part 13: Animation: Setting up actions______37:23
Part 14: Animation: combining the actions___47:32