Skip to content

ComfyUI and control net #26

@okulovsky

Description

@okulovsky

It might be a good idea to grab from the movies not only the pictures of the characters, but also poses and face expressions of them. Also, it might be interesting to train the model, it the future, that predicts the changes of face/position of the character from the dialog (currently, it can always be done with LLM, but probably with far less capture of the character's behaviour)

To do this, the following workflows are needed:

  1. Extract the ControlNet skeletal model for face or position from the image
  2. Apply the model to the character

These workflows need to be implemented as BrainBox ComfyUI workflows

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions