Modeling, Evaluation, and Control Optimization of Exosuit with OpenSim

Motivation

This project is motivated by DARPA Warrior Web Program.

Harvard Exosuit

In order to develop an under-suit that doesn’t hinder the wearer’s free movement, researchers are trying to make it soft and deformable, but still capable of applying force to body joints. The Harvard exosuit is an example of a new approach to creating an under-suit in a soft and deformable manner.

• Experimental data proved that it can help loaded walking by reducing metabolic cost.
• This suit applies force to lower limb joints through cables driven by actuators in the backpack.

Challenges

As the exosuit tries to assist human gait with a deformable structure, there are many challenges in its development. The challenges are:

• It is difficult to analyze the effectiveness of the suit.
• It is difficult to find the optimal input force for actuators to reduce the metabolic cost.
• It is difficult to identify the effect of changes in design parameters.

The reasons for the challenges are:

• The suit is deformable and closely attached to the body.
• We cannot predict how external actuation assists muscles during loaded walking, as the human body is highly redundant.
• Experimental data is inconsistent case-by-case.

Goals

• Evaluate the effectiveness of wearing active actuators on metabolic cost reduction.
• Explain how the exosuit can help loaded gait.
• Verify the impact of changes in design parameters.
• Find optimal control inputs for active actuators.

Strategy

Experimental data

• Two sets of data were collected from the same subject:

1. 1. One gait cycle of loaded walking (from left toe-off to next left toe-off).
   2. One gait cycle of unloaded walking (again, from left toe-off to next left toe-off).

• The subject didn't wear a suit and walked freely.
• Walking speeds were identical.
• Mass of the load was 38 kg.

Modeling

To simulate the movement of the exosuit wearer, the first thing to do is to create a model which can replicate a real subject as realistically as possible. Before I created the simulation model with active actuators on it, I used the generic gait model to go through the basic steps in the OpenSim simulation pipeline. By doing so, I could make my model dynamically consistent to the experimental data. I then added actuators and metabolic cost probes to the model.

Modeling a subject wearing an active actuator

The diagram above describes the procedure used to simulate the generic gait model.

• The first three steps comprise the basic modeling procedure in OpenSim to make a model dynamically and kinematically consistent with the experimental data. For more information, see the following pages on Confluence:

1. 1. How Scaling Works
   2. How Inverse Kinematics Works
   3. How RRA Works

• After step 3 was complete, probes for calculating metabolic cost were added to the model. For more information about how to add the probes, see Simulation-Based Design to Reduce Metabolic Cost.

• Finally, I added active actuators to the model. Here, I used the PathActuator class to simulate the active actuators of the exosuit, as they are cable-driven actuators. If you are interested in how the PathActuator works, see OpenSIm::PathActuator Class.

Sample models

Here are the figures of sample simulation models. I modified the RRA-adjusted model to create several different types of models for comparison.

Loaded gait models

Three types of models were created for loaded gait simulations:

• A model without any additional actuators
• A model with path actuators supporting plantarflexion
• A model with path actuators supporting hip extension

The path actuator supporting plantarflexion is attached to the heel and tibia, and the path actuator supporting hip extension is attached to the backpack and femur. For simplicity, the loaded mass was added directly to the torso.

Unloaded gait models

The same types of models were created for unloaded gait simulations.

Optimization methodology

The idea to optimize the control input force for the actuators is to take advantage of the Computed Muscle Control (CMC) tool. The main reason we use CMC in OpenSim is to find the most suitable excitations for muscles to create body movement while minimizing muscle activations. To see how it works, see How CMC Works.

In this project, I make different use of the optimization process in CMC in order to optimize the control input force for active actuators.

• CMC procedure is static optimization process, and it minimizes the cost function J which can be represented as  

• When we add active actuators to an OpenSim model, the activation term in the cost function becomes 

where X_muscle is muscle control and X_actuator is actuator control. As X_actuator is part of activation states, it is also adjusted after the optimization process.

• Now, if we diminish the influnece of X_actuator on J and run CMC, the optimizer tries to find X_actuator in the manner of minimizing muscle activations.
• We know that minimizing muscle activation correponds to minimizing metabolic cost, so we can conclude that the actuator input force resulting from CMC if we diminish the influence of X_actuator on objective function J is the optimal actuator input for metabolic cost reduction.
• Muscle force is constructed from the equation F_actuator =  F_actuator^max * X_actuator. If we assign a large maximum force to each actuator, the actuator control X_actuator decreases, so the influence of the actuator on J is decreased.
• Using this idea, I found an optimal input for each actuator, and also found the metabolic cost reduction after running CMC with a model where active actuators were added.

Results and Discussion

Metabolic cost change when active actuators are added to the model

I investigated how much metabolic cost is reduced when optimal input force is applied to a model by active actuators. I simulated both loaded and unloaded walking cases, and I compared the influence of the hip and ankle actuators on metabolic cost. I used 10,000 N as the maximum active actuator force (F_actuator^max) for these simulations.

Loaded walking	Unloaded walking

• Metabolic cost reduction when active actuators are added to the loaded gait model:

1. 1. Ankle actuator: 10.35%
   2. Hip actuator: 6.62%

• Metabolic cost reduction when active actuators are added to the unloaded gait model:

Optimal actuator input force

	Loaded walking	Unloaded walking
Ankle actuator
Hip actuator

Optimal input force for the ankle actuator:

• Actuation begins right after toe-off of the foot on the opposite side, and the peak force happens between heal-strike of the foot on the opposite side and toe-off of the foot on the same side.
• The same actuation strategy is valid for both loaded gait and unloaded gait.
• The force signal is clear and easy to implement in the real world.
• However, the maximum actuation force is about 2500 N, which is too high to achieve in reality.

Optimal input force for the hip actuator:

• The hip actuator can reduce the metabolic cost with lower maximum force than the ankle actuator.
• However, it is hard to identify how the actuator assists walking.
• Also, it is difficult to implement the optimal control input for the hip actuator in the real world.

How the ankle actuator assists loaded gait

We can explain how the optimal actuation input for the ankle actuator helps loaded gait by investigating the change of plantarflexor muscle forces.

Optimal input force for ankle actuator when actuation force is limited to 400 N (i.e., realistic actuation limit)

1. 1. My initial guess was to saturate the optimal input force that I found earlier at 400 N. I generated an new input force which is identical to the optimal input force up to 400 N, and saturated once the optimal input force exceeded 400 N.
   2. The second input force I tried was a new result from my CMC simulations. The new CMC result was acquired by assigning 4000 N to the maximum actuation force and bounding the control input between 0 and 0.1. In other words,

 

According to the formula F_actuator =  F_actuator^max * X_actuator, the new CMC result also has a maximum force of 400 N. As X_actuator is bounded between 0 and 0.1 and X_muscle is chosen between 0 and 1, the influence of X_actuator to the objective function of the CMC procedure is relatively lower than that of X_muscle, so we can use this idea to create an optimal input for the ankle actuator when the maximum actuation force is limited.

When we compare the saturated optimal input and the result from the new CMC procedure, we find similarity. Now, let's compare the metabolic cost reduction when each control input is applied to ankle actuators.

Metabolic cost reduction

Loaded walking	Unloaded walking

• Metabolic cost reduction when active actuators are added to loaded gait model:

1. 1. Optimal: 10.35% reduction
   2. Saturated: 1.84% reduction
   3. New CMC: 2.68% reduction

Now that we know both the ankle actuator and the hip actuator can reduce metabolic cost during loaded walking, a natural progression is to test actuators which can affect both ankle plantarflexion and hip extension. To reduce the number of actuators, I added single-degree-of-freedom biarticular actuators affecting ankle plantarflexion and hip extension to legs on both sides, and investigate the metabolic cost. The main idea in creating a biarticular actuator is to let the path actuator go through the axis of ankle joint rotation. I chose the attachment points of the ankle and hip actuators as the via points and end points of the biarticular actuator line, and also set the origin of the ankle joint rotation as one of the via points. By doing so, I created a biarticular actuator which combines the effects of the ankle and hip actuators.

Simulation result

I ran CMC on the loaded gait model with the biarticular actuator. I set the maximum force of the biarticular actuator to be 10,000N in order to see the optimal input force and the best possible metabolic cost reduction.

Optimal input	Metabolic cost reduction

Conclusions

• Three types of active actuators are evaluated in terms of metabolic cost reduction and controllability:

1. 1. If we can apply a sufficient amount of force, it is better to apply force to the ankle joint.
   2. If not, the hip actuator is a good alternative, though it is difficult to control.
   3. The biarticular actuator doesn’t assist loaded walking very well and the force input is not consistent.

Limitations

Source Code

You can find the simulation models that I created on my Simtk project page.