Ruby gems installed through the rvm version of rake through seg faults using the rake plugin.

When I launch the thin server through the rake script I'm getting a seg fault. It looks like the environment isn't properly setup for rvm.
The rake script works fine if I run the task through ssh, or a shell script in jenkins running through bash.