Ability to rollback sql action if anything fails

I am using version 2.3 to run entity framework migrations against env databases. I would like to know if I can rollback all of the script if any failure happens. Currently, bits and pieces of a migration will work while others fail. The end result is an insert into the ef migration history table which is not ideal for us.