BaseSwipeAdapter unchecks ListViewItems in MultiChoiceMode

I have a ListView that allows users to select multiple items in the ListView by registering a MultiChoiceMode listener on the ListView. I have since added the BaseSwipeAdapter to my project for this ListView, but now when you hold down on an item to select it, the item gets selected with the MultiChoiceMode menu appearing for a second before it gets deselected. If I move my finger down slightly, as if I'm swiping down just a bit (moving it maybe a few millimeters on my phone), the menu stays open and I can select multiple items in the ListView. Also interesting enough, if I set a debug point on my onItemCheckedStateChanged() method, it prevents the item from being deselected as well.