Swipe not working inside a viewpager

I have two fragments inside a view pager. Last fragment has a recycler view where I am trying to implement Swipe to Dismiss with SwipeLayout. However, SwipeLayout isn't working when that fragment is in viewpager and works when that fragment is not inside a view pager. By not working i mean that swipewont reveal background and event is consumed by ViewPager itself.