Android: Touchables trigger when swiping in the wrong horizontal direction on first/last slide

## Environment

```
"react-native": "0.72.5",
"react-native-tab-view": "*",
"react-native-pager-view": "6.0.1",
"react-native-gesture-handler": "~2.8.0"
```

## Description

I recently upgraded from a really old version of react-native-tab-view and can't seem to fix this one.

When swiping to the right on the first tab, or to the left on the last tab (so in the "wrong" direction) it triggers a tap inside my flatlist/scrollview touchables. Everything is fine when you swipe in the correct direction.

I would expect that a swipe over a touchable would not trigger a tap, even if it's in the wrong direction.

## Reproducible Demo

I have made a reproduceable snack here:
https://snack.expo.dev/@svrnlombaert/android-bug-react-native-tab-view?platform=android

Video:

https://github.com/callstack/react-native-pager-view/assets/2846986/f318c609-f5fe-4a6e-ac11-2f119390b0e5