Multperiod manifest with aac and dolby content has playback issues on firetv 4k (with exoplayer 2.18.1)

Im trying to play a mixed content (aac + dolby) which are added in different periods of a manifest. But once the 2nd period starts (which has dolby content) the playback freezes and goes completely out of sync and then a total freeze at the end of this period.
`adb logcat` at this time shows following spurious audio timestamp related logs:

```
09-21 17:34:57.312 19192 23498 W AudioTrack: Spurious audio timestamp (frame position mismatch): 28270119, 10923744015, 10923743917, 189528000, 9827328, 9827328
09-21 17:34:57.816 19192 23498 W AudioTrack: Spurious audio timestamp (frame position mismatch): 28294325, 10924248296, 10924248198, 189528000, 9827328, 9827328
09-21 17:34:58.211 19192 19231 V SessionStateManager: 2022-09-21 17:34:58,211 - Thread: [main] - player time 1663761496000ms program start time 1663759800000ms media session time 1696000ms
09-21 17:34:58.211 19192 19231 V SessionStateManager: 2022-09-21 17:34:58,211 - Thread: [main] - com.mobitv.client.connect.core.media.session.MobiMediaSession@34d0ee4 set media session playback state to PLAYING time 1696000ms
09-21 17:34:58.211 19192 19231 V SessionStateManager: 2022-09-21 17:34:58,211 - Thread: [main] - setting playback state PlaybackState {state=3, position=1696000, buffered position=0, speed=1.0, updated=10924643, actions=8963, error code=0, error message=null, custom actions=[], active item id=-1}
09-21 17:34:58.213 739 932 V Avrcp : MediaController playback changed: PlaybackState {state=3, position=1696000, buffered position=0, speed=1.0, updated=10924643, actions=8963, custom actions=[], active item id=-1, error=null}
09-21 17:34:58.322 19192 23498 W AudioTrack: Spurious audio timestamp (frame position mismatch): 28318587, 10924753767, 10924753671, 189528000, 9827328, 9827328
```
As of now I can confirm that this is something related to the dolby track because if the period contains only video track or video track + aac then the playback is smooth.

Device details: FireTV stick 4K with Fire OS 6.2.9.3 (NS6293/4731) and exoplayer 2.18.1

Please find the test asset which can be used to reproduce this issue here:
https://drive.google.com/file/d/15AA_Q3ReKCNVv_zTGk32-T0_NDeqOfF1/view?usp=share_link

Can anyone please provide any hints or any possible configuration fix to avoid this playback issue ?