setSortableCallback() doesn't work when using default or session sort

Doesn't work even when $grid->setRememberState(FALSE); is set.

$qb = $this->ipAddressFacade->createQueryBuilder('ip')

$grid = (new DataGrid)
    ->setPrimaryKey('id')
    ->setDataSource($qb)
    ->setDefaultSort(['ip' => 'ASC']);

$grid->addColumnText('ip', 'IP')
    ->setSortable()
    ->setSortableCallback(function (QueryBuilder $qb, array $sorting): void {
        $qb->addOrderBy('ip.fullIp ', $sorting['ip']);
    });

Start at the setSortableCallback(), setDefaultSort(), and setRememberState(FALSE) entry points and reproduce the issue with the provided DataGrid and QueryBuilder example. Trace how default or session sorting is applied alongside the callback; done means the callback works correctly for those sorting modes, with regression coverage for the reported setup.