[BUG]: patterns_allowed in github_actions_organization_permissions doesn't clear up the list when set to []

### Expected Behavior

`patterns_allowed = []` should update the Github UI with `no patterns`

### Actual Behavior

When `patterns_allowed = ["actions/cache@*", "actions/checkout@*"]` is changed to `patterns_allowed = []` , it doesn't clear up the list on Github UI, although terraform plan shows it will be changed.

Although, Github API is able to clear the list.

### Terraform Version

Terraform v1.11.1
on darwin_arm64
+ provider registry.terraform.io/integrations/github v6.6.0

### Affected Resource(s)

- github_actions_organization_permissions

### Terraform Configuration Files

```hcl

```

### Steps to Reproduce

```
$ terraform apply
```

### Debug Output

```shell

```

### Panic Output

```shell

```

### Code of Conduct

- [x] I agree to follow this project's Code of Conduct