Deeper Spark avro integration (?)

When Abris started it provided many features that were not available in Spark. This has changed and now avro Spark is capable to do many of those feature.

Abris is still useful because it supported the Confluent Avro format and provides Schema registry client abstractions, but it may be not the best solution to add new features that are already part of Spark.

A Better solution could be to use Spark expressions directly from Abris and just wrap them in Abris layer that will deal with the confluent format. That would allow us to provide the underlying features and at the same time keep the Abris functionality.

This might be challenging since the spark avro expressions are private and not designed to be used this way, but it seems to be doable.

This issue is still up for a discussion.