Expose DataFusion Extensible Optimizer

[cbiggar]

We're considering the adoption of DataFusion as a replacement for our custom query planner and plan optimizer. However this would require the ability to extend the Optimizer with custom optimization rules given some domain specific operations.

From perusing this repo I could not establish whether this ability is exposed in the java bindings. If this capability does in fact exist, a quick pointer to the relevant class would be much appreciated.

[jimexist]

We're considering the adoption of DataFusion as a replacement for our custom query planner and plan optimizer. However this would require the ability to extend the Optimizer with custom optimization rules given some domain specific operations.

From perusing this repo I could not establish whether this ability is exposed in the java bindings. If this capability does in fact exist, a quick pointer to the relevant class would be much appreciated.

can you demo some pseudo code if you were able to do that?

[cbiggar]

Are you trying to understand the interface that I am envisaging, or are you interested in the internals of a custom optimizer that we'd wish to implement?