Creating a Data Format Plugin

Creating a Data Format Plugin

Storage Engine API

Drill provides a storage engine "API" that each storage engine must implement. The API is really a collection of classes and objects within Drill that the storage engine uses.

Storage Plugin

A storage plugin starts with an implementation of the StoragePlugin interface, often as a subclass of AbstractStoragePlugin. Consult the JavaDoc for StoragePlugin for more information.

Conceptually, a storage plugin is a source of (logical) tables, such as a database, a file system and so on. Each storage plugin supports multiple format plugins, each which, as the name suggests, reads a different format.

The Mock Storage Engine

Drill provides a mock plugin in the org.apache.drill.exec.store.mock package within the drill-java-exec project. The Mock storage engine ...

The package consists of several classes:

Here we assume you know about Maven, Java, Eclipse/IntelliJ, etc. Our focus is on the meaning of the code, now the mechanics of developing a plugin.