File Readers

The commons configuration for Connect File Pulse.

The connector can be configured with a specific FileInputReader. The FileInputReader is used by tasks to read scheduled source files.

RowFileInputReader (default)

The RowFileInputReader reads files from the local file system line by line. This reader creates one record per row. It should be used for reading delimited text files, application log files, etc.

The following provides usage information for io.streamthoughts.kafka.connect.filepulse.reader.RowFileInputReader (source code)

BytesArrayInputReader

The BytesArrayInputReader create a single byte array record from a source file.

The following provides usage information for io.streamthoughts.kafka.connect.filepulse.reader.BytesArrayInputReader (source code)

AvroFileInputReader

The AvroFileInputReader is used to read Avro files.

The following provides usage information for io.streamthoughts.kafka.connect.filepulse.reader.AvroFileInputReader (source code)

XMLFileInputReader

The XMLFileInputReader is used to read XML files.

The following provides usage information for io.streamthoughts.kafka.connect.filepulse.reader.XMLFileInputReader (source code)

FileInputMetadataReader

The FileInputMetadataReader is used to send a single record per file containing metadata (i.e: name, path, hash, lastModified, size, etc)

The following provides usage information for io.streamthoughts.kafka.connect.filepulse.reader.FileInputMetadataReader (source code)

Last modified December 9, 2021: build(github): migrate github-pages build to github actions (413f8f6d)