Local
Learn how to configure the LocalFSDirectoryListing to read files from local filesystem.
FileSystem Listing
Learn how to configure Connect FilePulse for listing files from local or remote storage system.
The FilePulseSourceConnector periodically lists object files that may be streamed into Kafka using the FileSystemListing
configured in the connector’s configuration.
Supported Filesystems
Currently, Kafka Connect FilePulse supports the following implementations:
SFTP
Learn how to configure the SftpFilesystemListing to read files on SFTP.
AWS S3
Learn how to configure the AmazonS3FileSystemListing to read files from AWS S3.
GCP Cloud Storage
Learn how to configure the GcsFileSystemListing to read files from Google Cloud Storage.
Azure Blob Storage
Learn how to configure the AzureBlobStorageFileSystemListing to read object files from Azure Blob Storage.
Alibaba OSS
Learn how to configure the AliyunOSSFileSystemListing to read files on Alibaba OSS.
Last modified March 16, 2024: ci: release version 2.14.0 🎉 (49999b8f)