How to pull a file file from a NFS (network file system,on-premise machine with disk mounted) as source into Data fusion #9
Description
Issue type: Feature Request
Problem you have encountered:
I ran into an issue when I wanted to have a feature to be supported to fetch a file from a NFS (network file system,on-premise machine with disk mounted) as a source.
What you expected to happen:
- A data fusion plugin or this ftp-plugin to perform file fetching with NFS source can be set and
- A file polling can be possible when new files appear from the source and will be picked up automatically or a scheduler can be set together with ftp fetching from NFS source.
Other information (workarounds you have tried, documentation consulted, etc):
I tried to share a solution by considering [1] and combining airflow ftp operators under schedule to fetch a file from a NFS(network file system) source using FTP protocol. It seems there is no existing file or FTP plugin that can do the file fetching using a scheduler.
[1] https://stackoverflow.com/questions/48248369/how-to-implement-polling-in-airflow