Snowflake
Although there is no direct integration between Snowflake and the Files.com platform, both solutions integrate with Amazon S3, Google Cloud, and Microsoft Azure, allowing you to connect Snowflake's data import capabilities with Files.com data transfer capabilities.
Integration overview
Snowflake allows you to import data from files stored within cloud storage solutions, such Amazon S3, Google Cloud, and Microsoft Azure.
Files.com allows you to connect cloud storage locations, such Amazon S3, Google Cloud, and Microsoft Azure, to the Files.com platform so that users, systems, and scripts can transfer files to those storage locations using common methods, such as web browsers, SFTP and FTP clients, Files.com Apps, WebDAV, and RESTful APIs.
Configuring Snowflake and Files.com to use the exact same cloud storage provides a method for users to upload data files, such as CSV format files, directly to the cloud storage that Snowflake uses to import these data files from.
Configuring Snowflake
Refer to the Snowflake documentation about bulk loading for details on how to import data using the COPY INTO <tablename>
command.
Verify that Snowflake can bulk load data from your cloud storage.
For example, if you're using Amazon S3, then you should be able to successfully bulk load data files using a command such as:
Configuring Files.com
Use the Remote Mount feature to connect your Amazon S3, Google Cloud, or Microsoft Azure storage to Files.com.
For example, you can create a top-level folder in Files.com named Upload CSV Files Here
and configure the Remote Mount settings so that this folder connects to the s3://mybucket/path/to/folder_containing_csv_files/
folder in your Amazon S3 bucket.
Configure the Files.com permissions for the Remote Mount folder to allow access for the desired users or groups. For example, configure the permissions of the "Upload CSV Files Here" folder so that users "Amy", "Bob", and "Charlie" have permission to access and upload into this folder.
Verify that the users can now upload files, and that the files are directly written to your cloud storage location. For example, files uploaded into the Upload CSV Files Here folder will automatically appear in the s3://mybucket/path/to/folder_containing_csv_files/
folder.
Troubleshooting
Most issues are caused by incorrect access permissions.
Make sure that Files.com has the correct access permissions to your cloud storage, including create
, read
, update
, and delete
permissions.
Make sure that the cloud storage key and token being used by Files.com have the correct permissions, including create
, read
, update
, and delete
permissions.
Make sure your users and groups have the correct access permissions to the Remote Mount folder, with a minimum of at least write
permission.