Read CSV file (streaming, no download)

Gets CSV file content without downloading to disk (streaming). Supply DriveId and FileId (path must end with colon, e.g. root:/dump.csv:). Optionally set ColumnDelimiter and HasColumnHeaderRow.

Standard SQL query example

This is the base query accepted by the connector. To execute it in SQL Server, you have to pass it to the Data Gateway via a Linked Server. See how to accomplish this using the examples below.

SELECT * from get_csv_file
WITH(
	    DriveId='b!0zqXLXXJh0uUMzl-JXAd9Ztngc-5utVDqRyD2lKpD2535-11HLQTR5z4hOzmA7Q0'
	  , FileId='root:/dump.csv:'
    --, FileId='01N3NI7YRUO2UHV2TUMBGJ4H4QQMWCG6DA'			
	--, FileId='root:/myfolder/dump.csv:'	 --Path must end with colon
	
	--, ColumnDelimiter=',' --{LF}, {TAB}, | , \x0009 ... default is comma (",")
	--, HasColumnHeaderRow=0 --set for header less file
	
	--, FileId='root:/myfolder/test_out.csv.gz:'
	--, FileCompressionType='GZip' --None, GZip, Zip
)         

--SELECT * FROM get_csv_file WITH(FileId='01N3NI7YQA6I2F7YAXBBCZCLLPTRFLANAX')

 --Path must end with colon
--SELECT * FROM get_csv_file WITH(FileId='root:/dump.csv:')
--SELECT * FROM get_csv_file WITH(FileId='root:/Documents/dump.csv:')
--SELECT * FROM get_csv_file WITH(FileId='root:/Documents/SubFolder/dump.csv:')

Using OPENQUERY in SQL Server

SELECT * FROM OPENQUERY([LS_TO_ONEDRIVE_IN_GATEWAY], 'SELECT * from get_csv_file
WITH(
	    DriveId=''b!0zqXLXXJh0uUMzl-JXAd9Ztngc-5utVDqRyD2lKpD2535-11HLQTR5z4hOzmA7Q0''
	  , FileId=''root:/dump.csv:''
    --, FileId=''01N3NI7YRUO2UHV2TUMBGJ4H4QQMWCG6DA''			
	--, FileId=''root:/myfolder/dump.csv:''	 --Path must end with colon
	
	--, ColumnDelimiter='','' --{LF}, {TAB}, | , \x0009 ... default is comma (",")
	--, HasColumnHeaderRow=0 --set for header less file
	
	--, FileId=''root:/myfolder/test_out.csv.gz:''
	--, FileCompressionType=''GZip'' --None, GZip, Zip
)         

--SELECT * FROM get_csv_file WITH(FileId=''01N3NI7YQA6I2F7YAXBBCZCLLPTRFLANAX'')

 --Path must end with colon
--SELECT * FROM get_csv_file WITH(FileId=''root:/dump.csv:'')
--SELECT * FROM get_csv_file WITH(FileId=''root:/Documents/dump.csv:'')
--SELECT * FROM get_csv_file WITH(FileId=''root:/Documents/SubFolder/dump.csv:'')')

Using EXEC in SQL Server (handling larger SQL text)

The major drawback of OPENQUERY is its inability to incorporate variables within SQL statements. This often leads to the use of cumbersome dynamic SQL (with numerous ticks and escape characters).

Fortunately, starting with SQL 2005 and onwards, you can utilize the EXEC (your_sql) AT [LS_TO_ONEDRIVE_IN_GATEWAY] syntax.

DECLARE @MyQuery NVARCHAR(MAX) = 'SELECT * from get_csv_file
WITH(
	    DriveId=''b!0zqXLXXJh0uUMzl-JXAd9Ztngc-5utVDqRyD2lKpD2535-11HLQTR5z4hOzmA7Q0''
	  , FileId=''root:/dump.csv:''
    --, FileId=''01N3NI7YRUO2UHV2TUMBGJ4H4QQMWCG6DA''			
	--, FileId=''root:/myfolder/dump.csv:''	 --Path must end with colon
	
	--, ColumnDelimiter='','' --{LF}, {TAB}, | , \x0009 ... default is comma (",")
	--, HasColumnHeaderRow=0 --set for header less file
	
	--, FileId=''root:/myfolder/test_out.csv.gz:''
	--, FileCompressionType=''GZip'' --None, GZip, Zip
)         

--SELECT * FROM get_csv_file WITH(FileId=''01N3NI7YQA6I2F7YAXBBCZCLLPTRFLANAX'')

 --Path must end with colon
--SELECT * FROM get_csv_file WITH(FileId=''root:/dump.csv:'')
--SELECT * FROM get_csv_file WITH(FileId=''root:/Documents/dump.csv:'')
--SELECT * FROM get_csv_file WITH(FileId=''root:/Documents/SubFolder/dump.csv:'')'
EXEC (@MyQuery) AT [LS_TO_ONEDRIVE_IN_GATEWAY]